-- Logs begin at Mon 2022-10-31 13:19:13 UTC, end at Mon 2022-10-31 15:46:37 UTC. -- Oct 31 13:52:23.510244 n-d-863052-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 13:52:23.518728 n-d-863052-1 devstack@n-api.service[104562]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 13:52:23 2022] *** Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: nodename: n-d-863052-1 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: machine: x86_64 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: clock source: unix Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: pcre jit disabled Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: detected number of CPU cores: 4 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: current working directory: / Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: detected binary path: /usr/bin/uwsgi-core Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: your processes number limit is 47680 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: your memory page size is 4096 bytes Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: detected max file descriptor number: 2048 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: lock engine: pthread robust mutexes Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: thunder lock: enabled Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 13:52:23.522400 n-d-863052-1 devstack@n-api.service[104562]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 13:52:23.560269 n-d-863052-1 devstack@n-api.service[104562]: Python main interpreter initialized at 0x561ca6cd79c0 Oct 31 13:52:23.560269 n-d-863052-1 devstack@n-api.service[104562]: python threads support enabled Oct 31 13:52:23.560269 n-d-863052-1 devstack@n-api.service[104562]: your server socket listen backlog is limited to 100 connections Oct 31 13:52:23.560269 n-d-863052-1 devstack@n-api.service[104562]: your mercy for graceful operations on workers is 90 seconds Oct 31 13:52:23.560588 n-d-863052-1 devstack@n-api.service[104562]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 13:52:23.560663 n-d-863052-1 devstack@n-api.service[104562]: *** Operational MODE: preforking *** Oct 31 13:52:23.560865 n-d-863052-1 devstack@n-api.service[104562]: *** uWSGI is running in multiple interpreter mode *** Oct 31 13:52:23.560865 n-d-863052-1 devstack@n-api.service[104562]: spawned uWSGI master process (pid: 104562) Oct 31 13:52:23.561058 n-d-863052-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 31 13:52:23.562089 n-d-863052-1 devstack@n-api.service[104562]: spawned uWSGI worker 1 (pid: 104563, cores: 1) Oct 31 13:52:23.562089 n-d-863052-1 devstack@n-api.service[104562]: spawned uWSGI worker 2 (pid: 104564, cores: 1) Oct 31 13:52:23.562089 n-d-863052-1 devstack@n-api.service[104562]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 13:52:24.214616 n-d-863052-1 devstack@n-api.service[104563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 13:52:24.217704 n-d-863052-1 devstack@n-api.service[104564]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 13:52:25.285142 n-d-863052-1 devstack@n-api.service[104563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:52:25.285142 n-d-863052-1 devstack@n-api.service[104563]: from cryptography.utils import int_from_bytes Oct 31 13:52:25.285707 n-d-863052-1 devstack@n-api.service[104563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:52:25.285707 n-d-863052-1 devstack@n-api.service[104563]: from cryptography.utils import int_from_bytes Oct 31 13:52:25.286077 n-d-863052-1 devstack@n-api.service[104564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:52:25.286077 n-d-863052-1 devstack@n-api.service[104564]: from cryptography.utils import int_from_bytes Oct 31 13:52:25.287000 n-d-863052-1 devstack@n-api.service[104564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:52:25.287000 n-d-863052-1 devstack@n-api.service[104564]: from cryptography.utils import int_from_bytes Oct 31 13:52:27.778146 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 13:52:27.778683 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 13:52:27.778857 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 13:52:27.779212 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 13:52:27.779385 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 13:52:27.779744 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 13:52:27.779833 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 13:52:27.779917 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.780136 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.780221 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 13:52:27.780453 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.780541 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 13:52:27.780740 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 13:52:27.780825 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.781079 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.781177 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.781392 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.781477 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.781708 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.781798 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782021 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782118 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782367 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782465 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782622 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782707 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.782936 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783022 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783255 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783338 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783570 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783655 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783860 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.783943 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.784163 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.784246 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.784474 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.784567 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.784774 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.784858 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785080 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785161 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785378 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785468 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785694 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785870 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.785999 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.786352 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.786468 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.786659 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.786771 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.786966 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.787159 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.787349 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.787578 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.787663 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.787794 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.787883 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.788055 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.788184 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.788387 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.788478 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.788700 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.788784 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789008 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789106 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789325 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789467 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789637 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789782 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.789959 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.790090 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.790306 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.790434 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.790700 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.790843 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.791014 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.791151 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.791326 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.791469 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.791635 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.791763 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792048 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792142 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792379 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792465 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792669 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792765 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.792976 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793073 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793289 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793383 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793594 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793719 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793889 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.793981 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.794207 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.794295 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.794514 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.794597 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.794825 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.794910 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795124 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795209 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795422 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795504 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795666 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795760 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.795968 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796052 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796281 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796365 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796595 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796679 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796848 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.796939 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.797142 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.797234 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.797385 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.797515 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.797697 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.797785 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798012 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798107 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798333 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798417 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798585 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798680 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798906 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.798992 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.799208 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.799290 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.799508 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.799598 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.799809 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.799913 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.800106 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.800197 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.800407 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.800500 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.800714 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.800810 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801017 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801107 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801320 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801411 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801623 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801706 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.801958 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802041 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802294 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802393 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802612 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802757 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802916 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.802999 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.803239 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.803332 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.803551 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.803641 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.803852 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.803943 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.804162 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.804246 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.804475 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.804557 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.804777 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.804861 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805077 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805161 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805377 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805467 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805689 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805774 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.805991 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806093 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806319 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806417 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806565 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806648 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806862 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.806947 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.807160 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.807243 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.807472 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.807555 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.807774 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.807864 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808072 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808153 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808371 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808464 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808665 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808759 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.808966 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809049 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809265 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809361 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809564 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809656 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809867 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.809990 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.810173 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.810284 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.810479 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.810572 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.810775 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.810867 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811076 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811183 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811376 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811466 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811671 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811769 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.811971 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812071 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812275 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812367 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812588 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812679 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812855 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.812927 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.813163 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.813270 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.813463 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.813555 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.813771 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.813855 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814071 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814153 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814395 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814480 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814698 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814793 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.814996 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815079 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815294 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815377 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815593 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815687 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815896 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.815979 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.816198 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.816282 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.816497 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.816581 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.816791 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.816876 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.817092 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.817174 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.817394 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.817974 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.818236 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.818336 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.818542 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.818634 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.818838 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.818936 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.819135 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.819227 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.819432 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.819533 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.819732 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.819822 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820025 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820115 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820322 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820428 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820616 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820708 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.820916 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821013 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821215 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821320 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821514 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821605 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821810 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.821906 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.822113 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.822243 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.822453 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.822545 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.822757 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.822847 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.823063 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.823180 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.823367 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.823467 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.823688 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:52:27.823778 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824019 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824113 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824342 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824424 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824654 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824739 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.824963 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825047 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825273 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825365 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825594 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825689 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825901 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.825986 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.826228 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.826314 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.826538 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.826644 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.826852 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.826944 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.827161 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.827251 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.827469 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.827582 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.827779 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.827864 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.828087 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.828169 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.828399 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.828491 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.828704 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.828789 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829018 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829109 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829333 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829433 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829645 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829739 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.829957 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.830055 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.830290 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.830399 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.830615 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.830701 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.830925 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831020 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831234 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831327 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831549 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831634 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831862 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.831957 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.832170 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.832262 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.832477 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.832562 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.832812 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.832896 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.833180 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.833843 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834008 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834139 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834350 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834450 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834662 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834750 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.834982 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835068 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835293 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835389 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835600 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835685 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835907 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.835999 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.836218 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.836311 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.836523 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.836619 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.836842 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.836933 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.837153 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.837246 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.837462 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.837548 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.837800 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.837892 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.838077 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.838206 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.838415 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.838501 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.838722 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.838807 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839027 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839125 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839333 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839418 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839636 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839728 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.839938 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840031 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840241 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840379 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840549 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840633 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840849 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.840939 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.841152 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.841235 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.841459 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.841544 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.841769 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.841854 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.842073 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.842157 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.842417 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.842501 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.842727 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.842813 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843034 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843132 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843343 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843448 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843644 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843730 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.843955 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844040 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844263 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844359 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844564 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844647 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844867 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.844952 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.845179 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.845271 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.845482 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.845567 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.845784 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.845868 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.846090 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.846214 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.846422 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.846519 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.846726 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.846809 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847030 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847123 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847339 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847424 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847643 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847736 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.847948 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848033 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848256 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848340 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848564 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848647 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848899 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.848987 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.849207 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.849291 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.849529 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.849614 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.849829 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.849914 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.850138 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.850286 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.850484 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.850567 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.850798 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.850885 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.851098 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.851183 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.851404 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.851498 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.851704 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.851789 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852007 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852092 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852308 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852400 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852613 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852706 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852913 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.852998 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.853213 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.853304 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.853514 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.853600 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.853813 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.853905 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.854114 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.854251 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.854445 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.854532 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.854747 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.854830 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855048 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855135 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855347 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855432 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855645 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855730 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.855958 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856050 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856264 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856348 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856565 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856649 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856867 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.856959 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.857208 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.857293 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.857515 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.857600 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.857822 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.857906 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.858134 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.858237 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.858462 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.858558 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.858768 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.858859 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.859074 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.859159 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.859380 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.859476 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.859694 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.859778 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860000 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860084 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860308 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860400 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860610 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860699 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.860925 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861008 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861228 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861321 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861543 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861633 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861842 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.861926 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.862155 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.862274 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.862488 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.862572 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.862808 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.862892 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.863113 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.863207 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.863425 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.863547 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.863729 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.863813 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864040 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864161 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864370 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864455 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864677 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864762 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.864982 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865067 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865288 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865372 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865604 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865689 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865909 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.865995 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.866240 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.866329 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.866548 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.866645 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.866863 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.866953 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.867164 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.867254 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.867477 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.867624 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.867778 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.867872 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.868087 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.868171 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.868392 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.868484 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.868707 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.868792 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869010 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869136 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869317 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869409 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869639 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869724 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.869947 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870035 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870281 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870368 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870591 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870724 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870894 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.870978 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.871194 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.871279 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.871498 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.871582 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.871807 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.871892 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.872115 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.872200 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.872418 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.872501 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.872719 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.872811 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873030 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873165 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873331 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873416 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873632 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873725 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.873935 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874020 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874263 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874351 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874573 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874668 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874876 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.874968 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.875180 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.875263 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.875490 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.875583 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.875789 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.875873 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.876089 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.876174 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.876406 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.876503 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.876712 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.876796 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877011 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877096 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877310 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877406 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877609 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877694 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.877923 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.878006 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.878523 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.878616 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.878828 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.878954 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.879130 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.879214 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.879444 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.879529 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.879750 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.879846 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.880586 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.880677 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.880905 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.880990 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.881209 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.881293 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.881517 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.881600 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.881827 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.881911 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.882133 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.882275 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.882466 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.882568 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.882773 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.882890 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883080 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883165 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883386 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883478 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883697 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883788 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.883998 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884082 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884305 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884399 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884613 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884707 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884911 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.884994 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.885220 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.885313 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.885525 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.885608 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.885838 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.886084 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.886195 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.886442 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.886528 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.886755 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.886839 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.887070 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.887320 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.887410 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.887655 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.887749 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.887971 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.888056 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.888292 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.888421 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.888637 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.888730 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.888939 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889029 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889248 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889333 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889554 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889640 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889858 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.889943 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.890199 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.890288 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.890492 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.890578 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.890797 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.890930 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.891098 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.891182 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.891404 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.891490 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.891706 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.891791 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892008 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892099 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892309 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892393 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892616 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892699 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.892921 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893014 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893220 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893303 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893523 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893605 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893824 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.893917 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.894136 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.894238 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.894462 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.894547 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.894764 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.894862 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.895066 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.895158 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.895366 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.895458 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.896253 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.896355 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.896560 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.896651 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.896863 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.896948 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.897170 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.897256 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.897514 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.897609 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.897821 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.897906 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.898121 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.898230 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.898468 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.898561 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.898772 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.898857 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899074 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899160 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899374 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899471 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899680 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899773 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.899985 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.900072 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.900284 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.900370 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.900593 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.900689 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.900897 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901028 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901203 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901287 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901504 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901597 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901804 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.901890 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.902110 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.902212 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.902440 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.902536 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.902746 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.902831 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903048 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903133 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903347 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903431 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903648 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903732 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.903953 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904037 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904257 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904354 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904556 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904642 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904859 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.904942 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.905154 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.905239 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.905461 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.905545 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.905758 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.905849 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906059 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906145 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906383 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906485 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906696 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906799 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.906988 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907083 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907286 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907370 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907587 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907683 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907895 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.907980 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.908193 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.908277 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.908494 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.908587 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.908794 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.908878 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.909095 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.909187 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.909394 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.909496 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.909693 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.909778 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910002 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910087 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910333 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910443 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910633 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910726 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.910937 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911029 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911262 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911349 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911564 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911651 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911865 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.911951 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.912169 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.912256 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.912470 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.912557 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.912768 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.912853 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913067 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913152 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913366 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913452 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913666 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913758 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.913970 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914096 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914294 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914379 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914595 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914697 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914895 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.914979 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.915189 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.915274 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.915508 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.915601 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.915812 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.915897 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.916114 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.916198 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.916414 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.916546 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.916745 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.916838 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917047 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917131 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917351 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917435 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917656 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917742 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.917966 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918051 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918291 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918380 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918603 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918697 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918912 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.918997 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.919218 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.919303 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.919518 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.919602 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.919814 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.919898 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.920128 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.920212 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.920432 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.920518 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.920732 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.920816 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921036 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921122 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921352 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921439 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921661 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921795 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.921960 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922044 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922294 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922380 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922609 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922706 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922914 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.922999 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.923217 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.923300 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.923519 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.923677 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.923825 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.923910 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.924130 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.924213 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.924433 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.924528 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.924737 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.924835 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925042 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925126 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925342 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925428 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925645 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925730 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.925947 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.926032 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.926274 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.926374 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.926576 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.926660 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.927418 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.927517 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.927718 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.927803 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928023 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928107 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928323 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928408 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928629 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928723 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.928929 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929012 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929237 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929330 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929541 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929626 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929850 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.929935 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.930154 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.930269 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.930532 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.930618 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.930837 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.930922 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.931149 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.931250 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.931459 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.931547 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.931759 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.931854 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932068 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932160 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932380 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932472 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932693 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932777 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.932996 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.933088 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.933333 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.933417 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.933633 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.933726 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.933938 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934024 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934280 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934369 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934582 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934668 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934881 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.934967 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.935179 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.935264 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.935496 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.935587 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.935795 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.935886 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.936097 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.936188 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.936399 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.936512 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.936720 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.936805 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.937023 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.937107 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.937343 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.937478 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.937774 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.937864 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.938069 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.938175 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.938401 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.938498 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.938722 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.938948 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939052 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939145 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939333 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939430 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939645 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939739 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.939953 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940039 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940272 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940358 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940589 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940687 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940899 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.940986 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.941208 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.941293 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.941509 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.941603 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.941828 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.941914 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.942136 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.942239 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.943084 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.943178 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.943398 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.943484 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.943724 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.943810 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.944051 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.944139 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.944369 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.944453 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.944692 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.944785 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945020 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945105 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945323 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945430 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945627 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945742 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.945936 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.946067 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.946261 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.946422 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.946567 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.946731 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.946890 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947038 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947193 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947350 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947502 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947656 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947810 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.947962 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.948112 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.948288 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.948411 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.948595 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.948712 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.948908 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949032 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949219 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949334 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949530 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949679 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949836 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.949949 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.950141 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.950298 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.950501 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.950615 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.950808 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.950917 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.951130 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.951225 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.951444 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.951529 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.951767 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.951851 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.952087 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.952181 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.952383 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.952473 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.952701 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.952785 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953005 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953090 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953305 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953389 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953606 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953698 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953908 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.953995 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.954256 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.954358 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.954570 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.954665 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.954894 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.954986 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.955206 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.955290 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.955512 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.955597 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.955829 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.955915 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.956150 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.956242 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.956452 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.956611 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.956752 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.956846 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957057 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957142 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957358 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957451 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957658 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957744 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.957958 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958043 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958308 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958412 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958611 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958732 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958914 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.958999 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.959211 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.959304 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.959514 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.959598 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.959822 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.959915 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.960126 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.960213 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.960428 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.960513 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.960729 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.960814 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961028 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961114 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961325 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961410 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961645 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961730 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.961954 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962041 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962283 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962372 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962590 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962675 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962894 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.962980 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.963211 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.963294 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.963523 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.963616 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.963836 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.963922 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.964142 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.964233 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.964450 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.964580 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.964761 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.964846 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965072 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965157 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965376 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965509 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965688 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965772 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.965996 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.966079 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.966333 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.966429 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.966648 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.966842 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.966955 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.967169 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.967263 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.967479 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.967564 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.967785 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.967876 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.968094 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.968367 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.968454 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.968693 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.968785 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.968995 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.969080 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.969303 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.969392 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.969608 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.969693 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.969914 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970009 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970255 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970343 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970568 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970657 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970877 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.970974 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.971186 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.971272 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.971495 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.971589 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.971803 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.971896 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.972113 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.972201 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.972425 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.972511 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.972754 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.972840 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.973066 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.973152 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.973367 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.973461 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.973696 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.973782 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974010 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974131 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974346 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974445 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974657 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974743 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.974965 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975049 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975275 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975371 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975586 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975672 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975893 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.975978 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.976199 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.976292 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.976507 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.976592 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.976813 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.976898 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.977123 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.977215 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.977433 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.977525 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.977745 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.977859 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.978053 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.978144 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.978388 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.978476 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.978699 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.978786 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979028 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979211 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979345 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979522 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979657 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979852 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.979971 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.980176 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.980269 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.980498 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.980784 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.980879 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.981096 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.981182 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.981422 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.981506 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.981727 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.981823 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982029 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982114 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982358 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982458 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982666 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982764 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.982965 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983057 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983284 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983369 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983589 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983681 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983890 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.983983 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.984195 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.984278 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.984497 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.984583 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.984820 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985022 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985114 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985357 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985522 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985669 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985760 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.985992 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.986078 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.986336 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.986564 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.986652 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.986912 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987005 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987232 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987326 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987535 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987620 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987838 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.987924 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.988155 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.988249 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.988464 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.988550 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.988766 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.988851 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.989066 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.989160 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.989883 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.989975 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.990206 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.990293 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.990510 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.990611 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.990816 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.990901 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.991115 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.991201 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.991424 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.991509 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.991724 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.991807 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992025 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992110 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992323 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992408 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992627 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992712 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.992923 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993007 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993222 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993314 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993526 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993611 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993824 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.993908 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.994129 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.994253 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.994454 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.994549 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.994754 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.994846 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995052 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995136 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995356 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995439 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995667 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995799 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.995972 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996057 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996272 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996390 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996571 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996669 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996877 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.996960 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.997177 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.997269 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.997489 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.997582 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.997792 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.997877 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.998107 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.998219 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.998435 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.998530 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.998739 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.998823 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.999049 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.999132 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.999355 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.999442 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.999676 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:27.999882 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000005 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000212 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000306 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000527 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000621 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000855 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.000947 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.001180 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.001421 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.001507 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.001754 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.001840 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.002062 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.002210 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.002406 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.002491 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.002712 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.002797 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.003020 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.003390 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.003602 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.003686 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.003906 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.003990 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.004228 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.004324 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.004540 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.004625 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.004850 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.004935 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.005696 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.005784 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006005 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006088 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006334 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006419 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006643 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006729 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.006949 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007034 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007254 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007338 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007559 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007645 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007865 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.007957 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.008174 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.008268 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.008481 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.008567 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.008790 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.008877 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.009100 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.009197 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.009412 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.009496 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.009716 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.009799 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010023 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010257 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010345 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010423 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010650 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010736 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.010960 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011059 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011278 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011364 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011587 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011678 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011885 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.011971 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.012190 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.012504 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.012588 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.012830 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.012925 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.013145 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.013230 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.013449 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.013533 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.013762 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.014083 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.014185 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.014425 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.014522 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.014734 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.014832 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.015054 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.015140 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.015363 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.015448 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.015687 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.015843 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016008 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016093 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016320 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016405 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016638 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016731 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.016939 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017024 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017243 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017327 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017544 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017636 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017848 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.017933 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.018203 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.018292 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.018495 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.018581 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.018796 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.018881 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019094 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019179 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019399 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019483 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019696 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019779 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.019996 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.020089 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.020295 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.020383 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.020617 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.020706 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.020923 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021016 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021222 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021305 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021520 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021603 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021819 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.021912 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.022119 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.022230 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.022440 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.022525 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.022740 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.022837 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023041 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023125 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023337 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023427 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023636 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023720 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.023930 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024013 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024229 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024314 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024524 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024608 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024822 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.024906 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.025125 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.025254 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.025427 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.025513 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.025735 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.025819 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.026035 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.026195 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.026387 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.026480 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.026694 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.026780 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027011 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027114 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027330 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027414 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027639 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027723 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.027945 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028039 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028290 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028380 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028564 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028648 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028873 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.028967 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.029180 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.029265 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.029484 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.029568 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.029786 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.029883 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.030092 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.030196 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.030430 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.030514 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.030741 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.030834 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031042 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031144 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031349 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031444 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031657 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031744 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.031970 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032054 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032281 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032365 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032584 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032669 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032907 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.032991 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.033214 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.033312 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.033526 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.033618 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.033832 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.033917 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.034139 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.034276 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.034467 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.034551 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.034777 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.034864 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.035083 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.035176 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.035386 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.035471 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.035696 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.035781 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036001 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036094 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036340 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036429 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036649 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036735 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.036953 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037042 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037265 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037348 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037578 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037663 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037902 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.037989 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.038242 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.038341 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.038549 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.038643 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.038872 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.038958 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.039191 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.039274 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.039499 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.039593 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.039801 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.039886 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.040040 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 13:52:28.040160 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.040490 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.040804 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.041116 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.041419 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:52:28.041663 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 13:52:28.193147 n-d-863052-1 devstack@n-api.service[104563]: INFO dbcounter [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Registered counter for database nova_api Oct 31 13:52:28.194842 n-d-863052-1 devstack@n-api.service[104564]: INFO dbcounter [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Registered counter for database nova_api Oct 31 13:52:28.215302 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_db.sqlalchemy.engines [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.217043 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_db.sqlalchemy.engines [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.221819 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writer thread running {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.223517 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writer thread running {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.278263 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.context [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=104563) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 13:52:28.280231 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.context [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=104564) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 13:52:28.282080 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_concurrency.lockutils [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 13:52:28.282571 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_concurrency.lockutils [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 13:52:28.284038 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 13:52:28.284200 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_concurrency.lockutils [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 13:52:28.284509 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 13:52:28.284825 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_concurrency.lockutils [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 13:52:28.285263 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_concurrency.lockutils [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 13:52:28.288720 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 13:52:28.288720 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 13:52:28.288720 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 13:52:28.289079 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_concurrency.lockutils [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 13:52:28.289767 n-d-863052-1 devstack@n-api.service[104563]: INFO dbcounter [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Registered counter for database nova_cell0 Oct 31 13:52:28.289855 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 13:52:28.291772 n-d-863052-1 devstack@n-api.service[104564]: INFO dbcounter [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Registered counter for database nova_cell0 Oct 31 13:52:28.293934 n-d-863052-1 devstack@n-api.service[104563]: INFO dbcounter [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Registered counter for database nova_cell1 Oct 31 13:52:28.295867 n-d-863052-1 devstack@n-api.service[104564]: INFO dbcounter [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Registered counter for database nova_cell1 Oct 31 13:52:28.302700 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_db.sqlalchemy.engines [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.303855 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_db.sqlalchemy.engines [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.306069 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_db.sqlalchemy.engines [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.307760 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_db.sqlalchemy.engines [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.309713 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writer thread running {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.312742 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writer thread running {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.318440 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writer thread running {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.447682 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writer thread running {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.457297 n-d-863052-1 devstack@n-api.service[104563]: INFO dbcounter [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Registered counter for database nova_cell0 Oct 31 13:52:28.458729 n-d-863052-1 devstack@n-api.service[104564]: INFO dbcounter [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Registered counter for database nova_cell0 Oct 31 13:52:28.466530 n-d-863052-1 devstack@n-api.service[104563]: DEBUG oslo_db.sqlalchemy.engines [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.471143 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_db.sqlalchemy.engines [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:52:28.471549 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writer thread running {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.476451 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writer thread running {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:52:28.805281 n-d-863052-1 devstack@n-api.service[104563]: WARNING keystonemiddleware.auth_token [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 13:52:28.805947 n-d-863052-1 devstack@n-api.service[104564]: WARNING keystonemiddleware.auth_token [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 13:52:28.812520 n-d-863052-1 devstack@n-api.service[104563]: WARNING keystonemiddleware.auth_token [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 13:52:28.813090 n-d-863052-1 devstack@n-api.service[104564]: WARNING keystonemiddleware.auth_token [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 13:52:29.152000 n-d-863052-1 devstack@n-api.service[104563]: WARNING keystonemiddleware.auth_token [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 13:52:29.154733 n-d-863052-1 devstack@n-api.service[104564]: WARNING keystonemiddleware.auth_token [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 13:52:29.157862 n-d-863052-1 devstack@n-api.service[104563]: WARNING keystonemiddleware.auth_token [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 13:52:29.160610 n-d-863052-1 devstack@n-api.service[104564]: WARNING keystonemiddleware.auth_token [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 13:52:29.163206 n-d-863052-1 devstack@n-api.service[104563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ca6cd79c0 pid: 104563 (default app) Oct 31 13:52:29.165256 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:52:29.165984 n-d-863052-1 devstack@n-api.service[104564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ca6cd79c0 pid: 104564 (default app) Oct 31 13:52:29.166489 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-8f7a417c-c97c-4e36-9625-087896d43344 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Oct 31 13:52:29.166905 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Oct 31 13:52:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:53:49.270402 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:53:49.271589 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Oct 31 13:53:49.271991 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 13:53:49.283787 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_api:SELECT=3 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:49.285071 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_cell1:SELECT=3 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:49.286392 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_cell0:SELECT=3 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:49.288578 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:50.174732 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-9c994ba3-b413-4d67-abe5-940bf4cd1e01 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:53:50.207237 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-9c994ba3-b413-4d67-abe5-940bf4cd1e01 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929234 Oct 31 13:53:50.208112 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 13:53:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:53:52.794426 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:53:52.795637 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-d7801cbc-44ad-43dc-8ac6-e3d1b86e2d15 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Oct 31 13:53:52.796227 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 2/4] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:53:53.275295 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-b27e01e1-e2c8-4a1c-b87d-e97fcb1a79f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:53:53.323246 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-b27e01e1-e2c8-4a1c-b87d-e97fcb1a79f9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.520809 Oct 31 13:53:53.323986 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 3/5] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:53:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 13:53:53.341115 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_api:SELECT=3 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:53.341991 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_cell0:SELECT=3 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:53.344778 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_cell1:SELECT=3 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:53.345558 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:53:53.550652 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-6871636e-9983-4345-9ab8-7f2ccd6fa3e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:53:53.619236 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-6871636e-9983-4345-9ab8-7f2ccd6fa3e9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286290 Oct 31 13:53:53.619822 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 3/6] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 31 13:53:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:53:56.267419 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-b27e01e1-e2c8-4a1c-b87d-e97fcb1a79f9 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:53:56.268429 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-b27e01e1-e2c8-4a1c-b87d-e97fcb1a79f9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 31 13:53:56.268840 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 4/7] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:53:57.052033 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-dcf370e8-47ed-4131-9122-bb6d181f67ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M"}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:53:57.102600 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-dcf370e8-47ed-4131-9122-bb6d181f67ef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.827363 Oct 31 13:53:57.103792 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 4/8] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:53:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 13:53:57.116882 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-ae6d0019-a55e-4e15-8891-91c583dd851d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:53:57.177163 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-ae6d0019-a55e-4e15-8891-91c583dd851d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063622 Oct 31 13:53:57.177981 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 5/9] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 31 13:53:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:00.000341 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-dcf370e8-47ed-4131-9122-bb6d181f67ef admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:00.002150 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-dcf370e8-47ed-4131-9122-bb6d181f67ef admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Oct 31 13:54:00.002876 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:00.509925 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-ee46d091-1cf2-44af-8db4-86d0d845b493 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:00.533790 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-ee46d091-1cf2-44af-8db4-86d0d845b493 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524992 Oct 31 13:54:00.535065 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 6/11] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:00.546991 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-02e061ea-10b2-465c-8fb5-285314f0f399 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:00.574752 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-02e061ea-10b2-465c-8fb5-285314f0f399 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031459 Oct 31 13:54:00.575339 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 6/12] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 31 13:54:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:03.200532 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-ee46d091-1cf2-44af-8db4-86d0d845b493 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:03.202243 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-ee46d091-1cf2-44af-8db4-86d0d845b493 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Oct 31 13:54:03.202932 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 7/13] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:03.666612 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-5c1ecf91-780c-41b0-b15e-7002a193d71f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:03.688420 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-5c1ecf91-780c-41b0-b15e-7002a193d71f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479305 Oct 31 13:54:03.689137 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 7/14] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:03.701343 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-da6e0ef2-9c13-4272-9d2f-634ac4b3a1a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:03.732050 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-da6e0ef2-9c13-4272-9d2f-634ac4b3a1a4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034271 Oct 31 13:54:03.732674 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 8/15] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 31 13:54:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:06.372017 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-5c1ecf91-780c-41b0-b15e-7002a193d71f admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:06.373614 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-5c1ecf91-780c-41b0-b15e-7002a193d71f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Oct 31 13:54:06.384991 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 8/16] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:06.804890 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-c297fe00-439f-4f8b-8739-8e3a70ddd197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:06.824122 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-c297fe00-439f-4f8b-8739-8e3a70ddd197 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442871 Oct 31 13:54:06.832164 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 9/17] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:06.837652 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-47f2fd24-011e-435f-a252-e39e8776fc6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:06.863150 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-47f2fd24-011e-435f-a252-e39e8776fc6c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029187 Oct 31 13:54:06.870405 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 9/18] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 31 13:54:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:09.544393 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-c297fe00-439f-4f8b-8739-8e3a70ddd197 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:09.546400 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-c297fe00-439f-4f8b-8739-8e3a70ddd197 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002464 Oct 31 13:54:09.547584 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 10/19] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:10.012601 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-0e81f531-2ba1-42a6-9ed6-93b71ffabd1b admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:10.038053 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-0e81f531-2ba1-42a6-9ed6-93b71ffabd1b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.484512 Oct 31 13:54:10.038621 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 13:54:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:54:13.436498 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-c297fe00-439f-4f8b-8739-8e3a70ddd197 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:13.438399 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-c297fe00-439f-4f8b-8739-8e3a70ddd197 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Oct 31 13:54:13.438944 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 11/21] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:13.841837 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-bbc27c47-fd00-41a5-8955-0afaad0a7fc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:13.865969 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-bbc27c47-fd00-41a5-8955-0afaad0a7fc5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420689 Oct 31 13:54:13.866598 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 11/22] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 13:54:13.880892 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-fa60df69-4758-423e-9dbd-7377983e497d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:13.911615 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-fa60df69-4758-423e-9dbd-7377983e497d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036676 Oct 31 13:54:13.912208 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 12/23] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 31 13:54:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:16.494078 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-bbc27c47-fd00-41a5-8955-0afaad0a7fc5 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:16.495139 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-bbc27c47-fd00-41a5-8955-0afaad0a7fc5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 31 13:54:16.495535 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:16.885298 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-0a1d0b99-8f02-4130-98ec-2ff666bceb4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "name": "m1.small", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:16.904767 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-0a1d0b99-8f02-4130-98ec-2ff666bceb4d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402384 Oct 31 13:54:16.905307 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 13/25] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:16.917508 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-9d6468ca-fd02-4664-bd13-5df470b25182 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:16.942807 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-9d6468ca-fd02-4664-bd13-5df470b25182 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029079 Oct 31 13:54:16.943364 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 13/26] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 31 13:54:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 13:54:19.558141 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-0a1d0b99-8f02-4130-98ec-2ff666bceb4d admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:19.559174 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-0a1d0b99-8f02-4130-98ec-2ff666bceb4d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 31 13:54:19.559711 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:19.958206 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-f60e5aff-7c7c-4b7b-bf1b-faa12ec0a492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:19.985540 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-f60e5aff-7c7c-4b7b-bf1b-faa12ec0a492 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.419045 Oct 31 13:54:19.986028 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 14/28] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:19.998316 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-f9e6c66f-8719-453c-ac54-d98e8143ef4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:20.004335 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:54:20.030034 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-f9e6c66f-8719-453c-ac54-d98e8143ef4a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035394 Oct 31 13:54:20.031331 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 15/29] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 31 13:54:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:22.737145 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-f60e5aff-7c7c-4b7b-bf1b-faa12ec0a492 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:22.738784 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-f60e5aff-7c7c-4b7b-bf1b-faa12ec0a492 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Oct 31 13:54:22.739374 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:23.188337 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-2d82a232-47f6-4f84-a935-1facd7d61cb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:23.208166 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-2d82a232-47f6-4f84-a935-1facd7d61cb5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462596 Oct 31 13:54:23.208719 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 16/31] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:23.221373 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-35ed1726-4f40-43a6-bf68-8ee6738dcb25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:23.250639 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-35ed1726-4f40-43a6-bf68-8ee6738dcb25 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033424 Oct 31 13:54:23.251577 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 16/32] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 31 13:54:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:25.872762 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-2d82a232-47f6-4f84-a935-1facd7d61cb5 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:25.873769 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-2d82a232-47f6-4f84-a935-1facd7d61cb5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 31 13:54:25.875205 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 17/33] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:26.307111 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-ef784503-5f50-47d2-8d9e-11320c043fb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:26.321509 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:54:26.335879 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-ef784503-5f50-47d2-8d9e-11320c043fb0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454840 Oct 31 13:54:26.336740 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 17/34] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 31 13:54:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:26.348748 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5932414a-ebf8-4d53-8c13-4a6ebc6f1040 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:26.373653 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5932414a-ebf8-4d53-8c13-4a6ebc6f1040 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028702 Oct 31 13:54:26.382221 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 18/35] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 31 13:54:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:54:46.522607 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-ef784503-5f50-47d2-8d9e-11320c043fb0 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:46.523620 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-ef784503-5f50-47d2-8d9e-11320c043fb0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 31 13:54:46.524030 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:46.534551 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:54:46.908561 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-cf235a08-b790-430e-a1dc-b77a28013c09 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:46.926725 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-cf235a08-b790-430e-a1dc-b77a28013c09 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396680 Oct 31 13:54:46.927267 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 13:54:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:54:48.203535 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-ef784503-5f50-47d2-8d9e-11320c043fb0 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:48.204535 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-ef784503-5f50-47d2-8d9e-11320c043fb0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 31 13:54:48.204928 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:48.732509 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-64d54493-fff9-47b6-aa02-7151a0207ce7 admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:48.738420 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.wsgi [None req-64d54493-fff9-47b6-aa02-7151a0207ce7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-64d54493-fff9-47b6-aa02-7151a0207ce7 admin admin] Request method failure captured: Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Accept: application/json Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Accept-Encoding: gzip, deflate Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Connection: keep-alive Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Content-Length: 0 Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Host: 10.222.0.27 Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Openstack-Api-Version: compute 2.92 Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: Openstack-System-Scope: None Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: User-Agent: python-novaclient Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Auth-Token: gAAAAABjX9OosSGxtwEdxlBHutDNNSedqGpRBYNiiwt0m28piHrB8Ow3b2TZLH0LCPYldHmusxQ0oJRjOQtU-di5JaBj1qwzXXxB66qTz-2LYWqKaL6x8WtikfI75sWKE6IXbEIBXKjy0QW1kft2-QdK4I4-sVu3onwO2QXWVV_Br5H4zsgXvcw Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Domain-Id: None Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Domain-Name: None Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Identity-Status: Confirmed Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Is-Admin-Project: True Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Domain-Id: default Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Domain-Name: Default Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Name: admin Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Role: member,reader,admin Oct 31 13:54:48.741626 n-d-863052-1 devstack@n-api.service[104563]: X-Roles: member,reader,admin Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c3bb2c22ffb455cbac860e037ee03bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant: admin Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant-Name: admin Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-User: admin Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-User-Domain-Id: default Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-User-Domain-Name: Default Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-User-Id: a873263a8e3f464a869a8e0ca9ecd0ac Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: X-User-Name: admin Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: method: > Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: exception: Flavor 42 could not be found. Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: action_args: {'id': '42'} Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 13:54:48.743391 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:48.744295 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.745404 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-64d54493-fff9-47b6-aa02-7151a0207ce7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 13:54:48.746486 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-64d54493-fff9-47b6-aa02-7151a0207ce7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389634 Oct 31 13:54:48.746486 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 31 13:54:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 13:54:48.752932 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-120051fa-ecc4-4799-ac6a-ebdc8bfafef6 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:48.775563 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-120051fa-ecc4-4799-ac6a-ebdc8bfafef6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026432 Oct 31 13:54:48.776093 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 20/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 31 13:54:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:54:48.814151 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-af52e42e-ac19-469c-9c8d-de4b1b52a86a admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:48.835311 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-af52e42e-ac19-469c-9c8d-de4b1b52a86a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025622 Oct 31 13:54:48.835832 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 31 13:54:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 13:54:48.845426 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-873979dd-9136-42c5-a0be-be624c4daa15 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:48.850754 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.wsgi [None req-873979dd-9136-42c5-a0be-be624c4daa15 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-873979dd-9136-42c5-a0be-be624c4daa15 admin admin] Request method failure captured: Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Accept: application/json Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Accept-Encoding: gzip, deflate Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Connection: keep-alive Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Content-Length: 0 Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Host: 10.222.0.27 Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Openstack-Api-Version: compute 2.92 Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: Openstack-System-Scope: None Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: User-Agent: python-novaclient Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Auth-Token: gAAAAABjX9OosSGxtwEdxlBHutDNNSedqGpRBYNiiwt0m28piHrB8Ow3b2TZLH0LCPYldHmusxQ0oJRjOQtU-di5JaBj1qwzXXxB66qTz-2LYWqKaL6x8WtikfI75sWKE6IXbEIBXKjy0QW1kft2-QdK4I4-sVu3onwO2QXWVV_Br5H4zsgXvcw Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Domain-Id: None Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Domain-Name: None Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Identity-Status: Confirmed Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Is-Admin-Project: True Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Domain-Id: default Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Domain-Name: Default Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Name: admin Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Role: member,reader,admin Oct 31 13:54:48.853997 n-d-863052-1 devstack@n-api.service[104564]: X-Roles: member,reader,admin Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c3bb2c22ffb455cbac860e037ee03bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant: admin Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant-Name: admin Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-User: admin Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-User-Domain-Id: default Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-User-Domain-Name: Default Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-User-Id: a873263a8e3f464a869a8e0ca9ecd0ac Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: X-User-Name: admin Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: method: > Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: exception: Flavor 42 could not be found. Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: action_args: {'id': '42'} Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 13:54:48.855546 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:48.856493 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:48.857941 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-873979dd-9136-42c5-a0be-be624c4daa15 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 13:54:48.859197 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-873979dd-9136-42c5-a0be-be624c4daa15 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014015 Oct 31 13:54:48.859197 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 21/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 31 13:54:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 13:54:50.049399 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-af52e42e-ac19-469c-9c8d-de4b1b52a86a admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:50.050430 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-af52e42e-ac19-469c-9c8d-de4b1b52a86a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 31 13:54:50.050830 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:50.570423 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-fe7c0a95-7f62-4d2e-8518-3281d4a38b51 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:50.575392 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.wsgi [None req-fe7c0a95-7f62-4d2e-8518-3281d4a38b51 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-fe7c0a95-7f62-4d2e-8518-3281d4a38b51 admin admin] Request method failure captured: Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Accept: application/json Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Accept-Encoding: gzip, deflate Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Connection: keep-alive Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Content-Length: 0 Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Host: 10.222.0.27 Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Openstack-Api-Version: compute 2.92 Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: Openstack-System-Scope: None Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: User-Agent: python-novaclient Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Auth-Token: gAAAAABjX9OpFDVdqE9VO-TLWn40Wl8LZq58zjmqAeLVhoZpZbjj3hegZgyq71NQvNjsdfKWdw7NghOeP9ChLQHQSW12c7z-9Ya2RLh6dJ9wLn2qPmU9sqh-TeALz_61ZIl4bhd-HWzCZNZs-a886BwKywarMiBhm_QXPIvFIC0fADrSWgjJIzM Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Domain-Id: None Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Domain-Name: None Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Identity-Status: Confirmed Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Is-Admin-Project: True Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Domain-Id: default Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Domain-Name: Default Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Name: admin Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Role: member,reader,admin Oct 31 13:54:50.576879 n-d-863052-1 devstack@n-api.service[104564]: X-Roles: member,reader,admin Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c3bb2c22ffb455cbac860e037ee03bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant: admin Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant-Name: admin Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-User: admin Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-User-Domain-Id: default Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-User-Domain-Name: Default Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-User-Id: a873263a8e3f464a869a8e0ca9ecd0ac Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: X-User-Name: admin Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: method: > Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: exception: Flavor 84 could not be found. Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: action_args: {'id': '84'} Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 13:54:50.578994 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:50.579913 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.581228 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-fe7c0a95-7f62-4d2e-8518-3281d4a38b51 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 13:54:50.582465 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-fe7c0a95-7f62-4d2e-8518-3281d4a38b51 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390467 Oct 31 13:54:50.582465 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 31 13:54:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 13:54:50.588337 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-913ddcf6-05cf-48fd-a1bc-7e432cf26efc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:50.603861 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-913ddcf6-05cf-48fd-a1bc-7e432cf26efc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019120 Oct 31 13:54:50.604393 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 31 13:54:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:54:50.613363 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-92aa625a-dac7-49d6-902c-676aa067da24 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:50.628521 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-92aa625a-dac7-49d6-902c-676aa067da24 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018582 Oct 31 13:54:50.629033 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 31 13:54:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 13:54:50.637779 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-f5b527bd-62bd-420b-bcc1-a8bcab8e42ad admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:50.643133 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.wsgi [None req-f5b527bd-62bd-420b-bcc1-a8bcab8e42ad admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-f5b527bd-62bd-420b-bcc1-a8bcab8e42ad admin admin] Request method failure captured: Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Accept: application/json Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Accept-Encoding: gzip, deflate Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Connection: keep-alive Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Content-Length: 0 Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Host: 10.222.0.27 Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Openstack-Api-Version: compute 2.92 Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: Openstack-System-Scope: None Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: User-Agent: python-novaclient Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Auth-Token: gAAAAABjX9OpFDVdqE9VO-TLWn40Wl8LZq58zjmqAeLVhoZpZbjj3hegZgyq71NQvNjsdfKWdw7NghOeP9ChLQHQSW12c7z-9Ya2RLh6dJ9wLn2qPmU9sqh-TeALz_61ZIl4bhd-HWzCZNZs-a886BwKywarMiBhm_QXPIvFIC0fADrSWgjJIzM Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Domain-Id: None Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Domain-Name: None Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Identity-Status: Confirmed Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Is-Admin-Project: True Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Domain-Id: default Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Domain-Name: Default Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Name: admin Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Role: member,reader,admin Oct 31 13:54:50.644618 n-d-863052-1 devstack@n-api.service[104563]: X-Roles: member,reader,admin Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c3bb2c22ffb455cbac860e037ee03bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant: admin Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant-Name: admin Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-User: admin Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-User-Domain-Id: default Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-User-Domain-Name: Default Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-User-Id: a873263a8e3f464a869a8e0ca9ecd0ac Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: X-User-Name: admin Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: method: > Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: exception: Flavor 84 could not be found. Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: action_args: {'id': '84'} Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 13:54:50.646086 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:50.646984 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:50.648022 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-f5b527bd-62bd-420b-bcc1-a8bcab8e42ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 13:54:50.649096 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-f5b527bd-62bd-420b-bcc1-a8bcab8e42ad admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011646 Oct 31 13:54:50.649096 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 24/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 31 13:54:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 13:54:51.847433 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-92aa625a-dac7-49d6-902c-676aa067da24 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:51.848469 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-92aa625a-dac7-49d6-902c-676aa067da24 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 31 13:54:51.848862 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 24/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:52.359237 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5c491077-0b3b-42a8-8d35-467a1eb50cca admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:52.364908 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.wsgi [None req-5c491077-0b3b-42a8-8d35-467a1eb50cca admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5c491077-0b3b-42a8-8d35-467a1eb50cca admin admin] Request method failure captured: Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Accept: application/json Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Accept-Encoding: gzip, deflate Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Connection: keep-alive Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Content-Length: 0 Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Host: 10.222.0.27 Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Openstack-Api-Version: compute 2.92 Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: Openstack-System-Scope: None Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: User-Agent: python-novaclient Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Auth-Token: gAAAAABjX9OrG4ZJ-uVdQxpwljKGzFf4mVr_AiFjKo60ccOFpeY8XPoQHo6dRo9tDV22T0_0fjjqijCdEuZQhDUuA_FsmFGUvSeRukiup4USBH9cpEHsJrNnl_jw2pyPphHxc4PE7ghUDWe7djs2otgaxf_ioG2a44nnLznR27xd1W3JZ0bTRWI Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Domain-Id: None Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Domain-Name: None Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Identity-Status: Confirmed Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Is-Admin-Project: True Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Domain-Id: default Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Domain-Name: Default Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Project-Name: admin Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Role: member,reader,admin Oct 31 13:54:52.366429 n-d-863052-1 devstack@n-api.service[104563]: X-Roles: member,reader,admin Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c3bb2c22ffb455cbac860e037ee03bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant: admin Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-Tenant-Name: admin Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-User: admin Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-User-Domain-Id: default Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-User-Domain-Name: Default Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-User-Id: a873263a8e3f464a869a8e0ca9ecd0ac Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: X-User-Name: admin Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: method: > Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: exception: Flavor 451 could not be found. Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: action_args: {'id': '451'} Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 13:54:52.367919 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:52.368766 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.369802 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5c491077-0b3b-42a8-8d35-467a1eb50cca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 13:54:52.370855 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5c491077-0b3b-42a8-8d35-467a1eb50cca admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.382984 Oct 31 13:54:52.370855 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 25/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 13:54:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 13:54:52.377991 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-1cb2002f-0593-41de-b918-796080346159 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:52.393173 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-1cb2002f-0593-41de-b918-796080346159 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019458 Oct 31 13:54:52.393680 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 25/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 31 13:54:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:54:52.402697 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:52.417230 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018063 Oct 31 13:54:52.417750 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 26/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 31 13:54:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:54:52.426488 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-cc6c9a36-fa08-4df8-a45c-45c1015278ef admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:52.431334 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.wsgi [None req-cc6c9a36-fa08-4df8-a45c-45c1015278ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-cc6c9a36-fa08-4df8-a45c-45c1015278ef admin admin] Request method failure captured: Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Accept: application/json Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Accept-Encoding: gzip, deflate Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Connection: keep-alive Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Content-Length: 0 Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Host: 10.222.0.27 Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Openstack-Api-Version: compute 2.92 Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: Openstack-System-Scope: None Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: User-Agent: python-novaclient Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Auth-Token: gAAAAABjX9OrG4ZJ-uVdQxpwljKGzFf4mVr_AiFjKo60ccOFpeY8XPoQHo6dRo9tDV22T0_0fjjqijCdEuZQhDUuA_FsmFGUvSeRukiup4USBH9cpEHsJrNnl_jw2pyPphHxc4PE7ghUDWe7djs2otgaxf_ioG2a44nnLznR27xd1W3JZ0bTRWI Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Domain-Id: None Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Domain-Name: None Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Identity-Status: Confirmed Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Is-Admin-Project: True Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Domain-Id: default Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Domain-Name: Default Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Project-Name: admin Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Role: member,reader,admin Oct 31 13:54:52.432813 n-d-863052-1 devstack@n-api.service[104564]: X-Roles: member,reader,admin Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c3bb2c22ffb455cbac860e037ee03bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c3bb2c22ffb455cbac860e037ee03bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant: admin Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant-Id: 7c3bb2c22ffb455cbac860e037ee03bc Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-Tenant-Name: admin Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-User: admin Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-User-Domain-Id: default Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-User-Domain-Name: Default Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-User-Id: a873263a8e3f464a869a8e0ca9ecd0ac Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: X-User-Name: admin Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: method: > Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: exception: Flavor 451 could not be found. Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: action_args: {'id': '451'} Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 13:54:52.434347 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:52.435306 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: ERROR nova.api.openstack.wsgi Oct 31 13:54:52.436560 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-cc6c9a36-fa08-4df8-a45c-45c1015278ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 13:54:52.438371 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-cc6c9a36-fa08-4df8-a45c-45c1015278ef admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011043 Oct 31 13:54:52.438371 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 26/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 13:54:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 13:54:53.636361 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:53.637376 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 31 13:54:53.637765 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:54.153419 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-9cf2e834-e599-4fa9-a7d7-d57b93a0bd12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:54.173108 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-9cf2e834-e599-4fa9-a7d7-d57b93a0bd12 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.396640 Oct 31 13:54:54.173642 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 27/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 31 13:54:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:55.370231 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:55.371251 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 31 13:54:55.371651 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:55.881575 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-e67e4be7-04fa-42b4-9048-d9baf53886a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:55.899990 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-e67e4be7-04fa-42b4-9048-d9baf53886a9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.392788 Oct 31 13:54:55.900562 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 28/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 31 13:54:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:57.094299 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:57.095299 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 31 13:54:57.095713 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:57.612590 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-a205c1fd-5709-4809-b190-3872a5b67129 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:57.631222 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-a205c1fd-5709-4809-b190-3872a5b67129 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400972 Oct 31 13:54:57.631755 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 29/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 31 13:54:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:54:58.824904 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:54:58.825909 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 31 13:54:58.826337 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 30/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:54:59.340563 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-61141a69-a4e0-4540-9ada-382f01dc11f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 13:54:59.358891 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-61141a69-a4e0-4540-9ada-382f01dc11f4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395227 Oct 31 13:54:59.359429 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 30/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 31 13:54:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 13:55:00.564815 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:00.565818 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 31 13:55:00.566231 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 31/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 13:55:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:55:01.083024 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-1a44b0f3-891b-4524-8c1e-cac97fe3ff6c admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:01.102971 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-1a44b0f3-891b-4524-8c1e-cac97fe3ff6c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400487 Oct 31 13:55:01.103508 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 31/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 31 13:55:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 13:55:57.659763 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:57.660784 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-5250efc0-c1b3-45ee-b0bf-4dee3386d2dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 31 13:55:57.661188 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 32/63] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 31 13:55:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 13:55:57.671774 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:58.052055 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-2a1d5920-6f26-45d9-b692-f4b43e1c4a91 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:58.072434 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-2a1d5920-6f26-45d9-b692-f4b43e1c4a91 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405173 Oct 31 13:55:58.072973 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 32/64] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 13:55:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 13:55:58.094020 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_api:SELECT=14 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:58.097890 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-eecb4e53-4f5a-49b0-8321-2d4f81bffb8d admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:58.105216 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-eecb4e53-4f5a-49b0-8321-2d4f81bffb8d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012595 Oct 31 13:55:58.105730 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 33/65] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 31 13:55:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:58.117638 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-cc6780d6-6f86-4525-bd69-9d88cb201270 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:58.125340 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-cc6780d6-6f86-4525-bd69-9d88cb201270 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010798 Oct 31 13:55:58.125842 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 33/66] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 31 13:55:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:58.137020 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-bf84974e-36ee-4167-8a1d-e013d83a841a admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:58.144014 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-bf84974e-36ee-4167-8a1d-e013d83a841a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010412 Oct 31 13:55:58.144522 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 34/67] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 31 13:55:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:58.155490 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-02ba5c8b-32cf-458c-bf8a-40765da17265 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 13:55:58.162407 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-02ba5c8b-32cf-458c-bf8a-40765da17265 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010368 Oct 31 13:55:58.162913 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 34/68] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 31 13:55:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:01:06.633148 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-bf84974e-36ee-4167-8a1d-e013d83a841a admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:01:06.634149 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-bf84974e-36ee-4167-8a1d-e013d83a841a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 31 14:01:06.634562 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 14:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:01:06.773794 n-d-863052-1 devstack@n-api.service[104564]: DEBUG dbcounter [-] [104564] Writing DB stats nova_api:SELECT=6 {{(pid=104564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:01:06.912749 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:01:06.917388 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:06.917867 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:06.918337 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:06.919048 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:06.919491 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:06.919908 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:06.958553 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-73c741d2-5bb5-4637-b7f1-c0528c5727b8 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.185854 Oct 31 14:01:06.959134 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 35/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 14:01:06 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:01:08.025964 n-d-863052-1 devstack@n-api.service[104563]: DEBUG nova.api.openstack.wsgi [None req-bf84974e-36ee-4167-8a1d-e013d83a841a admin admin] Calling method '>' {{(pid=104563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:01:08.027004 n-d-863052-1 devstack@n-api.service[104563]: INFO nova.api.openstack.requestlog [None req-bf84974e-36ee-4167-8a1d-e013d83a841a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 31 14:01:08.027396 n-d-863052-1 devstack@n-api.service[104563]: [pid: 104563|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 31 14:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:01:08.217765 n-d-863052-1 devstack@n-api.service[104564]: DEBUG nova.api.openstack.wsgi [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Calling method '>' {{(pid=104564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:01:08.221205 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:08.221679 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:08.222108 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:08.222843 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:08.223291 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:08.223710 n-d-863052-1 devstack@n-api.service[104564]: DEBUG oslo_concurrency.lockutils [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:08.247171 n-d-863052-1 devstack@n-api.service[104564]: INFO nova.api.openstack.requestlog [None req-48f22d69-b45e-49af-baa1-e322eee754e8 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080293 Oct 31 14:01:08.247653 n-d-863052-1 devstack@n-api.service[104564]: [pid: 104564|app: 0|req: 36/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 14:01:08 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:01:51.403522 n-d-863052-1 devstack@n-api.service[104562]: Mon Oct 31 14:01:51 2022 - graceful shutdown triggered... Oct 31 14:01:51.403768 n-d-863052-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 31 14:01:51.404978 n-d-863052-1 devstack@n-api.service[104564]: Gracefully killing worker 2 (pid: 104564)... Oct 31 14:01:51.405497 n-d-863052-1 devstack@n-api.service[104563]: Gracefully killing worker 1 (pid: 104563)... Oct 31 14:01:51.532058 n-d-863052-1 devstack@n-api.service[104563]: DEBUG dbcounter [-] [104563] Writing DB stats nova_api:SELECT=4 {{(pid=104563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:01:52.404653 n-d-863052-1 devstack@n-api.service[104562]: worker 1 buried after 1 seconds Oct 31 14:01:52.404653 n-d-863052-1 devstack@n-api.service[104562]: worker 2 buried after 1 seconds Oct 31 14:01:52.405225 n-d-863052-1 devstack@n-api.service[104562]: goodbye to uWSGI. Oct 31 14:01:52.406227 n-d-863052-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 31 14:01:52.406833 n-d-863052-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 31 14:01:52.409593 n-d-863052-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 14:01:52.426494 n-d-863052-1 devstack@n-api.service[120631]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 14:01:52.446992 n-d-863052-1 devstack@n-api.service[120631]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 14:01:52 2022] *** Oct 31 14:01:52.447206 n-d-863052-1 devstack@n-api.service[120631]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 14:01:52.447323 n-d-863052-1 devstack@n-api.service[120631]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: nodename: n-d-863052-1 Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: machine: x86_64 Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: clock source: unix Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: pcre jit disabled Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: detected number of CPU cores: 4 Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: current working directory: / Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: detected binary path: /usr/bin/uwsgi-core Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: your processes number limit is 47680 Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: your memory page size is 4096 bytes Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: detected max file descriptor number: 2048 Oct 31 14:01:52.447506 n-d-863052-1 devstack@n-api.service[120631]: lock engine: pthread robust mutexes Oct 31 14:01:52.448263 n-d-863052-1 devstack@n-api.service[120631]: thunder lock: enabled Oct 31 14:01:52.448263 n-d-863052-1 devstack@n-api.service[120631]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 14:01:52.448263 n-d-863052-1 devstack@n-api.service[120631]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 14:01:52.487768 n-d-863052-1 devstack@n-api.service[120631]: Python main interpreter initialized at 0x55d1371d49c0 Oct 31 14:01:52.487768 n-d-863052-1 devstack@n-api.service[120631]: python threads support enabled Oct 31 14:01:52.487768 n-d-863052-1 devstack@n-api.service[120631]: your server socket listen backlog is limited to 100 connections Oct 31 14:01:52.487768 n-d-863052-1 devstack@n-api.service[120631]: your mercy for graceful operations on workers is 90 seconds Oct 31 14:01:52.488176 n-d-863052-1 devstack@n-api.service[120631]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 14:01:52.488176 n-d-863052-1 devstack@n-api.service[120631]: *** Operational MODE: preforking *** Oct 31 14:01:52.488448 n-d-863052-1 devstack@n-api.service[120631]: *** uWSGI is running in multiple interpreter mode *** Oct 31 14:01:52.488448 n-d-863052-1 devstack@n-api.service[120631]: spawned uWSGI master process (pid: 120631) Oct 31 14:01:52.488652 n-d-863052-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 31 14:01:52.489236 n-d-863052-1 devstack@n-api.service[120631]: spawned uWSGI worker 1 (pid: 120640, cores: 1) Oct 31 14:01:52.489752 n-d-863052-1 devstack@n-api.service[120631]: spawned uWSGI worker 2 (pid: 120641, cores: 1) Oct 31 14:01:52.490038 n-d-863052-1 devstack@n-api.service[120631]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 14:01:53.152541 n-d-863052-1 devstack@n-api.service[120640]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 14:01:53.161128 n-d-863052-1 devstack@n-api.service[120641]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 14:01:54.400205 n-d-863052-1 devstack@n-api.service[120641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:01:54.400205 n-d-863052-1 devstack@n-api.service[120641]: from cryptography.utils import int_from_bytes Oct 31 14:01:54.400892 n-d-863052-1 devstack@n-api.service[120641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:01:54.400892 n-d-863052-1 devstack@n-api.service[120641]: from cryptography.utils import int_from_bytes Oct 31 14:01:54.402971 n-d-863052-1 devstack@n-api.service[120640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:01:54.402971 n-d-863052-1 devstack@n-api.service[120640]: from cryptography.utils import int_from_bytes Oct 31 14:01:54.403384 n-d-863052-1 devstack@n-api.service[120640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:01:54.403384 n-d-863052-1 devstack@n-api.service[120640]: from cryptography.utils import int_from_bytes Oct 31 14:01:56.819266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:01:56.819830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:01:56.820038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:01:56.820400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:01:56.820657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:01:56.821043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.821374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.821690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.822009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.822367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.822679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.822999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.823321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.823650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.823946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.824226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.824551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.824873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.825181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.825494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.825814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.826156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.826508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.826828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.827335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.827783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.828095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.830985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.831285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.831609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.831909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.832327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.832637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.832944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.833265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.833593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.833900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.834247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.834568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.834889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.835209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.835512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.835822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.836133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.836459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.836764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.837068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.837316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.837622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.837943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.838287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.838623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.838866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.839115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.839432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.839752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.840059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.840364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.840667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.840972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.841276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.841581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.841932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.842264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.842585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.842898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.843222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.843529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.843848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.844245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.844495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.844802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.845140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.845458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.845767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.846086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.846454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.846743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.847048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.847352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.847618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:01:56.848075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.848213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:01:56.848348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.848348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.848618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:01:56.848747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.848882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:01:56.849010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.849176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:01:56.849312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.849456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.849595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.849723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.849861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.849995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.850136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.850305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.850440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.850594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.850717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.850902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.851995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.852140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.852357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.852550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.852707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.852850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.853896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.854047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.854297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.854446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.854588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.854738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.854891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.855971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.856128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.856337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.856512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.856725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.856915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.858593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.858752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.858905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.859049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.859200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.859481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.859645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.859808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.859958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.860099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.860257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.860404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.860564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.860731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.860967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.861121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.861264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.861418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.861568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.861724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.861877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.862932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.863982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.864202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.864384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.864537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.864680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.864829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.864979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.865128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.865276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.865418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.865558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.865722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.865865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.866019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.866195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.866372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.866581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.866762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.866762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.867050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.867193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.867341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.867498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.867647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.867800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.867956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.868109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.868250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.868390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.868547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.868705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.868854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.869004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.869154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.869307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.869466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.869608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.869761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.869910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.870067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.870227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.870378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.870530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.870678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.870818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.870818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.871197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.871351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.871516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.871677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.871825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.871979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.872121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.872262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.872402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.872551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.872702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.872853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.872993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.873785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.873928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.874080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.874297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.874496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.874650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.874800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.874948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.875097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.875248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.875397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.875801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.875953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.876101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.876253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.876403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.876567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.876787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.876943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.877092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.877242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.877396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.877547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.877688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.877836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.877977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.878123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.878370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.878525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.878723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.878880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.879022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.879172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.879372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.879518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.879667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.879809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.879957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.880421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.880573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.880734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.880876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.881025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.881184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.881410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.881565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.881710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.881710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.881992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.882134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.882340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.882491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.882641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.882794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.882935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.883089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.883242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.883392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.883540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.883690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.883838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.883987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.884136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.884283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.884431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.884614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.884781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.884932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.885083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.885230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.885373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.885521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.885663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.885817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.885817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.886107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.886282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.886437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.886631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.886802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.886957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.887099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.887247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.887402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.887544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.887691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.887835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.887980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.888177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.888332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.888474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.888651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.888804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.888947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.889099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.889250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.889392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.889532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.889680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.889828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.889986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.890128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.890291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.890439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.890593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.890744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.890898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.891053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.891202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.891350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.891582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.891729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.891880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.892031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.892180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.892321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.892462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.892635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.892787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.892935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.893079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.893219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.893361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.893514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.893664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.893805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.893954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.893954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.894248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.894415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.894558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.894745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:01:56.894891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.895904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.896941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.897967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.898108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.898296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.898448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.898596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.898750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.898902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.899935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.900965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.901113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.901268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.901416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.901575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.901789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.901935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.902094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.902291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.902445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.902595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.902737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.902878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.903019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.903168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.903310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.903450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.903628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.903967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.904966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.905245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.905245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.905521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.905664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.905811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.905972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.906114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.906300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.906450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.906450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.906727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.906727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.907885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.908932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.909958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.910099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.910309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.910468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.910611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.910751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.910899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.911048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.911204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.911353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.911495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.911642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.911801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.912904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.913943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.914093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.914265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.914416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.914565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.914717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.914898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.915050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.915243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.915400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.915550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.915692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.915838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.916926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.917066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.917303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.917464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.917615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.917757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.917910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.918973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.919128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.919278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.919278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.919565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.919565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.920328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.920496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.920639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.920787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.920935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.921976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.922226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.922402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.922547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.922704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.922855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.923900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.924054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.924196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.924395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.924551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.924701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.924849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.925045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.925236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.925391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.925532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.925674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.925815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.926934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.927967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.928153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.928356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.928512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.928703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.928945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.929876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.930206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.930382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.930547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.930699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.930848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.930990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.931130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.931278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.931427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.931571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.931720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.931871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.932090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.932260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.932410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.932607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.932807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.932967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.933116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.933272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.933414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.933563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.933712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.933862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.934041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.934250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.934399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.934625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.934780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.934780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.935104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.935248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.935397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.936167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.936326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.936482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.936624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.936766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.936914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.937105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.937264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.937416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.937558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.937878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.938027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.938371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.938546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.938697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.938847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.938997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.939138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.939288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.939490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.939656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.939799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.939946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.940960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.941981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.942123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.942285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.942428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.942580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.942729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.942879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.943909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.944927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.945088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.945298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.945455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.945604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.945747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.945895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.946990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.947131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.947292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.947435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.947583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.947725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.947873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.948945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.949100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.949262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.949419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.949574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.949730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.949890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.950995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.951233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.951407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.951564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.951564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.951869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.951869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.952157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.952305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.952453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.952453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.952791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.952946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.953094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.953251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.953406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.953563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.953720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.953871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.954967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.955121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.955330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.955490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.955646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.955794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.955949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.956098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.956259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.956409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.956557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.956704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.956873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.957026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.957222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.957382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.957531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.957876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.958877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.959933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.960994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.961785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.962882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.963931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.964938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.965979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.966054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.966133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.966240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.966385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.966701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.967020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.967370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.967568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.967728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.967936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.968117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.968313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.968449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.968593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.968862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.968966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.969169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.969263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.969619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.969903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.970022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.970790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.970896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.970978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.970978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.971973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.972093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.972315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.972511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.972643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.972730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.973083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.973190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.973321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.973558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.973668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.973874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.974263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.974263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.974447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.974544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.974661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.974866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.975029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.975219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.975515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.975667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.975813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.975945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.976083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.976220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.976355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.976483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.976678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.976810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.977117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.977303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.977437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.977643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.977789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.978073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.978285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.978418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.978607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.978746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.978907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.979029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.979237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.979385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.979665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.979811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.979975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.980135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.980290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.980537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.980680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.980870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.981003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.981283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.981430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.981619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.981779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.982026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.982189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.982880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.983043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.983283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.983496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.983636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.983759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.983888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.984005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.984141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.984317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.984461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.984753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.984925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.985065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.985196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.985340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.985765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.985913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.985913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.986157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.986378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.986523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.986644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.986783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.986915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.987087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.987253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.987474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.987607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.987718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.987983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.988424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.988424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.988739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.988864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.988974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.989082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.989200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.989325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.989473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.989600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.990570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.990712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.990839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.990969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.991925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.992897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.993744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.994073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.994228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.994540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.994871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.995192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.995524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.995848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.996165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.996483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.996854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.997135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.997430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.997741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.998794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.999022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.999333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.999772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:56.999974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.000266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.000852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.001164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.001475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.001817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.002111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.002441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.002761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.003053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.003418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.003721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.004042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.004356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.004685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.005057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.005322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.005639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.005958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.006283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.006534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.006755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.007063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.007227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.007390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.007548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.007957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.008191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.008421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.008609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.008766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.008916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.009181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.009367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.009553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.009802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.009802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.010192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.010359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.010359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.010643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.010793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.010943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.011997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.012148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.012297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.012440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.012582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.012731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.012882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.013959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.014110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.014339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.014568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.014732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.014876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.015041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.015191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.015356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.015574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.015732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.015876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.016067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.016232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.016448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.016595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.016747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.016892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.017055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.017211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.017362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.017517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.017668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.017832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.018071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.018245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.018396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.018547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.018702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.018846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.019879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.020839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.021134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.021286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.021427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.021576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.021725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.021867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.022957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.023976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.024217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.024373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.024547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.024776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.024940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.025085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.025237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.025380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.025522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.025762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.025911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.026099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.026561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.026783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.026950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.027951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.028069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.028180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.028487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.028636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.028799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.028946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.029097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.029264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.029421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.029564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.029716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.030926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.031076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.031219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.031361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.031523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.031666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.031958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.032142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.032293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.032437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.032620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.032769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.032919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.033125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.033279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.033279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.033575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.033719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.033875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.034018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.034202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.034354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.034509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.034652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.034652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.035030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.035181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.035339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.035482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.035641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.035873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.036022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.036214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.036377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.036522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.036752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.036944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.037231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.037398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.037584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.037864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.038054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.038239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.038408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.038643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.038808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.038960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.039117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.039260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.039408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.039560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.039702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.039852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.040877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.041885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.042971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.043115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.043257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.043398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.043582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.043728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.043881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.044043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.044187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.044490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.044642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.044793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.045632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.045780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.046063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.046279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.046436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.046580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.046761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.046987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.047147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.047298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.047298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.047596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.047746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.047889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.048031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.048250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.048403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.048561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.048803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.049981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.050323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.050323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.050615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.050760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.050902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.050902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.051179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.051348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.051636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.051780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.051893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.052901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.053949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.054091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.054091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.054383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.054537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.054680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.054835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.055027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.055177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.055326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.055326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.055706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.055869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.056014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.056244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.056592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.056745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.056909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.057231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.057392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.057535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.057687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.057837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.057989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.058138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.058553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.058696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.058830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.059248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.059411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.059563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.059707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.059869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.060021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.060171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.060171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.060483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.061222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.061373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.061517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.061674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.061817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.061960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.062109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.062384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.062819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.062978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.063121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.063272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.063414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.063564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.063707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.063858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.064904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.065055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.065206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.065349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.065349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.065636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.065935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.066101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.066402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.066569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.066722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.066884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.067044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.067216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.067436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.067598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.067742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.067893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.068928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.069169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.069318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.069476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.069626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.069778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.069921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.070062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.070284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.070707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.070867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.070867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.071158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.071309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.071465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.071609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.071751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.071900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.072929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.073970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.074937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.075877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.076087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.076332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.076616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.076767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.076921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.077073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.077218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.077375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.077617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.077769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.077919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.078070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.078269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.078429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.078584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.078727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.078886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.079039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.079210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.079729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.079891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.080927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.081958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.082109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.082392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.082595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.082737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.082737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.082961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.083428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.084841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.085065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.085451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.085624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.086138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.086376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.086678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.087350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.087517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.087765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.088172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.088465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.088744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.089134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.090556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.090556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.090556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.090556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.091186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.091186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.091534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.092108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.092718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.093075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.093732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.093902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.094327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.094669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.095165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.095560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.095729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.096050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.096357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.096690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.097086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.097406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.097876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.098145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.098510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.099343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.099343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.099669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.099819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.100040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.100350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.100849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.101042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.101322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.101639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.101955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.102403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.102617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.102932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.103245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.103555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.104253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.104253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.104597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.104798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.105229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.105543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.105865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.107234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.107234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.107234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.107234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.108474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.108474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.108792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.108956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.109235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.109572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.109900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.110284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.110537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.110847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.111160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.111481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.111792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.112099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.112402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.112712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.113017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.113325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.113630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.113933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.114267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.114574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.114878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.115181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.115485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.115788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.116091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.116401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.116703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.117011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.117977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.117977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.117977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.118563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.118563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.118872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.119196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.119509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.119834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.120145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.120470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.120794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.121171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.121424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.121757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.122072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.122411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.122741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.123933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.123933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.124269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.124518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.124828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.125140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.125470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.126056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.126404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.126724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.127117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.127369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.127681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.128154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.128322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.128602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.128912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.129230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.129542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.129852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.130304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.130496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.130820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.131149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.132605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.132605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.132605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.132605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.133354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.133354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.133661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.133810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.133988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.134321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:01:57.134570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:01:57.143485 n-d-863052-1 devstack@n-api.service[120641]: INFO dbcounter [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Registered counter for database nova_api Oct 31 14:01:57.165080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.173234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.197854 n-d-863052-1 devstack@n-api.service[120640]: INFO dbcounter [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Registered counter for database nova_api Oct 31 14:01:57.218775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.225407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.234096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.context [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=120641) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 14:01:57.238119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:57.238747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:57.240741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:57.241490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:57.241937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:57.244439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:57.246548 n-d-863052-1 devstack@n-api.service[120641]: INFO dbcounter [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Registered counter for database nova_cell0 Oct 31 14:01:57.251281 n-d-863052-1 devstack@n-api.service[120641]: INFO dbcounter [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Registered counter for database nova_cell1 Oct 31 14:01:57.259690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.260335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.266217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.268293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.286564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.context [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=120640) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 14:01:57.290608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:57.291093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:57.292707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:57.293435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:01:57.293884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:01:57.296497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:01:57.298559 n-d-863052-1 devstack@n-api.service[120640]: INFO dbcounter [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Registered counter for database nova_cell0 Oct 31 14:01:57.303401 n-d-863052-1 devstack@n-api.service[120640]: INFO dbcounter [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Registered counter for database nova_cell1 Oct 31 14:01:57.311146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.315519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.317835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.413955 n-d-863052-1 devstack@n-api.service[120641]: INFO dbcounter [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Registered counter for database nova_cell0 Oct 31 14:01:57.421508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.425954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.458823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.468722 n-d-863052-1 devstack@n-api.service[120640]: INFO dbcounter [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Registered counter for database nova_cell0 Oct 31 14:01:57.477704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:01:57.482199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:01:57.746587 n-d-863052-1 devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:01:57.754341 n-d-863052-1 devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:01:57.802815 n-d-863052-1 devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:01:57.810087 n-d-863052-1 devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:01:58.107031 n-d-863052-1 devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:01:58.113103 n-d-863052-1 devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-bcb5b691-b1ff-4ea0-9744-2a1eb44d03c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:01:58.118438 n-d-863052-1 devstack@n-api.service[120641]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1371d49c0 pid: 120641 (default app) Oct 31 14:01:58.159347 n-d-863052-1 devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:01:58.165378 n-d-863052-1 devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-d98cae57-7cc7-4fbf-9db9-560373c6cfee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:01:58.170734 n-d-863052-1 devstack@n-api.service[120640]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1371d49c0 pid: 120640 (default app) Oct 31 14:02:36.021700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:36.022826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:36.023547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:36.024654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:37.267461 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c3ba5d75-e432-41bf-b7c1-0829cdb8d396 tempest-TenantUsagesNegativeTestJSON-1412727104 tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-30T14%3A02%3A36.005985&end=2022-11-01T14%3A02%3A36.005985" status: 404 len: 112 microversion: - time: 1.252617 Oct 31 14:02:37.268394 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1316 bytes} [Mon Oct 31 14:02:36 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-30T14%3A02%3A36.005985&end=2022-11-01T14%3A02%3A36.005985 => generated 112 bytes in 1259 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:02:37.517887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6513aff6-e0f5-41f4-9991-7c629d207d8f tempest-TenantUsagesNegativeTestJSON-1412727104 tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin] Calling method '.version_select at 0x7fe10d384af0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:37.526029 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6513aff6-e0f5-41f4-9991-7c629d207d8f tempest-TenantUsagesNegativeTestJSON-1412727104 tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6513aff6-e0f5-41f4-9991-7c629d207d8f tempest-TenantUsagesNegativeTestJSON-1412727104 tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin] Request method failure captured: Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-simple-tenant-usage/891bde3831f14969a459b8e9a0687842?start=2022-11-01T14%3A02%3A36.005985&end=2022-10-30T14%3A02%3A36.005985 HTTP/1.1 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V7PbtKNjqKUwj6iamJ_XzZmxMP82sZLOSraYOd2aoLjGAoM_Hu2n8T_Kw8ku3ILpZ-QHDuTPcrdwuu76G7aVwpf7zQ8yu1eOIaoSc3y-wn9ykR7Bn1mDLGRcLIht0j6KCXOw8bc46VKfZGd0Og9AxhxjA_QETxjnpZB6nPfEtqY70 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8534c293ac8848c284b7b5aa305bd163 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1412727104 Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:02:37.528834 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8534c293ac8848c284b7b5aa305bd163", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8534c293ac8848c284b7b5aa305bd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8534c293ac8848c284b7b5aa305bd163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8534c293ac8848c284b7b5aa305bd163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1412727104 Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8534c293ac8848c284b7b5aa305bd163 Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1412727104 Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: dc431e173079409eaa6309f9e9175e41 Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid start time. The start time cannot occur after the end time. Oct 31 14:02:37.530562 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '891bde3831f14969a459b8e9a0687842'} Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 14:02:37.531446 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6513aff6-e0f5-41f4-9991-7c629d207d8f tempest-TenantUsagesNegativeTestJSON-1412727104 tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:02:37.532934 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6513aff6-e0f5-41f4-9991-7c629d207d8f tempest-TenantUsagesNegativeTestJSON-1412727104 tempest-TenantUsagesNegativeTestJSON-1412727104-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/891bde3831f14969a459b8e9a0687842?start=2022-11-01T14%3A02%3A36.005985&end=2022-10-30T14%3A02%3A36.005985" status: 400 len: 111 microversion: 2.1 time: 0.255243 Oct 31 14:02:37.534218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 31 14:02:37 2022] GET /compute/v2.1/os-simple-tenant-usage/891bde3831f14969a459b8e9a0687842?start=2022-11-01T14%3A02%3A36.005985&end=2022-10-30T14%3A02%3A36.005985 => generated 111 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:02:37.890558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce9525ce-d815-4e53-ace4-d9007477537a tempest-TenantUsagesNegativeTestJSON-1019880027 tempest-TenantUsagesNegativeTestJSON-1019880027-project] Calling method '.version_select at 0x7fe10d348430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:37.895405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ce9525ce-d815-4e53-ace4-d9007477537a tempest-TenantUsagesNegativeTestJSON-1019880027 tempest-TenantUsagesNegativeTestJSON-1019880027-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'da771a7d409b4f09ba8db8c2f7a4a7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891bde3831f14969a459b8e9a0687842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce9525ce-d815-4e53-ace4-d9007477537a tempest-TenantUsagesNegativeTestJSON-1019880027 tempest-TenantUsagesNegativeTestJSON-1019880027-project] Request method failure captured: Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T14%3A02%3A36.005985&end=2022-11-01T14%3A02%3A36.005985&detailed=1 HTTP/1.1 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9V6otzM4d9Ehx2mDH3BLIdQ1VxEttu8x24f81pf_FIaGpa5oYVPb4atoRLS2eDdZbXhR8roxgIkDpZcwMfAV9VFPE0BxNrRTBN4p5jTd8efLDRLk_73h5WkH7FJSLytnlVQeVwKBYWfMShD8coVQJte27XAnSTRo6IUq7NhkLjB0h0 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 891bde3831f14969a459b8e9a0687842 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1019880027 Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:02:37.899144 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_891bde3831f14969a459b8e9a0687842", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/891bde3831f14969a459b8e9a0687842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/891bde3831f14969a459b8e9a0687842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/891bde3831f14969a459b8e9a0687842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1019880027 Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 891bde3831f14969a459b8e9a0687842 Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1019880027 Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TenantUsagesNegativeTestJSON-1019880027-project Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: da771a7d409b4f09ba8db8c2f7a4a7ab Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1019880027-project Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: action_args: {} Oct 31 14:02:37.900684 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:02:37.901713 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:02:37.903902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:02:37.905724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 14:02:37.905724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:02:37.907514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce9525ce-d815-4e53-ace4-d9007477537a tempest-TenantUsagesNegativeTestJSON-1019880027 tempest-TenantUsagesNegativeTestJSON-1019880027-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:02:37.908389 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce9525ce-d815-4e53-ace4-d9007477537a tempest-TenantUsagesNegativeTestJSON-1019880027 tempest-TenantUsagesNegativeTestJSON-1019880027-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T14%3A02%3A36.005985&end=2022-11-01T14%3A02%3A36.005985&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.369267 Oct 31 14:02:37.909082 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1335 bytes} [Mon Oct 31 14:02:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T14%3A02%3A36.005985&end=2022-11-01T14%3A02%3A36.005985&detailed=1 => generated 123 bytes in 371 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:02:38.501628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:38.502613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:38.503607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:38.504029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:39.417436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Calling method '.version_select at 0x7fe10d1a3550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:39.426828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=120641) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 31 14:02:39.427549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:39.428018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:39.428450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:39.459546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:39.460031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:39.460468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:39.472842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:39.473312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:39.473741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:39.479718 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0de168b7-de8a-4f77-83e1-959c42b7b668 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.650019 Oct 31 14:02:39.490042 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3/4] 10.222.0.27 () {60 vars in 1208 bytes} [Mon Oct 31 14:02:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:39.504365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:39.506700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:39.507374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:39.507817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:39.508570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:39.509024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:39.509669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:39.552397 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e600149f-37f9-4ec9-a9f8-a46e61957f32 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.051363 Oct 31 14:02:39.553138 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2/5] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 31 14:02:38 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:39.704559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebea230f-1cbb-4aa6-8891-d424a189ec05 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1323609135", "id": 209496954, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:39.758644 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebea230f-1cbb-4aa6-8891-d424a189ec05 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.276010 Oct 31 14:02:39.759544 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 4/6] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:39 2022] POST /compute/v2.1/flavors => generated 427 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:39.874556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b80e9e2f-7c61-4386-95ac-e90dffee3dc6 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1286067138", "id": 1627647422, "os-flavor-access:is_public": "True"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:39.925664 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b80e9e2f-7c61-4386-95ac-e90dffee3dc6 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.363339 Oct 31 14:02:39.926451 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3/7] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:02:39 2022] POST /compute/v2.1/flavors => generated 449 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:39.930651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10a1e637-180f-4d33-bb58-dced691d3800 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1061865387"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:39.934669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-10a1e637-180f-4d33-bb58-dced691d3800 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Generated uuid c4801ea2-c997-461c-9f46-b8c68e4d87a5 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:02:40.001760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f0f45e4e-bfd0-42a0-8bec-f5727bc4c3c1 tempest-AZAdminNegativeTestJSON-95613910 tempest-AZAdminNegativeTestJSON-95613910-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.002969 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10a1e637-180f-4d33-bb58-dced691d3800 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.075207 Oct 31 14:02:40.004332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f0f45e4e-bfd0-42a0-8bec-f5727bc4c3c1 tempest-AZAdminNegativeTestJSON-95613910 tempest-AZAdminNegativeTestJSON-95613910-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '02b6dd5dbc2c4d64b6f1054a13318535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57844cd3da7248fcae59c5676e92fb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f0f45e4e-bfd0-42a0-8bec-f5727bc4c3c1 tempest-AZAdminNegativeTestJSON-95613910 tempest-AZAdminNegativeTestJSON-95613910-project] Request method failure captured: Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9V8x7n7UrIr-CQCEE04VerJdhdTz07TBic2POorEtvYM6m91R_jNkZBt-buxMSyFYQDHmYBnWiQYV5z62YFy1fcMuOO22Hg3GtzcJRtfWDFdmmN3lxg-Iu7PDPkAd1TR0FvJtNjwOglR0JG4dI_yYp5w6WCXs4mL6au2uyGZXl34QE Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 57844cd3da7248fcae59c5676e92fb5b Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AZAdminNegativeTestJSON-95613910 Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:02:40.006609 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57844cd3da7248fcae59c5676e92fb5b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57844cd3da7248fcae59c5676e92fb5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57844cd3da7248fcae59c5676e92fb5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57844cd3da7248fcae59c5676e92fb5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AZAdminNegativeTestJSON-95613910 Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 57844cd3da7248fcae59c5676e92fb5b Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-95613910 Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AZAdminNegativeTestJSON-95613910-project Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 02b6dd5dbc2c4d64b6f1054a13318535 Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AZAdminNegativeTestJSON-95613910-project Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 14:02:40.007914 n-d-863052-1 devstack@n-api.service[120641]: action_args: {} Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:02:40.040529 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 14:02:40.050734 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:02:40.052528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 4/8] 10.222.0.27 () {62 vars in 1205 bytes} [Mon Oct 31 14:02:39 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.052686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f0f45e4e-bfd0-42a0-8bec-f5727bc4c3c1 tempest-AZAdminNegativeTestJSON-95613910 tempest-AZAdminNegativeTestJSON-95613910-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:02:40.052686 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f0f45e4e-bfd0-42a0-8bec-f5727bc4c3c1 tempest-AZAdminNegativeTestJSON-95613910 tempest-AZAdminNegativeTestJSON-95613910-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.253460 Oct 31 14:02:40.052686 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:02:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:02:40.052686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.052686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:40.053049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:40.053049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:40.053049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:40.053049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:40.053313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:40.087678 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f1400b3-0c69-4576-ad78-5c60edec7fc5 tempest-AZAdminV2TestJSON-581971833 tempest-AZAdminV2TestJSON-581971833-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.070933 Oct 31 14:02:40.088608 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 6/10] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:02:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:40.260066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e22c74b9-3a6b-4acd-9cad-f2f970ab56b6 tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1094685267", "id": 1200475258, "os-flavor-access:is_public": "True"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:40.294430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e22c74b9-3a6b-4acd-9cad-f2f970ab56b6 tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.281925 Oct 31 14:02:40.295526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 5/11] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:02:40 2022] POST /compute/v2.1/flavors => generated 468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.305087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d1c9751-5032-4b2f-a0ad-02c64543ece3 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.332544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d1c9751-5032-4b2f-a0ad-02c64543ece3 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/209496954" status: 202 len: 0 microversion: 2.1 time: 0.035735 Oct 31 14:02:40.333284 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:02:40 2022] DELETE /compute/v2.1/flavors/209496954 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:40.464754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '.version_select at 0x7fe10d0e7e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.467211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:40.467784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:40.468309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:40.487697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:40.488501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:40.488942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:40.502822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:40.503310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:40.503755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:40.510384 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d13cc0d0-c262-4811-a43a-e1c814db74f5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.420564 Oct 31 14:02:40.510894 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:02:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:40.515878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00d6cc4b-a49a-4618-aee6-4637e9e97b60 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-251749076"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:40.674198 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00d6cc4b-a49a-4618-aee6-4637e9e97b60 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.162132 Oct 31 14:02:40.675516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 8/14] 10.222.0.27 () {62 vars in 1210 bytes} [Mon Oct 31 14:02:40 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.786215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d21d0d95-db23-40e6-91d6-60024035d587 tempest-FlavorsV255TestJSON-545284748 tempest-FlavorsV255TestJSON-545284748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.807667 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d21d0d95-db23-40e6-91d6-60024035d587 tempest-FlavorsV255TestJSON-545284748 tempest-FlavorsV255TestJSON-545284748-project] 10.222.0.27 "GET /compute/v2.1/flavors/1627647422" status: 200 len: 449 microversion: 2.55 time: 0.472945 Oct 31 14:02:40.808251 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 7/15] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 31 14:02:40 2022] GET /compute/v2.1/flavors/1627647422 => generated 449 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.813330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ab3a7dd-e449-4e05-88fa-f097a2a0a7d7 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.842722 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ab3a7dd-e449-4e05-88fa-f097a2a0a7d7 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5827 microversion: 2.1 time: 0.032587 Oct 31 14:02:40.843311 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:40 2022] GET /compute/v2.1/flavors/detail => generated 5827 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:40.847732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d77e23e-441f-483d-b219-e1e190d107dd tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.863267 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d77e23e-441f-483d-b219-e1e190d107dd tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.018930 Oct 31 14:02:40.863833 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 9/17] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 31 14:02:40 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.873155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2fc21a4-8ceb-4feb-88cf-d954a85febd7 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] Action: 'update', calling method: .version_select at 0x7fe10d707c10>, body: {"flavor": {"description": "new"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:40.901590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-540bbe34-f565-4f67-8bb1-e2ae41fb82ea tempest-FlavorsV261TestJSON-1406779276 tempest-FlavorsV261TestJSON-1406779276-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:40.926458 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-540bbe34-f565-4f67-8bb1-e2ae41fb82ea tempest-FlavorsV261TestJSON-1406779276 tempest-FlavorsV261TestJSON-1406779276-project] 10.222.0.27 "GET /compute/v2.1/flavors/1200475258" status: 200 len: 468 microversion: 2.61 time: 0.249509 Oct 31 14:02:40.927066 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 9/18] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 31 14:02:40 2022] GET /compute/v2.1/flavors/1200475258 => generated 468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.941502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f0e9d65-87d4-4040-9fc9-0f1e662aa3b9 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-316311413", "id": 561557356, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:40.943803 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2fc21a4-8ceb-4feb-88cf-d954a85febd7 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1627647422" status: 200 len: 450 microversion: 2.55 time: 0.073493 Oct 31 14:02:40.944987 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 10/19] 10.222.0.27 () {62 vars in 1219 bytes} [Mon Oct 31 14:02:40 2022] PUT /compute/v2.1/flavors/1627647422 => generated 450 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:40.958272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed9623e9-ad60-4780-979c-10a398002b91 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:40.983861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f0e9d65-87d4-4040-9fc9-0f1e662aa3b9 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.055536 Oct 31 14:02:40.984406 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:40 2022] POST /compute/v2.1/flavors => generated 413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:40.996832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ecc39ff-c317-4d67-a47e-c1f956f20f45 tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] Action: 'update', calling method: .version_select at 0x7fe10d708dc0>, body: {"flavor": {"description": "new"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.001175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9623e9-ad60-4780-979c-10a398002b91 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:41.001861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9623e9-ad60-4780-979c-10a398002b91 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:41.002421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9623e9-ad60-4780-979c-10a398002b91 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:41.057799 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ecc39ff-c317-4d67-a47e-c1f956f20f45 tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1200475258" status: 200 len: 469 microversion: 2.61 time: 0.070188 Oct 31 14:02:41.068466 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 11/21] 10.222.0.27 () {62 vars in 1219 bytes} [Mon Oct 31 14:02:40 2022] PUT /compute/v2.1/flavors/1200475258 => generated 469 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:41.073790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-90180705-2e0d-4169-b017-e71d4327d0a8 tempest-FlavorsV255TestJSON-545284748 tempest-FlavorsV255TestJSON-545284748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.113582 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-90180705-2e0d-4169-b017-e71d4327d0a8 tempest-FlavorsV255TestJSON-545284748 tempest-FlavorsV255TestJSON-545284748-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.043632 Oct 31 14:02:41.114820 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 12/22] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:41.123308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30ea342e-5351-4c6f-a631-c47fc7a1073c tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.157284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30ea342e-5351-4c6f-a631-c47fc7a1073c tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.039446 Oct 31 14:02:41.170706 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:41.179024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d0ed19f-abd6-4654-b3e5-fb48f97bc56e tempest-FlavorsV261TestJSON-1406779276 tempest-FlavorsV261TestJSON-1406779276-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.210444 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d0ed19f-abd6-4654-b3e5-fb48f97bc56e tempest-FlavorsV261TestJSON-1406779276 tempest-FlavorsV261TestJSON-1406779276-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.034496 Oct 31 14:02:41.214112 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 14/24] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:41.222883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-211a2ffd-c3fa-406b-be3a-11ccf6443e0e tempest-FlavorsV255TestJSON-545284748 tempest-FlavorsV255TestJSON-545284748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.251878 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-211a2ffd-c3fa-406b-be3a-11ccf6443e0e tempest-FlavorsV255TestJSON-545284748 tempest-FlavorsV255TestJSON-545284748-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.55 time: 0.035896 Oct 31 14:02:41.252783 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 15/25] 10.222.0.27 () {60 vars in 1166 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:41.258208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb68e269-c9f1-4416-8639-502d9c9fd1ed tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.304338 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb68e269-c9f1-4416-8639-502d9c9fd1ed tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/561557356" status: 202 len: 0 microversion: 2.1 time: 0.050066 Oct 31 14:02:41.305681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 16/26] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/flavors/561557356 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:41.314082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ea2d50f-76e1-4b3e-bf5d-0ca224169a14 tempest-FlavorsV261TestJSON-1406779276 tempest-FlavorsV261TestJSON-1406779276-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.340584 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ea2d50f-76e1-4b3e-bf5d-0ca224169a14 tempest-FlavorsV261TestJSON-1406779276 tempest-FlavorsV261TestJSON-1406779276-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3426 microversion: 2.61 time: 0.033262 Oct 31 14:02:41.341639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 17/27] 10.222.0.27 () {60 vars in 1166 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors => generated 3426 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:41.350266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ecb29f67-e8b0-431d-be8e-5a24ed4be297 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.377533 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ecb29f67-e8b0-431d-be8e-5a24ed4be297 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1627647422" status: 202 len: 0 microversion: 2.55 time: 0.032183 Oct 31 14:02:41.381407 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 18/28] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/flavors/1627647422 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:02:41.386153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-433ffdc8-47cd-4dd7-8100-786ccde9481b tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.414039 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-433ffdc8-47cd-4dd7-8100-786ccde9481b tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.033373 Oct 31 14:02:41.418790 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 19/29] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:41.430024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8229f48-2f92-4e8c-86b4-dad376f2f255 tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.459605 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8229f48-2f92-4e8c-86b4-dad376f2f255 tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1200475258" status: 202 len: 0 microversion: 2.61 time: 0.043112 Oct 31 14:02:41.460842 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 20/30] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/flavors/1200475258 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:02:41.467010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed12e7f1-3239-4f74-b717-b840520d8161 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.508948 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed12e7f1-3239-4f74-b717-b840520d8161 tempest-FlavorsV255TestJSON-488590079 tempest-FlavorsV255TestJSON-488590079-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.046440 Oct 31 14:02:41.509763 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 21/31] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:41.514810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-07a51c73-bff9-4a93-a25c-216f5ff7901b tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1637775924", "id": 1976189366, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.539264 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-07a51c73-bff9-4a93-a25c-216f5ff7901b tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.027751 Oct 31 14:02:41.540058 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 22/32] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/flavors => generated 429 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:41.546929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e66b228-2ce9-4624-a423-ef11bc281bfe tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.583665 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e66b228-2ce9-4624-a423-ef11bc281bfe tempest-FlavorsV261TestJSON-1163995073 tempest-FlavorsV261TestJSON-1163995073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.042354 Oct 31 14:02:41.584241 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 23/33] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:02:41.596277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b935841b-c2f7-4a3d-a55d-16da9d6bae72 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.613577 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b935841b-c2f7-4a3d-a55d-16da9d6bae72 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1976189366" status: 202 len: 0 microversion: 2.1 time: 0.027929 Oct 31 14:02:41.614124 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed9623e9-ad60-4780-979c-10a398002b91 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.667399 Oct 31 14:02:41.615199 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 24/34] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/flavors/1976189366 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:41.618148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 11/35] 10.222.0.27 () {62 vars in 1232 bytes} [Mon Oct 31 14:02:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:41.630653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f7371af-be54-4b38-8ae6-8d6c1ff353b6 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.631199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e953579a-fdde-4a5d-9d3c-97098e993557 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.642858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e953579a-fdde-4a5d-9d3c-97098e993557 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:41.643342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e953579a-fdde-4a5d-9d3c-97098e993557 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:41.643774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e953579a-fdde-4a5d-9d3c-97098e993557 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:41.656125 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f7371af-be54-4b38-8ae6-8d6c1ff353b6 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033053 Oct 31 14:02:41.656850 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 25/36] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:41.677174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-39b8782a-d687-4c53-bf70-bddcadb62ba1 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-640602466", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.703846 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-39b8782a-d687-4c53-bf70-bddcadb62ba1 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.030062 Oct 31 14:02:41.704621 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 26/37] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/flavors => generated 506 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:41.721274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb1d0582-135a-4899-88f5-8056644947f5 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.745728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb1d0582-135a-4899-88f5-8056644947f5 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/e4528837-e99f-485a-919b-fcb7c73cd1b4" status: 202 len: 0 microversion: 2.1 time: 0.032266 Oct 31 14:02:41.746687 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 27/38] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/flavors/e4528837-e99f-485a-919b-fcb7c73cd1b4 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:02:41.757985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff39bce8-4a10-4c80-9d77-a1927aae3cc5 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.766650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=15 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:41.783774 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff39bce8-4a10-4c80-9d77-a1927aae3cc5 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030054 Oct 31 14:02:41.784339 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 28/39] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:41.803927 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e953579a-fdde-4a5d-9d3c-97098e993557 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.177230 Oct 31 14:02:41.805660 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 12/40] 10.222.0.27 () {62 vars in 1232 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:02:41.818642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86800ded-9995-49a9-bb64-c952e81fe90c tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1483539529", "id": "440c735a-dd74-4011-ac62-44efe506c26e", "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.821666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2cfd16b-80e5-43f6-9ee2-ab594b4a7517 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.843019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86800ded-9995-49a9-bb64-c952e81fe90c tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.037232 Oct 31 14:02:41.844027 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 29/41] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/flavors => generated 507 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:41.856407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54709159-05c5-450b-a300-ef09f3e31a8a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.861938 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2cfd16b-80e5-43f6-9ee2-ab594b4a7517 tempest-AggregatesAdminTestV241-148266418 tempest-AggregatesAdminTestV241-148266418-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.047056 Oct 31 14:02:41.862593 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 13/42] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:41.882745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-54709159-05c5-450b-a300-ef09f3e31a8a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/440c735a-dd74-4011-ac62-44efe506c26e" status: 202 len: 0 microversion: 2.1 time: 0.030380 Oct 31 14:02:41.884836 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 30/43] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:02:41 2022] DELETE /compute/v2.1/flavors/440c735a-dd74-4011-ac62-44efe506c26e => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:02:41.888315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e362bc4-ca24-4689-b5f6-bb3f8e949c90 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1178885768", "name": "tempest-test_aggregate-1132487381"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.896526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c499a588-d265-4aa1-b5f1-c244b1f4c22b tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.912823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-1e362bc4-ca24-4689-b5f6-bb3f8e949c90 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 4b5b9170-1d24-43f2-86a6-a74952de392d for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:02:41.922925 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c499a588-d265-4aa1-b5f1-c244b1f4c22b tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031544 Oct 31 14:02:41.924222 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 31/44] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:41.944261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9867cad1-24d0-465d-95cc-e95bc498fb78 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-983496454", "id": 1556521439, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.954883 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e362bc4-ca24-4689-b5f6-bb3f8e949c90 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.073517 Oct 31 14:02:41.956310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 14/45] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:41.968182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d21d795a-e5a5-4568-8137-2ae05e97aacd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:41.979155 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d21d795a-e5a5-4568-8137-2ae05e97aacd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.015106 Oct 31 14:02:41.986234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9867cad1-24d0-465d-95cc-e95bc498fb78 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.034956 Oct 31 14:02:41.986234 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 32/46] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:41.986750 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 15/47] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:41.992282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99bb0d78-2ec6-4169-8dc7-a5b7277e3fbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:41.994207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9a5b9df-d99f-426f-b9fb-9e1c7ce2a04d tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.002645 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9a5b9df-d99f-426f-b9fb-9e1c7ce2a04d tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1556521439" status: 200 len: 413 microversion: 2.1 time: 0.013895 Oct 31 14:02:42.003499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 16/48] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:02:41 2022] GET /compute/v2.1/flavors/1556521439 => generated 413 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:42.009748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bb0d78-2ec6-4169-8dc7-a5b7277e3fbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:42.010446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bb0d78-2ec6-4169-8dc7-a5b7277e3fbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:42.011114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bb0d78-2ec6-4169-8dc7-a5b7277e3fbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:42.546467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d1f5be78-cec6-4671-bd00-36f4eeb5cfc2 tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.586756 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d1f5be78-cec6-4671-bd00-36f4eeb5cfc2 tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.573305 Oct 31 14:02:42.587842 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 17/49] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:42 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:42.611358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab4a4add-be1c-4f70-b321-9548acbc5525 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.630648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab4a4add-be1c-4f70-b321-9548acbc5525 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1556521439" status: 202 len: 0 microversion: 2.1 time: 0.025157 Oct 31 14:02:42.631787 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 18/50] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:02:42 2022] DELETE /compute/v2.1/flavors/1556521439 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:42.641184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e3e8bf9-687e-4848-8c47-121539fb816a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.662369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e3e8bf9-687e-4848-8c47-121539fb816a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026375 Oct 31 14:02:42.667142 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 19/51] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:42.689557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01d6fdd8-1eed-49ff-8080-7e80360d1623 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-882592334", "id": 1123664195, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:42.709743 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01d6fdd8-1eed-49ff-8080-7e80360d1623 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.023557 Oct 31 14:02:42.711064 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 20/52] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:42 2022] POST /compute/v2.1/flavors => generated 429 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:42.725135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdabd125-8254-4768-a281-e1518a8965be tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "1123664195"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:42.741448 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bdabd125-8254-4768-a281-e1518a8965be tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] HTTP exception thrown: Flavor 1123664195 could not be found. Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdabd125-8254-4768-a281-e1518a8965be tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] Request method failure captured: Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 107 Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V8QtmEO7iesAUg3dr4i6SHIv_nviMyyHWTkyF2NYpgOCQKjWszb2MHPN2s6Q7QNpWXsz7yKxiuefiGp6gEZPK3Hpra-SgMmlPeOnMiXPpbbO7x5acEVXiNYa2z-j8wXvDY5Z_EB6OgNqpMK8wPROqMuWJZlJO9MfuDIHf4sVpGfVs Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 903105fa44964a7a84ff54be8578e3b8 Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsAdminTestJSON-189294593 Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:02:42.748022 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_903105fa44964a7a84ff54be8578e3b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/903105fa44964a7a84ff54be8578e3b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/903105fa44964a7a84ff54be8578e3b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/903105fa44964a7a84ff54be8578e3b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsAdminTestJSON-189294593 Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 903105fa44964a7a84ff54be8578e3b8 Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-189294593 Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsAdminTestJSON-189294593-project Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 0e5a8fa1ec0a4b5dbc48f471b41ce621 Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsAdminTestJSON-189294593-project Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "test", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "1123664195"}} Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:02:42.749064 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor 1123664195 could not be found. Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '1123664195'}}} Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1123664195 could not be found. Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:42.749655 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1123664195 could not be found. Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:02:42.750821 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:02:42.751717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:02:42.751717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:02:42.751717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:02:42.751717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1123664195 could not be found. Oct 31 14:02:42.751717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:02:42.753938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdabd125-8254-4768-a281-e1518a8965be tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] Returning 400 to user: Flavor 1123664195 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:02:42.756415 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdabd125-8254-4768-a281-e1518a8965be tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.036953 Oct 31 14:02:42.757621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 21/53] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:42 2022] POST /compute/v2.1/servers => generated 81 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 31 14:02:42.768345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1bbbc09-276e-4671-a894-37db2c5ef6db tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.790943 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1bbbc09-276e-4671-a894-37db2c5ef6db tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1123664195" status: 202 len: 0 microversion: 2.1 time: 0.027055 Oct 31 14:02:42.792152 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 22/54] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:02:42 2022] DELETE /compute/v2.1/flavors/1123664195 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:42.800515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37e34a44-dc24-44c9-848e-2d9ec85637a4 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.823559 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37e34a44-dc24-44c9-848e-2d9ec85637a4 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026740 Oct 31 14:02:42.824934 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 23/55] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:42.845776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a45ef21b-6265-4526-80e5-45054b642577 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-120353879", "id": 827270382, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:42.869148 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a45ef21b-6265-4526-80e5-45054b642577 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.027778 Oct 31 14:02:42.870512 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 24/56] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:42 2022] POST /compute/v2.1/flavors => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:42.887118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-798bf112-b254-4d6f-85e8-1e9f36852799 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2103069997", "id": 1643647552, "os-flavor-access:is_public": "True"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:42.897592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:DELETE=12,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:42.926442 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-798bf112-b254-4d6f-85e8-1e9f36852799 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.043392 Oct 31 14:02:42.936300 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 25/57] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:42.943704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90de2542-6199-44d5-81f3-d8d1b9485b24 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.968163 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90de2542-6199-44d5-81f3-d8d1b9485b24 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.030007 Oct 31 14:02:42.974530 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 26/58] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 31 14:02:42 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:42.984427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1e53841-d33f-44ef-b6c7-e950c01158f7 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:42.999554 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1e53841-d33f-44ef-b6c7-e950c01158f7 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.020561 Oct 31 14:02:43.001552 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 27/59] 10.222.0.27 () {58 vars in 1177 bytes} [Mon Oct 31 14:02:42 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:43.014228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c8408b1-0994-44c3-8c9b-f5324cddcbd7 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.035422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c8408b1-0994-44c3-8c9b-f5324cddcbd7 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.025441 Oct 31 14:02:43.042338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 28/60] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:43.049275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b98fb877-79f9-4f0a-ab02-4e53c6eb4e3f tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.065578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b98fb877-79f9-4f0a-ab02-4e53c6eb4e3f tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.020114 Oct 31 14:02:43.066147 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 29/61] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:43.079183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ce54c59-4c6e-4643-829f-6297c56af764 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.102984 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ce54c59-4c6e-4643-829f-6297c56af764 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.027755 Oct 31 14:02:43.104880 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 30/62] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:43.125677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4df7d32f-20e3-4d16-92b1-6b334bc6e464 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.148341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4df7d32f-20e3-4d16-92b1-6b334bc6e464 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.028330 Oct 31 14:02:43.149235 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:43.168974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd12aed0-9a60-44c4-93c6-d4e8d6561ac9 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.193978 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd12aed0-9a60-44c4-93c6-d4e8d6561ac9 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.029256 Oct 31 14:02:43.194661 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 32/64] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:43.215543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-742e9e9c-ce02-4f9b-b794-69a8ef5ab4b4 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.240718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-742e9e9c-ce02-4f9b-b794-69a8ef5ab4b4 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.029971 Oct 31 14:02:43.241742 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:43.261495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-233f0833-5437-4e02-93c7-3700c691eb32 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.280658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-233f0833-5437-4e02-93c7-3700c691eb32 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1643647552" status: 202 len: 0 microversion: 2.1 time: 0.023608 Oct 31 14:02:43.284831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 34/66] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:02:43 2022] DELETE /compute/v2.1/flavors/1643647552 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:43.291816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43cc790e-7c1a-43fb-abea-3b9e239c360c tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.314410 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43cc790e-7c1a-43fb-abea-3b9e239c360c tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028255 Oct 31 14:02:43.326646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:43.333591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d93f7b5-99e7-4664-97fe-0d39b7bdd9c8 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.355235 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d93f7b5-99e7-4664-97fe-0d39b7bdd9c8 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/827270382" status: 202 len: 0 microversion: 2.1 time: 0.025107 Oct 31 14:02:43.359340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 36/68] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:02:43 2022] DELETE /compute/v2.1/flavors/827270382 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:02:43.367090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-031ae86a-2450-4ea7-af86-ca85af2a885a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.403751 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-031ae86a-2450-4ea7-af86-ca85af2a885a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038444 Oct 31 14:02:43.408304 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:43.429044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5b711b4-a326-46f0-86b5-135e161714c4 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1833740721", "id": 1859093383, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:43.450426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5b711b4-a326-46f0-86b5-135e161714c4 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.026598 Oct 31 14:02:43.451669 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 38/70] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:43 2022] POST /compute/v2.1/flavors => generated 415 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:43.464497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-055a5e79-1e9f-45c3-9450-f27c2a3aabf0 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.515313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-055a5e79-1e9f-45c3-9450-f27c2a3aabf0 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055383 Oct 31 14:02:43.515931 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 39/71] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:43.534280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-523ec57c-52b6-48f2-b3db-bdc395719d64 tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.582871 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-523ec57c-52b6-48f2-b3db-bdc395719d64 tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052440 Oct 31 14:02:43.583485 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 40/72] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:02:43.611684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a76b16a7-ccd0-490e-aa5e-a73a342b169a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.673191 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a76b16a7-ccd0-490e-aa5e-a73a342b169a tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1859093383" status: 202 len: 0 microversion: 2.1 time: 0.072699 Oct 31 14:02:43.679944 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 41/73] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:02:43 2022] DELETE /compute/v2.1/flavors/1859093383 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:43.685650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c414fc74-f225-4526-8a71-1204087a477d tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.690394 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99bb0d78-2ec6-4169-8dc7-a5b7277e3fbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 1.702326 Oct 31 14:02:43.707083 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 33/74] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:02:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:02:43.732115 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c414fc74-f225-4526-8a71-1204087a477d tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050547 Oct 31 14:02:43.739840 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 42/75] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:43.766695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7eca2c4-0f11-4d6e-95b7-36c6adda1b7e tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1453482117", "id": 985830002, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:43.812730 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7eca2c4-0f11-4d6e-95b7-36c6adda1b7e tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.053938 Oct 31 14:02:43.815547 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 34/76] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:43 2022] POST /compute/v2.1/flavors => generated 411 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:43.834135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26b5dad1-d65b-4b0a-bf65-5c637cebf953 tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.881327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26b5dad1-d65b-4b0a-bf65-5c637cebf953 tempest-FlavorsAdminTestJSON-189294593 tempest-FlavorsAdminTestJSON-189294593-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.058669 Oct 31 14:02:43.894581 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 43/77] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:43.901331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b8f08fd-7b91-42bb-a064-28af2d34d1f0 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.934682 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b8f08fd-7b91-42bb-a064-28af2d34d1f0 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/985830002" status: 202 len: 0 microversion: 2.1 time: 0.036690 Oct 31 14:02:43.937549 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 35/78] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:02:43 2022] DELETE /compute/v2.1/flavors/985830002 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:43.946961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53b2c594-80e3-46bf-be8e-98c9d751b912 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:43.977909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53b2c594-80e3-46bf-be8e-98c9d751b912 tempest-FlavorsAdminTestJSON-1551467623 tempest-FlavorsAdminTestJSON-1551467623-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036782 Oct 31 14:02:43.992495 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 44/79] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:44.544057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1132995569", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "availability_zone": "tempest-test_az-1178885768"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:44.567714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:44.570088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:44.571024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:44.575296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:44.575775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:44.581274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:46.389765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:02:47.260272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:02:47.260693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:02:47.261462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:02:47.262057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:02:47.263243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:02:47.293910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:47.294505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:47.294958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:47.297145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:47.297626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:47.298064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:47.376302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Getting quotas for project 5fbbd6c8074f46e1bfc5cb308cb7764d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:02:47.399870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Getting quotas for user 1c62e591cf274302bf84204bdf1f1977 and project 5fbbd6c8074f46e1bfc5cb308cb7764d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:02:47.436282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:02:47.442881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:02:47.560165 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-134391f4-d251-44a5-8471-b43c7bea0db4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.552635 Oct 31 14:02:47.561052 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 36/80] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:02:47.575741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-409c79e1-085e-4109-a220-b177a8f5d123 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:47.577238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-409c79e1-085e-4109-a220-b177a8f5d123 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:49.521038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:49.788233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-409c79e1-085e-4109-a220-b177a8f5d123 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:49.810809 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-409c79e1-085e-4109-a220-b177a8f5d123 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1243 microversion: 2.1 time: 2.241442 Oct 31 14:02:49.812040 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 45/81] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:47 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1243 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:50.835328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:50.835965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:50.851996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:50.852792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:50.853379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:50.854387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:50.855864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:50.856425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:51.256300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:51.291251 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3c3d001-4127-4748-be05-10d423eb7f8d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1291 microversion: 2.1 time: 0.459355 Oct 31 14:02:51.293934 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 37/82] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:50 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1291 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:51.663049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:51.669219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d517fb77-0e02-4aaf-ab86-7f034b112f72 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-626659646", "ram": 512, "vcpus": 1, "disk": 10, "id": 203722228, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:51.709106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d517fb77-0e02-4aaf-ab86-7f034b112f72 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.835997 Oct 31 14:02:51.715457 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 46/83] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:50 2022] POST /compute/v2.1/flavors => generated 412 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:51.731208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57d1e6e6-081b-4a3c-998b-48e3694d5849 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:51.786195 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57d1e6e6-081b-4a3c-998b-48e3694d5849 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059351 Oct 31 14:02:51.787226 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 47/84] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Oct 31 14:02:51 2022] POST /compute/v2.1/flavors/203722228/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:52.446385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1875589542", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "6210a55b-8790-4aa9-8e81-23a0101568be"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:52.544429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-808852aa-afe3-49de-9ca9-e75347f4f912 tempest-FlavorsExtraSpecsTestJSON-350160910 tempest-FlavorsExtraSpecsTestJSON-350160910-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:52.556711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] validate_networks() for [('6210a55b-8790-4aa9-8e81-23a0101568be', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:02:52.566494 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-808852aa-afe3-49de-9ca9-e75347f4f912 tempest-FlavorsExtraSpecsTestJSON-350160910 tempest-FlavorsExtraSpecsTestJSON-350160910-project] 10.222.0.27 "GET /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.771591 Oct 31 14:02:52.569341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 48/85] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 31 14:02:51 2022] GET /compute/v2.1/flavors/203722228/os-extra_specs => generated 66 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:52.581607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:52.582532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:52.607795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:52.608589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:52.610699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:52.611576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:52.618148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:52.618804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:53.075469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:53.101144 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fd79b3a-ba42-4ed8-a997-adef0e526802 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1297 microversion: 2.1 time: 0.530460 Oct 31 14:02:53.131478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 49/86] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:52 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1297 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:53.138890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfdcaf01-a367-41a9-b007-5c4b4bd8d34b tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:53.238532 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfdcaf01-a367-41a9-b007-5c4b4bd8d34b tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.105679 Oct 31 14:02:53.241242 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 50/87] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Oct 31 14:02:53 2022] POST /compute/v2.1/flavors/203722228/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:53.252039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7704efd6-8204-4ac5-af5e-57d1f6daf7de tempest-FlavorsExtraSpecsTestJSON-350160910 tempest-FlavorsExtraSpecsTestJSON-350160910-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:53.276544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7704efd6-8204-4ac5-af5e-57d1f6daf7de tempest-FlavorsExtraSpecsTestJSON-350160910 tempest-FlavorsExtraSpecsTestJSON-350160910-project] 10.222.0.27 "GET /compute/v2.1/flavors/203722228/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.029186 Oct 31 14:02:53.282373 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 51/88] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:02:53 2022] GET /compute/v2.1/flavors/203722228/os-extra_specs/hw:numa_nodes => generated 22 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:53.294349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28f1ef39-17b8-46fd-a424-67658f555bcb tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:53.330834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=9,nova_api:INSERT=4,nova_api:SAVEPOINT=6,nova_api:RELEASE=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:53.386120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28f1ef39-17b8-46fd-a424-67658f555bcb tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093973 Oct 31 14:02:53.387577 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 52/89] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Oct 31 14:02:53 2022] POST /compute/v2.1/flavors/203722228/os-extra_specs => generated 66 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:53.401691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-749d5f03-fc65-43d1-9541-a6f68b571cda tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:53.426061 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-749d5f03-fc65-43d1-9541-a6f68b571cda tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029836 Oct 31 14:02:53.427360 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 53/90] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 31 14:02:53 2022] GET /compute/v2.1/flavors/203722228/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:53.439926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53ab27ed-492e-4c57-bc15-c4b4e19c8366 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:53.524450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53ab27ed-492e-4c57-bc15-c4b4e19c8366 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/203722228/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.091439 Oct 31 14:02:53.530848 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 54/91] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:02:53 2022] PUT /compute/v2.1/flavors/203722228/os-extra_specs/hw:numa_nodes => generated 22 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 14:02:53.546322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-178591e6-ebe0-4f05-b76d-98b41f0d430e tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:53.590332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-178591e6-ebe0-4f05-b76d-98b41f0d430e tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057929 Oct 31 14:02:53.596533 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 55/92] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 31 14:02:53 2022] GET /compute/v2.1/flavors/203722228/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:53.605739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bf4430d-531d-4f22-a531-92d78b36c98f tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:53.726636 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bf4430d-531d-4f22-a531-92d78b36c98f tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/203722228/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.125028 Oct 31 14:02:53.727903 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 56/93] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:02:53 2022] DELETE /compute/v2.1/flavors/203722228/os-extra_specs/hw:numa_nodes => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:02:54.835735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10d384af0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:54.843379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:54.846963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:54.848395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:54.850257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:54.852453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:54.853836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:54.941385 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4521ac8-6938-4d79-ad90-a7eb6ad39a5b tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 1.211889 Oct 31 14:02:54.942580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 57/94] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 31 14:02:53 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:54.955316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35114710-2e54-4847-be66-634d69f47443 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:54.998620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35114710-2e54-4847-be66-634d69f47443 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/203722228/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.054636 Oct 31 14:02:54.999756 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 58/95] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:02:54 2022] DELETE /compute/v2.1/flavors/203722228/os-extra_specs/hw:cpu_policy => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:02:55.009863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:55.013621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:55.026431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:55.027644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:55.030761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:55.031737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:55.039511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:55.040297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:55.818301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:02:55.818810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:02:55.819194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:02:55.819605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:02:55.820025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:02:55.833418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:55.833909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:55.834375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:55.835109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:55.835562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:55.835984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:55.907481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Getting quotas for project a6c5ba969b654c3986dbd6c693887bff. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:02:55.923390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Getting quotas for user a58704dad2b94740be8042992cb16454 and project a6c5ba969b654c3986dbd6c693887bff. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:02:55.956020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:02:55.962786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:02:56.054939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:56.085403 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa2e9885-7aec-4136-aaf0-2803627b8a0d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 1.078584 Oct 31 14:02:56.100787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ef10a05-9fb9-4cdd-b389-0ec546400e9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.380726 Oct 31 14:02:56.109879 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 38/96] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:02:56.113062 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 59/97] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:55 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:56.142775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c6f9940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:56.146704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:56.160287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:56.163962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:56.166710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:56.170798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:56.172420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:56.329153 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c5cb15f-a9f2-42e2-8b3b-c8b0711e338c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.211288 Oct 31 14:02:56.331777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 60/98] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Oct 31 14:02:56 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:56.350351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a79e8ee-337a-4f36-9c6a-60985a01021e tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:56.388695 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a79e8ee-337a-4f36-9c6a-60985a01021e tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/203722228/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.054373 Oct 31 14:02:56.394511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 61/99] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 31 14:02:56 2022] GET /compute/v2.1/flavors/203722228/os-extra_specs => generated 19 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:56.753799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Calling method '.version_select at 0x7fe10c6a6ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:56.756699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:56.757829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:56.758491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:56.814042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:56.817512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:56.818094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:56.861432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:56.863837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:56.865239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:56.883636 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c0cdcc5-d756-45af-8d7b-7299129e6fa0 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.771694 Oct 31 14:02:56.884794 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 39/100] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:02:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:56.892820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20f23fb6-d6a1-45b7-a811-eb8aa1102999 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:56.893915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20f23fb6-d6a1-45b7-a811-eb8aa1102999 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:57.052578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:57.074148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.081046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.081677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.082801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.083882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.086833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.197694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59466f15-222c-4470-a1e8-193c30743bb1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.803058 Oct 31 14:02:57.212483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 62/101] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:02:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:57.216382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20f23fb6-d6a1-45b7-a811-eb8aa1102999 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:57.219244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c6bfc10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:57.223600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.224359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.225003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.225932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.226615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.227588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.254679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20f23fb6-d6a1-45b7-a811-eb8aa1102999 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1224 microversion: 2.1 time: 0.359653 Oct 31 14:02:57.273492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 40/102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:56 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1224 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:57.278774 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6dc9498-10a6-461d-b1ba-4ac3b74c8533 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.062272 Oct 31 14:02:57.280000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 63/103] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Oct 31 14:02:57 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:57.302498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02858cc7-64f7-4e13-8f72-c01f5b415c64 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:57.357693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02858cc7-64f7-4e13-8f72-c01f5b415c64 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/203722228" status: 202 len: 0 microversion: 2.1 time: 0.078116 Oct 31 14:02:57.358942 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 41/104] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:02:57 2022] DELETE /compute/v2.1/flavors/203722228 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:02:57.368473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Calling method '.version_select at 0x7fe10c671c10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:57.377104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.377601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.379859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.418567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.421265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.423008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.449329 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f989d30-d155-48e9-bbc7-1988e15a3ce7 tempest-HypervisorAdminV228Test-329327286 tempest-HypervisorAdminV228Test-329327286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.085775 Oct 31 14:02:57.451704 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 42/105] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 14:02:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:02:57.465607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:57.467248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:57.485465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.486203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.493634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.496305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:57.499010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:57.499629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:57.539492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b9632b2-3955-4d73-8319-09ea84a9ead0 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-105573528", "id": 1857861866, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:57.635384 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b9632b2-3955-4d73-8319-09ea84a9ead0 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.352817 Oct 31 14:02:57.643035 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 64/106] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:02:57 2022] POST /compute/v2.1/flavors => generated 430 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:57.672660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc2a4f5c-fb38-453f-9dd4-c448d58045d4 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:57.751525 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc2a4f5c-fb38-453f-9dd4-c448d58045d4 tempest-FlavorsExtraSpecsTestJSON-1567930887 tempest-FlavorsExtraSpecsTestJSON-1567930887-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106695 Oct 31 14:02:57.754555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 65/107] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:57.763987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d81be70-9aac-4279-a2f1-7014485d95a5 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2c6bde308917426fbe4b1cf100338b4a"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:58.074848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:58.094598 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a6f6966-8449-4535-8ddb-5febd49e13d5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.641403 Oct 31 14:02:58.097311 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 43/108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:57 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:58.302601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:58.305971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:58.325507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:58.327057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:58.331004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:58.338823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:58.344451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:58.345141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:58.837981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d81be70-9aac-4279-a2f1-7014485d95a5 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1857861866/action" status: 200 len: 97 microversion: 2.1 time: 1.080134 Oct 31 14:02:58.842892 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 66/109] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 31 14:02:57 2022] POST /compute/v2.1/flavors/1857861866/action => generated 97 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:02:59.023192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:59.032272 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48444cd7-5154-4658-af80-cb7ae3e886a3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1228 microversion: 2.1 time: 0.749722 Oct 31 14:02:59.037161 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 44/110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:58 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1228 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:59.117051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:59.119432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:02:59.126039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:59.142249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:59.164113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:59.165520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:59.166721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:59.167904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:59.168484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:59.382437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43376a89-2e83-4cf2-a25f-ff8782c93f75 tempest-FlavorsAccessTestJSON-1108672162 tempest-FlavorsAccessTestJSON-1108672162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:02:59.467509 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43376a89-2e83-4cf2-a25f-ff8782c93f75 tempest-FlavorsAccessTestJSON-1108672162 tempest-FlavorsAccessTestJSON-1108672162-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.619102 Oct 31 14:02:59.470463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 67/111] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:02:58 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:02:59.578305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5", "tag": "858225cc-0a73-4b52-addb-2078c397b639"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:59.618020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:59.619011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:59.619761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:59.679286 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Creating event network-changed:858225cc-0a73-4b52-addb-2078c397b639 for instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 on n-h2-863052-1 Oct 31 14:02:59.680708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:02:59.681531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0f233b5-c4bc-4686-8c6a-2b5093361fdc req-2a05ccd3-daa6-4f50-8cdf-6616a49240b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:02:59.692904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:59.693824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:59.694668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:59.696471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:02:59.697348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:02:59.697973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:02:59.715437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.rpcapi [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 14:02:59.717113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:02:59.806726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:02:59.815962 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4acbc911-3ea8-41ff-bf07-9a01597857e8 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338348 Oct 31 14:02:59.824839 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 68/112] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:02:59.844499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48d41f35-d8fe-4426-a250-3366d3e1b357 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2c6bde308917426fbe4b1cf100338b4a"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:02:59.976201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:02:59.986286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ab94751-f2b1-4fd9-a80b-c0c2563d9e4a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.873019 Oct 31 14:02:59.990891 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 45/113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:02:59 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:00.064587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.065237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:00.086753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:00.093608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:00.094128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:00.095007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:00.095514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:00.096012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:00.122871 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48d41f35-d8fe-4426-a250-3366d3e1b357 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1857861866/action" status: 200 len: 21 microversion: 2.1 time: 0.294945 Oct 31 14:03:00.127428 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 69/114] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 31 14:02:59 2022] POST /compute/v2.1/flavors/1857861866/action => generated 21 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:03:00.165384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84a275f9-c821-4fd0-9f43-8da7583bea30 tempest-FlavorsAccessTestJSON-1108672162 tempest-FlavorsAccessTestJSON-1108672162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.277612 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84a275f9-c821-4fd0-9f43-8da7583bea30 tempest-FlavorsAccessTestJSON-1108672162 tempest-FlavorsAccessTestJSON-1108672162-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.137060 Oct 31 14:03:00.294209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 70/115] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:00.328558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44584c7a-eedf-4af3-a19c-a274a7ea0fff tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.380989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44584c7a-eedf-4af3-a19c-a274a7ea0fff tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1857861866" status: 202 len: 0 microversion: 2.1 time: 0.075911 Oct 31 14:03:00.382275 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 71/116] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:03:00 2022] DELETE /compute/v2.1/flavors/1857861866 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:03:00.398422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-070d617a-6a54-4294-b305-94be2ec7ca61 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.454793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-070d617a-6a54-4294-b305-94be2ec7ca61 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067085 Oct 31 14:03:00.465695 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 72/117] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:00.492906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1806f5e3-ae70-4040-aafc-483d0ac9785b tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-802119750", "id": 743426169, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:00.562963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1806f5e3-ae70-4040-aafc-483d0ac9785b tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.070733 Oct 31 14:03:00.565032 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 73/118] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:00 2022] POST /compute/v2.1/flavors => generated 427 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:00.578632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e598c939-a9b1-4d88-97fa-648a194761c1 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.633076 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e598c939-a9b1-4d88-97fa-648a194761c1 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/743426169/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.058561 Oct 31 14:03:00.635198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 74/119] 10.222.0.27 () {58 vars in 1206 bytes} [Mon Oct 31 14:03:00 2022] GET /compute/v2.1/flavors/743426169/os-flavor-access => generated 21 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:03:00.647949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d98c8bc6-9de7-4bdb-85cf-28630c4b0d1c tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.697661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:RELEASE=4,nova_api:SELECT=81,nova_api:SAVEPOINT=3,nova_api:UPDATE=1,nova_api:DELETE=8,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:00.709735 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d98c8bc6-9de7-4bdb-85cf-28630c4b0d1c tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/743426169" status: 202 len: 0 microversion: 2.1 time: 0.066153 Oct 31 14:03:00.714732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:00.724008 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47891a41-c06e-4a65-a786-a9f321b77c19 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1282 microversion: 2.1 time: 0.663706 Oct 31 14:03:00.726705 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 75/120] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:03:00 2022] DELETE /compute/v2.1/flavors/743426169 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:03:00.733406 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 46/121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:00 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1282 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:00.741843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5216c2e9-47e8-40a4-940f-697caef7d370 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:00.851447 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5216c2e9-47e8-40a4-940f-697caef7d370 tempest-FlavorsAccessTestJSON-1923660512 tempest-FlavorsAccessTestJSON-1923660512-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.119793 Oct 31 14:03:00.860009 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 76/122] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:01.024034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:01.024690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:01.043680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:01.045963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:01.046628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:01.059339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:01.060612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:01.061471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:01.704527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:01.712627 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-23862a18-73f4-4452-bead-1644231671a5 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.696887 Oct 31 14:03:01.716202 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 47/123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:01 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:01.761545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:01.762497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:01.781872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:01.783839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:01.786476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:01.788467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:01.790974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:01.791967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:02.009336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:02.018557 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d2a8ab7-1f85-4e61-a84f-da811c8a51fc tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1282 microversion: 2.1 time: 0.264955 Oct 31 14:03:02.033917 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 77/124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:01 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:02.743575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:02.746221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:02.762747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:02.763588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:02.764925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:02.767873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:02.769734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:02.770889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:03.045855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:03.046616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:03.061043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:03.062801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:03.065370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:03.067896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:03.070092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:03.070817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:03.229024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:03.243653 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-528fcc6b-d925-4e0b-91b6-dc3e939491d3 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1282 microversion: 2.1 time: 0.200879 Oct 31 14:03:03.247109 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 78/125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:03 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:03.502351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:03.517565 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-14e9c6c3-9a95-49e9-90e3-52fd1f139132 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.778551 Oct 31 14:03:03.533306 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 48/126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:02 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:04.271270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:04.271896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:04.307210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:04.308105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:04.309025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:04.310549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:04.311206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:04.311808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:04.541393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:04.542697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:04.552634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:04.561646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:04.562367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:04.564568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:04.569941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:04.572374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:04.988838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:05.013296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a31d19db-17eb-41cf-ac86-68585e26129a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.746412 Oct 31 14:03:05.046599 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 79/127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:04 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:05.596329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:05.614849 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0dc9fa72-be55-44b5-b200-5fb11b372f98 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 1.067755 Oct 31 14:03:05.615516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 49/128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:04 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:06.037947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:06.038740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:06.065296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:06.066130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:06.071327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:06.077263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:06.078185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:06.079868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:06.644003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:06.644618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:06.652324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:06.655199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:06.658951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:06.659697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:06.660744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:06.666818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:06.667502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:06.740154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=83 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:06.966149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:06.982496 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24820b63-fa06-47cc-8759-97175b82c37a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.948184 Oct 31 14:03:06.984637 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 80/129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:06 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:07.248460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:07.261445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:07.266473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e14cd7f-6f73-49cc-adc6-0132a20b79e6 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.625250 Oct 31 14:03:07.271194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 50/130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:06 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:07.724381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-28e06ca2-d367-45d8-a379-5afd0eca0ba8 req-f1363336-ceab-4d6f-8c0e-8d13f423f4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:07.766209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-28e06ca2-d367-45d8-a379-5afd0eca0ba8 req-f1363336-ceab-4d6f-8c0e-8d13f423f4bd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:07.768313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-28e06ca2-d367-45d8-a379-5afd0eca0ba8 req-f1363336-ceab-4d6f-8c0e-8d13f423f4bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:07.768745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-28e06ca2-d367-45d8-a379-5afd0eca0ba8 req-f1363336-ceab-4d6f-8c0e-8d13f423f4bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:07.800295 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-28e06ca2-d367-45d8-a379-5afd0eca0ba8 req-f1363336-ceab-4d6f-8c0e-8d13f423f4bd service nova] Creating event network-changed:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:03:07.813651 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-28e06ca2-d367-45d8-a379-5afd0eca0ba8 req-f1363336-ceab-4d6f-8c0e-8d13f423f4bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095754 Oct 31 14:03:07.814881 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 81/131] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:08.012104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:08.012719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:08.033470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:08.037386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:08.038067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:08.038909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:08.039413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:08.039840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:08.301381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:08.302344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:08.327811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:08.329749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:08.332781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:08.344623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:08.346886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:08.352784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:08.675898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:08.690205 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-faec0791-5d10-494d-afa3-b407e1d59423 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.682416 Oct 31 14:03:08.694772 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 51/132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:08 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:09.212168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:09.221628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-525d5e11-5c20-43b1-9997-c7a1de7797cd tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.931200 Oct 31 14:03:09.237855 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 82/133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:08 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:09.725368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:09.725999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:09.743831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:09.750301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:09.751588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:09.752231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:09.755726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:09.757917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:09.759514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.242922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:10.252227 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ade33b63-259d-4552-8fb5-88b64228bb93 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.531119 Oct 31 14:03:10.282048 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 83/134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:09 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:10.296056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.297765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:10.319413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.320514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.322032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.322961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.327971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.331034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.421466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c6c91f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.424074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.424743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.425329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.475520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.478776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.480507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.548964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.551015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.553390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.611820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c1db67b-ee93-4af2-8e08-9ef140ce0ef2 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.204006 Oct 31 14:03:10.632431 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 52/135] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:10.647112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c7174c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.661648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.663680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.667270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.720236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.722453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.722978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.748111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.753170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.753853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.775009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6625b6e4-55f9-43bc-a5f5-a2041f493359 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.132524 Oct 31 14:03:10.775661 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 53/136] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:03:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:10.796033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c5fd5e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.799125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.800054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.800783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.831312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.832052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.832629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.853828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.856443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.857062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.865238 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05afaa6b-c0bf-4b83-bc6e-59b7df727faf tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.076022 Oct 31 14:03:10.866962 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 54/137] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:10.881337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c6c9430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.882896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.884134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.884940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.907841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.908613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.909226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.917994 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82a4a5e3-c343-42d0-a664-1c7a3a87233b tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044138 Oct 31 14:03:10.930363 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 55/138] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:10.935738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-85494b9f-8ca1-4def-bf5f-b3f8600068b4 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c5fd670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.937925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85494b9f-8ca1-4def-bf5f-b3f8600068b4 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:10.938660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85494b9f-8ca1-4def-bf5f-b3f8600068b4 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:10.939647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85494b9f-8ca1-4def-bf5f-b3f8600068b4 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:10.975821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-85494b9f-8ca1-4def-bf5f-b3f8600068b4 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.043674 Oct 31 14:03:10.984076 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 56/139] 10.222.0.27 () {58 vars in 1179 bytes} [Mon Oct 31 14:03:10 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:10.990135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c5fddc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:10.997550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.000344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.001133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.021988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.022713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.023301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.035066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.036097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.036753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.043953 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3680514e-3546-4a07-bd5d-6e687c8174c0 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057785 Oct 31 14:03:11.050737 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 57/140] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:11.055898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c6a6ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:11.058582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.059340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.059998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.074384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.075204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.075886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.083355 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f1b93cf9-2132-42f3-a698-3be8b3f69ca3 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.031149 Oct 31 14:03:11.091251 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 58/141] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:11.101986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c717280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:11.105193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.105974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.106750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.128164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.129014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.130160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.143338 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b4b743a-3b3e-4d30-9356-a3ea67570e0d tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.047344 Oct 31 14:03:11.144928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 59/142] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:11 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:11.179298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:11.180278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Calling method '.version_select at 0x7fe10c6a6ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:11.186849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.193315 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c1e19cf-7f28-4160-be26-cb6ef30c768d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.909655 Oct 31 14:03:11.194006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.204910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.209478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 84/143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:10 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:11.241798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.242654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.243842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.261745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.262152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.263302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.270385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:03:11.271141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51a826b1-70ac-4fff-bf12-2f9c60327e66 tempest-HypervisorAdminTestJSON-785672987 tempest-HypervisorAdminTestJSON-785672987-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:03:11.272228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.272858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.274552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.274552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.281260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:11.282429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:11.286362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.288852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.294713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.295632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.298442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.299734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:11.302658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:11.303742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:11.320295 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.compute.rpcapi [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 14:03:11.324571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] Releasing lock "compute-rpcapi-router" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:03:11.737444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:11.752851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86ac12e4-0ad0-40cd-8078-9b5b1e36c005 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.476456 Oct 31 14:03:11.758447 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 85/144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:11 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:11.773880 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-60f5d330-bc8d-4ae4-a4fb-1b22767a4300 None None] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.615596 Oct 31 14:03:11.775653 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 60/145] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 31 14:03:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:12.003134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6af82794-dbad-4676-9547-0639e5a266de tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1953503074", "id": 815165101, "os-flavor-access:is_public": "True"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:12.048849 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6af82794-dbad-4676-9547-0639e5a266de tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.293971 Oct 31 14:03:12.051180 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 86/146] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:03:11 2022] POST /compute/v2.1/flavors => generated 468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:12.087665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1dd5764d-903f-4d08-bff1-a4e38e825442 tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:12.440116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-480d5485-9a4a-4da7-a228-b75aeb86c6ec tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] Action: 'create', calling method: .version_select at 0x7fe10c5c4d30>, body: {"security_group": {"name": "tempest-securitygroup-590370178", "description": "tempest-description-2078249633"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:12.607588 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1dd5764d-903f-4d08-bff1-a4e38e825442 tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/815165101/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.544271 Oct 31 14:03:12.610201 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 87/147] 10.222.0.27 () {62 vars in 1262 bytes} [Mon Oct 31 14:03:12 2022] POST /compute/v2.1/flavors/815165101/os-extra_specs => generated 62 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:12.619491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:12.620964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:12.639478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:12.640121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:12.641997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:12.642860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:12.646933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:12.647521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:12.935036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:12.943977 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74cefe62-7479-4952-bdb3-96cc41e5f84d tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.331026 Oct 31 14:03:12.962052 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 88/148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:12 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:12.967141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-852675a0-7c40-4930-b1b3-fa365f9c9182 tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:12.990445 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-852675a0-7c40-4930-b1b3-fa365f9c9182 tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/815165101" status: 202 len: 0 microversion: 2.86 time: 0.027008 Oct 31 14:03:12.995346 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 89/149] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 31 14:03:12 2022] DELETE /compute/v2.1/flavors/815165101 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:03:13.000444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:13.001476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:13.013988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:13.016591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:13.017269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:13.019171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:13.022831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:13.024851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:13.256498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:13.267550 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44751442-c629-4997-99d3-b3cb53d52e4d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.275072 Oct 31 14:03:13.289126 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 90/150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:12 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:13.295157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b32528b-63c0-4df7-b5fa-94977a00418a tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:13.323760 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b32528b-63c0-4df7-b5fa-94977a00418a tempest-FlavorMetadataValidation-487167535 tempest-FlavorMetadataValidation-487167535-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.032424 Oct 31 14:03:13.324691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 91/151] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:03:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:03:13.961159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-480d5485-9a4a-4da7-a228-b75aeb86c6ec tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.183370 Oct 31 14:03:13.965402 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 61/152] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:03:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:13.969876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:13.970713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:13.978804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-caf02395-6c1d-4c94-9f79-e8564b420ca7 tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] Action: 'create', calling method: .version_select at 0x7fe10c5ca280>, body: {"security_group": {"name": "tempest-securitygroup-1241785357", "description": "tempest-description-1732445377"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:13.989416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:13.990784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:13.991414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:13.992283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:13.992887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:13.993471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:14.273675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:14.285306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7bc46ad-4170-423d-acc2-010a4716ce20 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.316421 Oct 31 14:03:14.286252 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 92/153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:13 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:14.306000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:14.316016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:14.330278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:14.331225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:14.332089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:14.333949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:14.334990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:14.335930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:14.492290 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-caf02395-6c1d-4c94-9f79-e8564b420ca7 tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.518606 Oct 31 14:03:14.492888 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 62/154] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:03:13 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:14.643400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:14.653900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f390eea-3ba4-4728-a5b6-c1100f23ad03 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.358396 Oct 31 14:03:14.654642 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 93/155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:14 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:15.003220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65e53feb-1b17-4962-a9bd-37189019cf43 tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] Action: 'create', calling method: .version_select at 0x7fe10c641f70>, body: {"security_group": {"name": "tempest-securitygroup-179736066", "description": "tempest-description-95964742"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:15.313581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:15.314259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:15.328150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:15.328964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:15.330156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:15.331061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:15.331754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:15.332280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:15.344110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:15.616504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:15.634773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-654776ea-96ee-45e6-a95b-79195256cbac tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.326546 Oct 31 14:03:15.648177 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 94/156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:15 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:15.691680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:15.693434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:15.713432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:15.714497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:15.717566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:15.718640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:15.725137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:15.727637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:15.759367 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65e53feb-1b17-4962-a9bd-37189019cf43 tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.256343 Oct 31 14:03:15.760312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 63/157] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:03:14 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:15.775621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00410762-6ab3-4bf2-8288-c90819e0ccac tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] Action: 'create', calling method: .version_select at 0x7fe10c641ee0>, body: {"security_group": {"name": "tempest-securitygroup-841790123", "description": "tempest-description-1212488274"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:16.063437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:16.073539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72823073-e732-4db6-8ad9-76632732c0a8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.396538 Oct 31 14:03:16.078210 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 95/158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:15 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:16.200289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-27bba1f0-c3e7-4448-b2c0-5273ce5b0c3c req-5c7db068-f56d-4b4e-94ad-bf5ac389d33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5", "name": "network-vif-plugged", "status": "completed", "tag": "858225cc-0a73-4b52-addb-2078c397b639"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:16.223796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-27bba1f0-c3e7-4448-b2c0-5273ce5b0c3c req-5c7db068-f56d-4b4e-94ad-bf5ac389d33f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:16.227293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-27bba1f0-c3e7-4448-b2c0-5273ce5b0c3c req-5c7db068-f56d-4b4e-94ad-bf5ac389d33f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:16.232171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-27bba1f0-c3e7-4448-b2c0-5273ce5b0c3c req-5c7db068-f56d-4b4e-94ad-bf5ac389d33f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:16.261367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-27bba1f0-c3e7-4448-b2c0-5273ce5b0c3c req-5c7db068-f56d-4b4e-94ad-bf5ac389d33f service nova] Creating event network-vif-plugged:858225cc-0a73-4b52-addb-2078c397b639 for instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 on n-h2-863052-1 Oct 31 14:03:16.274123 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-27bba1f0-c3e7-4448-b2c0-5273ce5b0c3c req-5c7db068-f56d-4b4e-94ad-bf5ac389d33f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193897 Oct 31 14:03:16.278701 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 96/159] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:16.311973 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00410762-6ab3-4bf2-8288-c90819e0ccac tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.542744 Oct 31 14:03:16.327773 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 64/160] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:03:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:16.330241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31dcfb85-0c9e-46e8-ac52-a68f8354a110 tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] Calling method '.version_select at 0x7fe10c6f99d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:16.912027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0fc9943b-a4c0-4c69-a69e-ffe88a18a099 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:16.924955 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0fc9943b-a4c0-4c69-a69e-ffe88a18a099 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.459686 Oct 31 14:03:16.935640 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 65/161] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:16.943575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:16.944334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:16.952599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:16.953299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:16.953751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:16.955026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:16.955504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:16.955937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:17.163748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:17.173472 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3dc51b0-61fb-436c-be76-de95de547054 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.244467 Oct 31 14:03:17.187740 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 66/162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:16 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:17.572759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-513f7209-64b0-426b-bbe6-f25e91cf7743 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2109597245", "id": 222071100, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:17.607492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-513f7209-64b0-426b-bbe6-f25e91cf7743 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.418398 Oct 31 14:03:17.608567 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 67/163] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:17 2022] POST /compute/v2.1/flavors => generated 422 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:17.632244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:17.633275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:17.647171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:17.648006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:17.648442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:17.650247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:17.653883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:17.654400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:17.723915 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31dcfb85-0c9e-46e8-ac52-a68f8354a110 tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6316 microversion: 2.1 time: 1.400007 Oct 31 14:03:17.725530 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 97/164] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 31 14:03:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6316 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:17.737422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-503edde0-a465-48e8-bfd5-c32084cada4f tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:17.756950 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-503edde0-a465-48e8-bfd5-c32084cada4f tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028121 Oct 31 14:03:17.757536 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 98/165] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 31 14:03:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:03:17.766768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d992d960-993e-44c5-9bba-2a8e51c8071a tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] Calling method '.version_select at 0x7fe10c69e160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:17.967329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:17.977349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-03da3694-af75-4d6c-915b-ea25b954018c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.367486 Oct 31 14:03:17.996206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 68/166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:17 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:18.002692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-90eac3a4-0f5d-457d-ab47-6eadf291e860 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1169111121", "id": 1554417832, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:18.026934 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d992d960-993e-44c5-9bba-2a8e51c8071a tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.267970 Oct 31 14:03:18.027781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 99/167] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 31 14:03:17 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:18.039828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-90eac3a4-0f5d-457d-ab47-6eadf291e860 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.042397 Oct 31 14:03:18.042291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef6b0b5d-4482-474b-a6a5-02d42adc53ea tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] Calling method '.version_select at 0x7fe10c68bc10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:18.054739 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 69/168] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:17 2022] POST /compute/v2.1/flavors => generated 425 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:18.068715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25f2afd0-d77d-4f95-b079-a5012453d437 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:18.089387 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25f2afd0-d77d-4f95-b079-a5012453d437 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032129 Oct 31 14:03:18.089811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 70/169] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 31 14:03:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:03:18.108052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-11b6f1b4-49cd-4b11-9350-df370996287f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Action: 'create', calling method: .version_select at 0x7fe10c5c4c10>, body: {"keypair": {"name": "tempest-keypair-959568785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4p9IsChp/ibhKBLcEXvSuICpghG3JuNfJAdWURGIlH+90kcIwNhY5CoAd10BgE+9+e7YQXtGIoz2iMztDZVDKrki6OUWmSO9nqoTRX7qyUPNx3QsMspjBonPLH1npFZg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:18.152543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-11b6f1b4-49cd-4b11-9350-df370996287f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Getting quotas for project cfde485f2bc54a4ba158a7297910a66a. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:18.160327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-11b6f1b4-49cd-4b11-9350-df370996287f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Getting quotas for user 998bd703ae1e47adb054f66e15a943cc and project cfde485f2bc54a4ba158a7297910a66a. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:18.198529 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-11b6f1b4-49cd-4b11-9350-df370996287f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097921 Oct 31 14:03:18.199734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 71/170] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:03:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:18.217081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:18.218012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:18.240789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:18.241546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:18.241977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:18.242875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:18.243496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:18.244510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:18.300240 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef6b0b5d-4482-474b-a6a5-02d42adc53ea tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dcf16c12-19d1-4ae6-9737-88bc22fdd4a7" status: 202 len: 0 microversion: 2.1 time: 0.261812 Oct 31 14:03:18.301366 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 100/171] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:03:18 2022] DELETE /compute/v2.1/os-security-groups/dcf16c12-19d1-4ae6-9737-88bc22fdd4a7 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:03:18.309896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e07a3267-71b6-4c0d-baeb-dcb7d188dc69 tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] Calling method '.version_select at 0x7fe10c68b280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:18.636366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:18.655376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ca918a3-057d-49e2-973e-6c37609d0d32 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1339 microversion: 2.1 time: 0.449935 Oct 31 14:03:18.666652 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 72/172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:18 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1339 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:18.855766 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e07a3267-71b6-4c0d-baeb-dcb7d188dc69 tempest-SecurityGroupsTestAdminJSON-419951947 tempest-SecurityGroupsTestAdminJSON-419951947-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/74ec60ca-c864-46c2-8a42-aae6b83e9928" status: 202 len: 0 microversion: 2.1 time: 0.550187 Oct 31 14:03:18.856662 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 101/173] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:03:18 2022] DELETE /compute/v2.1/os-security-groups/74ec60ca-c864-46c2-8a42-aae6b83e9928 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:03:18.864755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0fe08b8e-23e7-4494-a0c4-e78b28ebe750 tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] Calling method '.version_select at 0x7fe10c5ca1f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:19.145426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0fe08b8e-23e7-4494-a0c4-e78b28ebe750 tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a7459a88-a96a-48d8-96b7-36b2c5f9239b" status: 202 len: 0 microversion: 2.1 time: 0.284732 Oct 31 14:03:19.146146 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 73/174] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:03:18 2022] DELETE /compute/v2.1/os-security-groups/a7459a88-a96a-48d8-96b7-36b2c5f9239b => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:03:19.152794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:19.153573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:19.178575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.179335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.179880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:19.180708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.181331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.182952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:19.383730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65311f56-2064-4dce-ad90-5f559eff5d8b tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-73271066", "ram": 512, "vcpus": 1, "disk": 10, "id": 31482610, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:19.426588 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65311f56-2064-4dce-ad90-5f559eff5d8b tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.481185 Oct 31 14:03:19.427192 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 102/175] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:19.438094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-238e7b66-d1da-482b-9445-95972d356f7a tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] Calling method '.version_select at 0x7fe10c6f93a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:19.485876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:19.497728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-136c8e75-2c90-478a-9453-90c75778f8e9 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.350207 Oct 31 14:03:19.498520 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 74/176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:19 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:19.574909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Calling method '.version_select at 0x7fe10c671b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:19.576987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.577706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.578422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:19.597828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.598663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.599340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:19.610527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.611286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.611843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:19.618925 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-819a56b8-4959-4b9e-bd08-5658a6f59c52 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.118405 Oct 31 14:03:19.619851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 75/177] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:19.672113 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-238e7b66-d1da-482b-9445-95972d356f7a tempest-SecurityGroupsTestAdminJSON-150177027 tempest-SecurityGroupsTestAdminJSON-150177027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e644504d-2e70-46f3-890b-1225c300388a" status: 202 len: 0 microversion: 2.1 time: 0.241844 Oct 31 14:03:19.673367 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 103/178] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:03:19 2022] DELETE /compute/v2.1/os-security-groups/e644504d-2e70-46f3-890b-1225c300388a => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:03:19.818368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2d58c20-ec38-48a7-b30c-6db144459d27 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:19.842888 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d2d58c20-ec38-48a7-b30c-6db144459d27 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] HTTP exception thrown: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2d58c20-ec38-48a7-b30c-6db144459d27 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Request method failure captured: Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/flavors/31482610/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WlgQmvFvh-jC48GxbvsD1K4bmoQwjbAz6JXapHpxibxC4K6-iNw6zexVDMuYygKwHEzLwUhEhFA5BW-tSqax9i5TwITWnPKUXG3YCcnNRGZRie5L2vOEXXFuzelwCOG1eWoZPCail9i1fCb4c5ka2lqJbOysx4zD8zgiNNMWes87Q Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:03:19.845750 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1a043f500b348b2aae1160a2ebe918d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: a7e4b98d96b44dbb989ba1fe1a6dbf85 Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:19.846848 n-d-863052-1 devstack@n-api.service[120641]: exception: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'flavor_id': '31482610', 'id': 'hw:cpu_thread_policy'} Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:19.847431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:19.848494 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:19.851070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2d58c20-ec38-48a7-b30c-6db144459d27 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Returning 404 to user: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:19.851850 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2d58c20-ec38-48a7-b30c-6db144459d27 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] 10.222.0.27 "GET /compute/v2.1/flavors/31482610/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.230911 Oct 31 14:03:19.852856 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 76/179] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:03:19 2022] GET /compute/v2.1/flavors/31482610/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:19.873324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:19.873982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:19.884879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.890994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.893146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:19.894839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:19.897643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:19.899420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.016321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d01eae7e-5764-493a-af38-708fe74fa679 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Calling method '.version_select at 0x7fe10c6eadc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.022114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d01eae7e-5764-493a-af38-708fe74fa679 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'db958d9052294af9ab1696a2972458e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4d9e282dff4f0b94b4206763f39584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d01eae7e-5764-493a-af38-708fe74fa679 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Request method failure captured: Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/n-h2-863052-1/search HTTP/1.1 Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WlgxeQ9Uz8ID7QL1bhDrlHYVG0xICUKfsdcY1nRN0sXpYw9hvufyxHL_g7AcaknlUSGPy7_ny3owuFjmDB84zCOrBsadcR6Iyr5tCaQJQpBeDJlzMfUfbgXZeqXUuZDeTafzCLzVfW3IuaTZskRnAF988qUWSe_LTUiUr7YCv8bJY Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8e4d9e282dff4f0b94b4206763f39584 Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-424249104 Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:20.032849 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e4d9e282dff4f0b94b4206763f39584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e4d9e282dff4f0b94b4206763f39584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e4d9e282dff4f0b94b4206763f39584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e4d9e282dff4f0b94b4206763f39584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-424249104 Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8e4d9e282dff4f0b94b4206763f39584 Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-424249104 Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-424249104-project Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: db958d9052294af9ab1696a2972458e0 Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-424249104-project Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 14:03:20.034049 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-h2-863052-1'} Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:20.034791 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 14:03:20.035715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.038897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d01eae7e-5764-493a-af38-708fe74fa679 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.044040 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d01eae7e-5764-493a-af38-708fe74fa679 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-863052-1/search" status: 403 len: 117 microversion: 2.1 time: 0.369440 Oct 31 14:03:20.046728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 104/180] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 31 14:03:19 2022] GET /compute/v2.1/os-hypervisors/n-h2-863052-1/search => generated 117 bytes in 372 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.054901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-831c79f4-d35d-4785-bd5b-a2acc06052a8 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.068406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-831c79f4-d35d-4785-bd5b-a2acc06052a8 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a7e4b98d96b44dbb989ba1fe1a6dbf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a043f500b348b2aae1160a2ebe918d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-831c79f4-d35d-4785-bd5b-a2acc06052a8 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Request method failure captured: Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/flavors/31482610/os-extra_specs HTTP/1.1 Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 66 Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WlgQmvFvh-jC48GxbvsD1K4bmoQwjbAz6JXapHpxibxC4K6-iNw6zexVDMuYygKwHEzLwUhEhFA5BW-tSqax9i5TwITWnPKUXG3YCcnNRGZRie5L2vOEXXFuzelwCOG1eWoZPCail9i1fCb4c5ka2lqJbOysx4zD8zgiNNMWes87Q Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:20.073868 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1a043f500b348b2aae1160a2ebe918d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a7e4b98d96b44dbb989ba1fe1a6dbf85 Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 31 14:03:20.075115 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '31482610', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:20.075708 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 14:03:20.076660 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.079463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-831c79f4-d35d-4785-bd5b-a2acc06052a8 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.080524 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-831c79f4-d35d-4785-bd5b-a2acc06052a8 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] 10.222.0.27 "POST /compute/v2.1/flavors/31482610/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.032619 Oct 31 14:03:20.081830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 105/181] 10.222.0.27 () {60 vars in 1218 bytes} [Mon Oct 31 14:03:20 2022] POST /compute/v2.1/flavors/31482610/os-extra_specs => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.087138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Calling method '.version_select at 0x7fe10c591b80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.096054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=120640) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 31 14:03:20.097153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.098598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.099251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.115728 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Request method failure captured: Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WnjDoQI7Izt9Rbn0NEMjbNFLT0T74L2UMS7or8UFTSMzTnUafM1OVmGlGCK5tTAR313_ZGB5bwDubLNiiTJd59D4yCUn6JhhX5GrqRYoKWTAIuq7GhpeAk9fxvyTJNPcUJ4oB5s_0FQaRqwa1Y6sauy_ggcGHpclBKGh9Rn69pDYU Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 048f23018f6946d58967bca445b6bb24 Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-885424879 Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:20.117399 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_048f23018f6946d58967bca445b6bb24", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/048f23018f6946d58967bca445b6bb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/048f23018f6946d58967bca445b6bb24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/048f23018f6946d58967bca445b6bb24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-885424879 Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 048f23018f6946d58967bca445b6bb24 Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-885424879 Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1603b42be202492984b009f23750e4f0 Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 14:03:20.118801 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.119522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.120965 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.120965 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:20.120965 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:20.120965 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 14:03:20.120965 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.122908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.124130 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e12fb5b8-9ffe-403f-9e90-c52360d45c70 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.041133 Oct 31 14:03:20.125763 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 106/182] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.130815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ea87844-b584-481b-8f56-244a52826ff6 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.169015 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ea87844-b584-481b-8f56-244a52826ff6 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/31482610/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041889 Oct 31 14:03:20.170370 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 107/183] 10.222.0.27 () {60 vars in 1218 bytes} [Mon Oct 31 14:03:20 2022] POST /compute/v2.1/flavors/31482610/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:03:20.177648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b6ae12a6-8119-4572-8bdd-16499a74e2df req-b90ea281-aa97-4c09-b9a4-dae1d8d8ea48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "name": "network-vif-plugged", "status": "completed", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.194691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b6ae12a6-8119-4572-8bdd-16499a74e2df req-b90ea281-aa97-4c09-b9a4-dae1d8d8ea48 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.195930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b6ae12a6-8119-4572-8bdd-16499a74e2df req-b90ea281-aa97-4c09-b9a4-dae1d8d8ea48 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.196716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b6ae12a6-8119-4572-8bdd-16499a74e2df req-b90ea281-aa97-4c09-b9a4-dae1d8d8ea48 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.216821 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b6ae12a6-8119-4572-8bdd-16499a74e2df req-b90ea281-aa97-4c09-b9a4-dae1d8d8ea48 service nova] Creating event network-vif-plugged:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:03:20.224499 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b6ae12a6-8119-4572-8bdd-16499a74e2df req-b90ea281-aa97-4c09-b9a4-dae1d8d8ea48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052613 Oct 31 14:03:20.228066 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 108/184] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:20.236568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Calling method '.version_select at 0x7fe10c591670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.239233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.240121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.241009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.295005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.296586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.297202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.311706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.312368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.312951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.319851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d01675ff-4687-4870-b7ae-e3b796cd0c19 tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089448 Oct 31 14:03:20.327311 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 109/185] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:20.332754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fccc9d0-5555-48c4-b616-1e4edffb2184 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.335116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9fccc9d0-5555-48c4-b616-1e4edffb2184 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a7e4b98d96b44dbb989ba1fe1a6dbf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a043f500b348b2aae1160a2ebe918d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fccc9d0-5555-48c4-b616-1e4edffb2184 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Request method failure captured: Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WlgQmvFvh-jC48GxbvsD1K4bmoQwjbAz6JXapHpxibxC4K6-iNw6zexVDMuYygKwHEzLwUhEhFA5BW-tSqax9i5TwITWnPKUXG3YCcnNRGZRie5L2vOEXXFuzelwCOG1eWoZPCail9i1fCb4c5ka2lqJbOysx4zD8zgiNNMWes87Q Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:20.336813 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1a043f500b348b2aae1160a2ebe918d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a7e4b98d96b44dbb989ba1fe1a6dbf85 Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:20.337968 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '31482610', 'id': 'hw:numa_nodes'} Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:20.339013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.339985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fccc9d0-5555-48c4-b616-1e4edffb2184 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.341847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9fccc9d0-5555-48c4-b616-1e4edffb2184 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009999 Oct 31 14:03:20.341847 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 110/186] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:03:20 2022] DELETE /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.344827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-115867ea-a8fb-4b64-96a8-7c47b83cdde9 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Calling method '.version_select at 0x7fe10c538ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.346787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-115867ea-a8fb-4b64-96a8-7c47b83cdde9 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'db958d9052294af9ab1696a2972458e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4d9e282dff4f0b94b4206763f39584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-115867ea-a8fb-4b64-96a8-7c47b83cdde9 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Request method failure captured: Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WlgxeQ9Uz8ID7QL1bhDrlHYVG0xICUKfsdcY1nRN0sXpYw9hvufyxHL_g7AcaknlUSGPy7_ny3owuFjmDB84zCOrBsadcR6Iyr5tCaQJQpBeDJlzMfUfbgXZeqXUuZDeTafzCLzVfW3IuaTZskRnAF988qUWSe_LTUiUr7YCv8bJY Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8e4d9e282dff4f0b94b4206763f39584 Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-424249104 Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:20.348344 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e4d9e282dff4f0b94b4206763f39584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e4d9e282dff4f0b94b4206763f39584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e4d9e282dff4f0b94b4206763f39584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e4d9e282dff4f0b94b4206763f39584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-424249104 Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8e4d9e282dff4f0b94b4206763f39584 Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-424249104 Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-424249104-project Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: db958d9052294af9ab1696a2972458e0 Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-424249104-project Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 14:03:20.349387 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '1'} Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:20.350715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 14:03:20.351664 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.352820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-115867ea-a8fb-4b64-96a8-7c47b83cdde9 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.352820 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-115867ea-a8fb-4b64-96a8-7c47b83cdde9 tempest-HypervisorAdminNegativeUnderV252Test-424249104 tempest-HypervisorAdminNegativeUnderV252Test-424249104-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009331 Oct 31 14:03:20.355593 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 111/187] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.362095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48a71e64-a1a8-4139-868a-f4a6b71071b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.389544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48a71e64-a1a8-4139-868a-f4a6b71071b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/31482610/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032557 Oct 31 14:03:20.390473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 112/188] 10.222.0.27 () {60 vars in 1218 bytes} [Mon Oct 31 14:03:20 2022] POST /compute/v2.1/flavors/31482610/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:03:20.394913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Calling method '.version_select at 0x7fe10c59f820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.396959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.397442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.397870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.405250 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] HTTP exception thrown: No hypervisor matching '561d8444-d07c-4d49-9c8b-c0163decebf2' could be found. Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Request method failure captured: Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/561d8444-d07c-4d49-9c8b-c0163decebf2/servers HTTP/1.1 Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WnjDoQI7Izt9Rbn0NEMjbNFLT0T74L2UMS7or8UFTSMzTnUafM1OVmGlGCK5tTAR313_ZGB5bwDubLNiiTJd59D4yCUn6JhhX5GrqRYoKWTAIuq7GhpeAk9fxvyTJNPcUJ4oB5s_0FQaRqwa1Y6sauy_ggcGHpclBKGh9Rn69pDYU Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 048f23018f6946d58967bca445b6bb24 Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-885424879 Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:20.406863 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_048f23018f6946d58967bca445b6bb24", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/048f23018f6946d58967bca445b6bb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/048f23018f6946d58967bca445b6bb24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/048f23018f6946d58967bca445b6bb24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-885424879 Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 048f23018f6946d58967bca445b6bb24 Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-885424879 Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1603b42be202492984b009f23750e4f0 Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: exception: No hypervisor matching '561d8444-d07c-4d49-9c8b-c0163decebf2' could be found. Oct 31 14:03:20.408052 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '561d8444-d07c-4d49-9c8b-c0163decebf2'} Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '561d8444-d07c-4d49-9c8b-c0163decebf2' could be found. Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.408753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.409687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.409687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.409687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:20.409687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:20.409687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '561d8444-d07c-4d49-9c8b-c0163decebf2' could be found. Oct 31 14:03:20.409687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.411287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] Returning 404 to user: No hypervisor matching '561d8444-d07c-4d49-9c8b-c0163decebf2' could be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.412369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37d3cbab-cd2d-4a80-ad3e-a7832632c53d tempest-HypervisorAdminNegativeUnderV252Test-885424879 tempest-HypervisorAdminNegativeUnderV252Test-885424879-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/561d8444-d07c-4d49-9c8b-c0163decebf2/servers" status: 404 len: 123 microversion: 2.1 time: 0.020900 Oct 31 14:03:20.417691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 113/189] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/os-hypervisors/561d8444-d07c-4d49-9c8b-c0163decebf2/servers => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.425078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07c41314-7465-4932-b19f-1d26748001e3 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.429655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07c41314-7465-4932-b19f-1d26748001e3 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a7e4b98d96b44dbb989ba1fe1a6dbf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a043f500b348b2aae1160a2ebe918d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07c41314-7465-4932-b19f-1d26748001e3 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Request method failure captured: Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 22 Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WlgQmvFvh-jC48GxbvsD1K4bmoQwjbAz6JXapHpxibxC4K6-iNw6zexVDMuYygKwHEzLwUhEhFA5BW-tSqax9i5TwITWnPKUXG3YCcnNRGZRie5L2vOEXXFuzelwCOG1eWoZPCail9i1fCb4c5ka2lqJbOysx4zD8zgiNNMWes87Q Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:20.433492 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1a043f500b348b2aae1160a2ebe918d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1a043f500b348b2aae1160a2ebe918d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: e1a043f500b348b2aae1160a2ebe918d Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a7e4b98d96b44dbb989ba1fe1a6dbf85 Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: {"hw:numa_nodes": "1"} Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:20.434633 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '31482610', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:20.435473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 14:03:20.436412 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.438471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07c41314-7465-4932-b19f-1d26748001e3 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.439327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07c41314-7465-4932-b19f-1d26748001e3 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275 tempest-FlavorsExtraSpecsNegativeTestJSON-544365275-project] 10.222.0.27 "PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020387 Oct 31 14:03:20.439893 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 114/190] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:03:20 2022] PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.451425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cae92618-5388-409a-b8b8-450fbc0d3b36 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.466069 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-cae92618-5388-409a-b8b8-450fbc0d3b36 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] HTTP exception thrown: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cae92618-5388-409a-b8b8-450fbc0d3b36 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Request method failure captured: Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/flavors/31482610/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Wmgd-yH7cvcixnwgHPGsMqqypjOjbUGDzapu_o3rKcItBXIy7MVHeCx8B-eSHgOSZGQqV5ENPlIvh_dASVF3wKj9nq_SXZ8scy5h8yh7WGuZS5qREFfrgakFBB_wHInjXua4aJnmKzh7vhDewf0IlRozOpb3Jivc6WbCoNKr7mErY Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 152d2196638c43b08045a0f8f01c027a Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:20.474025 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_152d2196638c43b08045a0f8f01c027a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 152d2196638c43b08045a0f8f01c027a Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea2a343a48584cd987860823d6a7ade7 Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:20.475285 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '31482610', 'id': 'hw:cpu_thread_policy'} Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.475924 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cae92618-5388-409a-b8b8-450fbc0d3b36 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Returning 404 to user: Flavor 31482610 has no extra specs with key hw:cpu_thread_policy. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cae92618-5388-409a-b8b8-450fbc0d3b36 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/31482610/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.027712 Oct 31 14:03:20.476999 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 115/191] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:03:20 2022] DELETE /compute/v2.1/flavors/31482610/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:20.485612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f525af0-4136-4738-b5a0-bcadf1063bbd tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.488741 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1f525af0-4136-4738-b5a0-bcadf1063bbd tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f525af0-4136-4738-b5a0-bcadf1063bbd tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Request method failure captured: Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 27 Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Wmgd-yH7cvcixnwgHPGsMqqypjOjbUGDzapu_o3rKcItBXIy7MVHeCx8B-eSHgOSZGQqV5ENPlIvh_dASVF3wKj9nq_SXZ8scy5h8yh7WGuZS5qREFfrgakFBB_wHInjXua4aJnmKzh7vhDewf0IlRozOpb3Jivc6WbCoNKr7mErY Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 152d2196638c43b08045a0f8f01c027a Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:20.490034 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_152d2196638c43b08045a0f8f01c027a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 152d2196638c43b08045a0f8f01c027a Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea2a343a48584cd987860823d6a7ade7 Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: {"hw:cpu_policy": "shared"} Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:20.491267 n-d-863052-1 devstack@n-api.service[120640]: exception: Request body and URI mismatch Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '31482610', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.491987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.493534 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:20.493534 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:20.493534 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 31 14:03:20.493534 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.499084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f525af0-4136-4738-b5a0-bcadf1063bbd tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.502231 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f525af0-4136-4738-b5a0-bcadf1063bbd tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.018520 Oct 31 14:03:20.503231 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 116/192] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:03:20 2022] PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 31 14:03:20.514182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4ce48c3-2f15-4e36-8c85-9039fcdf71c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4ce48c3-2f15-4e36-8c85-9039fcdf71c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Request method failure captured: Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 49 Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Wmgd-yH7cvcixnwgHPGsMqqypjOjbUGDzapu_o3rKcItBXIy7MVHeCx8B-eSHgOSZGQqV5ENPlIvh_dASVF3wKj9nq_SXZ8scy5h8yh7WGuZS5qREFfrgakFBB_wHInjXua4aJnmKzh7vhDewf0IlRozOpb3Jivc6WbCoNKr7mErY Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 152d2196638c43b08045a0f8f01c027a Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:20.532589 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_152d2196638c43b08045a0f8f01c027a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/152d2196638c43b08045a0f8f01c027a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 152d2196638c43b08045a0f8f01c027a Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea2a343a48584cd987860823d6a7ade7 Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 31 14:03:20.533726 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '31482610', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance: Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 31 14:03:20.534391 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.536125 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4ce48c3-2f15-4e36-8c85-9039fcdf71c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4ce48c3-2f15-4e36-8c85-9039fcdf71c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026363 Oct 31 14:03:20.537862 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 117/193] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:03:20 2022] PUT /compute/v2.1/flavors/31482610/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:03:20.547621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.548465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:20.550745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=4,nova_api:INSERT=6,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:20.564955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.565542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.566018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.567366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.568005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.568531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.697392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.712150 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-abbed9d8-a011-4544-b357-6104e6b4f216 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1488 microversion: 2.1 time: 0.858642 Oct 31 14:03:20.728666 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 77/194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:19 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1488 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:20.737588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67302332-eee2-42e9-b398-54969e00f825 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.769294 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67302332-eee2-42e9-b398-54969e00f825 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/31482610" status: 202 len: 0 microversion: 2.1 time: 0.037979 Oct 31 14:03:20.770269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 78/195] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:20 2022] DELETE /compute/v2.1/flavors/31482610 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:03:20.778839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.781353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:20.791223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.792753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.793485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.794505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:20.795149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:20.795730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:20.806617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:20.842858 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85b3424b-18cf-4609-9127-1d677b643aff tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.278542 Oct 31 14:03:20.845571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 118/196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:20.851622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65ef18cf-30a7-40f7-ac68-6d29fbf4f1b3 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:20.893028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65ef18cf-30a7-40f7-ac68-6d29fbf4f1b3 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557 tempest-FlavorsExtraSpecsNegativeTestJSON-2020526557-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.045755 Oct 31 14:03:20.894199 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 119/197] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:21.147170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1470894369", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "1554417832", "adminPass": "***", "networks": [{"uuid": "03c8004a-c6a7-4f53-a7ba-61bbec053161"}], "security_groups": [{"name": "tempest-securitygroup--164383711"}], "key_name": "tempest-keypair-959568785", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:21.235406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d84da83-6d92-4d99-9764-66b40260e8ff tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1639 microversion: 2.1 time: 0.463807 Oct 31 14:03:21.236874 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 79/198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:20 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1639 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:21.265242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:21.265756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:21.275244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:21.275841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:21.276479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:21.277655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:21.278295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:21.278726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:21.284114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:21.325174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:21.350325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:03:21.368118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] validate_networks() for [('03c8004a-c6a7-4f53-a7ba-61bbec053161', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:03:21.737877 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-468ab629-0321-4c75-be8a-eceb9fcbf022 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 204 len: 0 microversion: 2.1 time: 0.477849 Oct 31 14:03:21.738530 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 80/199] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:03:21 2022] DELETE /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:03:21.764652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:21.765524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:21.773252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:21.774364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:21.779019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:21.779971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:21.780725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:21.782120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:21.969777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:21.978888 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7fb62604-251f-4e36-8144-116f96ba14d3 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1494 microversion: 2.1 time: 0.234557 Oct 31 14:03:21.980416 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 81/200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:21 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1494 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:21.985795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:21.986743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:21.993064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:21.993727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:21.994451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:21.995761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:21.996643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:21.997249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:22.161230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:22.171612 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dfebf176-fa2b-4ef1-ba94-212ec70167b8 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1324 microversion: 2.1 time: 0.189786 Oct 31 14:03:22.181157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 82/201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:21 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1324 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:22.663658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:03:22.664850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:03:22.665572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:03:22.666349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:03:22.667241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:03:22.689838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:22.690689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:22.691690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:22.693348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:22.695248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:22.695940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:22.764910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Getting quotas for project cfde485f2bc54a4ba158a7297910a66a. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:22.774916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Getting quotas for user 998bd703ae1e47adb054f66e15a943cc and project cfde485f2bc54a4ba158a7297910a66a. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:22.787698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:03:22.790930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:03:22.848022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a7c821e-f702-4b41-8221-26a80e2795a3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.707006 Oct 31 14:03:22.855762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 120/202] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:03:22.860544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-358f63ae-1da8-4c9c-bfd2-2e050eed3272 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:22.861380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-358f63ae-1da8-4c9c-bfd2-2e050eed3272 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:22.866250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:22.945794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-358f63ae-1da8-4c9c-bfd2-2e050eed3272 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:22.958457 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-358f63ae-1da8-4c9c-bfd2-2e050eed3272 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1264 microversion: 2.1 time: 0.102206 Oct 31 14:03:22.959267 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 83/203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:22 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1264 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:23.004446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:23.005136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:23.012749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:23.013246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:23.013686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:23.014486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:23.014940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:23.015365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:23.197712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:23.198491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:23.210779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:23.211643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:23.212198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:23.220290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:23.220852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:23.221306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:23.245297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:23.255966 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6da77b41-75e0-4392-9999-4fe07f08d0af tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1494 microversion: 2.1 time: 0.256041 Oct 31 14:03:23.257000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 121/204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:22 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1494 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:23.736528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:23.746743 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0cc4452-0f12-4a3c-aee5-69df623bb484 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1521 microversion: 2.1 time: 0.553747 Oct 31 14:03:23.747947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 84/205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:23 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:23.773448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e87282e1-90f8-4c74-82b9-99c630d7ac9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'create', calling method: .version_select at 0x7fe10c4cc9d0>, body: {"pool": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:23.985878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:23.986494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:24.000260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:24.006471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:24.007826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:24.008771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:24.009442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:24.010387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:24.219390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:24.231013 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17682b6d-c024-4528-a3ae-898a99e97158 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1338 microversion: 2.1 time: 0.249992 Oct 31 14:03:24.242620 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 85/206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:23 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1338 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:24.265442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-043d1d0d-1a60-40a7-91e8-7b3adaa2738e req-52db14b7-225a-4b4c-a6c4-30dce3a42915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5", "name": "network-vif-deleted", "tag": "858225cc-0a73-4b52-addb-2078c397b639"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:24.331457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-043d1d0d-1a60-40a7-91e8-7b3adaa2738e req-52db14b7-225a-4b4c-a6c4-30dce3a42915 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:24.334083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-043d1d0d-1a60-40a7-91e8-7b3adaa2738e req-52db14b7-225a-4b4c-a6c4-30dce3a42915 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:24.334972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-043d1d0d-1a60-40a7-91e8-7b3adaa2738e req-52db14b7-225a-4b4c-a6c4-30dce3a42915 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:24.392661 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-043d1d0d-1a60-40a7-91e8-7b3adaa2738e req-52db14b7-225a-4b4c-a6c4-30dce3a42915 service nova] Creating event network-vif-deleted:858225cc-0a73-4b52-addb-2078c397b639 for instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 on n-h2-863052-1 Oct 31 14:03:24.404269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-043d1d0d-1a60-40a7-91e8-7b3adaa2738e req-52db14b7-225a-4b4c-a6c4-30dce3a42915 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143664 Oct 31 14:03:24.409545 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 86/207] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:24.418989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:24.420983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:24.438100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:24.439882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:24.442076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:24.443275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:24.447440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:24.448790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:24.570624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c62e591cf274302bf84204bdf1f1977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbbd6c8074f46e1bfc5cb308cb7764d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:24.583845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d558c932-c18a-436b-8394-281a4e800e0a tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 200 len: 1324 microversion: 2.1 time: 0.168292 Oct 31 14:03:24.595586 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 87/208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:24 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:25.007603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-241556212", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:25.095092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:03:25.496229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:03:25.496814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:03:25.497432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:03:25.497999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:03:25.498571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:03:25.514478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.515897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.517366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:25.518747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.527996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.528733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:25.576842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Getting quotas for project 584b25a1002a45b88dcc9b2483201512. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:25.582454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Getting quotas for user 0611d0454bef41cfafdd8ff359cd1f3d and project 584b25a1002a45b88dcc9b2483201512. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:25.595873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:03:25.598380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:03:25.660960 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2a4fbe2-4777-4618-bfc9-c3093987368d tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064166 Oct 31 14:03:25.668799 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 88/209] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:03:25.668799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:25.671499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:25.689958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.691242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.694519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:25.695580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.696158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.696694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:25.702336 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e87282e1-90f8-4c74-82b9-99c630d7ac9a tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.930559 Oct 31 14:03:25.705797 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 122/210] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:03:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:25.714869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:25.716570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:25.731823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.732315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.734148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:25.734919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.736878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.738306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:25.771922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] HTTP exception thrown: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Request method failure captured: Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 HTTP/1.1 Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V9yv4qVq1ME6U91UrC7KZN_Ons017_HuJ_2Z15OOmX_E5_NJ4MGefic6tCEBTYNcj8M-zrrHWrWJjV8Tg18XF_7tYJApb4HJuL1HqGTzViTTwXulScZA7Yg1GG6j1lJFfhfgOCQG_Is2LT8j9CLvXr0OwHWmxbHNGCpo7_zZYlUHE Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 5fbbd6c8074f46e1bfc5cb308cb7764d Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:25.780020 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fbbd6c8074f46e1bfc5cb308cb7764d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 5fbbd6c8074f46e1bfc5cb308cb7764d Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminTestJSON-910131627-project Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1c62e591cf274302bf84204bdf1f1977 Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminTestJSON-910131627-project Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:25.781406 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5'} Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:25.782188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:25.783451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:25.786080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Returning 404 to user: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:25.787140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32b0c17e-ffb7-49eb-97e7-faa2830d4bdc tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 404 len: 111 microversion: 2.1 time: 0.080137 Oct 31 14:03:25.788198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 123/211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:25 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:25.828392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:25.845557 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7c0d3c4-ae63-40f8-98dd-8d6a48a3d6f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1344 microversion: 2.1 time: 0.180717 Oct 31 14:03:25.848512 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 89/212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:25 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:25.860639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e5d9c5b-3f87-4ec2-aa6f-d638561a09ae tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:25.861398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e5d9c5b-3f87-4ec2-aa6f-d638561a09ae tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:25.929503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e5d9c5b-3f87-4ec2-aa6f-d638561a09ae tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:25.940155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e5d9c5b-3f87-4ec2-aa6f-d638561a09ae tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1213 microversion: 2.1 time: 0.089660 Oct 31 14:03:25.961414 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 90/213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:25 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:25.982379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ffa21a4-3e65-41d9-9b3a-eb523df72451 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:25.997042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ffa21a4-3e65-41d9-9b3a-eb523df72451 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:25.997736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ffa21a4-3e65-41d9-9b3a-eb523df72451 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:25.998365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ffa21a4-3e65-41d9-9b3a-eb523df72451 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:26.144200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c70843c3-9634-4043-a82a-b179f20b95c3 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Action: 'create', calling method: .version_select at 0x7fe10c3bd160>, body: {"keypair": {"name": "tempest-keypair-2042381204", "type": "ssh", "user_id": "d65ef17c97ad4cd79969654959ec8f22", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDz/OL9fTAkl+L7Yws32L2/RNPfzOlivXVp0/pLnPtnrdbouzx55HfdbMIowwuZcvAliBZcLNYvyk4PerGJ4q6yEeIHvuueuUZuo3skONH6yJqYPGJw1UiK2zuoQF/rwlA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:26.152803 n-d-863052-1 devstack@n-api.service[120641]: WARNING nova.scheduler.client.report [None req-8ffa21a4-3e65-41d9-9b3a-eb523df72451 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] [req-e7cc02de-ff07-4c3d-b1db-27970aceff06] Failed to update aggregates to [] for resource provider with UUID e007004d-a834-458f-a7e6-40fce332cdaa. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-e7cc02de-ff07-4c3d-b1db-27970aceff06"}]} Oct 31 14:03:26.171593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c70843c3-9634-4043-a82a-b179f20b95c3 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Getting quotas for project f91fb31e36a24c46af4a7224df1e3ecb. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:26.176019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c70843c3-9634-4043-a82a-b179f20b95c3 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Getting quotas for user 7dc39fa106f7490597a16ee17d980cbf and project f91fb31e36a24c46af4a7224df1e3ecb. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:26.207410 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c70843c3-9634-4043-a82a-b179f20b95c3 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.417918 Oct 31 14:03:26.208368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 124/214] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:03:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 419 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:03:26.216013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-47193552", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "6210a55b-8790-4aa9-8e81-23a0101568be"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:26.356029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] validate_networks() for [('6210a55b-8790-4aa9-8e81-23a0101568be', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:03:26.367883 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ffa21a4-3e65-41d9-9b3a-eb523df72451 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.404752 Oct 31 14:03:26.375568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 91/215] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:26.381759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-597de567-918f-44f6-bb9b-6255374b56c7 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Action: 'create', calling method: .version_select at 0x7fe10c6c93a0>, body: {"keypair": {"name": "tempest-keypair-1551235973", "type": "ssh", "user_id": "d65ef17c97ad4cd79969654959ec8f22", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMcsPr1hEGFHA1YYVKFzTEQVsPl/cmCoagFE11FyiJmAijwxl2c7Qe9BYsn4jAXm63AIps0ZB8LjwVKtsdR+8bBQzHsh8CEpbxim/YmNneNP9JC4Pm6CcBsvDYlRfbdiQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:26.402976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-597de567-918f-44f6-bb9b-6255374b56c7 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Getting quotas for project f91fb31e36a24c46af4a7224df1e3ecb. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:26.407707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-597de567-918f-44f6-bb9b-6255374b56c7 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Getting quotas for user 7dc39fa106f7490597a16ee17d980cbf and project f91fb31e36a24c46af4a7224df1e3ecb. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:26.467832 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-597de567-918f-44f6-bb9b-6255374b56c7 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.090976 Oct 31 14:03:26.468794 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 92/216] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:03:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:03:26.473373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-976a7fbf-76fd-4882-936a-e9f170505c0a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:26.510826 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-976a7fbf-76fd-4882-936a-e9f170505c0a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.040228 Oct 31 14:03:26.511989 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 93/217] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:26.699128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5df990d-65e3-4b0a-a5d8-28b7877b26f3 tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] Calling method '.version_select at 0x7fe10dbacee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:26.729981 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c5df990d-65e3-4b0a-a5d8-28b7877b26f3 tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.216640 Oct 31 14:03:26.730546 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 94/218] 10.222.0.27 () {60 vars in 1226 bytes} [Mon Oct 31 14:03:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:26.751708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc3681c1-6232-4d21-a6e0-23395b0dd13e tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Calling method '.version_select at 0x7fe10c4de280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:26.777453 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc3681c1-6232-4d21-a6e0-23395b0dd13e tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-2042381204?user_id=d65ef17c97ad4cd79969654959ec8f22" status: 200 len: 512 microversion: 2.10 time: 0.042329 Oct 31 14:03:26.786598 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 95/219] 10.222.0.27 () {60 vars in 1340 bytes} [Mon Oct 31 14:03:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2042381204?user_id=d65ef17c97ad4cd79969654959ec8f22 => generated 512 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:26.792477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cfcb888d-c84a-4d10-8612-2daeabb23ede tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-714828939"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:26.797191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-cfcb888d-c84a-4d10-8612-2daeabb23ede tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 5a78155c-a411-4c19-865e-af8bb4a09553 for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:26.833827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cfcb888d-c84a-4d10-8612-2daeabb23ede tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045885 Oct 31 14:03:26.835379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 96/220] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:26.841154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c4b8c6d-3083-432f-bf05-0f00686fa0bd tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c671940>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:26.998374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:03:26.998920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:03:26.999856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:03:27.000564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:03:27.000977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:03:27.009941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.010569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.010891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.011629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.012074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.012754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.020277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=11,nova_api:DELETE=3,nova_api:UPDATE=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:27.031168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Getting quotas for project a6c5ba969b654c3986dbd6c693887bff. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:27.036920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Getting quotas for user a58704dad2b94740be8042992cb16454 and project a6c5ba969b654c3986dbd6c693887bff. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:27.049997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:03:27.052117 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c4b8c6d-3083-432f-bf05-0f00686fa0bd tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.215612 Oct 31 14:03:27.052284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:03:27.052935 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 97/221] 10.222.0.27 () {62 vars in 1247 bytes} [Mon Oct 31 14:03:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:27.057747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd869b3a-e25c-44fe-b3ad-007c01facfab tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Action: 'create', calling method: .version_select at 0x7fe10c4deb80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-557726227", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMTO9+cLAFfEV0koGCXBCXyzzil22RjIu0KDOwqeX/aW7ORwsYAEL5/XUXgwEPMDNx3bXe8CF544zDq+6gnLncXdGwPt57LYa+dVwH8qxpsf5LOQ9moL5X21uO3GV/2sQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:27.073665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-bd869b3a-e25c-44fe-b3ad-007c01facfab tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Getting quotas for project f91fb31e36a24c46af4a7224df1e3ecb. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:27.078735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-bd869b3a-e25c-44fe-b3ad-007c01facfab tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Getting quotas for user 7dc39fa106f7490597a16ee17d980cbf and project f91fb31e36a24c46af4a7224df1e3ecb. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:27.102998 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd869b3a-e25c-44fe-b3ad-007c01facfab tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.048820 Oct 31 14:03:27.105277 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 98/222] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:03:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:03:27.112975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26bb158d-b649-4bfb-97e4-38dba837c8dd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:27.117247 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbf1251a-2f44-45b7-b8e1-9f5882d5ef70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907422 Oct 31 14:03:27.119217 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 125/223] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:03:27.124826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.126700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:27.132803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26bb158d-b649-4bfb-97e4-38dba837c8dd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.133607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26bb158d-b649-4bfb-97e4-38dba837c8dd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.134117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26bb158d-b649-4bfb-97e4-38dba837c8dd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.296899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.297400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.297990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.298833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.299203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.299592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.334105 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26bb158d-b649-4bfb-97e4-38dba837c8dd tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.225323 Oct 31 14:03:27.334718 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 99/224] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:27.340401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.346399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:27.354509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.355000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.355835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.356656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.357270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.358213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.470542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:27.484139 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24811599-8b8c-4c67-8d8c-22486f76e10f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1273 microversion: 2.1 time: 0.148058 Oct 31 14:03:27.490456 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 100/225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:27 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:27.495165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-33a74de7-4235-413b-bc43-2d59cfd0efcc req-2058891b-8af9-4784-8fe8-43c35d45b138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60af71f3-df25-4ad4-967b-5414eaf8577a", "tag": "c8104c9c-f975-4500-a421-dcafe812be76"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:27.504863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-33a74de7-4235-413b-bc43-2d59cfd0efcc req-2058891b-8af9-4784-8fe8-43c35d45b138 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.505338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-33a74de7-4235-413b-bc43-2d59cfd0efcc req-2058891b-8af9-4784-8fe8-43c35d45b138 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.505775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-33a74de7-4235-413b-bc43-2d59cfd0efcc req-2058891b-8af9-4784-8fe8-43c35d45b138 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.526515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-33a74de7-4235-413b-bc43-2d59cfd0efcc req-2058891b-8af9-4784-8fe8-43c35d45b138 service nova] Creating event network-changed:c8104c9c-f975-4500-a421-dcafe812be76 for instance 60af71f3-df25-4ad4-967b-5414eaf8577a on n-h2-863052-1 Oct 31 14:03:27.542353 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-33a74de7-4235-413b-bc43-2d59cfd0efcc req-2058891b-8af9-4784-8fe8-43c35d45b138 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049634 Oct 31 14:03:27.543312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 101/226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:27.548793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f39ca6d-eea6-48ef-b430-f9c732dfec2e tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] Calling method '.version_select at 0x7fe10c426ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.571338 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f39ca6d-eea6-48ef-b430-f9c732dfec2e tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026410 Oct 31 14:03:27.572142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 102/227] 10.222.0.27 () {60 vars in 1226 bytes} [Mon Oct 31 14:03:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:27.577068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f21d2006-315a-42b8-9012-125f3088a105 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Calling method '.version_select at 0x7fe10c426af0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.581143 n-d-863052-1 devstack@n-api.service[120641]: WARNING oslo_db.sqlalchemy.utils [None req-f21d2006-315a-42b8-9012-125f3088a105 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 14:03:27.589165 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f21d2006-315a-42b8-9012-125f3088a105 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=d65ef17c97ad4cd79969654959ec8f22" status: 200 len: 726 microversion: 2.10 time: 0.015430 Oct 31 14:03:27.590575 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 103/228] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:03:27 2022] GET /compute/v2.1/os-keypairs?user_id=d65ef17c97ad4cd79969654959ec8f22 => generated 726 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:27.595013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fae3e284-4550-4a87-a0e3-a0e2bccff20e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.596255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fae3e284-4550-4a87-a0e3-a0e2bccff20e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:27.714793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fae3e284-4550-4a87-a0e3-a0e2bccff20e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:27.723905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fae3e284-4550-4a87-a0e3-a0e2bccff20e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1222 microversion: 2.1 time: 0.132748 Oct 31 14:03:27.739167 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 104/229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:27 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:27.745487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-13efbcc4-f79b-4902-bb4e-3e4db31165b6 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.753895 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-13efbcc4-f79b-4902-bb4e-3e4db31165b6 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.013424 Oct 31 14:03:27.754830 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 105/230] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:03:27 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:27.765169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-535021fb-1727-4855-89f9-c345b05826ca tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c426c10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:27.829899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-535021fb-1727-4855-89f9-c345b05826ca tempest-QuotaClassesAdmin257Test-1146164732 tempest-QuotaClassesAdmin257Test-1146164732-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.073890 Oct 31 14:03:27.831353 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 106/231] 10.222.0.27 () {62 vars in 1247 bytes} [Mon Oct 31 14:03:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:27.836223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a401eb71-bb4a-4df4-9237-9ee63b3985e0 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Calling method '.version_select at 0x7fe10c426b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.842785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:27.854041 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0860b2e9-119e-48f0-bb03-bbec1eae1342 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1389 microversion: 2.1 time: 0.732051 Oct 31 14:03:27.871879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a401eb71-bb4a-4df4-9237-9ee63b3985e0 tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-557726227" status: 204 len: 0 microversion: 2.10 time: 0.038903 Oct 31 14:03:27.872381 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 126/233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:27 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1389 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:27.876288 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 107/233] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Oct 31 14:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-557726227 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:03:27.878954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5fc0383-f04b-4d7c-b3e1-d6f88354f8d5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:27.882076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35199aab-670f-40a7-9029-f346abce773d tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Calling method '.version_select at 0x7fe10c4dedc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.892568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5fc0383-f04b-4d7c-b3e1-d6f88354f8d5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:27.893344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5fc0383-f04b-4d7c-b3e1-d6f88354f8d5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:27.894136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5fc0383-f04b-4d7c-b3e1-d6f88354f8d5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:27.906330 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35199aab-670f-40a7-9029-f346abce773d tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551235973?user_id=d65ef17c97ad4cd79969654959ec8f22" status: 204 len: 0 microversion: 2.10 time: 0.028112 Oct 31 14:03:27.907783 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 108/234] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551235973?user_id=d65ef17c97ad4cd79969654959ec8f22 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:03:27.916042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fac8876a-b6dc-49cd-86bd-2668cfafd59a tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] Calling method '.version_select at 0x7fe10c44e5e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:27.961342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fac8876a-b6dc-49cd-86bd-2668cfafd59a tempest-KeyPairsV210TestJSON-948913704 tempest-KeyPairsV210TestJSON-948913704-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042381204?user_id=d65ef17c97ad4cd79969654959ec8f22" status: 204 len: 0 microversion: 2.10 time: 0.047949 Oct 31 14:03:27.966597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 109/235] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042381204?user_id=d65ef17c97ad4cd79969654959ec8f22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:03:28.080686 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5fc0383-f04b-4d7c-b3e1-d6f88354f8d5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.206863 Oct 31 14:03:28.088037 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 127/236] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:28.092967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ab6366b-13da-4f19-982b-3ab2dbc6342d tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:28.132014 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ab6366b-13da-4f19-982b-3ab2dbc6342d tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039005 Oct 31 14:03:28.136213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 110/237] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:28 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 14:03:28.148217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e42536a-cff9-4e14-8154-a80dc341269c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1137406205"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:28.152221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-7e42536a-cff9-4e14-8154-a80dc341269c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 6a4720a1-7758-4ab8-b3c4-857ed8908072 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:28.215279 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e42536a-cff9-4e14-8154-a80dc341269c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072163 Oct 31 14:03:28.217038 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 128/238] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:28.230609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa283b4d-310d-4751-9d2a-2fb01457d5ed tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:28.258517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa283b4d-310d-4751-9d2a-2fb01457d5ed tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.262993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa283b4d-310d-4751-9d2a-2fb01457d5ed tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.263819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa283b4d-310d-4751-9d2a-2fb01457d5ed tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.520076 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa283b4d-310d-4751-9d2a-2fb01457d5ed tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.292762 Oct 31 14:03:28.522643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:28.523498 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 111/239] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:28.523822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:28.540738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce37e387-655a-47b8-a287-c3de30c485e2 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:28.548009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.552249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.554097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.558366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.559313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.561530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.577589 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce37e387-655a-47b8-a287-c3de30c485e2 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.046083 Oct 31 14:03:28.588708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 112/240] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:03:28 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:28.594822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33af50b7-7c8b-40b3-b0ee-bfadecbf6883 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:28.607571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33af50b7-7c8b-40b3-b0ee-bfadecbf6883 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.608063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33af50b7-7c8b-40b3-b0ee-bfadecbf6883 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.608499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33af50b7-7c8b-40b3-b0ee-bfadecbf6883 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.774195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:28.776586 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33af50b7-7c8b-40b3-b0ee-bfadecbf6883 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.186503 Oct 31 14:03:28.779225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 113/241] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:28.784484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:28.785369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:28.793090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.793806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.794605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.795626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.796375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.797065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.799055 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eeeb1fa9-b582-47e9-b506-183e39fd12c3 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1271 microversion: 2.1 time: 0.289303 Oct 31 14:03:28.802410 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 129/242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:28 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1271 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:28.816998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e49ff87-3dbb-42e8-a672-e676d5550201 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:28.857436 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e49ff87-3dbb-42e8-a672-e676d5550201 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.051190 Oct 31 14:03:28.858352 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 130/243] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:28 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:28.870783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0468f59-357a-450d-be67-390e038fa689 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-215405206"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:28.875022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-e0468f59-357a-450d-be67-390e038fa689 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid d7afc405-cbd8-4064-8e65-c92cc5aef3cc for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:28.924958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0468f59-357a-450d-be67-390e038fa689 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059587 Oct 31 14:03:28.927051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 131/244] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:28.937596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:28.939354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:28.951852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.952612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.953332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.955538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:28.957469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:28.958065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:28.969315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:28.980954 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-346d1cf4-5959-447b-88ca-605c87956c60 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1282 microversion: 2.1 time: 0.200218 Oct 31 14:03:28.996544 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 114/245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:28 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:29.007728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eec14404-2819-4d4f-a119-b675cb3044d1 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.020675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eec14404-2819-4d4f-a119-b675cb3044d1 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.021541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eec14404-2819-4d4f-a119-b675cb3044d1 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.021912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eec14404-2819-4d4f-a119-b675cb3044d1 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:29.189020 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eec14404-2819-4d4f-a119-b675cb3044d1 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.191063 Oct 31 14:03:29.189907 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 115/246] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:28 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:29.202233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d5bc789-181c-4996-965b-9682402f8d6b tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.209859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:UPDATE=7,nova_api:DELETE=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:29.214301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d5bc789-181c-4996-965b-9682402f8d6b tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.214987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d5bc789-181c-4996-965b-9682402f8d6b tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.215651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d5bc789-181c-4996-965b-9682402f8d6b tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:29.364208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d5bc789-181c-4996-965b-9682402f8d6b tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.165679 Oct 31 14:03:29.365478 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 116/247] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:29.383701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1afc7f4a-8272-48c1-8d8c-1e10c2726450 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.407369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1afc7f4a-8272-48c1-8d8c-1e10c2726450 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.032999 Oct 31 14:03:29.408702 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 117/248] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:29 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:29.418507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9eb41549-721e-4d7c-90b8-b4d20eeabdbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-526603163"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.421885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-9eb41549-721e-4d7c-90b8-b4d20eeabdbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 654765ce-2d9a-4a68-8f52-43565e82f420 for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:29.446532 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9eb41549-721e-4d7c-90b8-b4d20eeabdbc tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.032487 Oct 31 14:03:29.447622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 118/249] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:29.453124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-14dc56d1-787a-4935-9af6-802919bdc9ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-383448095"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.457591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-14dc56d1-787a-4935-9af6-802919bdc9ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 8d503d80-a01b-4e1f-930b-d4922b1a0f9e for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:29.485951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:29.490975 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-14dc56d1-787a-4935-9af6-802919bdc9ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041367 Oct 31 14:03:29.498911 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 119/250] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:29.504130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f906c1f9-4369-46cd-8e07-6cc9d8373630 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.512384 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ec73ef8-fc0b-4b06-adb5-2a6fd9745710 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1389 microversion: 2.1 time: 0.579220 Oct 31 14:03:29.526649 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 132/251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:28 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1389 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:29.526649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd5464ba-9a14-4004-b69c-a8156e495eae tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.542272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5464ba-9a14-4004-b69c-a8156e495eae tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.545290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5464ba-9a14-4004-b69c-a8156e495eae tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.547314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5464ba-9a14-4004-b69c-a8156e495eae tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:29.551442 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f906c1f9-4369-46cd-8e07-6cc9d8373630 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.051387 Oct 31 14:03:29.553016 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 120/252] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:29.562493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4069df8b-10f1-4299-8e70-616327947638 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.577230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-4069df8b-10f1-4299-8e70-616327947638 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4069df8b-10f1-4299-8e70-616327947638 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Request method failure captured: Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9V_VjR2ip_Jhr1LVlJQiIpDyjU8J2BIYxnPkpxGMKLj8NKdNiJ11EtlBXEE2ppqxDvT7HlRfQNWT8p7DsmIOEynuNSWRCZi51A-z8xKQgoigdlhseuAVnauIyfnjfo8DAJHMGjinhK2XFQQhc5rnP85ZQpFEGWhwM6860Vr3BTD7wE Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:03:29.589488 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_497e16dd8aa949759f362343d33c52da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/497e16dd8aa949759f362343d33c52da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 0ca6e69380b8498098c9bfd002385f40 Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: exception: Aggregate 6 could not be found. Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '6'} Oct 31 14:03:29.590916 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.591753 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 31 14:03:29.595250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.597529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4069df8b-10f1-4299-8e70-616327947638 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:29.598642 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4069df8b-10f1-4299-8e70-616327947638 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.042326 Oct 31 14:03:29.599634 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 121/253] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:03:29 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:03:29.608585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31553880-143d-41ea-be43-6db935e14502 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.667168 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-31553880-143d-41ea-be43-6db935e14502 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31553880-143d-41ea-be43-6db935e14502 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Request method failure captured: Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9V_VjR2ip_Jhr1LVlJQiIpDyjU8J2BIYxnPkpxGMKLj8NKdNiJ11EtlBXEE2ppqxDvT7HlRfQNWT8p7DsmIOEynuNSWRCZi51A-z8xKQgoigdlhseuAVnauIyfnjfo8DAJHMGjinhK2XFQQhc5rnP85ZQpFEGWhwM6860Vr3BTD7wE Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:03:29.675639 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_497e16dd8aa949759f362343d33c52da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/497e16dd8aa949759f362343d33c52da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 0ca6e69380b8498098c9bfd002385f40 Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: exception: Aggregate 6 could not be found. Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '6'} Oct 31 14:03:29.677102 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:29.677916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.678967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31553880-143d-41ea-be43-6db935e14502 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:29.680045 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31553880-143d-41ea-be43-6db935e14502 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.075046 Oct 31 14:03:29.682754 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 122/254] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:03:29.698998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6c022bf-94e6-47e4-9993-3bd9eaafcb56 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1540710940", "name": "tempest-test_aggregate-215119156"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.751489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-a6c022bf-94e6-47e4-9993-3bd9eaafcb56 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 7583e5bd-9e34-40ab-95d5-a1e6f4174197 for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:29.767678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd5464ba-9a14-4004-b69c-a8156e495eae tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.250255 Oct 31 14:03:29.769310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 133/255] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:29.781036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.794075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a6c022bf-94e6-47e4-9993-3bd9eaafcb56 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.105532 Oct 31 14:03:29.794876 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 123/256] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:29.809127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f00ff4d-9542-4487-a392-5bf426953cb5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.823647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.824153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.824594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:29.849434 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f00ff4d-9542-4487-a392-5bf426953cb5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.046546 Oct 31 14:03:29.851057 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 124/257] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:29 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 14:03:29.859880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.860551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:29.870012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.870867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.871320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:29.872279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.873125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.873566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:29.873679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:29.899925 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-863052-1. Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 39 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:29.924151 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: {"add_host": {"host": "n-h2-863052-1"}} Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:29.925584 n-d-863052-1 devstack@n-api.service[120640]: exception: Aggregate 7 already has host n-h2-863052-1. Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-863052-1'}}} Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result.read() Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:03:29.927676 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-863052-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:03:29.928901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:03:29.930019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:03:29.931345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result.read() Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-863052-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 14, 3, 29, 864159), 'updated_at': None, 'host': 'n-h2-863052-1', 'aggregate_id': 7}] Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.933089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-863052-1. Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.934136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-863052-1. Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:29.935385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:29.936595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-863052-1. Oct 31 14:03:29.936595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.939586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-863052-1. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:29.941031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d69d737-7de5-4fc4-bc58-070cfd406813 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.164516 Oct 31 14:03:29.941980 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 134/258] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 31 14:03:29.951144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc005f85-72fb-4b49-9584-14996dc6c8db tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:29.960280 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-fc005f85-72fb-4b49-9584-14996dc6c8db tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc005f85-72fb-4b49-9584-14996dc6c8db tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Request method failure captured: Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V_VjR2ip_Jhr1LVlJQiIpDyjU8J2BIYxnPkpxGMKLj8NKdNiJ11EtlBXEE2ppqxDvT7HlRfQNWT8p7DsmIOEynuNSWRCZi51A-z8xKQgoigdlhseuAVnauIyfnjfo8DAJHMGjinhK2XFQQhc5rnP85ZQpFEGWhwM6860Vr3BTD7wE Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:29.962859 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_497e16dd8aa949759f362343d33c52da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/497e16dd8aa949759f362343d33c52da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 0ca6e69380b8498098c9bfd002385f40 Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: exception: Aggregate 8 could not be found. Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '8'} Oct 31 14:03:29.964138 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.964896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 31 14:03:29.966015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:29.967477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc005f85-72fb-4b49-9584-14996dc6c8db tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:29.968765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc005f85-72fb-4b49-9584-14996dc6c8db tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.022061 Oct 31 14:03:29.969844 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 135/259] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:03:29 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:29.975431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1fff82e-ec57-4c16-a3cb-66ba1ff6ecaf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:29.993907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1fff82e-ec57-4c16-a3cb-66ba1ff6ecaf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:29.995133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1fff82e-ec57-4c16-a3cb-66ba1ff6ecaf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:29.995721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1fff82e-ec57-4c16-a3cb-66ba1ff6ecaf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.162835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1fff82e-ec57-4c16-a3cb-66ba1ff6ecaf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.191583 Oct 31 14:03:30.163759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 136/260] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:30.169230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00f3bcb0-ad3d-4f5c-b084-723ed9b2854c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:30.183431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-00f3bcb0-ad3d-4f5c-b084-723ed9b2854c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00f3bcb0-ad3d-4f5c-b084-723ed9b2854c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Request method failure captured: Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V_VjR2ip_Jhr1LVlJQiIpDyjU8J2BIYxnPkpxGMKLj8NKdNiJ11EtlBXEE2ppqxDvT7HlRfQNWT8p7DsmIOEynuNSWRCZi51A-z8xKQgoigdlhseuAVnauIyfnjfo8DAJHMGjinhK2XFQQhc5rnP85ZQpFEGWhwM6860Vr3BTD7wE Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:30.185307 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_497e16dd8aa949759f362343d33c52da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/497e16dd8aa949759f362343d33c52da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/497e16dd8aa949759f362343d33c52da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 497e16dd8aa949759f362343d33c52da Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-30290333 Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 0ca6e69380b8498098c9bfd002385f40 Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminTestJSON-30290333-project-admin Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: exception: Aggregate 8 could not be found. Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '8'} Oct 31 14:03:30.186479 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:30.187157 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:30.188185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00f3bcb0-ad3d-4f5c-b084-723ed9b2854c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00f3bcb0-ad3d-4f5c-b084-723ed9b2854c tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.022117 Oct 31 14:03:30.189567 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 137/261] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:30 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:30.192877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:30.194310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:30.201031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:30.201524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:30.202290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.203331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:30.203928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:30.205141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.344985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:30.363133 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1ca0fcc-c51a-48e7-ad56-166e47c6f33e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1280 microversion: 2.1 time: 0.172608 Oct 31 14:03:30.374345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 138/262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:30 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:30.379508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f1b3bcf-0ae8-40a0-9fc0-edc94436fd36 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:30.406871 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f1b3bcf-0ae8-40a0-9fc0-edc94436fd36 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.041150 Oct 31 14:03:30.412780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 139/263] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:30.421425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6921b3a-4151-47fd-9653-a512eae118e5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-549835588"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:30.437305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-c6921b3a-4151-47fd-9653-a512eae118e5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 5d776d20-2ef9-4c92-81cb-ad289a84ec54 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:30.479926 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6921b3a-4151-47fd-9653-a512eae118e5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063924 Oct 31 14:03:30.486780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 140/264] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:30.492982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7499d17a-8e62-4447-8106-c6f429449ecf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-881850820"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:30.501755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-7499d17a-8e62-4447-8106-c6f429449ecf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid cacfa159-4530-4500-9af8-f92eef6ae7f4 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:30.542556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:30.546520 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7499d17a-8e62-4447-8106-c6f429449ecf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063375 Oct 31 14:03:30.546666 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 141/265] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:30.553145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-281113ea-d136-441c-a831-39654162c295 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:30.562704 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-281113ea-d136-441c-a831-39654162c295 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.015036 Oct 31 14:03:30.564506 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 142/266] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:03:30 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:30.576295 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83968332-2b66-4fe4-bf26-8a21995acf7c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1313 microversion: 2.1 time: 0.720694 Oct 31 14:03:30.582225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c5f5ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:30.588502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:30.589216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:30.589659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.590518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:30.591000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:30.592577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.597347 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 125/267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:29 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:30.608292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:30.608922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:30.617819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:30.618378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:30.619073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.619943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:30.620115 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08790988-1978-4f09-8b66-fd0bd24b0988 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.054347 Oct 31 14:03:30.620701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:30.621816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:30.627486 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 143/268] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 31 14:03:30 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:30.629204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:31.112917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f6ffb7e-9031-4ebc-a631-80dde05f6107 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:31.117179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f6ffb7e-9031-4ebc-a631-80dde05f6107 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2e963ad90927487db6dd948cbecdfd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a07a9460a248a5873f4e065ebaf7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f6ffb7e-9031-4ebc-a631-80dde05f6107 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Request method failure captured: Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 39 Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WK_mrbltBuz9-NQd4wV7KA2x4ZufN1ZRvJQNjSwlYmRUKUYOK2lJ3j8Siv7kTEhIFGWdp_c56ECymFGajWC8RVFvg4blUl4UqQYCkTv431MNrA4eH0sLv0wT1edG367zA3KzDthYY7cgK6r5r4qskucE4CHYse3XwY00H81maf7Ow Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:31.118806 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9a07a9460a248a5873f4e065ebaf7c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2e963ad90927487db6dd948cbecdfd3b Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: {"add_host": {"host": "n-h2-863052-1"}} Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:31.120694 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-863052-1'}}} Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:31.121447 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 14:03:31.122486 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.123513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f6ffb7e-9031-4ebc-a631-80dde05f6107 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:31.123513 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f6ffb7e-9031-4ebc-a631-80dde05f6107 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.492203 Oct 31 14:03:31.128870 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 144/269] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:03:30 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 501 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:31.137155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9001c5a-2eff-46c6-8921-054e72a11c9a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:31.194675 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9001c5a-2eff-46c6-8921-054e72a11c9a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.064494 Oct 31 14:03:31.195288 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 145/270] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 31 14:03:31 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.210036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c1a7a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.220362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.222035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.225106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.228122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.231788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.232815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.267123 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34d5ed4f-bace-4775-be53-f9261dcb0145 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.067497 Oct 31 14:03:31.267915 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 146/271] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.272623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81a8f6cb-7385-4367-8870-9fadd6345733 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.317624 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81a8f6cb-7385-4367-8870-9fadd6345733 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.042446 Oct 31 14:03:31.329155 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 147/272] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:31 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:31.344020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c238f6d8-3aa2-4424-8ac6-d18e7d0faac5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.368019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:31.370360 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c238f6d8-3aa2-4424-8ac6-d18e7d0faac5 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.039623 Oct 31 14:03:31.375769 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 148/273] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.387729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c5f5820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.390459 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7b18ab3-55b4-4f39-bf76-9e16aca6588c tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1389 microversion: 2.1 time: 0.790422 Oct 31 14:03:31.391173 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 126/274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:30 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1389 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:31.392117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.395654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.396384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.397351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.398023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.398698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.402412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83d579f4-c641-4178-a66b-f62aede730db tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-418394124"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:31.437231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-83d579f4-c641-4178-a66b-f62aede730db tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 3c3e3a9e-e233-4d82-b0f2-2d931aca770e for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:31.455330 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d79a5c3-a20b-42fb-95fb-32d39fdd99af tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.078154 Oct 31 14:03:31.456291 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 149/275] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.466481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f562117-563b-4683-898e-ae621762e057 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.500090 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83d579f4-c641-4178-a66b-f62aede730db tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103507 Oct 31 14:03:31.500778 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 127/276] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.518263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f562117-563b-4683-898e-ae621762e057 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.055756 Oct 31 14:03:31.519292 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 150/277] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:31 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:31.520122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.521076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:31.524316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c591b80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.532152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.533037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.533641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.533974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.534706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.535272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.536225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.536872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.537528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.551037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.551696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.552265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.584349 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d4493cd-1eaf-49c8-8ea7-234b01d31d6c tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-863052-1" status: 200 len: 598 microversion: 2.1 time: 0.063863 Oct 31 14:03:31.585404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 151/278] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/os-hosts/n-h2-863052-1 => generated 598 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.590106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1747481620"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:31.602525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.603194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.604295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.612824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.613464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.614014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.622516 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1747481620 could not be found. Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 58 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:31.626239 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: {"add_host": {"host": "tempest-nonexist_host-1747481620"}} Oct 31 14:03:31.627580 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: exception: Compute host tempest-nonexist_host-1747481620 could not be found. Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1747481620'}}} Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1747481620' is not mapped to any cell Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.628314 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 31 14:03:31.629594 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1747481620 could not be found. Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1747481620 could not be found. Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:31.630777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1747481620 could not be found. Oct 31 14:03:31.632012 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:31.632550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1747481620 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:31.634101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3223174d-d097-4fe4-b7b5-59f3280e28e9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.047096 Oct 31 14:03:31.637680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 152/279] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:03:31 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:31.643161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ed107c5-873a-41d8-b1cb-be2f2eb6f9d4 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-41511203", "availability_zone": "tempest-test_az-2028383857"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:31.666632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-8ed107c5-873a-41d8-b1cb-be2f2eb6f9d4 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid 127d1167-a29d-4a69-b4a6-6d4807c4c755 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:31.716922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ed107c5-873a-41d8-b1cb-be2f2eb6f9d4 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.078062 Oct 31 14:03:31.718584 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 153/280] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 31 14:03:31 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.730110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Calling method '.version_select at 0x7fe10c1a7040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.747429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.748295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.750413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.779349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.782823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.783550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.817526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:31.833658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9c43650-a05a-4bcd-b588-9f50fcbffa21 tempest-HostsAdminTestJSON-1137997859 tempest-HostsAdminTestJSON-1137997859-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-863052-1" status: 200 len: 467 microversion: 2.1 time: 0.112714 Oct 31 14:03:31.835172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 154/281] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/os-hosts/n-h1-863052-1 => generated 467 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:31.859489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:31.861444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:31.878049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.884570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.885939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:31.888740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:31.889283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:31.889835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:32.112565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:32.124289 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9efa7ac5-3cf6-4376-94d2-10915319541e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.612905 Oct 31 14:03:32.128066 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 128/282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:32.147258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce81decf-deee-4f71-85f7-2045917045cf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:32.194670 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce81decf-deee-4f71-85f7-2045917045cf tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.065454 Oct 31 14:03:32.199297 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 129/283] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:32 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:32.223149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed2b7853-877d-45e0-a0a6-77f29b84346a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-41511203_new", "availability_zone": "tempest-test_az-2028383857_new"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.319041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed2b7853-877d-45e0-a0a6-77f29b84346a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:32.319534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed2b7853-877d-45e0-a0a6-77f29b84346a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:32.319973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed2b7853-877d-45e0-a0a6-77f29b84346a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:32.387976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:32.388638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed2b7853-877d-45e0-a0a6-77f29b84346a tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.189861 Oct 31 14:03:32.396248 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 130/284] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 31 14:03:32 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:32.403014 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4f8cadc-94b1-4dd1-aebb-cc43177327f7 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1313 microversion: 2.1 time: 0.565791 Oct 31 14:03:32.403632 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 155/285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:31 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:32.418485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ace1f4ed-cfcf-407d-87b0-e33f69fcd7f8 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ace1f4ed-cfcf-407d-87b0-e33f69fcd7f8 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 283 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:32.424293 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:32.425687 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:03:32.426394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:32.427036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:32.428085 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:32.428885 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:03:32.428885 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:03:32.428885 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:03:32.428885 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.429990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ace1f4ed-cfcf-407d-87b0-e33f69fcd7f8 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:32.431352 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ace1f4ed-cfcf-407d-87b0-e33f69fcd7f8 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.026740 Oct 31 14:03:32.432960 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 156/286] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 31 14:03:32 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:03:32.440467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95c3ff34-2532-4e5c-8dc6-d7cede9316cf tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:32.452101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95c3ff34-2532-4e5c-8dc6-d7cede9316cf tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.017776 Oct 31 14:03:32.453304 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 157/287] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:03:32 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:32.457833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:32.458654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:32.465848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:32.466661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:32.467294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:32.468345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:32.468985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:32.470158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:32.620120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-dd6fcf2c-35f0-404b-8045-75066d48fc5d req-f308677c-8309-45bc-95be-65d4e618a085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538405c5-19b1-401b-beb0-1e7de6a26783", "tag": "d08d2f1d-92d6-4cb6-b6f3-2004c089cf9f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.630826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dd6fcf2c-35f0-404b-8045-75066d48fc5d req-f308677c-8309-45bc-95be-65d4e618a085 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:32.631379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dd6fcf2c-35f0-404b-8045-75066d48fc5d req-f308677c-8309-45bc-95be-65d4e618a085 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:32.632208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dd6fcf2c-35f0-404b-8045-75066d48fc5d req-f308677c-8309-45bc-95be-65d4e618a085 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:32.649138 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-dd6fcf2c-35f0-404b-8045-75066d48fc5d req-f308677c-8309-45bc-95be-65d4e618a085 service nova] Creating event network-changed:d08d2f1d-92d6-4cb6-b6f3-2004c089cf9f for instance 538405c5-19b1-401b-beb0-1e7de6a26783 on n-h2-863052-1 Oct 31 14:03:32.654812 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-dd6fcf2c-35f0-404b-8045-75066d48fc5d req-f308677c-8309-45bc-95be-65d4e618a085 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248952 Oct 31 14:03:32.655839 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 131/288] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:32.661412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7f89acb-02a0-4717-a297-b6f2330c4965 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7f89acb-02a0-4717-a297-b6f2330c4965 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 27 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:03:32.666000 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: {"aggregate": {"name": ""}} Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:32.667257 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '' Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:32.667981 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:03:32.669120 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.671831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7f89acb-02a0-4717-a297-b6f2330c4965 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:32.672828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7f89acb-02a0-4717-a297-b6f2330c4965 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015954 Oct 31 14:03:32.673535 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 132/289] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:32 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:03:32.698784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-56603605-48e9-4724-af4a-9bcfedf37755 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:32.739053 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-56603605-48e9-4724-af4a-9bcfedf37755 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058082 Oct 31 14:03:32.739726 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 133/290] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:32 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:32.748783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89fe687f-d355-4140-941b-866a020ba789 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1805958484"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.763775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89fe687f-d355-4140-941b-866a020ba789 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2e963ad90927487db6dd948cbecdfd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a07a9460a248a5873f4e065ebaf7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89fe687f-d355-4140-941b-866a020ba789 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Request method failure captured: Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 60 Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WK_mrbltBuz9-NQd4wV7KA2x4ZufN1ZRvJQNjSwlYmRUKUYOK2lJ3j8Siv7kTEhIFGWdp_c56ECymFGajWC8RVFvg4blUl4UqQYCkTv431MNrA4eH0sLv0wT1edG367zA3KzDthYY7cgK6r5r4qskucE4CHYse3XwY00H81maf7Ow Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:03:32.765679 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9a07a9460a248a5873f4e065ebaf7c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 2e963ad90927487db6dd948cbecdfd3b Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: {"aggregate": {"name": "tempest-test_aggregate-1805958484"}} Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:32.766880 n-d-863052-1 devstack@n-api.service[120641]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1805958484'}}} Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:32.767630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:32.768572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 14:03:32.769573 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:32.769573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89fe687f-d355-4140-941b-866a020ba789 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:32.775824 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89fe687f-d355-4140-941b-866a020ba789 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029578 Oct 31 14:03:32.775824 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 134/291] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:32 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:32.786571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7548a30e-bf7b-4ac4-9e61-57eefb820bc3 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-71651761"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.802617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-7548a30e-bf7b-4ac4-9e61-57eefb820bc3 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Generated uuid b15940a0-dc2a-45a6-aded-ad785e55567a for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:32.876674 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7548a30e-bf7b-4ac4-9e61-57eefb820bc3 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.104420 Oct 31 14:03:32.877508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 135/292] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:32.883478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b5be1c4-23e1-4a4c-9eb7-8f3be0ae71b4 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1755214730"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:32.899816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:32.908824 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8957b9df-4b9c-4544-85b5-2e526d31c8fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1389 microversion: 2.1 time: 0.454386 Oct 31 14:03:32.913668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-4b5be1c4-23e1-4a4c-9eb7-8f3be0ae71b4 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 4f60638c-7667-422f-b095-bbea6ba8db38 for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:32.915220 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 158/293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:32 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1389 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:32.923961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c50c4de3-676e-4c63-aac2-0d39f0b4d489 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:32.943716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c50c4de3-676e-4c63-aac2-0d39f0b4d489 tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.026740 Oct 31 14:03:32.951278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 159/294] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:03:32 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:32.956473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de34b94a-37b8-4154-9a84-2812e81fe8fe tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:32.997683 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b5be1c4-23e1-4a4c-9eb7-8f3be0ae71b4 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.118799 Oct 31 14:03:33.004910 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 136/295] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:33.019896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de34b94a-37b8-4154-9a84-2812e81fe8fe tempest-AggregatesAdminTestJSON-30290333 tempest-AggregatesAdminTestJSON-30290333-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.063599 Oct 31 14:03:33.020510 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 160/296] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:32 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 14:03:33.020691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2b9e663-36a8-45ee-993d-6543e8822c1f tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1755214730"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:33.029867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.033307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:33.039807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.aggregate [None req-f2b9e663-36a8-45ee-993d-6543e8822c1f tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 7becae38-cd22-4ae1-983a-88d02782669d for aggregate {{(pid=120641) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:33.050421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.052171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.053549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.057207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.057850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.059632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.061917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f2b9e663-36a8-45ee-993d-6543e8822c1f tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1755214730 already exists. Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2b9e663-36a8-45ee-993d-6543e8822c1f tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 60 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:03:33.068602 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: {"aggregate": {"name": "tempest-test_aggregate-1755214730"}} Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:33.069975 n-d-863052-1 devstack@n-api.service[120641]: exception: Aggregate tempest-test_aggregate-1755214730 already exists. Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1755214730'}}} Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 31 14:03:33.070749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1755214730 already exists. Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:33.071719 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1755214730 already exists. Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1755214730 already exists. Oct 31 14:03:33.073283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.077450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2b9e663-36a8-45ee-993d-6543e8822c1f tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1755214730 already exists. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.078957 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2b9e663-36a8-45ee-993d-6543e8822c1f tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.062463 Oct 31 14:03:33.085826 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 137/297] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:33 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:33.101329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a85ea9d5-37d9-476c-9169-9f37b4f0e450 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.111491 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] HTTP exception thrown: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Request method failure captured: Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 HTTP/1.1 Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V9yv4qVq1ME6U91UrC7KZN_Ons017_HuJ_2Z15OOmX_E5_NJ4MGefic6tCEBTYNcj8M-zrrHWrWJjV8Tg18XF_7tYJApb4HJuL1HqGTzViTTwXulScZA7Yg1GG6j1lJFfhfgOCQG_Is2LT8j9CLvXr0OwHWmxbHNGCpo7_zZYlUHE Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 5fbbd6c8074f46e1bfc5cb308cb7764d Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:33.117136 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fbbd6c8074f46e1bfc5cb308cb7764d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 5fbbd6c8074f46e1bfc5cb308cb7764d Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminTestJSON-910131627-project Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1c62e591cf274302bf84204bdf1f1977 Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminTestJSON-910131627-project Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.118449 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5'} Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.119648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.122673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.126148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Returning 404 to user: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.126148 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efa99f49-133f-4d3d-9118-d7f16e9667b4 tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 404 len: 111 microversion: 2.1 time: 0.093167 Oct 31 14:03:33.128597 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 161/298] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:03:33 2022] DELETE /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:33.155654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.156533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] [instance: bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:33.166378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.167271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.167904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.168897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.169491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.179040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a85ea9d5-37d9-476c-9169-9f37b4f0e450 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.090299 Oct 31 14:03:33.180014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.187146 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 138/299] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:33 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:33.200909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.203092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:33.208959 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] HTTP exception thrown: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Request method failure captured: Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 HTTP/1.1 Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9V9yv4qVq1ME6U91UrC7KZN_Ons017_HuJ_2Z15OOmX_E5_NJ4MGefic6tCEBTYNcj8M-zrrHWrWJjV8Tg18XF_7tYJApb4HJuL1HqGTzViTTwXulScZA7Yg1GG6j1lJFfhfgOCQG_Is2LT8j9CLvXr0OwHWmxbHNGCpo7_zZYlUHE Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 5fbbd6c8074f46e1bfc5cb308cb7764d Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:33.215644 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fbbd6c8074f46e1bfc5cb308cb7764d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fbbd6c8074f46e1bfc5cb308cb7764d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 5fbbd6c8074f46e1bfc5cb308cb7764d Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910131627 Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminTestJSON-910131627-project Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1c62e591cf274302bf84204bdf1f1977 Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminTestJSON-910131627-project Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.216758 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5'} Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.217379 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. Oct 31 14:03:33.218475 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.219422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.219698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.220307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.221199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.221570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] Returning 404 to user: Instance bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.222451 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db4de190-fb3c-4ab8-b52e-27f45d24958b tempest-AggregatesAdminTestJSON-910131627 tempest-AggregatesAdminTestJSON-910131627-project] 10.222.0.27 "GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5" status: 404 len: 111 microversion: 2.1 time: 0.092631 Oct 31 14:03:33.223016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.226792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.226959 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 162/300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/servers/bb6d2520-3fed-45a2-a8c4-973bd8c6ebf5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:33.233767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62572bd0-7dad-495d-940c-c0615ecaf040 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749813319"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:33.242214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-62572bd0-7dad-495d-940c-c0615ecaf040 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 1639f539-cfe0-48a8-9617-45e7d7a6e6a1 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:33.246554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=85,nova_api:DELETE=9 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:33.288509 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62572bd0-7dad-495d-940c-c0615ecaf040 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059993 Oct 31 14:03:33.289107 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 163/301] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:33.305125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee3eedc9-0df5-49ce-bf82-5f05cb2e344d tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.306975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee3eedc9-0df5-49ce-bf82-5f05cb2e344d tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2e963ad90927487db6dd948cbecdfd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a07a9460a248a5873f4e065ebaf7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee3eedc9-0df5-49ce-bf82-5f05cb2e344d tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Request method failure captured: Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WK_mrbltBuz9-NQd4wV7KA2x4ZufN1ZRvJQNjSwlYmRUKUYOK2lJ3j8Siv7kTEhIFGWdp_c56ECymFGajWC8RVFvg4blUl4UqQYCkTv431MNrA4eH0sLv0wT1edG367zA3KzDthYY7cgK6r5r4qskucE4CHYse3XwY00H81maf7Ow Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:33.310870 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9a07a9460a248a5873f4e065ebaf7c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2e963ad90927487db6dd948cbecdfd3b Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 14:03:33.312010 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '15'} Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:33.312736 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.313777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee3eedc9-0df5-49ce-bf82-5f05cb2e344d tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.314764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee3eedc9-0df5-49ce-bf82-5f05cb2e344d tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.013134 Oct 31 14:03:33.316546 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 164/302] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:33 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:33.324212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ceb595bf-3a1b-4bc8-ae5a-19aaee7d6474 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.347073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ceb595bf-3a1b-4bc8-ae5a-19aaee7d6474 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.029438 Oct 31 14:03:33.348266 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 165/303] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:33 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:33.357869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4796715c-476d-41ff-88d8-f76a281235d1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.369273 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4796715c-476d-41ff-88d8-f76a281235d1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4796715c-476d-41ff-88d8-f76a281235d1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:33.371338 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: exception: Aggregate -1 could not be found. Oct 31 14:03:33.372797 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '-1'} Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 14:03:33.373583 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.379031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4796715c-476d-41ff-88d8-f76a281235d1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4796715c-476d-41ff-88d8-f76a281235d1 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020428 Oct 31 14:03:33.380099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 166/304] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:33 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:03:33.384421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-456b56f6-e391-4a61-99d5-c01d5a71f884 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-420968993"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:33.388249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-456b56f6-e391-4a61-99d5-c01d5a71f884 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 6fd63991-7d3a-4ea7-87d2-1c57bbe1c52f for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:33.417037 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-456b56f6-e391-4a61-99d5-c01d5a71f884 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036282 Oct 31 14:03:33.418586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 167/305] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:33.437441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.438927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:33.449199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.450123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.450897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.451900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.452505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.453751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.631651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:33.641674 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-941b57d6-de95-4828-a5f2-968f4a607462 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.452327 Oct 31 14:03:33.661091 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 139/306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:33.669149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51807349-7736-457b-97f9-20d229a84137 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.678985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-51807349-7736-457b-97f9-20d229a84137 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2e963ad90927487db6dd948cbecdfd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a07a9460a248a5873f4e065ebaf7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51807349-7736-457b-97f9-20d229a84137 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Request method failure captured: Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WK_mrbltBuz9-NQd4wV7KA2x4ZufN1ZRvJQNjSwlYmRUKUYOK2lJ3j8Siv7kTEhIFGWdp_c56ECymFGajWC8RVFvg4blUl4UqQYCkTv431MNrA4eH0sLv0wT1edG367zA3KzDthYY7cgK6r5r4qskucE4CHYse3XwY00H81maf7Ow Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:03:33.689513 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9a07a9460a248a5873f4e065ebaf7c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 2e963ad90927487db6dd948cbecdfd3b Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 14:03:33.690768 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '16'} Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:33.691412 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.692377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51807349-7736-457b-97f9-20d229a84137 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.693242 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-51807349-7736-457b-97f9-20d229a84137 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.029282 Oct 31 14:03:33.696143 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 140/307] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:33.708394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-962834ec-798e-47e5-b6eb-ece108bc6f2a tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.720319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:33.781816 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-962834ec-798e-47e5-b6eb-ece108bc6f2a tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.078058 Oct 31 14:03:33.783579 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 141/308] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:33 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:33.797179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29fba221-43c3-4b7f-b756-501312e6a61e tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.807589 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-29fba221-43c3-4b7f-b756-501312e6a61e tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29fba221-43c3-4b7f-b756-501312e6a61e tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:03:33.810159 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: exception: Aggregate -1 could not be found. Oct 31 14:03:33.811455 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '-1'} Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.812172 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 31 14:03:33.813191 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.816091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29fba221-43c3-4b7f-b756-501312e6a61e tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.817368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29fba221-43c3-4b7f-b756-501312e6a61e tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029355 Oct 31 14:03:33.823566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:33.834418 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 142/309] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:33.842329 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8f386de-fec1-4a10-adc6-7dc4dea75b1c tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1313 microversion: 2.1 time: 0.413489 Oct 31 14:03:33.846633 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 168/310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:33.850811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4168b81e-25c5-4e50-9ef6-ed4ea9d3e1b7 req-c813c054-f0d5-4253-b4db-aed15b7f7f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af71f3-df25-4ad4-967b-5414eaf8577a", "name": "network-vif-plugged", "status": "completed", "tag": "c8104c9c-f975-4500-a421-dcafe812be76"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:33.860135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c585e36-ec90-44a5-abbe-0c9774795a75 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.861940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c585e36-ec90-44a5-abbe-0c9774795a75 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2e963ad90927487db6dd948cbecdfd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a07a9460a248a5873f4e065ebaf7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c585e36-ec90-44a5-abbe-0c9774795a75 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Request method failure captured: Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WK_mrbltBuz9-NQd4wV7KA2x4ZufN1ZRvJQNjSwlYmRUKUYOK2lJ3j8Siv7kTEhIFGWdp_c56ECymFGajWC8RVFvg4blUl4UqQYCkTv431MNrA4eH0sLv0wT1edG367zA3KzDthYY7cgK6r5r4qskucE4CHYse3XwY00H81maf7Ow Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:33.867700 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9a07a9460a248a5873f4e065ebaf7c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2e963ad90927487db6dd948cbecdfd3b Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 14:03:33.869036 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:33.869672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:33.870674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c585e36-ec90-44a5-abbe-0c9774795a75 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:33.873058 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c585e36-ec90-44a5-abbe-0c9774795a75 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024215 Oct 31 14:03:33.875648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 169/311] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:33.884446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4168b81e-25c5-4e50-9ef6-ed4ea9d3e1b7 req-c813c054-f0d5-4253-b4db-aed15b7f7f7f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.889742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4168b81e-25c5-4e50-9ef6-ed4ea9d3e1b7 req-c813c054-f0d5-4253-b4db-aed15b7f7f7f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.890239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4168b81e-25c5-4e50-9ef6-ed4ea9d3e1b7 req-c813c054-f0d5-4253-b4db-aed15b7f7f7f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.892242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-90bd8fe3-1004-41b0-b9d5-645e72327772 req-d0c150fd-ad6f-48a5-98da-43869d53d7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02a333c-6593-4778-94cc-f5da011be94d", "tag": "2aed93f8-b2f3-467c-b642-7a8a41b36ece"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:33.904646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90bd8fe3-1004-41b0-b9d5-645e72327772 req-d0c150fd-ad6f-48a5-98da-43869d53d7bb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.905933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90bd8fe3-1004-41b0-b9d5-645e72327772 req-d0c150fd-ad6f-48a5-98da-43869d53d7bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.906630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90bd8fe3-1004-41b0-b9d5-645e72327772 req-d0c150fd-ad6f-48a5-98da-43869d53d7bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.919067 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-90bd8fe3-1004-41b0-b9d5-645e72327772 req-d0c150fd-ad6f-48a5-98da-43869d53d7bb service nova] Creating event network-changed:2aed93f8-b2f3-467c-b642-7a8a41b36ece for instance d02a333c-6593-4778-94cc-f5da011be94d on n-h1-863052-1 Oct 31 14:03:33.920044 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4168b81e-25c5-4e50-9ef6-ed4ea9d3e1b7 req-c813c054-f0d5-4253-b4db-aed15b7f7f7f service nova] Creating event network-vif-plugged:c8104c9c-f975-4500-a421-dcafe812be76 for instance 60af71f3-df25-4ad4-967b-5414eaf8577a on n-h2-863052-1 Oct 31 14:03:33.928619 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-90bd8fe3-1004-41b0-b9d5-645e72327772 req-d0c150fd-ad6f-48a5-98da-43869d53d7bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049865 Oct 31 14:03:33.932650 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 170/312] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:33.933693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4168b81e-25c5-4e50-9ef6-ed4ea9d3e1b7 req-c813c054-f0d5-4253-b4db-aed15b7f7f7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097514 Oct 31 14:03:33.936892 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 143/313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:33.949468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:33.956556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:33.957621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-627db003-b127-468e-976c-fd8884f973b9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1233039150"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:33.966070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.966306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-627db003-b127-468e-976c-fd8884f973b9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 4ee5ea74-d3b1-4da6-b28b-74329be3f611 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:33.971146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.973828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:33.976972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:33.980136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:33.981456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.028997 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-627db003-b127-468e-976c-fd8884f973b9 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091853 Oct 31 14:03:34.039317 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 171/314] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:34.049823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5c8ab6c-188c-4cb5-970e-26c42616f7d7 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:34.090318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5c8ab6c-188c-4cb5-970e-26c42616f7d7 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.091291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5c8ab6c-188c-4cb5-970e-26c42616f7d7 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.091919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5c8ab6c-188c-4cb5-970e-26c42616f7d7 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.424077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:34.432336 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2e106ec0-adc6-4f45-8b6e-aeef4eae00fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1389 microversion: 2.1 time: 0.493852 Oct 31 14:03:34.433015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 144/315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:33 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1389 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:34.457348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5c8ab6c-188c-4cb5-970e-26c42616f7d7 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.416504 Oct 31 14:03:34.459022 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 172/316] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:03:34 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:34.472036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f1042f5-ae7e-4e78-b062-fe1a9e2b7bb1 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:34.476102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f1042f5-ae7e-4e78-b062-fe1a9e2b7bb1 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2e963ad90927487db6dd948cbecdfd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a07a9460a248a5873f4e065ebaf7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f1042f5-ae7e-4e78-b062-fe1a9e2b7bb1 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Request method failure captured: Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 42 Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WK_mrbltBuz9-NQd4wV7KA2x4ZufN1ZRvJQNjSwlYmRUKUYOK2lJ3j8Siv7kTEhIFGWdp_c56ECymFGajWC8RVFvg4blUl4UqQYCkTv431MNrA4eH0sLv0wT1edG367zA3KzDthYY7cgK6r5r4qskucE4CHYse3XwY00H81maf7Ow Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:03:34.478879 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9a07a9460a248a5873f4e065ebaf7c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9a07a9460a248a5873f4e065ebaf7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c9a07a9460a248a5873f4e065ebaf7c4 Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859 Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 2e963ad90927487db6dd948cbecdfd3b Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1680999859-project Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: {"remove_host": {"host": "n-h2-863052-1"}} Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:03:34.480072 n-d-863052-1 devstack@n-api.service[120641]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-863052-1'}}} Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:34.480797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 14:03:34.481749 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.484668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f1042f5-ae7e-4e78-b062-fe1a9e2b7bb1 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:34.485759 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f1042f5-ae7e-4e78-b062-fe1a9e2b7bb1 tempest-AggregatesAdminNegativeTestJSON-1680999859 tempest-AggregatesAdminNegativeTestJSON-1680999859-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018385 Oct 31 14:03:34.486996 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 145/317] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:03:34 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:34.495578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24b468ef-2663-45cb-ac76-a268e6d02dc3 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:34.511398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b468ef-2663-45cb-ac76-a268e6d02dc3 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.512117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b468ef-2663-45cb-ac76-a268e6d02dc3 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.512748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b468ef-2663-45cb-ac76-a268e6d02dc3 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.683033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:34.687301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:34.712738 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24b468ef-2663-45cb-ac76-a268e6d02dc3 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.221538 Oct 31 14:03:34.715948 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 173/318] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:03:34 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:34.720276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.721500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.722895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.723764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.724329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.730222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.731732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0bb484b-ebef-4df8-84fc-2fa95b412bef tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:34.790856 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0bb484b-ebef-4df8-84fc-2fa95b412bef tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.064740 Oct 31 14:03:34.791683 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 174/319] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:34 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:34.802123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a076eced-b110-492e-8627-c49c9d75cd0b tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-661813844"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:34.807894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-a076eced-b110-492e-8627-c49c9d75cd0b tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Generated uuid 2264b176-546f-45a3-8ec2-0e2e586a5508 for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:03:34.846547 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a076eced-b110-492e-8627-c49c9d75cd0b tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049340 Oct 31 14:03:34.847161 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 175/320] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:03:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:34.860511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:34.874992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.875495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.875935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.884251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.885396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.885765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.896159 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.compute.aggregates [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 31 14:03:34.896690 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Request method failure captured: Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 42 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WO8wYkr_nolbZBWT3KL60kfidWjy4GXhqwd3wxZ-YTUqIIV2axmpYftboZA-D_xZ7xJBibYi6BTbIKBDon4TynxntrCo_MS64rODDWHbDOaL3jmvPpSTd6wHeGZiGTrxGcmcBJX14AfhchChBfwukaHFje2-ciS8q1nlPpfq-IMr8 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:34.898996 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afe37b1fce88465d8d79edfc09cf7ae5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afe37b1fce88465d8d79edfc09cf7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: afe37b1fce88465d8d79edfc09cf7ae5 Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850 Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 22d42e6503244847acb9f74bc96e1109 Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: {"remove_host": {"host": "nonexist_host"}} Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:34.900262 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 31 14:03:34.900960 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 31 14:03:34.905269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.908325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6305646-2bd0-4aae-8940-fb37671455ad tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.045517 Oct 31 14:03:34.911323 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 176/321] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:03:34 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:03:34.927654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:34.928312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:34.939009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.939525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.939943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:34.940667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:34.941126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:34.941550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:35.049248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:35.058541 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cd6feb0-092b-4227-9615-ea3a93b510e4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.391427 Oct 31 14:03:35.070722 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 146/322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:34 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:35.070722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3126234e-1aab-4c0d-ab54-425f8092fc54 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:35.096193 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3126234e-1aab-4c0d-ab54-425f8092fc54 tempest-AggregatesAdminNegativeTestJSON-1865692850 tempest-AggregatesAdminNegativeTestJSON-1865692850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.034687 Oct 31 14:03:35.096925 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 147/323] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:03:35 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 14:03:35.334011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:35.346949 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-458d833c-5942-4ad9-958c-86ea4b9c46a0 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1313 microversion: 2.1 time: 0.444128 Oct 31 14:03:35.348831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 177/324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:34 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:35.458417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:35.459811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:35.471518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:35.472028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:35.472676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:35.473541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:35.474199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:35.474898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:35.565699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:35.693720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:35.703527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad5c9cd6-5937-4166-adc5-5f17aae0110b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1588 microversion: 2.1 time: 0.249625 Oct 31 14:03:35.704424 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 148/325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:35 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1588 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:35.728051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:35.729628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:35.739418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:35.740027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:35.740680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:35.741610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:35.742336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:35.742975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:35.904285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a61f118-5aff-4ffc-8721-1c1d933341ba tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180731 Oct 31 14:03:35.905154 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 178/326] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:03:35 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:36.086977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:36.088301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:36.100675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:36.101199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:36.103663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:36.106382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:36.106890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:36.107337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:36.374368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:36.375243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:36.386063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:36.389747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:36.390922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:36.397896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:36.398982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:36.399616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:36.503154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:36.515155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-54e325b8-6add-4c18-a28a-a04a8984125c tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.434579 Oct 31 14:03:36.517989 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 149/327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:36 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:36.937863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:36.945558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f09a7e5a-6b5b-46a7-9f61-616f10d51a6a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1313 microversion: 2.1 time: 0.574938 Oct 31 14:03:36.946139 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 179/328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:36 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:37.542950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:37.543722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:37.557084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:37.557591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:37.558080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:37.561663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:37.562145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:37.562921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:37.710066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d3532a7d-e34b-4ffb-8676-f06834645c90 req-281e4114-f18b-47be-bbcd-d71991d4634c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538405c5-19b1-401b-beb0-1e7de6a26783", "name": "network-vif-plugged", "status": "completed", "tag": "d08d2f1d-92d6-4cb6-b6f3-2004c089cf9f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:37.719456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:37.725630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d3532a7d-e34b-4ffb-8676-f06834645c90 req-281e4114-f18b-47be-bbcd-d71991d4634c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:37.730633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d3532a7d-e34b-4ffb-8676-f06834645c90 req-281e4114-f18b-47be-bbcd-d71991d4634c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:37.731227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d3532a7d-e34b-4ffb-8676-f06834645c90 req-281e4114-f18b-47be-bbcd-d71991d4634c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:37.764569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d3532a7d-e34b-4ffb-8676-f06834645c90 req-281e4114-f18b-47be-bbcd-d71991d4634c service nova] Creating event network-vif-plugged:d08d2f1d-92d6-4cb6-b6f3-2004c089cf9f for instance 538405c5-19b1-401b-beb0-1e7de6a26783 on n-h2-863052-1 Oct 31 14:03:37.773523 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d3532a7d-e34b-4ffb-8676-f06834645c90 req-281e4114-f18b-47be-bbcd-d71991d4634c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066271 Oct 31 14:03:37.780461 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 180/329] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:37.828276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=53,nova_cell0:UPDATE=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:37.978337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:37.980242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:37.992406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:37.992923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:37.993363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:37.999771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:38.002114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:38.002780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:38.095956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:38.104418 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9f36bd4-b0ef-4378-b86d-592688302147 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.568962 Oct 31 14:03:38.107935 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 150/330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:37 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:38.301307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:38.309895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9280466-0c09-4c6b-9c90-3f57d1eb7fff tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1313 microversion: 2.1 time: 0.335853 Oct 31 14:03:38.325168 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 181/331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:37 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:38.559851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:38.561296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:38.568167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:38.573580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-55447aa9-00f3-4317-b5cd-e384f17fcd2b req-ba859868-5c05-4d9b-9b12-46b344e461b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60af71f3-df25-4ad4-967b-5414eaf8577a", "tag": "c8104c9c-f975-4500-a421-dcafe812be76"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:38.578898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:38.580833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:38.581793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:38.585585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-55447aa9-00f3-4317-b5cd-e384f17fcd2b req-ba859868-5c05-4d9b-9b12-46b344e461b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:38.586379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:38.587086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:38.591289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-55447aa9-00f3-4317-b5cd-e384f17fcd2b req-ba859868-5c05-4d9b-9b12-46b344e461b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:38.591924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-55447aa9-00f3-4317-b5cd-e384f17fcd2b req-ba859868-5c05-4d9b-9b12-46b344e461b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:38.616404 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-55447aa9-00f3-4317-b5cd-e384f17fcd2b req-ba859868-5c05-4d9b-9b12-46b344e461b0 service nova] Creating event network-changed:c8104c9c-f975-4500-a421-dcafe812be76 for instance 60af71f3-df25-4ad4-967b-5414eaf8577a on n-h2-863052-1 Oct 31 14:03:38.630424 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-55447aa9-00f3-4317-b5cd-e384f17fcd2b req-ba859868-5c05-4d9b-9b12-46b344e461b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060555 Oct 31 14:03:38.631365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 182/332] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:39.132182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:39.139144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:39.154125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:39.157334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:39.160411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:39.162575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:39.163191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:39.164138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:39.188333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:39.200173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a2fcfc6-d9b3-464b-83c7-9a7adc3f323a tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 200 len: 1588 microversion: 2.1 time: 0.642980 Oct 31 14:03:39.206394 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 151/333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:38 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 1588 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:39.335501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:39.336139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:39.353577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:39.354081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:39.354553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:39.355278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:39.359311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:39.360366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:39.993876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:40.004998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-020de6c7-9a84-4bb8-ad6e-cf57f35a90fb tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.877027 Oct 31 14:03:40.026872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 183/334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:39 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:40.440836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c26a2c3d-7e24-42b8-960c-75afc50a592b req-7637dd3e-a2bc-48df-8203-92bc8d7e0fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02a333c-6593-4778-94cc-f5da011be94d", "name": "network-vif-plugged", "status": "completed", "tag": "2aed93f8-b2f3-467c-b642-7a8a41b36ece"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:40.455211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:40.473055 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a9e11ff-e71d-4a3b-8098-4f1dcb5ef9ab tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1463 microversion: 2.1 time: 1.144427 Oct 31 14:03:40.473799 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 152/335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:39 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1463 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:40.518769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c26a2c3d-7e24-42b8-960c-75afc50a592b req-7637dd3e-a2bc-48df-8203-92bc8d7e0fed service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:40.523692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c26a2c3d-7e24-42b8-960c-75afc50a592b req-7637dd3e-a2bc-48df-8203-92bc8d7e0fed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:40.524237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c26a2c3d-7e24-42b8-960c-75afc50a592b req-7637dd3e-a2bc-48df-8203-92bc8d7e0fed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:40.591398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c26a2c3d-7e24-42b8-960c-75afc50a592b req-7637dd3e-a2bc-48df-8203-92bc8d7e0fed service nova] Creating event network-vif-plugged:2aed93f8-b2f3-467c-b642-7a8a41b36ece for instance d02a333c-6593-4778-94cc-f5da011be94d on n-h1-863052-1 Oct 31 14:03:40.608508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c26a2c3d-7e24-42b8-960c-75afc50a592b req-7637dd3e-a2bc-48df-8203-92bc8d7e0fed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171523 Oct 31 14:03:40.612230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 184/336] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:41.021327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Calling method '.version_select at 0x7fe10c35c700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:41.035151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:41.035994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:41.038647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.039392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.040045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.047857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.048359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.048802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.055157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.055711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.056854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.082475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.083752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.086944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.126016 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cc75ee0-98c0-4e67-a6c8-7d254cc460a9 tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/584b25a1002a45b88dcc9b2483201512?start=2022-10-30T14%3A03%3A40.489046&end=2022-11-01T14%3A03%3A40.489046" status: 200 len: 694 microversion: 2.1 time: 0.630992 Oct 31 14:03:41.127783 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 153/337] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 31 14:03:40 2022] GET /compute/v2.1/os-simple-tenant-usage/584b25a1002a45b88dcc9b2483201512?start=2022-10-30T14%3A03%3A40.489046&end=2022-11-01T14%3A03%3A40.489046 => generated 694 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:41.144916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '.version_select at 0x7fe10c2d9d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:41.170804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.172277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.172895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.187749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.188988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.189763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.208409 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f3af36c-d4ed-4c52-a4f6-cfac7c53454a tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/584b25a1002a45b88dcc9b2483201512?start=2022-10-30T14%3A03%3A40.489046&end=2022-11-01T14%3A03%3A40.489046" status: 200 len: 649 microversion: 2.1 time: 0.067790 Oct 31 14:03:41.209867 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 154/338] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 31 14:03:41 2022] GET /compute/v2.1/os-simple-tenant-usage/584b25a1002a45b88dcc9b2483201512?start=2022-10-30T14%3A03%3A40.489046&end=2022-11-01T14%3A03%3A40.489046 => generated 649 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:41.224426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Calling method '.version_select at 0x7fe10c3119d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:41.243424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.244555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.244996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.266312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.267354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.267959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.305920 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f144c0d6-5f8e-4225-b66f-d83106ea0d3d tempest-TenantUsagesTestJSON-920266299 tempest-TenantUsagesTestJSON-920266299-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T14%3A03%3A40.489046&end=2022-11-01T14%3A03%3A40.489046&detailed=1" status: 200 len: 2761 microversion: 2.1 time: 0.085290 Oct 31 14:03:41.331235 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 155/339] 10.222.0.27 () {58 vars in 1335 bytes} [Mon Oct 31 14:03:41 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T14%3A03%3A40.489046&end=2022-11-01T14%3A03%3A40.489046&detailed=1 => generated 2761 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:41.344252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:41.345381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:41.358877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.361248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.361500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.362365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.362858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.363288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.402529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:03:41.585861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-783eb801-60a9-4666-8ace-dd4e8af4eb82 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "DELETE /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 204 len: 0 microversion: 2.1 time: 0.252001 Oct 31 14:03:41.592047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 156/340] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:03:41 2022] DELETE /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:03:41.600255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:41.600960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:41.618112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.619781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.620230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.621930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:41.624986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:41.625517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:41.799416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:41.808621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1322 microversion: 2.1 time: 0.777960 Oct 31 14:03:41.819265 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 185/341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:41 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:42.193227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:42.209854 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a0f64b2-fe21-4c15-b839-cb5116ee5d0f tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1469 microversion: 2.1 time: 0.614116 Oct 31 14:03:42.215968 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 157/342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:41 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1469 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:42.244604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:42.245790 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-925067c2-8e94-41d3-904f-3c4acb8d28bf tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002453 Oct 31 14:03:42.254675 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 186/343] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 31 14:03:42 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 14:03:42.845718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:42.846492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:42.863716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:42.864483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:42.865380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:42.873560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:42.874912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:42.882735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:43.240477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:43.241817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:43.251281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:43.252995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:43.254083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:43.255911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:43.257686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:43.259601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:43.360963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:43.370738 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-406f0b8d-3700-40cb-beb9-fc11fcb62648 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 200 len: 1518 microversion: 2.1 time: 0.529894 Oct 31 14:03:43.390933 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 158/344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:42 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 1518 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:43.400876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'action', calling method: .version_select at 0x7fe10d70d8b0>, body: {"addFloatingIp": {"address": "172.25.9.162"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:43.406458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:43.416541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:43.417576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:43.418754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:43.419960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:43.421715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:43.422584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:43.477241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:43.574639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:03:43.578303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquired lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:03:43.627684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:43.646981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcc6b363-c1c4-444f-84b7-87662c3dcdb1 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1469 microversion: 2.1 time: 0.402546 Oct 31 14:03:43.647850 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 187/345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:43 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:43.912587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a67daafc-e968-4844-bc6e-7694f830d374 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:43.920727 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a67daafc-e968-4844-bc6e-7694f830d374 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.248134 Oct 31 14:03:43.921661 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 188/346] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:43.935607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d850c51a-60e9-4ffb-be61-acca03236a39 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:43.994478 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d850c51a-60e9-4ffb-be61-acca03236a39 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3079 microversion: 2.1 time: 0.061917 Oct 31 14:03:43.998291 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 189/347] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:03:43 2022] GET /compute/v2.1/flavors => generated 3079 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:44.013890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f83292b-7418-4574-bdad-bf1ded5492d9 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.054070 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f83292b-7418-4574-bdad-bf1ded5492d9 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046700 Oct 31 14:03:44.064420 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 190/348] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:44.084044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2bcc0980-6526-4767-a49d-4f089898e58c tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.113902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2bcc0980-6526-4767-a49d-4f089898e58c tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040421 Oct 31 14:03:44.117759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 191/349] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:44.132880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bdca77e-02c1-460a-9df7-788f92fad76a tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.225150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bdca77e-02c1-460a-9df7-788f92fad76a tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.094835 Oct 31 14:03:44.226233 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 192/350] 10.222.0.27 () {58 vars in 1165 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:44.244883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5db4e4d5-6a83-4f69-a9ed-8f884b0c96b6 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.259873 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5db4e4d5-6a83-4f69-a9ed-8f884b0c96b6 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020054 Oct 31 14:03:44.299392 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 193/351] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:44.319186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3da3860-fd4c-4055-904b-7d2495735cf0 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.393248 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3da3860-fd4c-4055-904b-7d2495735cf0 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.083983 Oct 31 14:03:44.409875 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 194/352] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:03:44.424452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6002d1df-2e29-4ee1-844f-98f915be0165 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.450785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6002d1df-2e29-4ee1-844f-98f915be0165 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.039283 Oct 31 14:03:44.461949 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 195/353] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:44.470872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8765311a-5e6b-437e-9d5d-bb5d8323275f tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.491129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8765311a-5e6b-437e-9d5d-bb5d8323275f tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026096 Oct 31 14:03:44.493658 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 196/354] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:44.505607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85d01182-22f1-4a62-864a-732b4d6a4e18 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.549173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:44.621330 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85d01182-22f1-4a62-864a-732b4d6a4e18 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.119439 Oct 31 14:03:44.622184 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 197/355] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:44.641520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9761090-eb06-47ed-9a76-9abf0fc388dd tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.664726 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9761090-eb06-47ed-9a76-9abf0fc388dd tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028140 Oct 31 14:03:44.666407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 198/356] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:44.679170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1bb697ba-1bba-4216-b69b-6fe967ded6f8 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.737698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1bb697ba-1bba-4216-b69b-6fe967ded6f8 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.046991 Oct 31 14:03:44.747786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 199/357] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:44.764844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:44.765791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:44.780282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:44.782778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:44.784357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:44.785263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:44.788489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:44.789672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:44.882057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=14 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:45.259303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0611d0454bef41cfafdd8ff359cd1f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b25a1002a45b88dcc9b2483201512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:45.281968 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6572eef6-60cc-4fa3-865f-62bfc34f3964 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 200 len: 1427 microversion: 2.1 time: 0.533091 Oct 31 14:03:45.282596 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 200/358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:44 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 1427 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:45.308206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f91cc5e-156d-407a-977e-e62d7eee51cb tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:45.317792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f91cc5e-156d-407a-977e-e62d7eee51cb tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024318 Oct 31 14:03:45.326064 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 201/359] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:46.043961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Calling method '.version_select at 0x7fe10c1db4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.048683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:46.051198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:46.051657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:46.057606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:46.063446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:46.063981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:46.167720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f601c66-29f8-4841-a470-41dfe7d990d5 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.840081 Oct 31 14:03:46.176541 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 202/360] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 31 14:03:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:46.183577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ee8f648e-c040-41c6-8702-f8dde27990e6 req-825fa46e-02d1-48fd-92a8-93fcb8d03ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538405c5-19b1-401b-beb0-1e7de6a26783", "name": "network-vif-deleted", "tag": "d08d2f1d-92d6-4cb6-b6f3-2004c089cf9f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:46.197424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ee8f648e-c040-41c6-8702-f8dde27990e6 req-825fa46e-02d1-48fd-92a8-93fcb8d03ced service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:46.198210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ee8f648e-c040-41c6-8702-f8dde27990e6 req-825fa46e-02d1-48fd-92a8-93fcb8d03ced service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:46.198856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ee8f648e-c040-41c6-8702-f8dde27990e6 req-825fa46e-02d1-48fd-92a8-93fcb8d03ced service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:46.213568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ee8f648e-c040-41c6-8702-f8dde27990e6 req-825fa46e-02d1-48fd-92a8-93fcb8d03ced service nova] Creating event network-vif-deleted:d08d2f1d-92d6-4cb6-b6f3-2004c089cf9f for instance 538405c5-19b1-401b-beb0-1e7de6a26783 on n-h2-863052-1 Oct 31 14:03:46.219622 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ee8f648e-c040-41c6-8702-f8dde27990e6 req-825fa46e-02d1-48fd-92a8-93fcb8d03ced service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040375 Oct 31 14:03:46.220838 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 203/361] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:46.230150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ee9a9d7-4fc1-4576-8668-1596322c7c93 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.251745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ee9a9d7-4fc1-4576-8668-1596322c7c93 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029342 Oct 31 14:03:46.253113 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 204/362] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:46.558622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02efa460-5860-4a13-af09-9f709780e990 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Calling method '.version_select at 0x7fe10c3d75e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.567057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02efa460-5860-4a13-af09-9f709780e990 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c424a25c9a2b48e38d1d8c1587e898da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc29786db35b4fa7a3494d7d84b68419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02efa460-5860-4a13-af09-9f709780e990 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Request method failure captured: Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9W_kS6Bukv1Hx8LspjaoRRjx3B0WZw9kUUnol2E-DdrDsl9Rye39CMxhXaA0df3epskqT5gulveAUflQS0aCh2wFRUOGzh1NeMv5R-B8bWNvroBFPZkK-fIA9C2V7QiRDv2gnGrOZoZqUz8qqG05TrYrBm4glywlQHtpA2XBbJqh0U Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:46.569871 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc29786db35b4fa7a3494d7d84b68419", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c424a25c9a2b48e38d1d8c1587e898da Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:03:46.571255 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:46.572066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 14:03:46.573300 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.575432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02efa460-5860-4a13-af09-9f709780e990 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:46.577014 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02efa460-5860-4a13-af09-9f709780e990 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.322144 Oct 31 14:03:46.577757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 205/363] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 324 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:46.594758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27709710-3b73-4f12-be09-8eb063dc5dbc tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.628834 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27709710-3b73-4f12-be09-8eb063dc5dbc tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.041086 Oct 31 14:03:46.630001 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 206/364] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:46.634996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.635940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] [instance: 538405c5-19b1-401b-beb0-1e7de6a26783] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:46.643832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:46.644615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:46.645225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:46.645949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:46.646452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:46.646877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:46.683009 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] HTTP exception thrown: Instance 538405c5-19b1-401b-beb0-1e7de6a26783 could not be found. Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Request method failure captured: Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 HTTP/1.1 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Wq7AkG8fvCkMPx5Fvg0iDLb-IBbHDP23bsRwrGWM9JNULurdfZe_RgTvlKdz5U0d7YXm-nHruNrC4IQeebod0qbOM6I_lw6V9-jDgZImNAdG77Ahp10XamcdvwyWQzX_YX1A34YiWVIF6_klnkYm0g6sj7fD2UzV1PT5r5H02Nvu4 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 584b25a1002a45b88dcc9b2483201512 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TenantUsagesTestJSON-1160647053 Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:46.688292 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_584b25a1002a45b88dcc9b2483201512", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/584b25a1002a45b88dcc9b2483201512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/584b25a1002a45b88dcc9b2483201512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/584b25a1002a45b88dcc9b2483201512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TenantUsagesTestJSON-1160647053 Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 584b25a1002a45b88dcc9b2483201512 Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1160647053 Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TenantUsagesTestJSON-1160647053-project Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 0611d0454bef41cfafdd8ff359cd1f3d Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TenantUsagesTestJSON-1160647053-project Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 538405c5-19b1-401b-beb0-1e7de6a26783 could not be found. Oct 31 14:03:46.689469 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '538405c5-19b1-401b-beb0-1e7de6a26783'} Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538405c5-19b1-401b-beb0-1e7de6a26783 could not be found. Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:46.690204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538405c5-19b1-401b-beb0-1e7de6a26783 could not be found. Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538405c5-19b1-401b-beb0-1e7de6a26783 could not be found. Oct 31 14:03:46.691741 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.696296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] Returning 404 to user: Instance 538405c5-19b1-401b-beb0-1e7de6a26783 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:46.697963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9456566-af1d-41cd-a594-f379e54f7dc2 tempest-TenantUsagesTestJSON-1160647053 tempest-TenantUsagesTestJSON-1160647053-project] 10.222.0.27 "GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783" status: 404 len: 111 microversion: 2.1 time: 0.066756 Oct 31 14:03:46.702270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 207/365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/servers/538405c5-19b1-401b-beb0-1e7de6a26783 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:46.708587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d88c8068-515b-4220-9b0e-f8f232d2a654 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Calling method '.version_select at 0x7fe10c19cc10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.711188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d88c8068-515b-4220-9b0e-f8f232d2a654 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c424a25c9a2b48e38d1d8c1587e898da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc29786db35b4fa7a3494d7d84b68419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d88c8068-515b-4220-9b0e-f8f232d2a654 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Request method failure captured: Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/n-d-863052-1/reboot HTTP/1.1 Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9W_kS6Bukv1Hx8LspjaoRRjx3B0WZw9kUUnol2E-DdrDsl9Rye39CMxhXaA0df3epskqT5gulveAUflQS0aCh2wFRUOGzh1NeMv5R-B8bWNvroBFPZkK-fIA9C2V7QiRDv2gnGrOZoZqUz8qqG05TrYrBm4glywlQHtpA2XBbJqh0U Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:46.715634 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc29786db35b4fa7a3494d7d84b68419", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c424a25c9a2b48e38d1d8c1587e898da Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1'} Oct 31 14:03:46.716848 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:46.717552 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 14:03:46.718589 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.722841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d88c8068-515b-4220-9b0e-f8f232d2a654 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:46.723941 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d88c8068-515b-4220-9b0e-f8f232d2a654 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-863052-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019768 Oct 31 14:03:46.724650 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 208/366] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/os-hosts/n-d-863052-1/reboot => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:46.734028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4d4b864-1aca-4b0d-9656-15908ecc6d1d tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.743960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4d4b864-1aca-4b0d-9656-15908ecc6d1d tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013012 Oct 31 14:03:46.750227 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 209/367] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:46.778824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db44741a-cee1-47ad-8ee0-54bf25ad378b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Calling method '.version_select at 0x7fe10c3d7a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.792146 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-db44741a-cee1-47ad-8ee0-54bf25ad378b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db44741a-cee1-47ad-8ee0-54bf25ad378b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:46.794032 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'nonexistent_hostname'} Oct 31 14:03:46.795527 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:46.796380 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 14:03:46.797458 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db44741a-cee1-47ad-8ee0-54bf25ad378b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:46.798508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db44741a-cee1-47ad-8ee0-54bf25ad378b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051657 Oct 31 14:03:46.803526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 210/368] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:46.808695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d671f30d-b569-4ef8-9bd9-06d70a160995 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.867044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d671f30d-b569-4ef8-9bd9-06d70a160995 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.062176 Oct 31 14:03:46.879353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 211/369] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:46.884904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af3897af-7f1d-44ca-b9e6-92834265a5f5 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Calling method '.version_select at 0x7fe10c0f88b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.887011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-af3897af-7f1d-44ca-b9e6-92834265a5f5 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c424a25c9a2b48e38d1d8c1587e898da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc29786db35b4fa7a3494d7d84b68419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af3897af-7f1d-44ca-b9e6-92834265a5f5 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Request method failure captured: Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/n-d-863052-1 HTTP/1.1 Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9W_kS6Bukv1Hx8LspjaoRRjx3B0WZw9kUUnol2E-DdrDsl9Rye39CMxhXaA0df3epskqT5gulveAUflQS0aCh2wFRUOGzh1NeMv5R-B8bWNvroBFPZkK-fIA9C2V7QiRDv2gnGrOZoZqUz8qqG05TrYrBm4glywlQHtpA2XBbJqh0U Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:46.889890 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc29786db35b4fa7a3494d7d84b68419", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c424a25c9a2b48e38d1d8c1587e898da Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1'} Oct 31 14:03:46.891091 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:46.891964 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 14:03:46.892947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:46.897523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af3897af-7f1d-44ca-b9e6-92834265a5f5 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:46.897523 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af3897af-7f1d-44ca-b9e6-92834265a5f5 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-863052-1" status: 403 len: 109 microversion: 2.1 time: 0.010937 Oct 31 14:03:46.897523 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 212/370] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/os-hosts/n-d-863052-1 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:46.904531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-058fdaae-7d2b-4682-ab94-1fd8aeb7b498 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:46.940158 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-058fdaae-7d2b-4682-ab94-1fd8aeb7b498 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.041284 Oct 31 14:03:46.940743 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 213/371] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:46.975024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5ee5f29-b015-4151-b2a5-fd956682dc5a tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Calling method '.version_select at 0x7fe10c1db5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:47.003120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d5ee5f29-b015-4151-b2a5-fd956682dc5a tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5ee5f29-b015-4151-b2a5-fd956682dc5a tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.007722 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'nonexistent_hostname'} Oct 31 14:03:47.009570 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.010321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.012039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.018361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5ee5f29-b015-4151-b2a5-fd956682dc5a tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.021102 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5ee5f29-b015-4151-b2a5-fd956682dc5a tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.064412 Oct 31 14:03:47.022243 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 214/372] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 31 14:03:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:47.040075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b57985ad-b554-4632-8b4b-9f11330ee7c0 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:47.054062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b57985ad-b554-4632-8b4b-9f11330ee7c0 tempest-FlavorsV2TestJSON-156042232 tempest-FlavorsV2TestJSON-156042232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020396 Oct 31 14:03:47.064396 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 215/373] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:03:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:47.075759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be64a5c5-23b2-404a-9de7-ae3f17c921bc tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Calling method '.version_select at 0x7fe10c1db040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:47.079127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-be64a5c5-23b2-404a-9de7-ae3f17c921bc tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c424a25c9a2b48e38d1d8c1587e898da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc29786db35b4fa7a3494d7d84b68419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be64a5c5-23b2-404a-9de7-ae3f17c921bc tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Request method failure captured: Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/n-d-863052-1/shutdown HTTP/1.1 Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9W_kS6Bukv1Hx8LspjaoRRjx3B0WZw9kUUnol2E-DdrDsl9Rye39CMxhXaA0df3epskqT5gulveAUflQS0aCh2wFRUOGzh1NeMv5R-B8bWNvroBFPZkK-fIA9C2V7QiRDv2gnGrOZoZqUz8qqG05TrYrBm4glywlQHtpA2XBbJqh0U Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:47.081784 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc29786db35b4fa7a3494d7d84b68419", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c424a25c9a2b48e38d1d8c1587e898da Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1'} Oct 31 14:03:47.083284 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:47.084145 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 14:03:47.085365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.089424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be64a5c5-23b2-404a-9de7-ae3f17c921bc tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.090807 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be64a5c5-23b2-404a-9de7-ae3f17c921bc tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-863052-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.022462 Oct 31 14:03:47.099981 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 216/374] 10.222.0.27 () {58 vars in 1194 bytes} [Mon Oct 31 14:03:47 2022] GET /compute/v2.1/os-hosts/n-d-863052-1/shutdown => generated 113 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:47.107411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30d21aac-9d4b-4726-8a7d-11644fcf760b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Calling method '.version_select at 0x7fe10c0f8820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:47.124736 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-30d21aac-9d4b-4726-8a7d-11644fcf760b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30d21aac-9d4b-4726-8a7d-11644fcf760b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.127275 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'nonexistent_hostname'} Oct 31 14:03:47.128423 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:47.129421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 14:03:47.130451 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30d21aac-9d4b-4726-8a7d-11644fcf760b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30d21aac-9d4b-4726-8a7d-11644fcf760b tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027491 Oct 31 14:03:47.131461 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 217/375] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:03:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:47.145377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86aac988-97a1-4b7b-8b92-ba3e57cf3459 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Calling method '.version_select at 0x7fe10c5f5ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:47.147466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86aac988-97a1-4b7b-8b92-ba3e57cf3459 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c424a25c9a2b48e38d1d8c1587e898da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc29786db35b4fa7a3494d7d84b68419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86aac988-97a1-4b7b-8b92-ba3e57cf3459 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Request method failure captured: Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/n-d-863052-1/startup HTTP/1.1 Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9W_kS6Bukv1Hx8LspjaoRRjx3B0WZw9kUUnol2E-DdrDsl9Rye39CMxhXaA0df3epskqT5gulveAUflQS0aCh2wFRUOGzh1NeMv5R-B8bWNvroBFPZkK-fIA9C2V7QiRDv2gnGrOZoZqUz8qqG05TrYrBm4glywlQHtpA2XBbJqh0U Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:47.151151 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc29786db35b4fa7a3494d7d84b68419", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c424a25c9a2b48e38d1d8c1587e898da Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1'} Oct 31 14:03:47.152344 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:47.153038 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 14:03:47.154110 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.160024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86aac988-97a1-4b7b-8b92-ba3e57cf3459 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.160024 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86aac988-97a1-4b7b-8b92-ba3e57cf3459 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-863052-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017617 Oct 31 14:03:47.160024 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 218/376] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 31 14:03:47 2022] GET /compute/v2.1/os-hosts/n-d-863052-1/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:47.169324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d22c762-93dc-479d-a0a4-413174312232 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Calling method '.version_select at 0x7fe10c1db0d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:47.180754 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1d22c762-93dc-479d-a0a4-413174312232 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d22c762-93dc-479d-a0a4-413174312232 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.183913 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'nonexistent_hostname'} Oct 31 14:03:47.185238 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:47.185918 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 14:03:47.186970 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.188082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.190407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d22c762-93dc-479d-a0a4-413174312232 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.191465 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d22c762-93dc-479d-a0a4-413174312232 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.026120 Oct 31 14:03:47.194509 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 219/377] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Oct 31 14:03:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:47.205055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b22e4d1-7849-41a4-bc59-61f69fe568ab tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c16f550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b22e4d1-7849-41a4-bc59-61f69fe568ab tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-hosts/n-d-863052-1 HTTP/1.1 Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 51 Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.211526 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: {"status": "enable", "maintenance_mode": "invalid"} Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.213315 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance: Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.214019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.219188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b22e4d1-7849-41a4-bc59-61f69fe568ab tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b22e4d1-7849-41a4-bc59-61f69fe568ab tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-863052-1" status: 400 len: 199 microversion: 2.1 time: 0.017391 Oct 31 14:03:47.220247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 220/378] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:03:47 2022] PUT /compute/v2.1/os-hosts/n-d-863052-1 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:03:47.225941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f877e14b-f545-428a-8d71-f943216a5b76 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c1db160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f877e14b-f545-428a-8d71-f943216a5b76 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-hosts/n-d-863052-1 HTTP/1.1 Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 51 Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.234695 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: {"status": "invalid", "maintenance_mode": "enable"} Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.236099 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance: Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.236914 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.238439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.239488 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.239488 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:03:47.239488 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:03:47.239488 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 14:03:47.239488 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.240386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f877e14b-f545-428a-8d71-f943216a5b76 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.241336 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f877e14b-f545-428a-8d71-f943216a5b76 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-863052-1" status: 400 len: 189 microversion: 2.1 time: 0.019150 Oct 31 14:03:47.248416 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 221/379] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:03:47 2022] PUT /compute/v2.1/os-hosts/n-d-863052-1 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:03:47.255135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6585167-1278-4000-8bed-237e9755b4e0 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Action: 'update', calling method: .version_select at 0x7fe10c069040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:47.261363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6585167-1278-4000-8bed-237e9755b4e0 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c424a25c9a2b48e38d1d8c1587e898da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc29786db35b4fa7a3494d7d84b68419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6585167-1278-4000-8bed-237e9755b4e0 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Request method failure captured: Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-hosts/n-d-863052-1 HTTP/1.1 Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 50 Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9W_kS6Bukv1Hx8LspjaoRRjx3B0WZw9kUUnol2E-DdrDsl9Rye39CMxhXaA0df3epskqT5gulveAUflQS0aCh2wFRUOGzh1NeMv5R-B8bWNvroBFPZkK-fIA9C2V7QiRDv2gnGrOZoZqUz8qqG05TrYrBm4glywlQHtpA2XBbJqh0U Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:47.264074 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc29786db35b4fa7a3494d7d84b68419", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc29786db35b4fa7a3494d7d84b68419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fc29786db35b4fa7a3494d7d84b68419 Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-958914189 Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c424a25c9a2b48e38d1d8c1587e898da Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-958914189-project Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: {"status": "enable", "maintenance_mode": "enable"} Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 14:03:47.265275 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:47.266083 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 14:03:47.267240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.268223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6585167-1278-4000-8bed-237e9755b4e0 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.268223 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6585167-1278-4000-8bed-237e9755b4e0 tempest-HostsAdminNegativeTestJSON-958914189 tempest-HostsAdminNegativeTestJSON-958914189-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-863052-1" status: 403 len: 111 microversion: 2.1 time: 0.015977 Oct 31 14:03:47.272592 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 222/380] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:03:47 2022] PUT /compute/v2.1/os-hosts/n-d-863052-1 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:03:47.279807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c818ec85-0195-4fcc-9979-3e3fbc502e85 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c069af0>, body: {"status": null, "maintenance_mode": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c818ec85-0195-4fcc-9979-3e3fbc502e85 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-hosts/n-d-863052-1 HTTP/1.1 Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 42 Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.297162 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: {"status": null, "maintenance_mode": null} Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 14:03:47.298460 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'n-d-863052-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance: Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi None Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.299220 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.300547 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.303005 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:03:47.303005 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:03:47.303005 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 14:03:47.303005 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.303005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c818ec85-0195-4fcc-9979-3e3fbc502e85 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.303005 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c818ec85-0195-4fcc-9979-3e3fbc502e85 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-863052-1" status: 400 len: 127 microversion: 2.1 time: 0.024538 Oct 31 14:03:47.310786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 223/381] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:03:47 2022] PUT /compute/v2.1/os-hosts/n-d-863052-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:03:47.320714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbe5ff27-299e-4cf8-8171-2bcf484bb8c3 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c65ac10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:47.325589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.hosts [None req-dbe5ff27-299e-4cf8-8171-2bcf484bb8c3 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Enabling host nonexistent_hostname. Oct 31 14:03:47.335644 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-dbe5ff27-299e-4cf8-8171-2bcf484bb8c3 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbe5ff27-299e-4cf8-8171-2bcf484bb8c3 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Request method failure captured: Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 50 Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XAmMIr7_tz86IN9xhySxO41VMYlWt7Jg4_ZpOyfKAWhEQNh2tQpw3BniYJ9hI0kvSZbdzWDEXu0I8wZgG17csfdvU5GBvql_-Ba-xFBOFsi__vk1Uq68CUYE5Rzb9r6frjHtBGL7Tx2z76iNXhZWhhTKygajCGbBvo74DWEpFoJko Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:03:47.338478 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ff0f12b3400426f8463099d81ff7ce9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ff0f12b3400426f8463099d81ff7ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8ff0f12b3400426f8463099d81ff7ce9 Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-422408481 Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 54814e38174f4c62a567ae105318ec40 Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HostsAdminNegativeTestJSON-422408481-project-admin Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: {"status": "enable", "maintenance_mode": "enable"} Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.339733 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 14:03:47.340621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:47.341703 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 14:03:47.343017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:47.345863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbe5ff27-299e-4cf8-8171-2bcf484bb8c3 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:47.347114 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbe5ff27-299e-4cf8-8171-2bcf484bb8c3 tempest-HostsAdminNegativeTestJSON-422408481 tempest-HostsAdminNegativeTestJSON-422408481-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035070 Oct 31 14:03:47.352422 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 224/382] 10.222.0.27 () {60 vars in 1211 bytes} [Mon Oct 31 14:03:47 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:48.824358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Building network info cache for instance {{(pid=120641) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:03:48.847937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d904f98e-9a97-4fef-a314-622c00847ec1 req-6c06a3f3-3d53-40b4-9c85-5a28395e726e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:48.925141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d904f98e-9a97-4fef-a314-622c00847ec1 req-6c06a3f3-3d53-40b4-9c85-5a28395e726e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:48.926503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d904f98e-9a97-4fef-a314-622c00847ec1 req-6c06a3f3-3d53-40b4-9c85-5a28395e726e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:48.928678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d904f98e-9a97-4fef-a314-622c00847ec1 req-6c06a3f3-3d53-40b4-9c85-5a28395e726e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:48.967852 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d904f98e-9a97-4fef-a314-622c00847ec1 req-6c06a3f3-3d53-40b4-9c85-5a28395e726e service nova] Creating event network-changed:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:03:48.991351 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d904f98e-9a97-4fef-a314-622c00847ec1 req-6c06a3f3-3d53-40b4-9c85-5a28395e726e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148962 Oct 31 14:03:48.996198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 225/383] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:03:51.266352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:52.123421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Updating instance_info_cache with network_info: [{"id": "416e21ee-8d1a-48c3-b433-9f75ce084928", "address": "fa:16:3e:2b:8f:c5", "network": {"id": "6210a55b-8790-4aa9-8e81-23a0101568be", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1293722175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a6c5ba969b654c3986dbd6c693887bff", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap416e21ee-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120641) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:03:52.138049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Releasing lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:03:52.140895 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c4fabfc-b00d-4646-b45e-2c92792d763e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action" status: 202 len: 0 microversion: 2.1 time: 8.748616 Oct 31 14:03:52.143700 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 159/384] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:03:43 2022] POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action => generated 0 bytes in 8752 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:03:52.152738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'action', calling method: .version_select at 0x7fe10d589af0>, body: {"addFloatingIp": {"address": "172.25.9.162"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:52.156019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:52.179702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:52.182212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:52.182916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:52.184966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:52.186655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:52.188449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:52.305368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "refresh_cache-d02a333c-6593-4778-94cc-f5da011be94d" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:03:52.306577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquired lock "refresh_cache-d02a333c-6593-4778-94cc-f5da011be94d" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:03:53.068759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Calling method '.version_select at 0x7fe10c2f1940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:53.081931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.085089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.085560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.142749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.143611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.144349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.268024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.270313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.274215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.345358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.345902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.346412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.390960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.391852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.401644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.409292 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-920ff514-2ae8-4194-bcec-5d1b9bf5105e tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.940813 Oct 31 14:03:53.425846 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 160/385] 10.222.0.27 () {60 vars in 1243 bytes} [Mon Oct 31 14:03:52 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:03:53.442843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Calling method '.version_select at 0x7fe10c2f1b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:53.451013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.454117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.454887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.504414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.504908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.505343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.570313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.572389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.572887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.599158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.599902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.601139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.648901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.650661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.651134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.669492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d0c3a54-e3e6-4f35-b7c2-38b039cb59fb tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.236052 Oct 31 14:03:53.672339 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 161/386] 10.222.0.27 () {60 vars in 1222 bytes} [Mon Oct 31 14:03:53 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:03:53.682508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Calling method '.version_select at 0x7fe10c2f1700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:53.713898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.714777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.715835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.743823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:53.744636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:53.746386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:53.756014 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e70e2694-e405-41db-b057-718b0983809c tempest-HypervisorAdminV253TestBase-1360340079 tempest-HypervisorAdminV253TestBase-1360340079-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/e007004d-a834-458f-a7e6-40fce332cdaa" status: 200 len: 792 microversion: 2.53 time: 0.076900 Oct 31 14:03:53.757398 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 162/387] 10.222.0.27 () {60 vars in 1298 bytes} [Mon Oct 31 14:03:53 2022] GET /compute/v2.1/os-hypervisors/e007004d-a834-458f-a7e6-40fce332cdaa => generated 792 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:03:56.105859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:56.127149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-346937d1-8d07-4c5b-bf6a-2e85c89cc3e9 req-4f626243-5aa2-4758-aee6-31212d79121b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:56.155724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-346937d1-8d07-4c5b-bf6a-2e85c89cc3e9 req-4f626243-5aa2-4758-aee6-31212d79121b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:56.157671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-346937d1-8d07-4c5b-bf6a-2e85c89cc3e9 req-4f626243-5aa2-4758-aee6-31212d79121b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:56.160582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-346937d1-8d07-4c5b-bf6a-2e85c89cc3e9 req-4f626243-5aa2-4758-aee6-31212d79121b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:56.186205 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-346937d1-8d07-4c5b-bf6a-2e85c89cc3e9 req-4f626243-5aa2-4758-aee6-31212d79121b service nova] Creating event network-changed:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:03:56.199797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-346937d1-8d07-4c5b-bf6a-2e85c89cc3e9 req-4f626243-5aa2-4758-aee6-31212d79121b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074973 Oct 31 14:03:56.201809 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 163/388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:56.252615 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.network.neutron [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] re-assign floating IP 172.25.9.162 from instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b Oct 31 14:03:56.411903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:03:56.420019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Building network info cache for instance {{(pid=120640) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:03:57.216429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1703594703", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:57.361880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:03:57.803073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Updating instance_info_cache with network_info: [{"id": "416e21ee-8d1a-48c3-b433-9f75ce084928", "address": "fa:16:3e:2b:8f:c5", "network": {"id": "6210a55b-8790-4aa9-8e81-23a0101568be", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1293722175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a6c5ba969b654c3986dbd6c693887bff", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap416e21ee-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:03:57.823381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Building network info cache for instance {{(pid=120640) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:03:58.726861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:03:58.727922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:03:58.728475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:03:58.729446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:03:58.729446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:03:58.750108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:58.752601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:58.753324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:58.755540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:58.757770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:58.759840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:58.815627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Getting quotas for project f616fea9c23a4d1bb330aff30f78057d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:03:58.822927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Getting quotas for user b0091bea85ad4e77871d537309bdb88f and project f616fea9c23a4d1bb330aff30f78057d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:03:58.837398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:03:58.841302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:03:58.943018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35b544f1-4781-47ea-b943-70f9802b5776 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.244058 Oct 31 14:03:58.945276 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 164/389] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:03:58.958718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d544ff97-98a8-4bdd-9290-db9eb7616a37 req-882b1186-0769-45e3-ae9d-8987d248fe16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02a333c-6593-4778-94cc-f5da011be94d", "tag": "2aed93f8-b2f3-467c-b642-7a8a41b36ece"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:58.995118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d544ff97-98a8-4bdd-9290-db9eb7616a37 req-882b1186-0769-45e3-ae9d-8987d248fe16 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:58.996271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d544ff97-98a8-4bdd-9290-db9eb7616a37 req-882b1186-0769-45e3-ae9d-8987d248fe16 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:58.998157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d544ff97-98a8-4bdd-9290-db9eb7616a37 req-882b1186-0769-45e3-ae9d-8987d248fe16 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:59.028234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d544ff97-98a8-4bdd-9290-db9eb7616a37 req-882b1186-0769-45e3-ae9d-8987d248fe16 service nova] Creating event network-changed:2aed93f8-b2f3-467c-b642-7a8a41b36ece for instance d02a333c-6593-4778-94cc-f5da011be94d on n-h1-863052-1 Oct 31 14:03:59.032451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Updating instance_info_cache with network_info: [{"id": "2aed93f8-b2f3-467c-b642-7a8a41b36ece", "address": "fa:16:3e:6c:eb:b4", "network": {"id": "6210a55b-8790-4aa9-8e81-23a0101568be", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1293722175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a6c5ba969b654c3986dbd6c693887bff", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2aed93f8-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:03:59.041095 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d544ff97-98a8-4bdd-9290-db9eb7616a37 req-882b1186-0769-45e3-ae9d-8987d248fe16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086902 Oct 31 14:03:59.043680 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 165/390] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:03:59.061940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Releasing lock "refresh_cache-d02a333c-6593-4778-94cc-f5da011be94d" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:03:59.062978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ccf0a16-8973-4e7c-9704-a44d4f7fcecc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:03:59.063975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ccf0a16-8973-4e7c-9704-a44d4f7fcecc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:59.068835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0e6d0fb-c480-46b7-be49-df7ebfff60fa tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d/action" status: 202 len: 0 microversion: 2.1 time: 6.917241 Oct 31 14:03:59.074731 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 226/391] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:03:52 2022] POST /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d/action => generated 0 bytes in 6925 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:03:59.088524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'action', calling method: .version_select at 0x7fe10df790d0>, body: {"removeFloatingIp": {"address": "172.25.9.162"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:03:59.364938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:03:59.374782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:59.375484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:59.377369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:59.378820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:03:59.381443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:03:59.382816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:03:59.800423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ccf0a16-8973-4e7c-9704-a44d4f7fcecc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:03:59.811902 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ccf0a16-8973-4e7c-9704-a44d4f7fcecc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1219 microversion: 2.1 time: 0.765603 Oct 31 14:03:59.816732 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 166/392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:03:59 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1219 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:03:59.856335 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] HTTP exception thrown: Floating IP 172.25.9.162 is not associated with instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b. Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Request method failure captured: Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action HTTP/1.1 Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 49 Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WKTPm0T0ao0ZMLbktIrTC0O8Hh6htQROf0uhsRkX9FXzDYsM9y1q8eco11z26gIZBE5VRCaJJaQGaimjczarbZ5-jc8DzBtEFLd3hoXfjhU5SSkKyGPgBCv9KhcpxbeCrAoeA3fP5xwYnfF4KJahsevo1WD8c7E2175ewbr9JsMxo Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:03:59.858146 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c5ba969b654c3986dbd6c693887bff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a58704dad2b94740be8042992cb16454 Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: {"removeFloatingIp": {"address": "172.25.9.162"}} Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:03:59.859618 n-d-863052-1 devstack@n-api.service[120640]: exception: Floating IP 172.25.9.162 is not associated with instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b. Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'dd5fe167-b0da-49a6-8ffb-e91e5ae1529b', 'body': {'removeFloatingIp': {'address': '172.25.9.162'}}} Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.162 is not associated with instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b. Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:59.861174 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.162 is not associated with instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b. Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Returning 409 to user: Floating IP 172.25.9.162 is not associated with instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5182c29c-8339-4b52-b4dd-2ea90535758b tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action" status: 409 len: 146 microversion: 2.1 time: 0.783444 Oct 31 14:03:59.862507 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 227/393] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:03:59 2022] POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action => generated 146 bytes in 785 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:03:59.870952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'action', calling method: .version_select at 0x7fe10d5818b0>, body: {"removeFloatingIp": {"address": "172.25.9.162"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:00.565622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:00.572007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:00.575062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:00.576778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:00.579883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:00.583572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:00.584848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:00.585542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:00.841379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:00.842153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:00.861765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:00.862633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:00.863328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:00.864238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:00.864894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:00.865523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:01.066366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:01.080164 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3880e6d5-b1ff-488a-bd2a-c05e8f8a4452 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1271 microversion: 2.1 time: 0.242325 Oct 31 14:04:01.117230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 228/394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:00 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:04:01.574290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02b8ae15-398d-4b55-831b-9c73140d76f2 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Calling method '.version_select at 0x7fe10c0284c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.576815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02b8ae15-398d-4b55-831b-9c73140d76f2 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'df7cbb2fdd124760b8fa73d16e1a25a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99ecd33f094f3fb4a24c0b9ceb62c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02b8ae15-398d-4b55-831b-9c73140d76f2 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Request method failure captured: Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XPFnz2QitHXXn5iK4ToxwaNv6tZ4eM3Xzw5gE74D4sMQ1WQnt5HPZLB14fjwSIhdt5-tXisfT8W2yPoV-kWAsaHJLh8G4fsSC9Z1wc4pEPxqOTcczvXpS54_zBbp5mJN-RglPKWdzRJ7EW8x3BN4ejojauWrJbl-hvpoHAx3RS8P0 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:04:01.579014 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e99ecd33f094f3fb4a24c0b9ceb62c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: df7cbb2fdd124760b8fa73d16e1a25a4 Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:04:01.580447 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:04:01.581421 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 14:04:01.582696 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.587484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02b8ae15-398d-4b55-831b-9c73140d76f2 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:01.590422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02b8ae15-398d-4b55-831b-9c73140d76f2 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.470837 Oct 31 14:04:01.597623 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 229/395] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:01.602676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91337858-d7a3-4634-ac38-b5d1237da1c3 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Calling method '.version_select at 0x7fe10c1dbf70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.604729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-91337858-d7a3-4634-ac38-b5d1237da1c3 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'df7cbb2fdd124760b8fa73d16e1a25a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99ecd33f094f3fb4a24c0b9ceb62c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91337858-d7a3-4634-ac38-b5d1237da1c3 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Request method failure captured: Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XPFnz2QitHXXn5iK4ToxwaNv6tZ4eM3Xzw5gE74D4sMQ1WQnt5HPZLB14fjwSIhdt5-tXisfT8W2yPoV-kWAsaHJLh8G4fsSC9Z1wc4pEPxqOTcczvXpS54_zBbp5mJN-RglPKWdzRJ7EW8x3BN4ejojauWrJbl-hvpoHAx3RS8P0 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:04:01.608866 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e99ecd33f094f3fb4a24c0b9ceb62c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: df7cbb2fdd124760b8fa73d16e1a25a4 Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:04:01.610416 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:04:01.611277 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 14:04:01.612603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.618645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91337858-d7a3-4634-ac38-b5d1237da1c3 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:01.619723 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91337858-d7a3-4634-ac38-b5d1237da1c3 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021016 Oct 31 14:04:01.625951 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 230/396] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:01.634290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bc58cda-24bc-440b-ba52-d21ea65fdaaf tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Calling method '.version_select at 0x7fe10c19c310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.640950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0bc58cda-24bc-440b-ba52-d21ea65fdaaf tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'df7cbb2fdd124760b8fa73d16e1a25a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99ecd33f094f3fb4a24c0b9ceb62c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bc58cda-24bc-440b-ba52-d21ea65fdaaf tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Request method failure captured: Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XPFnz2QitHXXn5iK4ToxwaNv6tZ4eM3Xzw5gE74D4sMQ1WQnt5HPZLB14fjwSIhdt5-tXisfT8W2yPoV-kWAsaHJLh8G4fsSC9Z1wc4pEPxqOTcczvXpS54_zBbp5mJN-RglPKWdzRJ7EW8x3BN4ejojauWrJbl-hvpoHAx3RS8P0 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:04:01.642794 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e99ecd33f094f3fb4a24c0b9ceb62c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: df7cbb2fdd124760b8fa73d16e1a25a4 Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:04:01.644224 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:04:01.645329 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 14:04:01.646592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.649928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bc58cda-24bc-440b-ba52-d21ea65fdaaf tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:01.651813 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bc58cda-24bc-440b-ba52-d21ea65fdaaf tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.024252 Oct 31 14:04:01.657984 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 231/397] 10.222.0.27 () {58 vars in 1179 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:01.770317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Calling method '.version_select at 0x7fe10c0690d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.773945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:01.774679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:01.775289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:01.817626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:01.818133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:01.818648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:01.850951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:01.851593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:01.852644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:01.871647 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44469467-8321-4871-9d26-60f6bc780e67 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.208977 Oct 31 14:04:01.879207 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 232/398] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:01.885032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a19476c-d997-47b6-86ff-f7b8d82624ee tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Calling method '.version_select at 0x7fe10c1dba60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.887173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a19476c-d997-47b6-86ff-f7b8d82624ee tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'df7cbb2fdd124760b8fa73d16e1a25a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99ecd33f094f3fb4a24c0b9ceb62c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a19476c-d997-47b6-86ff-f7b8d82624ee tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Request method failure captured: Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XPFnz2QitHXXn5iK4ToxwaNv6tZ4eM3Xzw5gE74D4sMQ1WQnt5HPZLB14fjwSIhdt5-tXisfT8W2yPoV-kWAsaHJLh8G4fsSC9Z1wc4pEPxqOTcczvXpS54_zBbp5mJN-RglPKWdzRJ7EW8x3BN4ejojauWrJbl-hvpoHAx3RS8P0 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:04:01.892617 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e99ecd33f094f3fb4a24c0b9ceb62c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: df7cbb2fdd124760b8fa73d16e1a25a4 Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '1'} Oct 31 14:04:01.894100 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:04:01.895104 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 14:04:01.896311 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.898320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a19476c-d997-47b6-86ff-f7b8d82624ee tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:01.899402 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a19476c-d997-47b6-86ff-f7b8d82624ee tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018444 Oct 31 14:04:01.900395 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 233/399] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:01.915592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0537b64b-0b72-45d1-b6a5-b0cac90729eb tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Calling method '.version_select at 0x7fe10c028ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.931691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0537b64b-0b72-45d1-b6a5-b0cac90729eb tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] HTTP exception thrown: Hypervisor with ID '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5' could not be found. Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0537b64b-0b72-45d1-b6a5-b0cac90729eb tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Request method failure captured: Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/0cf1e17e-92fe-4c0d-bc74-ff2da95eede5/uptime HTTP/1.1 Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XQot4qR6aN9OFxYC4EbYaEJDy8JBOONwYKo4j9IJfHPWf6AxUzZbl6fUIdRJoM7CNZuVu-KFn9Q9Q2yRx3PVFX3ue9-YOicZu0cv2T3qkIDFAEDdzf3XCnPlHzVQ4WElSumLIODZqHmHM55gV0MDI7UMP14blyS3KpYZ2PXtE0m1I Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: e2c6b4963f544fe0b7050719f88a9340 Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1149313056 Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:04:01.950871 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e2c6b4963f544fe0b7050719f88a9340", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2c6b4963f544fe0b7050719f88a9340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e2c6b4963f544fe0b7050719f88a9340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2c6b4963f544fe0b7050719f88a9340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1149313056 Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: e2c6b4963f544fe0b7050719f88a9340 Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1149313056 Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 67445f00f79b44d381e96715098c5d5b Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: exception: Hypervisor with ID '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5' could not be found. Oct 31 14:04:01.952301 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5'} Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5' Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 31 14:04:01.953082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5' could not be found. Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:01.958799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5' could not be found. Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0537b64b-0b72-45d1-b6a5-b0cac90729eb tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Returning 404 to user: Hypervisor with ID '0cf1e17e-92fe-4c0d-bc74-ff2da95eede5' could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0537b64b-0b72-45d1-b6a5-b0cac90729eb tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/0cf1e17e-92fe-4c0d-bc74-ff2da95eede5/uptime" status: 404 len: 123 microversion: 2.1 time: 0.046520 Oct 31 14:04:01.960537 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 234/400] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors/0cf1e17e-92fe-4c0d-bc74-ff2da95eede5/uptime => generated 123 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:01.970371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Calling method '.version_select at 0x7fe10c16f280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:01.988545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:01.989995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:01.991686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:02.027558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:02.028206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:02.032087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:02.071502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:02.073895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:02.073895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:02.092876 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c6061f8-2164-4846-afb1-84e0cf313316 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.129830 Oct 31 14:04:02.094118 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 235/401] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:04:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:02.108897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd1c7844-1149-407f-bd1b-3060c94aae33 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Calling method '.version_select at 0x7fe10c1db4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:02.113123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd1c7844-1149-407f-bd1b-3060c94aae33 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'df7cbb2fdd124760b8fa73d16e1a25a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99ecd33f094f3fb4a24c0b9ceb62c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd1c7844-1149-407f-bd1b-3060c94aae33 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Request method failure captured: Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XPFnz2QitHXXn5iK4ToxwaNv6tZ4eM3Xzw5gE74D4sMQ1WQnt5HPZLB14fjwSIhdt5-tXisfT8W2yPoV-kWAsaHJLh8G4fsSC9Z1wc4pEPxqOTcczvXpS54_zBbp5mJN-RglPKWdzRJ7EW8x3BN4ejojauWrJbl-hvpoHAx3RS8P0 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:04:02.116730 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e99ecd33f094f3fb4a24c0b9ceb62c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e99ecd33f094f3fb4a24c0b9ceb62c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1e99ecd33f094f3fb4a24c0b9ceb62c3 Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-128466071 Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: df7cbb2fdd124760b8fa73d16e1a25a4 Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-128466071-project Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '1'} Oct 31 14:04:02.118238 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:04:02.119124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 14:04:02.120244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.130574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd1c7844-1149-407f-bd1b-3060c94aae33 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:02.136501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd1c7844-1149-407f-bd1b-3060c94aae33 tempest-HypervisorAdminNegativeTestJSON-128466071 tempest-HypervisorAdminNegativeTestJSON-128466071-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.035438 Oct 31 14:04:02.138054 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 236/402] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:04:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:02.148651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:02.149999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:02.158450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:02.159246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:02.161527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:02.162516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:02.163229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:02.163844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:02.264970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:02.273391 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b4119a6-54a3-4694-be88-81955611cd09 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1277 microversion: 2.1 time: 0.133625 Oct 31 14:04:02.274762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 237/403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:02 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:02.294589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a40b162-971f-4539-8466-f561c2a2cf57 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Calling method '.version_select at 0x7fe10c19c5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:02.296949 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4a40b162-971f-4539-8466-f561c2a2cf57 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] HTTP exception thrown: Hypervisor with ID 'a8fa2c71-21ab-424a-968f-469eaca390cb' could not be found. Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a40b162-971f-4539-8466-f561c2a2cf57 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Request method failure captured: Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-hypervisors/a8fa2c71-21ab-424a-968f-469eaca390cb HTTP/1.1 Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XQot4qR6aN9OFxYC4EbYaEJDy8JBOONwYKo4j9IJfHPWf6AxUzZbl6fUIdRJoM7CNZuVu-KFn9Q9Q2yRx3PVFX3ue9-YOicZu0cv2T3qkIDFAEDdzf3XCnPlHzVQ4WElSumLIODZqHmHM55gV0MDI7UMP14blyS3KpYZ2PXtE0m1I Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: e2c6b4963f544fe0b7050719f88a9340 Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1149313056 Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:04:02.303699 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e2c6b4963f544fe0b7050719f88a9340", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2c6b4963f544fe0b7050719f88a9340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e2c6b4963f544fe0b7050719f88a9340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2c6b4963f544fe0b7050719f88a9340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1149313056 Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: e2c6b4963f544fe0b7050719f88a9340 Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1149313056 Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 67445f00f79b44d381e96715098c5d5b Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: exception: Hypervisor with ID 'a8fa2c71-21ab-424a-968f-469eaca390cb' could not be found. Oct 31 14:04:02.305773 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a8fa2c71-21ab-424a-968f-469eaca390cb'} Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a8fa2c71-21ab-424a-968f-469eaca390cb' Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 31 14:04:02.306617 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:04:02.307967 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a8fa2c71-21ab-424a-968f-469eaca390cb' could not be found. Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a8fa2c71-21ab-424a-968f-469eaca390cb' could not be found. Oct 31 14:04:02.309213 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:02.317037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a40b162-971f-4539-8466-f561c2a2cf57 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] Returning 404 to user: Hypervisor with ID 'a8fa2c71-21ab-424a-968f-469eaca390cb' could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:02.320731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a40b162-971f-4539-8466-f561c2a2cf57 tempest-HypervisorAdminNegativeTestJSON-1149313056 tempest-HypervisorAdminNegativeTestJSON-1149313056-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/a8fa2c71-21ab-424a-968f-469eaca390cb" status: 404 len: 123 microversion: 2.1 time: 0.042758 Oct 31 14:04:02.323278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 238/404] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 31 14:04:02 2022] GET /compute/v2.1/os-hypervisors/a8fa2c71-21ab-424a-968f-469eaca390cb => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:02.469636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "refresh_cache-d02a333c-6593-4778-94cc-f5da011be94d" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:04:02.470746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquired lock "refresh_cache-d02a333c-6593-4778-94cc-f5da011be94d" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:04:03.299715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:03.301031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:03.308692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:03.311259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:03.312222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:03.313166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:03.315127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:03.318816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:03.616472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:03.637253 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9829d369-e5e4-4645-ab62-9d2afcce49e7 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1319 microversion: 2.1 time: 0.340527 Oct 31 14:04:03.661993 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 239/405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:03 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:04.668950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:04.669569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:04.679608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:04.680449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:04.681680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:04.682500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:04.687826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:04.688770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:05.830848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Building network info cache for instance {{(pid=120641) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:04:05.923113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:05.930787 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0161093a-6b43-4ac6-8f24-4359b6bc6217 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1319 microversion: 2.1 time: 1.266540 Oct 31 14:04:05.946608 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 240/406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:04 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1319 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:05.958743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d0e4702d-a1d7-4f5d-9503-03275ec62291 req-fc77397b-7338-45f7-9163-8f94d2546097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87f117c-9c0e-43a5-9dec-9c824c4cc0af", "tag": "8e1e6cae-d2d0-4d6f-bc9f-eaaa4840500a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:05.992705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0e4702d-a1d7-4f5d-9503-03275ec62291 req-fc77397b-7338-45f7-9163-8f94d2546097 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:05.993434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0e4702d-a1d7-4f5d-9503-03275ec62291 req-fc77397b-7338-45f7-9163-8f94d2546097 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:05.993947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d0e4702d-a1d7-4f5d-9503-03275ec62291 req-fc77397b-7338-45f7-9163-8f94d2546097 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:06.015900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d0e4702d-a1d7-4f5d-9503-03275ec62291 req-fc77397b-7338-45f7-9163-8f94d2546097 service nova] Creating event network-changed:8e1e6cae-d2d0-4d6f-bc9f-eaaa4840500a for instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af on n-h2-863052-1 Oct 31 14:04:06.029940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d0e4702d-a1d7-4f5d-9503-03275ec62291 req-fc77397b-7338-45f7-9163-8f94d2546097 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078861 Oct 31 14:04:06.030827 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 241/407] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:06.036178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-369a0f08-9098-49fb-98d1-78ed59c904c9 req-03e8724a-fdfa-4420-bd5f-c842e0df2aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02a333c-6593-4778-94cc-f5da011be94d", "tag": "2aed93f8-b2f3-467c-b642-7a8a41b36ece"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:06.060552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-369a0f08-9098-49fb-98d1-78ed59c904c9 req-03e8724a-fdfa-4420-bd5f-c842e0df2aa8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:06.062384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-369a0f08-9098-49fb-98d1-78ed59c904c9 req-03e8724a-fdfa-4420-bd5f-c842e0df2aa8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:06.067874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-369a0f08-9098-49fb-98d1-78ed59c904c9 req-03e8724a-fdfa-4420-bd5f-c842e0df2aa8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:06.095030 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-369a0f08-9098-49fb-98d1-78ed59c904c9 req-03e8724a-fdfa-4420-bd5f-c842e0df2aa8 service nova] Creating event network-changed:2aed93f8-b2f3-467c-b642-7a8a41b36ece for instance d02a333c-6593-4778-94cc-f5da011be94d on n-h1-863052-1 Oct 31 14:04:06.107997 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-369a0f08-9098-49fb-98d1-78ed59c904c9 req-03e8724a-fdfa-4420-bd5f-c842e0df2aa8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075498 Oct 31 14:04:06.108765 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 242/408] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:06.972861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:06.974385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:07.016093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:07.017181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:07.018436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:07.024466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:07.025412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:07.026447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:07.384869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:07.393737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adb00fe1-b40a-467d-9e53-01d8ba42855f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1319 microversion: 2.1 time: 0.435805 Oct 31 14:04:07.407804 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 243/409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:06 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:08.419351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:08.420053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:08.432904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:08.433525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:08.433963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:08.439760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:08.440269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:08.440874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:08.648976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Updating instance_info_cache with network_info: [{"id": "2aed93f8-b2f3-467c-b642-7a8a41b36ece", "address": "fa:16:3e:6c:eb:b4", "network": {"id": "6210a55b-8790-4aa9-8e81-23a0101568be", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1293722175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a6c5ba969b654c3986dbd6c693887bff", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2aed93f8-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120641) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:04:08.683920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Releasing lock "refresh_cache-d02a333c-6593-4778-94cc-f5da011be94d" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:04:08.684881 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06bb6e48-951d-417b-a65b-e9b208612c69 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d/action" status: 202 len: 0 microversion: 2.1 time: 8.819721 Oct 31 14:04:08.692548 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 167/410] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:03:59 2022] POST /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d/action => generated 0 bytes in 8828 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:04:08.705401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:08.707013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:08.725218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:08.730692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:08.732252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:08.737054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:08.738676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:08.739749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:08.812273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:08.818224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:04:08.938448 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab884854-89d0-498c-a6b8-5e134039825d tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 204 len: 0 microversion: 2.1 time: 0.237832 Oct 31 14:04:08.939840 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 168/411] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:04:08 2022] DELETE /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:04:08.952402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.162"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:08.955653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:08.963301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:08.963996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:08.964665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:08.965582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:08.966362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:08.967001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:09.020445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:09.031122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:04:09.031122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquired lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:04:09.033091 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c376216f-59ef-4383-9caa-621091358a75 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1319 microversion: 2.1 time: 0.617511 Oct 31 14:04:09.037047 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 244/412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:08 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:04:09.806122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:10.060360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:10.061713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:10.072647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:10.073151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:10.073586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:10.074328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:10.080651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:10.081935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:10.832250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:10.852683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21eb0c61-7c4a-47a8-8305-76d5c3bc5d9b tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1319 microversion: 2.1 time: 0.795284 Oct 31 14:04:10.857528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 245/413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:10 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1319 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:11.185949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-daa86a77-4c6c-457e-9063-4319f8505fe1 tempest-InstanceUsageAuditLogTestJSON-483989209 tempest-InstanceUsageAuditLogTestJSON-483989209-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:11.229592 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-daa86a77-4c6c-457e-9063-4319f8505fe1 tempest-InstanceUsageAuditLogTestJSON-483989209 tempest-InstanceUsageAuditLogTestJSON-483989209-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31 14:04:10" status: 200 len: 318 microversion: 2.1 time: 0.370411 Oct 31 14:04:11.230443 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 246/414] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:04:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2014%3A04%3A10 => generated 318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:11.247955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f457534-273c-4c0d-8b62-8754dc3b2ac0 tempest-InstanceUsageAuditLogTestJSON-483989209 tempest-InstanceUsageAuditLogTestJSON-483989209-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:11.280707 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f457534-273c-4c0d-8b62-8754dc3b2ac0 tempest-InstanceUsageAuditLogTestJSON-483989209 tempest-InstanceUsageAuditLogTestJSON-483989209-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.038698 Oct 31 14:04:11.284179 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 247/415] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:04:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:11.882393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:11.884021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:11.922668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:11.923415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:11.924095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:11.925041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:11.925853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:11.926965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:12.556298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:12.572490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1da34e9c-0493-4439-bd40-d0be2dac3ffc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1319 microversion: 2.1 time: 0.695220 Oct 31 14:04:12.576019 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 248/416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:11 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:12.673169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d229bed2-47bf-4b0c-a45b-1527c61739b3 req-3ace4057-18d6-4103-8736-69f942774db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87f117c-9c0e-43a5-9dec-9c824c4cc0af", "name": "network-vif-plugged", "status": "completed", "tag": "8e1e6cae-d2d0-4d6f-bc9f-eaaa4840500a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:12.693267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d229bed2-47bf-4b0c-a45b-1527c61739b3 req-3ace4057-18d6-4103-8736-69f942774db2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:12.703690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d229bed2-47bf-4b0c-a45b-1527c61739b3 req-3ace4057-18d6-4103-8736-69f942774db2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:12.706656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d229bed2-47bf-4b0c-a45b-1527c61739b3 req-3ace4057-18d6-4103-8736-69f942774db2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:12.756452 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d229bed2-47bf-4b0c-a45b-1527c61739b3 req-3ace4057-18d6-4103-8736-69f942774db2 service nova] Creating event network-vif-plugged:8e1e6cae-d2d0-4d6f-bc9f-eaaa4840500a for instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af on n-h2-863052-1 Oct 31 14:04:12.768414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d229bed2-47bf-4b0c-a45b-1527c61739b3 req-3ace4057-18d6-4103-8736-69f942774db2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100784 Oct 31 14:04:12.777380 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 249/417] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:13.060530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1624883300", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9c84957c-d94e-4df7-b39f-eedf08b5d1fa"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:13.127180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] validate_networks() for [('9c84957c-d94e-4df7-b39f-eedf08b5d1fa', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:04:14.788635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:04:14.791204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:04:14.794260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:04:14.796717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:04:14.797313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:04:14.800142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=82 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:14.845971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:14.850309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:14.855810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:14.859671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:14.862840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:14.863539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:14.970027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Getting quotas for project 1494b216046e4d228777af0f07af30fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:04:14.984183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Getting quotas for user 7ed5a0341c0d41edad1c61ca6460d956 and project 1494b216046e4d228777af0f07af30fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:04:15.014331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:04:15.019554 n-d-863052-1 devstack@n-api.service[120640]: WARNING nova.utils [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1624883300 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-162488330 Oct 31 14:04:15.021967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:04:15.113808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a75b2274-41d4-40eb-93ef-8f00cc8750f8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332027 Oct 31 14:04:15.123110 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 250/418] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:04:15.129387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:15.132392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:15.146411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:15.147381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:15.148121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:15.149585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:15.150459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:15.151096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:15.447668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:15.459728 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0334d56-811f-4f7e-888c-fc59deed1155 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1468 microversion: 2.1 time: 0.333893 Oct 31 14:04:15.461546 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 251/419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:15 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:15.468894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:15.469635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:15.476426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:15.477267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:15.478066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:15.479024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:15.480376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:15.481344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:15.518587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:04:15.594578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:15.789718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89403484-9c72-4d3b-9811-c76b74ac61d8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 204 len: 0 microversion: 2.1 time: 0.326202 Oct 31 14:04:15.792120 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 252/420] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:04:15 2022] DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:04:15.812054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7921edaa-26e4-49b8-8a29-ed2ae2006d6c req-75c8c4de-faa8-4fac-801e-cee7860ce4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02a333c-6593-4778-94cc-f5da011be94d", "name": "network-vif-deleted", "tag": "2aed93f8-b2f3-467c-b642-7a8a41b36ece"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:15.840065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7921edaa-26e4-49b8-8a29-ed2ae2006d6c req-75c8c4de-faa8-4fac-801e-cee7860ce4ad service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:15.840945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7921edaa-26e4-49b8-8a29-ed2ae2006d6c req-75c8c4de-faa8-4fac-801e-cee7860ce4ad service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:15.842318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7921edaa-26e4-49b8-8a29-ed2ae2006d6c req-75c8c4de-faa8-4fac-801e-cee7860ce4ad service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:15.872292 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7921edaa-26e4-49b8-8a29-ed2ae2006d6c req-75c8c4de-faa8-4fac-801e-cee7860ce4ad service nova] Creating event network-vif-deleted:2aed93f8-b2f3-467c-b642-7a8a41b36ece for instance d02a333c-6593-4778-94cc-f5da011be94d on n-h1-863052-1 Oct 31 14:04:15.899237 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7921edaa-26e4-49b8-8a29-ed2ae2006d6c req-75c8c4de-faa8-4fac-801e-cee7860ce4ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103686 Oct 31 14:04:15.899913 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 253/421] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:15.925853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d11b25da-717f-413b-8fb9-a23e79979684 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:15.930736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d11b25da-717f-413b-8fb9-a23e79979684 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:16.243860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d11b25da-717f-413b-8fb9-a23e79979684 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:16.252210 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d11b25da-717f-413b-8fb9-a23e79979684 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1232 microversion: 2.1 time: 0.348726 Oct 31 14:04:16.260254 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 254/422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:15 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1232 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:16.821626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-708564683", "block_migration": true, "disk_over_commit": false}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:16.824962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:16.861754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:16.868781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:16.872095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:16.873217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:16.873931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:16.876770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:17.200913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lazy-loading 'flavor' on Instance uuid e87f117c-9c0e-43a5-9dec-9c824c4cc0af {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:04:17.344401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Going to try to live migrate instance to tempest-host-708564683 {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:04:17.360984 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] HTTP exception thrown: Compute host tempest-host-708564683 could not be found. Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Request method failure captured: Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af/action HTTP/1.1 Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 106 Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XMMbZ3z06RFdJuw-Y80OQtRmdSMCEMGb6VZIfD8qcxOv0g0guZjQMXS-wZMS0mAtUbEXCFkUiUhuiVCzplGEQLA_g-2sb1vYhz71pZSS_eNVEQfJ4Y_TmsYR05lscgiHKbdv_z9UmakwiPc9bEkVFd6rSEp3fltGnifUrrBCzjP7g Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 516f1a25e4aa47bca05f781b960eda4b Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveMigrationNegativeTest-1113293236 Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:04:17.375071 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_516f1a25e4aa47bca05f781b960eda4b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/516f1a25e4aa47bca05f781b960eda4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/516f1a25e4aa47bca05f781b960eda4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/516f1a25e4aa47bca05f781b960eda4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveMigrationNegativeTest-1113293236 Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 516f1a25e4aa47bca05f781b960eda4b Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1113293236 Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveMigrationNegativeTest-1113293236-project-admin Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: cfa04d4ea12f41b092e73a819dc8139a Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveMigrationNegativeTest-1113293236-project-admin Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: {"os-migrateLive": {"host": "tempest-host-708564683", "block_migration": true, "disk_over_commit": false}} Oct 31 14:04:17.377121 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: exception: Compute host tempest-host-708564683 could not be found. Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e87f117c-9c0e-43a5-9dec-9c824c4cc0af', 'body': {'os-migrateLive': {'host': 'tempest-host-708564683', 'block_migration': True, 'disk_over_commit': False}}} Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:17.378067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-708564683 could not be found. Oct 31 14:04:17.379389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-708564683 could not be found. Oct 31 14:04:17.380711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-708564683 could not be found. Oct 31 14:04:17.382030 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:17.384462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Returning 400 to user: Compute host tempest-host-708564683 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:17.385803 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d913deca-fc80-4b2b-b168-7f78e68b6b7a tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af/action" status: 400 len: 99 microversion: 2.1 time: 1.107409 Oct 31 14:04:17.392168 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 255/423] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 31 14:04:16 2022] POST /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af/action => generated 99 bytes in 1114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:04:17.398808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-738819860", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "222071100", "adminPass": "***", "networks": [{"uuid": "03c8004a-c6a7-4f53-a7ba-61bbec053161"}], "security_groups": [{"name": "tempest-securitygroup--164383711"}], "key_name": "tempest-keypair-959568785", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:18.194992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] validate_networks() for [('03c8004a-c6a7-4f53-a7ba-61bbec053161', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:04:18.365668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Building network info cache for instance {{(pid=120641) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:04:18.369842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=72,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:18.963119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:20.554578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:04:20.555136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:04:20.555558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:04:20.555889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:04:20.556312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:04:20.578555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:20.579053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:20.581838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:20.582856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:20.589422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:20.590204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:20.628808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Getting quotas for project cfde485f2bc54a4ba158a7297910a66a. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:04:20.640142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Getting quotas for user 998bd703ae1e47adb054f66e15a943cc and project cfde485f2bc54a4ba158a7297910a66a. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:04:20.663549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:04:20.672083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:04:20.769395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-987f9b66-3318-4b59-8e7f-a920f64d7d22 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.375842 Oct 31 14:04:20.778338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 256/424] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:04:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 3385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:04:20.791135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:20.792834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:20.813046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:20.814866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:20.816021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:20.817481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:20.820790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:20.822467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:21.047222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:21.057349 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a77c270-cfed-431e-a391-2613e575b311 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1290 microversion: 2.1 time: 0.277020 Oct 31 14:04:21.070935 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 257/425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:20 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1290 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:21.094440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:21.102882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:21.128873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:21.129123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:21.129571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:21.137622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:21.140197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:21.140649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:21.895233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:21.912007 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b548ae8-3981-4ca5-9b14-1c38eb5f2421 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1468 microversion: 2.1 time: 0.834295 Oct 31 14:04:21.932812 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 258/426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:21 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1468 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:21.951253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ec088bb1-aede-4f6e-874c-603a09e4574a req-8e03a658-ed45-441a-9db0-d94e2e927302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:21.981257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ec088bb1-aede-4f6e-874c-603a09e4574a req-8e03a658-ed45-441a-9db0-d94e2e927302 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:21.982538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ec088bb1-aede-4f6e-874c-603a09e4574a req-8e03a658-ed45-441a-9db0-d94e2e927302 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:21.983303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ec088bb1-aede-4f6e-874c-603a09e4574a req-8e03a658-ed45-441a-9db0-d94e2e927302 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:22.024082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ec088bb1-aede-4f6e-874c-603a09e4574a req-8e03a658-ed45-441a-9db0-d94e2e927302 service nova] Creating event network-changed:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:04:22.031946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ec088bb1-aede-4f6e-874c-603a09e4574a req-8e03a658-ed45-441a-9db0-d94e2e927302 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096427 Oct 31 14:04:22.034742 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 259/427] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:22.396084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a103ebd-cc60-4947-8597-945fb68ea7c7 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '.version_select at 0x7fe107e36550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:22.513842 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a103ebd-cc60-4947-8597-945fb68ea7c7 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8" status: 200 len: 371 microversion: 2.1 time: 0.477687 Oct 31 14:04:22.514457 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 260/428] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:04:22 2022] GET /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8 => generated 371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:22.519440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:22.521986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:22.524149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Updating instance_info_cache with network_info: [{"id": "416e21ee-8d1a-48c3-b433-9f75ce084928", "address": "fa:16:3e:2b:8f:c5", "network": {"id": "6210a55b-8790-4aa9-8e81-23a0101568be", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1293722175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a6c5ba969b654c3986dbd6c693887bff", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap416e21ee-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120641) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:04:22.547350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:22.550841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:22.551327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:22.553649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:22.555985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Releasing lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:04:22.556157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:22.556960 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ded8bb01-1715-4bc5-a0e4-45d571771fb4 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action" status: 202 len: 0 microversion: 2.1 time: 13.609863 Oct 31 14:04:22.557521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:22.573935 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 169/429] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:08 2022] POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action => generated 0 bytes in 13623 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:04:22.583867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3062e1ff-5143-4e34-932b-e080a7d2a8d6 req-f92c8bfc-043c-4b2f-875e-b5b8c825b283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af71f3-df25-4ad4-967b-5414eaf8577a", "name": "network-vif-deleted", "tag": "c8104c9c-f975-4500-a421-dcafe812be76"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:22.645118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3062e1ff-5143-4e34-932b-e080a7d2a8d6 req-f92c8bfc-043c-4b2f-875e-b5b8c825b283 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:22.646112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3062e1ff-5143-4e34-932b-e080a7d2a8d6 req-f92c8bfc-043c-4b2f-875e-b5b8c825b283 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:22.650490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3062e1ff-5143-4e34-932b-e080a7d2a8d6 req-f92c8bfc-043c-4b2f-875e-b5b8c825b283 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:22.714927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3062e1ff-5143-4e34-932b-e080a7d2a8d6 req-f92c8bfc-043c-4b2f-875e-b5b8c825b283 service nova] Creating event network-vif-deleted:c8104c9c-f975-4500-a421-dcafe812be76 for instance 60af71f3-df25-4ad4-967b-5414eaf8577a on n-h2-863052-1 Oct 31 14:04:22.745664 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3062e1ff-5143-4e34-932b-e080a7d2a8d6 req-f92c8bfc-043c-4b2f-875e-b5b8c825b283 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164425 Oct 31 14:04:22.747173 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 170/430] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:22.753076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:22.759433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:22.776616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:22.781243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:22.786749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:22.807209 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c78c3016-a365-4df2-ba74-57e35ec813b4 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1313 microversion: 2.1 time: 0.291419 Oct 31 14:04:22.807794 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 261/431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:22 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:22.824013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:22.824013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:22.824013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:22.824830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:22.870859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-532773102", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:23.000346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:04:23.531369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:23.540972 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e321d225-a322-4be9-bb48-098fce14e4fa tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 0.792261 Oct 31 14:04:23.547056 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 171/432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:22 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:23.565542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c192af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:23.683614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:23.686894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:23.687594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:23.689909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:23.690640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:23.693195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:23.842642 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71adbfe7-0e6a-4d13-b9ab-7c27357d8365 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8" status: 200 len: 328 microversion: 2.1 time: 0.293947 Oct 31 14:04:23.845904 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 172/433] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:04:23 2022] PUT /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8 => generated 328 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:23.861565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ea6b598-0370-4055-849e-679d35f6b2e1 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '.version_select at 0x7fe10c25cb80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:23.994823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:04:23.994823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:04:23.995371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:04:23.995907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:04:23.996573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:04:24.020346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:24.020927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:24.021270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:24.022010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:24.022500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:24.022932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:24.065487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Getting quotas for project f616fea9c23a4d1bb330aff30f78057d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:04:24.076701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Getting quotas for user b0091bea85ad4e77871d537309bdb88f and project f616fea9c23a4d1bb330aff30f78057d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:04:24.112443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:04:24.117246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:04:24.244798 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf5f2d54-cb0b-4b4d-ab28-82988b2ad0bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391737 Oct 31 14:04:24.255759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 262/434] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:04:24.399312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-888692394", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d2840ce8-8e29-4e7a-8617-461972287234"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:24.481763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] validate_networks() for [('d2840ce8-8e29-4e7a-8617-461972287234', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:04:25.468334 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ea6b598-0370-4055-849e-679d35f6b2e1 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/c30fb824-82f7-440f-ad4e-c4511e328b85" status: 200 len: 185 microversion: 2.1 time: 1.621059 Oct 31 14:04:25.469830 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 173/435] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:04:23 2022] GET /compute/v2.1/os-floating-ips/c30fb824-82f7-440f-ad4e-c4511e328b85 => generated 185 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:25.485826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:25.486498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:25.497226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:25.499433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:25.500820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:25.503227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:25.504072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:25.506876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:25.648945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:25.675784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-338431e7-1b27-400a-a04a-c980e1354c15 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1319 microversion: 2.1 time: 0.204593 Oct 31 14:04:25.686512 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 174/436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:25 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:25.691721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a0940935-c29d-4a87-90ce-7c79b4f78948 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:25.728980 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a0940935-c29d-4a87-90ce-7c79b4f78948 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8" status: 202 len: 0 microversion: 2.1 time: 0.039308 Oct 31 14:04:25.730767 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 175/437] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:04:25 2022] DELETE /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:04:25.750272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:25.752105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:25.767327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:25.768090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:25.768755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:25.769626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:25.770457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:25.771042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:25.892480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:25.913746 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89227e1c-2164-4c0a-8ea5-0920e70b4479 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1270 microversion: 2.1 time: 0.181643 Oct 31 14:04:25.916317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 176/438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:25 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:25.942314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:25.943257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:25.965546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:25.966349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:25.968048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:25.969101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:25.971327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:25.971936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:26.873011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:04:26.873489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:04:26.873715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:04:26.874710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:04:26.875302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:04:26.900292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:26.901016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:26.910955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:26.912044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:26.912684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:26.913273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:26.951753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:04:26.964606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for user 57251d140f49460087e4cf90f6b94a78 and project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:04:26.987330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:04:26.990245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:04:27.014478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:27.028948 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70cc2259-84ec-438f-87f8-3e6d92b6ae26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 1.111139 Oct 31 14:04:27.029789 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 177/439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:25 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:27.046616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.162"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:27.067405 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d24569d-9712-439e-bc94-8633d8555f81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.808154 Oct 31 14:04:27.075818 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 263/440] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:04:27.090607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41b0583f-d3ca-4585-8b48-4ae0b88a1aa8 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '.version_select at 0x7fe107e06b80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:27.311791 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41b0583f-d3ca-4585-8b48-4ae0b88a1aa8 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8" status: 200 len: 371 microversion: 2.1 time: 0.234402 Oct 31 14:04:27.327434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 264/441] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:04:27 2022] GET /compute/v2.1/os-quota-sets/bde919429df244ea861fc7544dceadf8 => generated 371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:27.345588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:27.346235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:27.373573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:27.374751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:27.375219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:27.376160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:27.376654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:27.377261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.037042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:28.058962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.060751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.063119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.065482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.068382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.072314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.105605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:28.114446 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f847d57f-0363-4c7a-b508-9f128ebac30b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.785554 Oct 31 14:04:28.115043 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 265/442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:27 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:28.135953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:28.136698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:28.139840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:28.172201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.172778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.185413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.186272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.186762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.187196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.596856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:28.606558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02056c38-a327-458e-bc53-0c93a07579bc tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1276 microversion: 2.1 time: 0.490407 Oct 31 14:04:28.626349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 266/443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:28 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1276 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:28.641992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a618d02c-9d1a-4b6d-8870-f01018f12aa7 req-de3d68be-7a7f-42bc-9b70-069f93bb7dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ca322-fb3a-4360-ac28-1f322c61c634", "tag": "888da1e1-02b2-4550-8eb4-450eed6d09a4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:28.682229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a618d02c-9d1a-4b6d-8870-f01018f12aa7 req-de3d68be-7a7f-42bc-9b70-069f93bb7dbf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.682962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a618d02c-9d1a-4b6d-8870-f01018f12aa7 req-de3d68be-7a7f-42bc-9b70-069f93bb7dbf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.687606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a618d02c-9d1a-4b6d-8870-f01018f12aa7 req-de3d68be-7a7f-42bc-9b70-069f93bb7dbf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.715574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a618d02c-9d1a-4b6d-8870-f01018f12aa7 req-de3d68be-7a7f-42bc-9b70-069f93bb7dbf service nova] Creating event network-changed:888da1e1-02b2-4550-8eb4-450eed6d09a4 for instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 on n-h1-863052-1 Oct 31 14:04:28.729818 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a618d02c-9d1a-4b6d-8870-f01018f12aa7 req-de3d68be-7a7f-42bc-9b70-069f93bb7dbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101766 Oct 31 14:04:28.731006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 267/444] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:28.736412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:28.743331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:28.756294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.757118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.762899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.763693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:28.764837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:28.766008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:28.920676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:28.936966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:28.943128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:28.944296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e3e3f74e-7d59-4c05-a840-bdd8eeadff2a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1257 microversion: 2.25 time: 0.212016 Oct 31 14:04:28.952941 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 268/445] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:28 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1257 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:28.957799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4adc29f6-7bd7-43cf-9b56-e68c20460d59 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '.version_select at 0x7fe107e06280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:29.363731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4adc29f6-7bd7-43cf-9b56-e68c20460d59 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.408252 Oct 31 14:04:29.366288 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 269/446] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:04:28 2022] GET /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc/defaults => generated 371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:29.379131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:29.384068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:29.405951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:29.408355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:29.409083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:29.409962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:29.414690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:29.417549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:04:29.418195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquired lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:04:29.425365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:30.461524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:30.474204 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2189b118-99a9-4076-85b8-91629f8c956e tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 1.105982 Oct 31 14:04:30.475021 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 270/447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:29 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:30.493088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:30.497085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:30.519650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:30.521315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:30.522026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:30.525149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:30.525894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:30.526856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:31.222054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:31.231150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2776882d-544b-4799-bc4a-32143e17c2e3 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.751637 Oct 31 14:04:31.237022 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 271/448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:30 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:31.255017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:31.255849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:31.262831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:31.263638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:31.264300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:31.265192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:31.265918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:31.266647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:32.006079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:32.027685 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53e2524f-7e31-4b7b-81be-9f49e9fb75bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.786241 Oct 31 14:04:32.031078 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 272/449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:31 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:32.037322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Action: 'update', calling method: .version_select at 0x7fe107e36a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:32.225051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:32.225536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:32.226336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:32.227219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:32.227827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:32.228405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:32.316334 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4bb0433b-362c-4ead-8051-eba832f4abcf tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f" status: 200 len: 328 microversion: 2.1 time: 0.283872 Oct 31 14:04:32.325713 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 273/450] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:04:32 2022] PUT /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f => generated 328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:32.332061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:32.332679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:32.339690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:32.340373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:32.341439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:32.342381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:32.343006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:32.343615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:33.188438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:33.199916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:33.201373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:33.209099 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98ff6dbe-7cc0-4715-8ce9-42c64e32d412 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.881905 Oct 31 14:04:33.211106 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 274/451] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:32 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:33.225229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:33.226788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:33.235298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:33.236348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:33.236991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:33.247959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:33.249114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:33.249787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:33.508670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Building network info cache for instance {{(pid=120641) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:04:33.722156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:33.825727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:33.915111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:33.932433 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5a0afe2-c2ef-40a8-a1af-74b2a7cc5d64 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 0.719324 Oct 31 14:04:33.934055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 275/452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:33 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:33.942677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:33.944340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:33.955507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:33.956311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:33.956920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:33.957618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:33.958512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:33.958940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:33.981128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:34.379804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:34.394630 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69441be7-5414-4aa9-ac92-485c78788df8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.459085 Oct 31 14:04:34.396003 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 276/453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:33 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:34.410101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-39e2785a-09bd-44be-88b5-32a35b65a85a req-ac9203a3-6654-4df6-a26c-9f992e63be51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800d44ad-a714-4a33-a0b0-dc46b4091241", "tag": "2451e158-5ca6-4a65-a126-d3806a2886a1"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:34.427704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-39e2785a-09bd-44be-88b5-32a35b65a85a req-ac9203a3-6654-4df6-a26c-9f992e63be51 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:34.429071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-39e2785a-09bd-44be-88b5-32a35b65a85a req-ac9203a3-6654-4df6-a26c-9f992e63be51 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:34.429578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-39e2785a-09bd-44be-88b5-32a35b65a85a req-ac9203a3-6654-4df6-a26c-9f992e63be51 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:34.458028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-39e2785a-09bd-44be-88b5-32a35b65a85a req-ac9203a3-6654-4df6-a26c-9f992e63be51 service nova] Creating event network-changed:2451e158-5ca6-4a65-a126-d3806a2886a1 for instance 800d44ad-a714-4a33-a0b0-dc46b4091241 on n-h1-863052-1 Oct 31 14:04:34.466127 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-39e2785a-09bd-44be-88b5-32a35b65a85a req-ac9203a3-6654-4df6-a26c-9f992e63be51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068582 Oct 31 14:04:34.467178 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 277/454] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:34.474150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '.version_select at 0x7fe107e36940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:34.633025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:34.646633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:34.647171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:34.652361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:34.654382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:34.654849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:34.719608 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03750f17-1982-428d-ad83-1900e990a623 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f/detail" status: 200 len: 916 microversion: 2.1 time: 0.247890 Oct 31 14:04:34.734213 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 278/455] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:04:34 2022] GET /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f/detail => generated 916 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:34.768910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:34.769782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:34.779707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:34.780276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:34.780720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:34.781431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:34.782244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:34.782429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.141735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:35.152719 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8da0ba9-7c2c-4632-bcec-4b9b3e9ee966 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.428813 Oct 31 14:04:35.153979 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 279/456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:34 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:35.159447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f3165195-e06b-48d1-af4a-63c4b3437857 req-0e4ca877-3f70-4da3-80fb-5ef7b351bf41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:35.183871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f3165195-e06b-48d1-af4a-63c4b3437857 req-0e4ca877-3f70-4da3-80fb-5ef7b351bf41 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.189786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f3165195-e06b-48d1-af4a-63c4b3437857 req-0e4ca877-3f70-4da3-80fb-5ef7b351bf41 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.190222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f3165195-e06b-48d1-af4a-63c4b3437857 req-0e4ca877-3f70-4da3-80fb-5ef7b351bf41 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.213065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f3165195-e06b-48d1-af4a-63c4b3437857 req-0e4ca877-3f70-4da3-80fb-5ef7b351bf41 service nova] Creating event network-changed:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:04:35.225073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f3165195-e06b-48d1-af4a-63c4b3437857 req-0e4ca877-3f70-4da3-80fb-5ef7b351bf41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067747 Oct 31 14:04:35.225793 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 280/457] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:35.232657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:35.234006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:35.241033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.241999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.242501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.243478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.246478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.246478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.566019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:35.580533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:35.583774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:35.584896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d367e43-825d-4059-a867-fdec2c68f82b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.357493 Oct 31 14:04:35.585491 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 281/458] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:35 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:35.594813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:35.599042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:35.611547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.612314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.612907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.613765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.614398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.614971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.824554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Updating instance_info_cache with network_info: [{"id": "416e21ee-8d1a-48c3-b433-9f75ce084928", "address": "fa:16:3e:2b:8f:c5", "network": {"id": "6210a55b-8790-4aa9-8e81-23a0101568be", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1293722175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a6c5ba969b654c3986dbd6c693887bff", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap416e21ee-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120641) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:04:35.839215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Releasing lock "refresh_cache-dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:04:35.840884 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-637f8ad9-5671-46b4-97c1-e44683801b22 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action" status: 202 len: 0 microversion: 2.1 time: 8.809763 Oct 31 14:04:35.847411 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 178/459] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:27 2022] POST /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b/action => generated 0 bytes in 8817 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:04:35.855277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c35c430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:35.970001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.971376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.971992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:35.973001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:35.975207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:35.976567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.039468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.040201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.040858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.041913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.042695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.043941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.130205 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0d96d86-db54-444b-bc16-770d2663f501 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f?user_id=782eb151d2254ad5948585924d115b6f" status: 200 len: 328 microversion: 2.1 time: 0.281141 Oct 31 14:04:36.139337 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 179/460] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:04:35 2022] PUT /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f?user_id=782eb151d2254ad5948585924d115b6f => generated 328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:36.145091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:36.145870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:36.154300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.154985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.155766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.156628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.157189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.157731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.162190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:36.176405 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cad1ce69-378d-48f5-a2b5-da571a257d73 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 0.585102 Oct 31 14:04:36.190193 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 282/461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:35 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:36.401012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-035a6ed1-5671-4271-8627-6a5fd80e2417 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Action: 'create', calling method: .version_select at 0x7fe107d8a0d0>, body: {"keypair": {"name": "tempest-keypair-1340831913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxaP/ZR0dRb8Drmsb20YaTq5P7IO7K6j2NYjO/4X65TkRAilnQnhZXHzyXPNxr6R36OXbsZFEhV8r2Ud76LsFwlfUiy5M/kxZSV1DYzXdC+1OBZCVlecg0XM8Mzi/46VQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:36.427759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-035a6ed1-5671-4271-8627-6a5fd80e2417 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Getting quotas for project 3b521bd0aac94c2ea9702ae724953dbf. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:04:36.438211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-035a6ed1-5671-4271-8627-6a5fd80e2417 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Getting quotas for user 525cf99f53e043d39794f8ecf0f739f0 and project 3b521bd0aac94c2ea9702ae724953dbf. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:04:36.506013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-035a6ed1-5671-4271-8627-6a5fd80e2417 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324947 Oct 31 14:04:36.513414 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 283/462] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:04:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:36.522107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:36.523311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:36.534916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.535285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.535719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.536922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.536922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.537270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.553345 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] HTTP exception thrown: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Request method failure captured: Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d HTTP/1.1 Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WKTPm0T0ao0ZMLbktIrTC0O8Hh6htQROf0uhsRkX9FXzDYsM9y1q8eco11z26gIZBE5VRCaJJaQGaimjczarbZ5-jc8DzBtEFLd3hoXfjhU5SSkKyGPgBCv9KhcpxbeCrAoeA3fP5xwYnfF4KJahsevo1WD8c7E2175ewbr9JsMxo Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:04:36.555633 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c5ba969b654c3986dbd6c693887bff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a58704dad2b94740be8042992cb16454 Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:36.556974 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'd02a333c-6593-4778-94cc-f5da011be94d'} Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:36.557670 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:36.558886 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:36.561553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Returning 404 to user: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:36.562628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-081b6961-0697-45eb-8d8d-3847632049a0 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 404 len: 111 microversion: 2.1 time: 0.053338 Oct 31 14:04:36.563351 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 284/463] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:04:36 2022] DELETE /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:36.568618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2edde8c8-0a7e-434b-ba9c-ed990434d329 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '.version_select at 0x7fe107de9160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:36.665329 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2edde8c8-0a7e-434b-ba9c-ed990434d329 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f?user_id=782eb151d2254ad5948585924d115b6f" status: 200 len: 370 microversion: 2.1 time: 0.100626 Oct 31 14:04:36.666240 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 285/464] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Oct 31 14:04:36 2022] GET /compute/v2.1/os-quota-sets/882856b658b5403d8e8bba4a8c537f2f?user_id=782eb151d2254ad5948585924d115b6f => generated 370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:36.679391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:36.680118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:36.689557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.690051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.691710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.693005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.694102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.695331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.809449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:36.827222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-11aba222-171e-4b9b-b050-916c623c9764 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.686217 Oct 31 14:04:36.830067 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 180/465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:36 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:36.840903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b4066db2-49ed-4c65-b459-a70fcf8f4a14 req-557d40f7-b232-42bd-8891-9f17b8879483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa13472-b070-4173-9a4e-4b8f8feaa8c1", "tag": "7f4d092f-29c3-4472-8418-3f747782bad3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:36.851862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b4066db2-49ed-4c65-b459-a70fcf8f4a14 req-557d40f7-b232-42bd-8891-9f17b8879483 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.853859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b4066db2-49ed-4c65-b459-a70fcf8f4a14 req-557d40f7-b232-42bd-8891-9f17b8879483 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.854548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b4066db2-49ed-4c65-b459-a70fcf8f4a14 req-557d40f7-b232-42bd-8891-9f17b8879483 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.879733 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b4066db2-49ed-4c65-b459-a70fcf8f4a14 req-557d40f7-b232-42bd-8891-9f17b8879483 service nova] Creating event network-changed:7f4d092f-29c3-4472-8418-3f747782bad3 for instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 on n-h2-863052-1 Oct 31 14:04:36.890570 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b4066db2-49ed-4c65-b459-a70fcf8f4a14 req-557d40f7-b232-42bd-8891-9f17b8879483 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058796 Oct 31 14:04:36.891170 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 181/466] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:36.911988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:36.926221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: d02a333c-6593-4778-94cc-f5da011be94d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:36.960794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.963976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.964466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:36.965222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:36.965693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:36.966127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:37.004679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] HTTP exception thrown: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Request method failure captured: Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d HTTP/1.1 Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WKTPm0T0ao0ZMLbktIrTC0O8Hh6htQROf0uhsRkX9FXzDYsM9y1q8eco11z26gIZBE5VRCaJJaQGaimjczarbZ5-jc8DzBtEFLd3hoXfjhU5SSkKyGPgBCv9KhcpxbeCrAoeA3fP5xwYnfF4KJahsevo1WD8c7E2175ewbr9JsMxo Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:04:37.012654 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c5ba969b654c3986dbd6c693887bff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: a58704dad2b94740be8042992cb16454 Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:37.014005 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd02a333c-6593-4778-94cc-f5da011be94d'} Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:37.014740 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. Oct 31 14:04:37.016470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:37.018094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Returning 404 to user: Instance d02a333c-6593-4778-94cc-f5da011be94d could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:37.018094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cebb42e3-9ac0-4079-8dd6-667afea8b253 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d" status: 404 len: 111 microversion: 2.1 time: 0.118370 Oct 31 14:04:37.019040 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 182/467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:36 2022] GET /compute/v2.1/servers/d02a333c-6593-4778-94cc-f5da011be94d => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:37.026291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:37.027310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:37.037583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:37.039547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:37.040342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:37.041272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:37.041929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:37.042601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:37.318765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:37.330680 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ea1bf67-3c42-498e-96ce-12d1ee1c7e95 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.662767 Oct 31 14:04:37.331592 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 286/468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:36 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:37.337801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed4cd5ba-0d44-464b-894a-3d325fdbb009 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '.version_select at 0x7fe107d8a310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:37.841403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:37.855400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:37.859679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:37.860965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-158ec23c-2534-4038-8cb5-f6f54e393fa7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.840881 Oct 31 14:04:37.864021 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 183/469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:37 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:37.888491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:37.889120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:37.901804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:37.910991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:37.912147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:37.914039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:37.915226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:37.915876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:38.298111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:38.318335 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4841c96f-ba62-4030-aa87-6ddf4007caf7 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 0.449986 Oct 31 14:04:38.335737 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 184/470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:37 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:38.335737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01e973f2-e8fe-45fe-a81c-fc0b0500a05e tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Calling method '.version_select at 0x7fe10c0aa040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:38.634076 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01e973f2-e8fe-45fe-a81c-fc0b0500a05e tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.313167 Oct 31 14:04:38.635645 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 185/471] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:04:38 2022] GET /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc/defaults => generated 371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:38.644217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c9f69dfa-31d2-454a-9fb4-35234b8d46ff req-9991e90f-cc55-4930-a4c9-8443cd9e630f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e2d575-4378-4af3-a7df-7cd877f77090", "tag": "304c534a-f4f7-4fee-a9f0-589142a7085e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:38.654081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c9f69dfa-31d2-454a-9fb4-35234b8d46ff req-9991e90f-cc55-4930-a4c9-8443cd9e630f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:38.654703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c9f69dfa-31d2-454a-9fb4-35234b8d46ff req-9991e90f-cc55-4930-a4c9-8443cd9e630f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:38.655204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c9f69dfa-31d2-454a-9fb4-35234b8d46ff req-9991e90f-cc55-4930-a4c9-8443cd9e630f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:38.688143 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c9f69dfa-31d2-454a-9fb4-35234b8d46ff req-9991e90f-cc55-4930-a4c9-8443cd9e630f service nova] Creating event network-changed:304c534a-f4f7-4fee-a9f0-589142a7085e for instance 14e2d575-4378-4af3-a7df-7cd877f77090 on n-h2-863052-1 Oct 31 14:04:38.696117 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c9f69dfa-31d2-454a-9fb4-35234b8d46ff req-9991e90f-cc55-4930-a4c9-8443cd9e630f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058645 Oct 31 14:04:38.698315 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 186/472] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:38.707859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:38.709860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:38.719806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:38.720682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:38.721457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:38.722953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:38.724061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:38.724652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:38.935058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:38.946047 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da738946-15d7-4418-b117-f03cca8b2106 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.246107 Oct 31 14:04:38.958211 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 187/473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:38 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:38.964787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:38.965728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:38.972305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:38.972954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:38.973547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:38.974460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:38.975083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:38.975596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.224681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:39.233419 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7dccb009-c4da-47d2-b6e7-764978539fbe tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.280626 Oct 31 14:04:39.234226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 188/474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:38 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:39.239000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed4cd5ba-0d44-464b-894a-3d325fdbb009 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/c30fb824-82f7-440f-ad4e-c4511e328b85" status: 202 len: 0 microversion: 2.1 time: 1.905730 Oct 31 14:04:39.240872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 287/475] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:04:37 2022] DELETE /compute/v2.1/os-floating-ips/c30fb824-82f7-440f-ad4e-c4511e328b85 => generated 0 bytes in 1909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:04:39.249119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Action: 'update', calling method: .version_select at 0x7fe107dc2f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:39.254731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-79b0444a-d642-45a6-856f-7ddbd2ee713d req-dd280d86-30e2-413d-9eb3-5484bc8694c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2ca322-fb3a-4360-ac28-1f322c61c634", "name": "network-vif-plugged", "status": "completed", "tag": "888da1e1-02b2-4550-8eb4-450eed6d09a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:39.264766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79b0444a-d642-45a6-856f-7ddbd2ee713d req-dd280d86-30e2-413d-9eb3-5484bc8694c9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.265312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79b0444a-d642-45a6-856f-7ddbd2ee713d req-dd280d86-30e2-413d-9eb3-5484bc8694c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.265808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79b0444a-d642-45a6-856f-7ddbd2ee713d req-dd280d86-30e2-413d-9eb3-5484bc8694c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.284096 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-79b0444a-d642-45a6-856f-7ddbd2ee713d req-dd280d86-30e2-413d-9eb3-5484bc8694c9 service nova] Creating event network-vif-plugged:888da1e1-02b2-4550-8eb4-450eed6d09a4 for instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 on n-h1-863052-1 Oct 31 14:04:39.289273 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-79b0444a-d642-45a6-856f-7ddbd2ee713d req-dd280d86-30e2-413d-9eb3-5484bc8694c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044184 Oct 31 14:04:39.290052 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 189/476] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:39.295691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:39.296404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:39.306145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.306578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.307019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.307728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.308185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.308610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.333740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=57 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:39.342426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.343604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.344123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.345383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.346059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.346526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.355759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=13 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:39.515505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:39.598738 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73444416-0a4b-4457-95d3-a3a296120c0f tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc" status: 200 len: 329 microversion: 2.1 time: 0.355355 Oct 31 14:04:39.599551 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 288/477] 10.222.0.27 () {60 vars in 1263 bytes} [Mon Oct 31 14:04:39 2022] PUT /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc => generated 329 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:39.611514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:39.612005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:39.620605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.621411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.622274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.623330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.624300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.624923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.661528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:04:39.760438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7024191d-6616-43cb-a27a-524da464af70 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 204 len: 0 microversion: 2.1 time: 0.152213 Oct 31 14:04:39.764516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 289/478] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:04:39 2022] DELETE /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:04:39.772697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:39.773568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:39.781294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.781844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.782338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:39.783108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:39.783574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:39.784023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.082470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:40.088637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:40.099229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:40.099368 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65ed189d-8702-422e-93ed-0d0864b73dae tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 0.332925 Oct 31 14:04:40.100120 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 290/479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:39 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:40.102516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:40.103928 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a59794b4-fb8a-486f-a8de-9a36c66ef0df tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.812873 Oct 31 14:04:40.120025 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 190/480] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:39 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:40.127843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:40.128010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Action: 'update', calling method: .version_select at 0x7fe107ec5a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:40.128680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:40.135305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.136141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.136797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.137937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.138657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.139313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.213065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.213708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.213968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.215583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.216354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.216786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.506813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:40.515454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8acbe1b-479c-4fc1-a64b-ed3c99ea734e tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1527 microversion: 2.1 time: 0.394071 Oct 31 14:04:40.516048 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 191/481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:40 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1527 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:40.530485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:40.530485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:40.547810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.549619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.551344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.552266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.552847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.554903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.619418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:40.815948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45dc540a-722f-4bac-a7f7-04afde7d62e9 tempest-QuotasAdminTestJSON-483549851 tempest-QuotasAdminTestJSON-483549851-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc" status: 200 len: 329 microversion: 2.1 time: 0.697697 Oct 31 14:04:40.827991 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 291/482] 10.222.0.27 () {60 vars in 1263 bytes} [Mon Oct 31 14:04:40 2022] PUT /compute/v2.1/os-quota-sets/9e15e60bfed64c5d99f3ffb6330905fc => generated 329 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:40.850555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:40.851225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:40.880865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.882815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.884761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.886369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:40.889271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:40.889779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:40.909678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:40.920483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fcc678ed-b850-4209-a47a-36bae32969b0 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.393173 Oct 31 14:04:40.921898 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 192/483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:40 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:41.102231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1269270082", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "3292b331-9f74-4da0-a73e-1098bacf9c71"}], "security_groups": [{"name": "tempest-securitygroup--508983268"}], "key_name": "tempest-keypair-1340831913", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:41.199652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:41.225778 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d34004e3-3ea3-4d33-b9ee-2ac9648f04cb tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.387595 Oct 31 14:04:41.245432 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 292/484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:40 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:41.254505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:41.258982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:41.273514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:41.274053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:41.274523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:41.275248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:41.278845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:41.279302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:41.415766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] validate_networks() for [('3292b331-9f74-4da0-a73e-1098bacf9c71', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:04:41.665967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:41.682683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-261c835f-79e0-4fa7-97de-d106df685931 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1332 microversion: 2.1 time: 0.435330 Oct 31 14:04:41.684826 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 293/485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:41 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1332 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:41.691933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:41.692636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:41.704697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:41.705228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:41.706096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:41.706838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:41.707295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:41.708053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:41.966922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:41.979625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:41.981743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:41.982577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3575c6ab-b1f7-4a82-affc-05eb7149f622 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.296551 Oct 31 14:04:41.988386 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 294/486] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:41 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:41.993774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d776bf17-34f8-4a1f-8c6a-0a554efa4066 req-863d993d-187c-4867-8ea0-03c5eb5ef7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800d44ad-a714-4a33-a0b0-dc46b4091241", "name": "network-vif-plugged", "status": "completed", "tag": "2451e158-5ca6-4a65-a126-d3806a2886a1"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:42.021090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d776bf17-34f8-4a1f-8c6a-0a554efa4066 req-863d993d-187c-4867-8ea0-03c5eb5ef7a3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.021606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d776bf17-34f8-4a1f-8c6a-0a554efa4066 req-863d993d-187c-4867-8ea0-03c5eb5ef7a3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.022077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d776bf17-34f8-4a1f-8c6a-0a554efa4066 req-863d993d-187c-4867-8ea0-03c5eb5ef7a3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.041095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d776bf17-34f8-4a1f-8c6a-0a554efa4066 req-863d993d-187c-4867-8ea0-03c5eb5ef7a3 service nova] Creating event network-vif-plugged:2451e158-5ca6-4a65-a126-d3806a2886a1 for instance 800d44ad-a714-4a33-a0b0-dc46b4091241 on n-h1-863052-1 Oct 31 14:04:42.051875 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d776bf17-34f8-4a1f-8c6a-0a554efa4066 req-863d993d-187c-4867-8ea0-03c5eb5ef7a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062464 Oct 31 14:04:42.052769 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 295/487] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:42.065887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:42.066826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:42.078915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.079488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.079936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.082783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.083688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.084592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.571482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58704dad2b94740be8042992cb16454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c5ba969b654c3986dbd6c693887bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:42.571741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:04:42.575247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:04:42.575767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:04:42.576238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:04:42.576662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:04:42.601801 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6a970d8-b1ac-493c-9cdf-6f4b2773c886 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 200 len: 1527 microversion: 2.1 time: 0.545445 Oct 31 14:04:42.602760 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 296/488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:42 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 1527 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:42.612724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.613716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.614186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.614982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.615443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.616046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.622488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:42.623432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:42.628989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:INSERT=18,nova_api:SELECT=67,nova_api:UPDATE=15 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:42.642281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.643127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Getting quotas for project 3b521bd0aac94c2ea9702ae724953dbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:04:42.651741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.652567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.653549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.654283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.654826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Getting quotas for user 525cf99f53e043d39794f8ecf0f739f0 and project 3b521bd0aac94c2ea9702ae724953dbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:04:42.655192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.676498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:04:42.692805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:04:42.784894 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9254e0ed-7ede-4d37-996c-4695b47dd468 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.689085 Oct 31 14:04:42.785534 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 193/489] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:04:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:04:42.791259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:42.792092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:42.801633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.802106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.803238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:42.804184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:42.805946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:42.806561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:43.024336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:43.035625 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44be3a86-849b-468e-ab1b-0907a1270696 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.248778 Oct 31 14:04:43.036500 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 194/490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:42 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:43.061382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-99de46fa-d250-4009-bda9-5665704c8ea3 req-c1f7671f-cd3c-49c7-b9d4-a2823db6454e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5fe167-b0da-49a6-8ffb-e91e5ae1529b", "name": "network-vif-deleted", "tag": "416e21ee-8d1a-48c3-b433-9f75ce084928"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:43.073958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:43.076613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99de46fa-d250-4009-bda9-5665704c8ea3 req-c1f7671f-cd3c-49c7-b9d4-a2823db6454e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:43.077429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99de46fa-d250-4009-bda9-5665704c8ea3 req-c1f7671f-cd3c-49c7-b9d4-a2823db6454e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:43.077786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99de46fa-d250-4009-bda9-5665704c8ea3 req-c1f7671f-cd3c-49c7-b9d4-a2823db6454e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:43.097587 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-99de46fa-d250-4009-bda9-5665704c8ea3 req-c1f7671f-cd3c-49c7-b9d4-a2823db6454e service nova] Creating event network-vif-deleted:416e21ee-8d1a-48c3-b433-9f75ce084928 for instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b on n-h1-863052-1 Oct 31 14:04:43.107998 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-99de46fa-d250-4009-bda9-5665704c8ea3 req-c1f7671f-cd3c-49c7-b9d4-a2823db6454e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050536 Oct 31 14:04:43.110814 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 195/491] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:43.125821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:43.126941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:43.136088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:43.137081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:43.137932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:43.138956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:43.139649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:43.140281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:43.388721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:43.419692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1509c287-ca37-40f7-9fd8-6af0fcfee201 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1386 microversion: 2.1 time: 0.810715 Oct 31 14:04:43.423341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 297/492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:42 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1386 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:43.433152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:43.435131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8181016e-226b-4b7e-8035-6b94fe9cdacf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:43.436826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8181016e-226b-4b7e-8035-6b94fe9cdacf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:43.454024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c96dafcf-89f0-42b1-83e7-a9343c01b5f3 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1537 microversion: 2.1 time: 0.333302 Oct 31 14:04:43.456402 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 196/493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:43 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1537 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:43.470249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:43.471729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:43.492569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:43.495984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:43.497594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:43.501145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:43.502717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:43.503744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:43.619462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8181016e-226b-4b7e-8035-6b94fe9cdacf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:43.649095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8181016e-226b-4b7e-8035-6b94fe9cdacf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1242 microversion: 2.1 time: 0.212502 Oct 31 14:04:43.649674 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 298/494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:43 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1242 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:43.679427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e423b862-22c1-4e81-a46a-63583a3a60d4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'create', calling method: .version_select at 0x7fe107de9c10>, body: {"pool": "1bd3be27-dc2f-4849-b93b-48f92e845229"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:44.134291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:44.143021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:44.144474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:44.145600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04926e56-6167-4ac0-93c2-c62fb966421d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.685111 Oct 31 14:04:44.146152 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 197/495] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:43 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:44.163417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:44.164039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] [instance: dd5fe167-b0da-49a6-8ffb-e91e5ae1529b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:44.187079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:44.187568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:44.188008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:44.199163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:44.199671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:44.200207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:44.237524 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] HTTP exception thrown: Instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b could not be found. Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Request method failure captured: Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b HTTP/1.1 Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WKTPm0T0ao0ZMLbktIrTC0O8Hh6htQROf0uhsRkX9FXzDYsM9y1q8eco11z26gIZBE5VRCaJJaQGaimjczarbZ5-jc8DzBtEFLd3hoXfjhU5SSkKyGPgBCv9KhcpxbeCrAoeA3fP5xwYnfF4KJahsevo1WD8c7E2175ewbr9JsMxo Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:04:44.242194 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c5ba969b654c3986dbd6c693887bff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c5ba969b654c3986dbd6c693887bff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a6c5ba969b654c3986dbd6c693887bff Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1758018243 Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: a58704dad2b94740be8042992cb16454 Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1758018243-project Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b could not be found. Oct 31 14:04:44.243518 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'dd5fe167-b0da-49a6-8ffb-e91e5ae1529b'} Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b could not be found. Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:44.244223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b could not be found. Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b could not be found. Oct 31 14:04:44.245360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:44.256341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] Returning 404 to user: Instance dd5fe167-b0da-49a6-8ffb-e91e5ae1529b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:44.257479 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b09e245-9f74-4812-97ee-ae159da6d410 tempest-FloatingIPsAssociationTestJSON-1758018243 tempest-FloatingIPsAssociationTestJSON-1758018243-project] 10.222.0.27 "GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b" status: 404 len: 111 microversion: 2.1 time: 0.098437 Oct 31 14:04:44.258037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 198/496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:44 2022] GET /compute/v2.1/servers/dd5fe167-b0da-49a6-8ffb-e91e5ae1529b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:04:44.267287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:44.279143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:44.297451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:44.299590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:44.301912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:44.311066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:44.313073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:44.313554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:44.735088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:44.747115 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1da9e39-c68c-4a1c-b249-0116cad63081 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.487745 Oct 31 14:04:44.750975 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 199/497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:44 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:44.755826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:44.763100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:44.785839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:44.786627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:44.787059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:44.788299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:44.788741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:44.789170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.696873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:45.721420 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-068b4d5e-184d-4557-9369-a33aecc319f1 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1585 microversion: 2.1 time: 0.969035 Oct 31 14:04:45.736327 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 200/498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:44 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1585 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:45.736532 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e423b862-22c1-4e81-a46a-63583a3a60d4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.062118 Oct 31 14:04:45.736532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 299/499] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:04:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:45.736532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:45.736532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:45.744782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6bd841a0-e0d1-4040-8cf5-55329111bdf5 req-c0479457-8312-49ae-8029-a7f21fb1f1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa13472-b070-4173-9a4e-4b8f8feaa8c1", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d092f-29c3-4472-8418-3f747782bad3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:45.744921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.744921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.745208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.746083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.752377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.753276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.765562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6bd841a0-e0d1-4040-8cf5-55329111bdf5 req-c0479457-8312-49ae-8029-a7f21fb1f1c0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.766247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6bd841a0-e0d1-4040-8cf5-55329111bdf5 req-c0479457-8312-49ae-8029-a7f21fb1f1c0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.766898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6bd841a0-e0d1-4040-8cf5-55329111bdf5 req-c0479457-8312-49ae-8029-a7f21fb1f1c0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.810107 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6bd841a0-e0d1-4040-8cf5-55329111bdf5 req-c0479457-8312-49ae-8029-a7f21fb1f1c0 service nova] Creating event network-vif-plugged:7f4d092f-29c3-4472-8418-3f747782bad3 for instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 on n-h2-863052-1 Oct 31 14:04:45.858800 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6bd841a0-e0d1-4040-8cf5-55329111bdf5 req-c0479457-8312-49ae-8029-a7f21fb1f1c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119622 Oct 31 14:04:45.859804 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 201/500] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:45.867772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:45.868654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:45.876876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.877602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.878264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.879160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.879773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.880502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.904219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:45.939701 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc81ff60-193d-4476-b16b-5e136ca2e2ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1300 microversion: 2.1 time: 0.209197 Oct 31 14:04:45.942379 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 300/501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:45 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:45.950914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.26"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:45.953633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:45.977816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.978444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.978954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.980211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:45.982139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:45.983713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:45.998264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:46.038859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:04:46.039571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquired lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:04:46.419650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:46.429012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:46.431301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:46.433710 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10dd8d5c-7b76-4765-9042-244da25e3872 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.572223 Oct 31 14:04:46.435035 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 202/502] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:45 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:46.440828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:46.441791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:46.448649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:46.449526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:46.450228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:46.451301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:46.452045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:46.452459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:46.644444 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8425fb0-a62d-4445-9584-d3f3c74f50fe tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208044 Oct 31 14:04:46.649204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 203/503] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:04:46 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:46.658288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:46.659557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:46.680524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:46.681497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:46.682489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:46.683441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:46.684434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:46.685247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:47.068266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:47.079289 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a0926d69-6abb-432c-84c2-c380c2bbe5c8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1318 microversion: 2.1 time: 0.427540 Oct 31 14:04:47.079610 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 204/504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:46 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:47.098153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:47.098972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:47.105331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:47.118931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:47.119713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:47.120663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:47.121306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:47.121923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:47.251860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:47.268741 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9198c0c-9521-413a-9b01-010ca700bbd4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1300 microversion: 2.1 time: 0.186607 Oct 31 14:04:47.269932 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 205/505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:47 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:47.463256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:47.463885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:47.477179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:47.477722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:47.478345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:47.478983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:47.479447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:47.479879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:48.086695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:48.099239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:48.102007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:48.105003 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e3d1c97-cdaa-466f-993b-b62cdccf8932 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1361 microversion: 2.25 time: 0.645790 Oct 31 14:04:48.106328 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 206/506] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:47 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:04:48.111967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2ce7c58b-172e-4ebb-86a0-26cff610bb3e req-224b7cc6-06c2-4b7e-a464-e8953b3c8cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e2d575-4378-4af3-a7df-7cd877f77090", "name": "network-vif-plugged", "status": "completed", "tag": "304c534a-f4f7-4fee-a9f0-589142a7085e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:48.122637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2ce7c58b-172e-4ebb-86a0-26cff610bb3e req-224b7cc6-06c2-4b7e-a464-e8953b3c8cfb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:48.123334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2ce7c58b-172e-4ebb-86a0-26cff610bb3e req-224b7cc6-06c2-4b7e-a464-e8953b3c8cfb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:48.124377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2ce7c58b-172e-4ebb-86a0-26cff610bb3e req-224b7cc6-06c2-4b7e-a464-e8953b3c8cfb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:48.138745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2ce7c58b-172e-4ebb-86a0-26cff610bb3e req-224b7cc6-06c2-4b7e-a464-e8953b3c8cfb service nova] Creating event network-vif-plugged:304c534a-f4f7-4fee-a9f0-589142a7085e for instance 14e2d575-4378-4af3-a7df-7cd877f77090 on n-h2-863052-1 Oct 31 14:04:48.144163 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2ce7c58b-172e-4ebb-86a0-26cff610bb3e req-224b7cc6-06c2-4b7e-a464-e8953b3c8cfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Oct 31 14:04:48.145450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 207/507] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:48.151812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:48.152696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:48.159937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:48.160639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:48.161259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:48.162342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:48.164054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:48.164641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:48.601420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Building network info cache for instance {{(pid=120640) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:04:48.670467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:48.680422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97156ed0-02e1-4a80-8704-434025ba5306 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1468 microversion: 2.1 time: 0.533409 Oct 31 14:04:48.681738 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 208/508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:48 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:48.687384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:48.688474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:48.694593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:48.695254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:48.695683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:48.696524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:48.697117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:48.697716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:49.437774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Updating instance_info_cache with network_info: [{"id": "888da1e1-02b2-4550-8eb4-450eed6d09a4", "address": "fa:16:3e:88:65:95", "network": {"id": "9c84957c-d94e-4df7-b39f-eedf08b5d1fa", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1152320541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1494b216046e4d228777af0f07af30fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap888da1e1-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:04:49.470591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Releasing lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:04:49.471473 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b6a3405-2727-43e0-a67f-8aa7c29e7a05 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action" status: 202 len: 0 microversion: 2.1 time: 3.528108 Oct 31 14:04:49.476278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 301/509] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:45 2022] POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action => generated 0 bytes in 3531 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:04:49.492230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:49.515648 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8fdb696-1291-4609-8e6c-e4fc4234fc39 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1367 microversion: 2.1 time: 0.832434 Oct 31 14:04:49.517843 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 209/510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:48 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1367 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:49.531616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2e097eeb-6341-4498-9b2b-4fac2aa5fd2b req-8ff9eac5-6841-4e95-8869-2def6b029231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ca322-fb3a-4360-ac28-1f322c61c634", "tag": "888da1e1-02b2-4550-8eb4-450eed6d09a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:49.585647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e097eeb-6341-4498-9b2b-4fac2aa5fd2b req-8ff9eac5-6841-4e95-8869-2def6b029231 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:49.592643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e097eeb-6341-4498-9b2b-4fac2aa5fd2b req-8ff9eac5-6841-4e95-8869-2def6b029231 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:49.603127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e097eeb-6341-4498-9b2b-4fac2aa5fd2b req-8ff9eac5-6841-4e95-8869-2def6b029231 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:49.636745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2e097eeb-6341-4498-9b2b-4fac2aa5fd2b req-8ff9eac5-6841-4e95-8869-2def6b029231 service nova] Creating event network-changed:888da1e1-02b2-4550-8eb4-450eed6d09a4 for instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 on n-h1-863052-1 Oct 31 14:04:49.650935 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2e097eeb-6341-4498-9b2b-4fac2aa5fd2b req-8ff9eac5-6841-4e95-8869-2def6b029231 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130235 Oct 31 14:04:49.651882 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 210/511] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:49.667084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:49.671078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:49.686396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:49.687322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:49.688043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:49.689012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:49.692689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:49.693494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:49.807783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lazy-loading 'flavor' on Instance uuid eaa13472-b070-4173-9a4e-4b8f8feaa8c1 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:04:49.930910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:49.966859 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb49d407-af3a-465d-b3ca-76b8ff812695 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1/action" status: 202 len: 0 microversion: 2.1 time: 0.310164 Oct 31 14:04:49.967558 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 211/512] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:49 2022] POST /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:04:49.991122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:50.000434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:50.010891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.019409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.020242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.021272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.025627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.026462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.072560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Action: 'update', calling method: .version_select at 0x7fe107d8ab80>, body: {"quota_set": {"ram": "5120"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:50.159462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.161143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.163941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.165575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.167341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.168428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.264098 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eba5a7e0-465d-4528-8bdb-2c1bc6e32e43 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4" status: 200 len: 240 microversion: 2.36 time: 0.785898 Oct 31 14:04:50.265247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 302/513] 10.222.0.27 () {62 vars in 1303 bytes} [Mon Oct 31 14:04:49 2022] PUT /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4 => generated 240 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:04:50.273549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:50.279115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:50.288848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.289662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.291749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.292764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.293486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.294118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.710912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:50.722422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:50.732261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:50.738330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:50.739653 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6338486c-c8a1-404d-8595-f291efcac451 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1557 microversion: 2.25 time: 0.471812 Oct 31 14:04:50.740217 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6692a8e9-4a25-4bad-9637-74e7248cb253 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1585 microversion: 2.1 time: 0.769908 Oct 31 14:04:50.745517 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 212/514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:49 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1585 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:50.751172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 303/515] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:50 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1557 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:50.755863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-119d9e5d-8adb-4a55-b31f-02dab175b1cd tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'create', calling method: .version_select at 0x7fe10c192e50>, body: {"pool": "1bd3be27-dc2f-4849-b93b-48f92e845229"} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:50.770429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:50.771449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:50.778053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.778787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.779410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:50.782355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:50.783021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:50.786115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:51.114196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:51.129658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2e9ee28-85bc-43cf-b498-fc1f2b78f507 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1459 microversion: 2.1 time: 0.376583 Oct 31 14:04:51.131710 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 304/516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:50 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1459 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:51.143058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Calling method '.version_select at 0x7fe107d6daf0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:51.270373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:51.270867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:51.273038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:51.274406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:51.275051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:51.275648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:51.368543 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b99f1ac-255b-45bf-bf9d-a306019db0c3 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4/detail" status: 200 len: 672 microversion: 2.36 time: 0.233170 Oct 31 14:04:51.369802 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 305/517] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 31 14:04:51 2022] GET /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4/detail => generated 672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:04:51.380262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:51.381338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:51.388547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:51.390683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:51.391378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:51.395555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:51.396331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:51.397036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:51.657986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:51.668055 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87cb42a4-47a8-4f85-8654-d071049bd0ff tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1367 microversion: 2.1 time: 0.297077 Oct 31 14:04:51.682404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 306/518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:51 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:51.811828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:51.812762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:51.818976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:51.819542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:51.820085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:51.820847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:51.821394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:51.821860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.014486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 14e2d575-4378-4af3-a7df-7cd877f77090 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:04:52.072469 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b84fa544-d9af-42fa-bc00-88d2124c5247 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 2049 microversion: 2.25 time: 0.402146 Oct 31 14:04:52.073070 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 307/519] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:51 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 2049 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:52.077493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:52.078108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:52.085046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.085546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.085982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.086719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.087182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.087604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.325894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2fff238-1b97-4705-b04f-db6b68be63b5 tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1610 microversion: 2.1 time: 0.251750 Oct 31 14:04:52.326580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 308/520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:52 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1610 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:52.331117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b8d312cf-d98f-47aa-8213-7b1f3db167e7 req-827ae875-530c-423a-b24d-b2bae0cd2d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a58b508-0106-4617-80ee-1ea6ea5d07a9", "tag": "a7bda1ae-3528-4f2d-8709-aed92aab902a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:52.340455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b8d312cf-d98f-47aa-8213-7b1f3db167e7 req-827ae875-530c-423a-b24d-b2bae0cd2d22 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.341118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b8d312cf-d98f-47aa-8213-7b1f3db167e7 req-827ae875-530c-423a-b24d-b2bae0cd2d22 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.341772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b8d312cf-d98f-47aa-8213-7b1f3db167e7 req-827ae875-530c-423a-b24d-b2bae0cd2d22 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.352718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b8d312cf-d98f-47aa-8213-7b1f3db167e7 req-827ae875-530c-423a-b24d-b2bae0cd2d22 service nova] Creating event network-changed:a7bda1ae-3528-4f2d-8709-aed92aab902a for instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 on n-h1-863052-1 Oct 31 14:04:52.358000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b8d312cf-d98f-47aa-8213-7b1f3db167e7 req-827ae875-530c-423a-b24d-b2bae0cd2d22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030328 Oct 31 14:04:52.358731 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 309/521] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:52.364657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Action: 'update', calling method: .version_select at 0x7fe107ec5310>, body: {"quota_set": {"ram": "2048"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:52.441191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.441680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.442534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.443285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.444311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.444941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.478637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.479119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.479738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.480650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.481117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.481542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.549526 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc231f15-3f34-4c3b-8f40-153dcf6bb71c tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4?user_id=0d09afd56321438d96bce48fd385a2fe" status: 200 len: 240 microversion: 2.36 time: 0.188593 Oct 31 14:04:52.550617 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 310/522] 10.222.0.27 () {62 vars in 1384 bytes} [Mon Oct 31 14:04:52 2022] PUT /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4?user_id=0d09afd56321438d96bce48fd385a2fe => generated 240 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:04:52.557743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ec49de33-6b5e-47dd-bbde-121bad048154 req-a76b168c-0dd7-4793-8981-af0ce52bf170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800d44ad-a714-4a33-a0b0-dc46b4091241", "tag": "2451e158-5ca6-4a65-a126-d3806a2886a1"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:52.568448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ec49de33-6b5e-47dd-bbde-121bad048154 req-a76b168c-0dd7-4793-8981-af0ce52bf170 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.569775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ec49de33-6b5e-47dd-bbde-121bad048154 req-a76b168c-0dd7-4793-8981-af0ce52bf170 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.570380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ec49de33-6b5e-47dd-bbde-121bad048154 req-a76b168c-0dd7-4793-8981-af0ce52bf170 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.588178 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ec49de33-6b5e-47dd-bbde-121bad048154 req-a76b168c-0dd7-4793-8981-af0ce52bf170 service nova] Creating event network-changed:2451e158-5ca6-4a65-a126-d3806a2886a1 for instance 800d44ad-a714-4a33-a0b0-dc46b4091241 on n-h1-863052-1 Oct 31 14:04:52.593734 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ec49de33-6b5e-47dd-bbde-121bad048154 req-a76b168c-0dd7-4793-8981-af0ce52bf170 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041772 Oct 31 14:04:52.594831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 311/523] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:52.601177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:52.602069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:52.610711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.611459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.612132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.613016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.613631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.614221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.622995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:52.662265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=18 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:52.844414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 14e2d575-4378-4af3-a7df-7cd877f77090 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:04:52.862989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e4b4479-23b6-4d56-94bd-e51306fbbc24 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 2049 microversion: 2.25 time: 0.266737 Oct 31 14:04:52.863580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 312/524] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:52 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 2049 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:52.873080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:52.878452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.879227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.879956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.881557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:52.882218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:52.884071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:52.917177 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f172d2f-e51b-48d9-9c9f-32ecc5c4577d tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051789 Oct 31 14:04:52.918134 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 313/525] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:04:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:52.924567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d276fd16-6778-44e3-b4dc-b5638765aca6 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] Calling method '.version_select at 0x7fe107d64700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:53.047040 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d276fd16-6778-44e3-b4dc-b5638765aca6 tempest-QuotasAdminTestV236-322590654 tempest-QuotasAdminTestV236-322590654-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4?user_id=0d09afd56321438d96bce48fd385a2fe" status: 200 len: 282 microversion: 2.36 time: 0.127800 Oct 31 14:04:53.048123 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 314/526] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 31 14:04:52 2022] GET /compute/v2.1/os-quota-sets/7eb43e7ac5bb4feda91d11d1dde3c3e4?user_id=0d09afd56321438d96bce48fd385a2fe => generated 282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:04:53.052914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:53.054504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:53.061567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.062425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.063082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.064380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.065053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.065735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.514246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:53.523072 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5cfa889b-0d24-488f-ac16-7eb3e5502ecb tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1367 microversion: 2.1 time: 0.473647 Oct 31 14:04:53.527484 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 315/527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:53 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:53.557281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:53.565419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.565923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.566402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.567145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.567602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.568028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.638684 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dba7672c-f928-4222-866e-4fa135b47d3e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.090777 Oct 31 14:04:53.640006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 316/528] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 31 14:04:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:04:53.658280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:53.662882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:53.670504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.672414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.673101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.674016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.674947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.675631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.718311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Lazy-loading 'flavor' on Instance uuid eaa13472-b070-4173-9a4e-4b8f8feaa8c1 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:04:53.740739 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 while it is in vm_state suspended Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Request method failure captured: Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1/action HTTP/1.1 Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 97 Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XMMbZ3z06RFdJuw-Y80OQtRmdSMCEMGb6VZIfD8qcxOv0g0guZjQMXS-wZMS0mAtUbEXCFkUiUhuiVCzplGEQLA_g-2sb1vYhz71pZSS_eNVEQfJ4Y_TmsYR05lscgiHKbdv_z9UmakwiPc9bEkVFd6rSEp3fltGnifUrrBCzjP7g Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 516f1a25e4aa47bca05f781b960eda4b Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveMigrationNegativeTest-1113293236 Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:04:53.743509 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_516f1a25e4aa47bca05f781b960eda4b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/516f1a25e4aa47bca05f781b960eda4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/516f1a25e4aa47bca05f781b960eda4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/516f1a25e4aa47bca05f781b960eda4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveMigrationNegativeTest-1113293236 Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 516f1a25e4aa47bca05f781b960eda4b Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1113293236 Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveMigrationNegativeTest-1113293236-project-admin Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: cfa04d4ea12f41b092e73a819dc8139a Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveMigrationNegativeTest-1113293236-project-admin Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": true, "disk_over_commit": false}} Oct 31 14:04:53.744884 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot 'os-migrateLive' instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 while it is in vm_state suspended Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'eaa13472-b070-4173-9a4e-4b8f8feaa8c1', 'body': {'os-migrateLive': {'host': 'n-h1-863052-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 14:04:53.746240 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:53.747471 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 while it is in vm_state suspended Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 while it is in vm_state suspended Oct 31 14:04:53.748957 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:04:53.749946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 while it is in vm_state suspended {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:53.749946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8a71178-f21d-4b76-a321-dfcec28a2c3e tempest-LiveMigrationNegativeTest-1113293236 tempest-LiveMigrationNegativeTest-1113293236-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1/action" status: 409 len: 155 microversion: 2.1 time: 0.106720 Oct 31 14:04:53.749946 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 317/529] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:53 2022] POST /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1/action => generated 155 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:04:53.770083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": "auto"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:53.776269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:53.791712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.792320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.793421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.794407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:53.794972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:53.796007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:53.831597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'flavor' on Instance uuid 14e2d575-4378-4af3-a7df-7cd877f77090 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:04:53.849245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Going to try to live migrate instance to n-h1-863052-1 {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:04:54.791163 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-119d9e5d-8adb-4a55-b31f-02dab175b1cd tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.044044 Oct 31 14:04:54.792064 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 213/530] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:04:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:54.815022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:54.816809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:54.845659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:54.849042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:54.849697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:54.852642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:54.855579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:54.856242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:54.902041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:04:55.113156 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a6daf85-57c0-46f6-8fce-72ffeca5ad90 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 204 len: 0 microversion: 2.1 time: 0.318997 Oct 31 14:04:55.117272 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 214/531] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:04:54 2022] DELETE /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:04:55.125105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:55.126911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:55.139652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:55.140231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:55.140763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:55.152837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:55.166559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:55.167571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:55.526078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:55.535284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd798fc3-2eca-44cf-ad09-5f3d52c720fd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1367 microversion: 2.1 time: 0.415193 Oct 31 14:04:55.543045 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 215/532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:55 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:55.566759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.86"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:55.578595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:55.607301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:55.612728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:55.613830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:55.615182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:55.616336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:55.616916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:55.646251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:04:55.646978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquired lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:04:56.198959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229.", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:04:56.200221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Releasing lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:04:56.201382 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.201382 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Request method failure captured: Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action HTTP/1.1 Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 45 Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XcIVUUkrzVZQLjmlXcPGLD61QP0sWJnBjYPnu5QiARzGP2hHJhqFLKLk3Th_ut__Pp8dMuSH9-KU-a3eJSux3nXbLYmLD2zil2NqMyzRvoUWzPJ9eg_zxw7pl3hQJ8Pt775qhotkeIlcGsRL-uug2PM9pSlF5qguwm9abRYkydkKE Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:04:56.211409 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1494b216046e4d228777af0f07af30fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1494b216046e4d228777af0f07af30fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7ed5a0341c0d41edad1c61ca6460d956 Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: {"addFloatingIp": {"address": "172.25.9.86"}} Oct 31 14:04:56.212892 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7e2ca322-fb3a-4360-ac28-1f322c61c634', 'body': {'addFloatingIp': {'address': '172.25.9.86'}}} Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:04:56.213589 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:04:56.214614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.217398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.219881 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Returning 400 to user: Cannot associate floating IP 172.25.9.86 (16a3fce7-6652-4c5b-8324-b246f82b8de2) with port 888da1e1-02b2-4550-8eb4-450eed6d09a4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 1bd3be27-dc2f-4849-b93b-48f92e845229. Oct 31 14:04:56.224251 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-26283344-4768-4c5d-a671-35eb94a93a04'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:04:56.227532 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-abfa9d38-bd2e-4096-ba43-79ace2ec7768 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action" status: 400 len: 381 microversion: 2.1 time: 0.666350 Oct 31 14:04:56.227532 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 216/533] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:55 2022] POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action => generated 381 bytes in 679 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:04:56.240903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:56.241648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:56.254759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:56.255485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:56.255963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:56.257662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:56.258132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:56.258588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:56.630885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:56.640261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3739fab3-7cb7-430a-9179-a2efea16239f tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1465 microversion: 2.1 time: 0.409596 Oct 31 14:04:56.640848 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 217/534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:56 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1465 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:56.665180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d103e5a-eba4-4d33-a0df-2355b35c3d5f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '.version_select at 0x7fe107f728b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:58.316608 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55c0988a-c4a9-4895-9928-4ff04e3e0a35 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090/action" status: 202 len: 0 microversion: 2.25 time: 4.566440 Oct 31 14:04:58.319414 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 318/535] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:04:53 2022] POST /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090/action => generated 0 bytes in 4570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:04:58.327149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:58.329249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:58.340362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:58.341129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:58.341801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:58.342949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:58.344270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:58.345059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:58.375377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:58.681086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:58.698927 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3f8f013-7c46-4b25-a685-e555286bc83c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1367 microversion: 2.1 time: 0.371382 Oct 31 14:04:58.698927 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 319/536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:58 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:58.718675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:58.720931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:58.737887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:58.738734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:58.742071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:58.743202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:58.743889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:58.746740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:58.886743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:58.911923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f2d0335-6745-4d6e-88af-5c55ab9fcdad tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 200 len: 1423 microversion: 2.1 time: 0.218017 Oct 31 14:04:58.913096 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 320/537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:58 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 1423 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:04:58.918088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:58.922921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:58.937771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:58.938801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:58.939501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:58.940431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:58.941095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:58.941733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:59.136688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:59.146317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:59.147065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:04:59.155881 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3149fdcb-9a0f-4d47-86e2-158571f9288a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.241346 Oct 31 14:04:59.156789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 321/538] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:04:58 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:04:59.169247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cd5ae79a-8f72-4d46-aba8-f43bffe06188 req-164a3bb8-45dd-4632-b6e1-9cf20d369b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a58b508-0106-4617-80ee-1ea6ea5d07a9", "name": "network-vif-plugged", "status": "completed", "tag": "a7bda1ae-3528-4f2d-8709-aed92aab902a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:59.188954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cd5ae79a-8f72-4d46-aba8-f43bffe06188 req-164a3bb8-45dd-4632-b6e1-9cf20d369b0b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:59.189423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cd5ae79a-8f72-4d46-aba8-f43bffe06188 req-164a3bb8-45dd-4632-b6e1-9cf20d369b0b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:59.189841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cd5ae79a-8f72-4d46-aba8-f43bffe06188 req-164a3bb8-45dd-4632-b6e1-9cf20d369b0b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:59.233107 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cd5ae79a-8f72-4d46-aba8-f43bffe06188 req-164a3bb8-45dd-4632-b6e1-9cf20d369b0b service nova] Creating event network-vif-plugged:a7bda1ae-3528-4f2d-8709-aed92aab902a for instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 on n-h1-863052-1 Oct 31 14:04:59.241731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cd5ae79a-8f72-4d46-aba8-f43bffe06188 req-164a3bb8-45dd-4632-b6e1-9cf20d369b0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083692 Oct 31 14:04:59.245316 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 322/539] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:59.252571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c98bfac1-36dd-4f97-ba79-897cf515857a req-fb373230-f64a-4cee-bf2b-0b866905486c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa13472-b070-4173-9a4e-4b8f8feaa8c1", "name": "network-vif-deleted", "tag": "7f4d092f-29c3-4472-8418-3f747782bad3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:59.265217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:04:59.284692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c98bfac1-36dd-4f97-ba79-897cf515857a req-fb373230-f64a-4cee-bf2b-0b866905486c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:59.285420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c98bfac1-36dd-4f97-ba79-897cf515857a req-fb373230-f64a-4cee-bf2b-0b866905486c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:59.285988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c98bfac1-36dd-4f97-ba79-897cf515857a req-fb373230-f64a-4cee-bf2b-0b866905486c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:59.300605 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c98bfac1-36dd-4f97-ba79-897cf515857a req-fb373230-f64a-4cee-bf2b-0b866905486c service nova] Creating event network-vif-deleted:7f4d092f-29c3-4472-8418-3f747782bad3 for instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 on n-h2-863052-1 Oct 31 14:04:59.315549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c98bfac1-36dd-4f97-ba79-897cf515857a req-fb373230-f64a-4cee-bf2b-0b866905486c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068621 Oct 31 14:04:59.316832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 323/540] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:04:59.577405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d103e5a-eba4-4d33-a0df-2355b35c3d5f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/16a3fce7-6652-4c5b-8324-b246f82b8de2" status: 202 len: 0 microversion: 2.1 time: 2.935472 Oct 31 14:04:59.578597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 218/541] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:04:56 2022] DELETE /compute/v2.1/os-floating-ips/16a3fce7-6652-4c5b-8324-b246f82b8de2 => generated 0 bytes in 2937 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:04:59.614201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.26"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:04:59.720625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:04:59.721321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:59.738132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:59.738673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:59.739121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:59.739847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:59.740338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:59.740765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:59.889039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:04:59.896860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:59.897622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:59.898255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:04:59.899110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:04:59.899702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:04:59.900314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.102654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:00.111580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c59c30f1-be9c-495d-b192-73dfb4d5202a tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1367 microversion: 2.1 time: 0.396080 Oct 31 14:05:00.127703 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 219/542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:04:59 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:00.133779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:00.137235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: eaa13472-b070-4173-9a4e-4b8f8feaa8c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:00.146717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:00.147572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:00.148672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.149627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:00.150332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:00.150971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.168140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] HTTP exception thrown: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 could not be found. Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Request method failure captured: Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 HTTP/1.1 Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XLhpQR8NvdU0ziGhjNWNw2tAvFcCZ3n55BDabYrxNGdqMdzOqVQDMzy--3moliChR-g7hF_np0u84mbrR94st2pGyvdrupKcWjZd_YMdU3kD6_0m3dJJ6x0_nLk4BnHo_n6vFUvRlh7dsYZRE5tmgv6SI7AS2VpnsPDXkX3_qAmyE Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: f616fea9c23a4d1bb330aff30f78057d Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-LiveMigrationNegativeTest-518275990 Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:00.170101 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f616fea9c23a4d1bb330aff30f78057d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f616fea9c23a4d1bb330aff30f78057d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f616fea9c23a4d1bb330aff30f78057d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f616fea9c23a4d1bb330aff30f78057d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-LiveMigrationNegativeTest-518275990 Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: f616fea9c23a4d1bb330aff30f78057d Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-518275990 Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-LiveMigrationNegativeTest-518275990-project Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b0091bea85ad4e77871d537309bdb88f Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-LiveMigrationNegativeTest-518275990-project Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 could not be found. Oct 31 14:05:00.171779 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'eaa13472-b070-4173-9a4e-4b8f8feaa8c1'} Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 could not be found. Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:00.172646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 could not be found. Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 could not be found. Oct 31 14:05:00.174923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:00.176393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Returning 404 to user: Instance eaa13472-b070-4173-9a4e-4b8f8feaa8c1 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:00.176393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7d68092-1a3a-4ee5-8d60-ea555f4086a4 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1" status: 404 len: 111 microversion: 2.1 time: 0.045341 Oct 31 14:05:00.181102 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 220/543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:00 2022] GET /compute/v2.1/servers/eaa13472-b070-4173-9a4e-4b8f8feaa8c1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:00.364303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1836961699", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:00.438228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:00.438823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:00.439415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:00.440153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:00.440782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:00.456726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:00.457569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:00.458435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.459699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:00.460452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:00.461096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.491455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Getting quotas for project 2622acfc96a9410cb2d2f211b3a539f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:00.497291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Getting quotas for user 938121437d8149a094bdac7bd24be209 and project 2622acfc96a9410cb2d2f211b3a539f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:00.526285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:05:00.528791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:05:00.587623 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-408ede9d-c366-4c27-8e0c-7f85388624c7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.407881 Oct 31 14:05:00.588919 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 221/544] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:05:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:05:00.603705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:00.606907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:00.626897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:00.628290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:00.630200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.632084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:00.634493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:00.635573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:00.746111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:05:00.746550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquired lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:05:01.403327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:01.413498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:01.415005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:01.417032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-432d7f0a-3c21-4507-b361-7fdaade4707b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.825841 Oct 31 14:05:01.417804 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 222/545] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:00 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:01.422854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:01.423563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:01.432738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:01.433498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:01.434761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:01.436739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:01.437236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:01.437701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:01.483401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:05:01.639722 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f83a4116-523b-46d5-a806-3dc8a6d9970a tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 204 len: 0 microversion: 2.1 time: 0.220116 Oct 31 14:05:01.642382 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 223/546] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:05:01 2022] DELETE /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:05:01.650919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:01.655267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:01.665463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:01.666307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:01.667096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:01.668453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:01.669344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:01.670754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:01.738147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Building network info cache for instance {{(pid=120640) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:05:01.918401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:01.944399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:01.948288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:01.965771 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a44f0254-9726-42d2-b71c-f3f5fab3558e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "PUT /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1411 microversion: 2.75 time: 0.321513 Oct 31 14:05:01.992710 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 224/547] 10.222.0.27 () {62 vars in 1297 bytes} [Mon Oct 31 14:05:01 2022] PUT /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1411 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:01.998071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:02.001495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:02.009455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.010297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.011038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.012022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.014078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.014748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.379762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Updating instance_info_cache with network_info: [{"id": "888da1e1-02b2-4550-8eb4-450eed6d09a4", "address": "fa:16:3e:88:65:95", "network": {"id": "9c84957c-d94e-4df7-b39f-eedf08b5d1fa", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1152320541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1494b216046e4d228777af0f07af30fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap888da1e1-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:05:02.393585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Releasing lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:05:02.395053 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a3d66d6-fa23-4aaa-9cf4-6c7744d8dab8 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action" status: 202 len: 0 microversion: 2.1 time: 2.808662 Oct 31 14:05:02.397349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 324/548] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:04:59 2022] POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action => generated 0 bytes in 2812 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:05:02.423459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:02.424273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:02.430677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.431162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.431596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.432281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.432934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.433538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.449862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:02.461890 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-07cb44e2-2c46-47bb-99c3-576038c0e426 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1557 microversion: 2.1 time: 0.467985 Oct 31 14:05:02.467200 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 225/549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:01 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1557 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:02.474535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-1f6500d1-9336-4245-a543-5e0601f8ef8b req-f05679f2-29ba-4d38-8dee-263969e65393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ca322-fb3a-4360-ac28-1f322c61c634", "tag": "888da1e1-02b2-4550-8eb4-450eed6d09a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:02.513637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1f6500d1-9336-4245-a543-5e0601f8ef8b req-f05679f2-29ba-4d38-8dee-263969e65393 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.514357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1f6500d1-9336-4245-a543-5e0601f8ef8b req-f05679f2-29ba-4d38-8dee-263969e65393 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.514940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1f6500d1-9336-4245-a543-5e0601f8ef8b req-f05679f2-29ba-4d38-8dee-263969e65393 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.530367 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-1f6500d1-9336-4245-a543-5e0601f8ef8b req-f05679f2-29ba-4d38-8dee-263969e65393 service nova] Creating event network-changed:888da1e1-02b2-4550-8eb4-450eed6d09a4 for instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 on n-h1-863052-1 Oct 31 14:05:02.537540 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-1f6500d1-9336-4245-a543-5e0601f8ef8b req-f05679f2-29ba-4d38-8dee-263969e65393 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068138 Oct 31 14:05:02.539156 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 226/550] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:02.546308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:02.549285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:02.557075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.558236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.559000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.559921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.560527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.561124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.724387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:02.741017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:02.746804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:02.757767 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e15d12b1-7483-4eaa-92bf-5f3c36dd896d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1411 microversion: 2.75 time: 0.217070 Oct 31 14:05:02.788701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 227/551] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:02 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1411 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:02.793715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c02f898-183f-4aa1-adfc-25698b8f1109 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '.version_select at 0x7fe107f754c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:02.825265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:02.840187 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c967106d-3232-47fc-8470-d75e485461fd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1474 microversion: 2.1 time: 0.441198 Oct 31 14:05:02.859069 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 325/552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:02 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1474 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:02.867798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:02.869161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:02.883471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.883966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.884405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:02.885115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:02.885562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:02.885980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:03.040614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=95 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:03.488799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:03.503255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:03.511335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:03.512567 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44a12f7c-1880-4fc6-a846-aba48e51bc81 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.650842 Oct 31 14:05:03.520941 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 326/553] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:02 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:03.540645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0ca839c9-83cf-488c-beab-7e821da28b6c req-fb9f3bca-edbb-47df-91d6-010a23589f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e2d575-4378-4af3-a7df-7cd877f77090", "name": "network-vif-unplugged", "status": "completed", "tag": "304c534a-f4f7-4fee-a9f0-589142a7085e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:03.553057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ca839c9-83cf-488c-beab-7e821da28b6c req-fb9f3bca-edbb-47df-91d6-010a23589f11 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:03.553457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ca839c9-83cf-488c-beab-7e821da28b6c req-fb9f3bca-edbb-47df-91d6-010a23589f11 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:03.555993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ca839c9-83cf-488c-beab-7e821da28b6c req-fb9f3bca-edbb-47df-91d6-010a23589f11 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:03.578803 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0ca839c9-83cf-488c-beab-7e821da28b6c req-fb9f3bca-edbb-47df-91d6-010a23589f11 service nova] Creating event network-vif-unplugged:304c534a-f4f7-4fee-a9f0-589142a7085e for instance 14e2d575-4378-4af3-a7df-7cd877f77090 on n-h2-863052-1 Oct 31 14:05:03.595723 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0ca839c9-83cf-488c-beab-7e821da28b6c req-fb9f3bca-edbb-47df-91d6-010a23589f11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072726 Oct 31 14:05:03.600194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 327/554] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:03.612459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:03.614975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:03.631566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:03.639384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:03.640164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:03.642608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:03.644762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:03.645494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:03.646711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:03.879883 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac4531d6-b47a-4e44-9472-dc2a8992fe50 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277951 Oct 31 14:05:03.888668 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 328/555] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:05:03 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:03.894761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:03.895947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:03.910902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:03.914131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:03.916461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:03.918366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:03.919011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:03.921490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:04.176047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:04.203177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:04.210261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:04.234817 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d95cd40b-b7bd-47d9-9bb1-c85d703c3eab tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1417 microversion: 2.75 time: 0.344889 Oct 31 14:05:04.237350 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 329/556] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:03 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1417 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:04.261606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:04.262579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:04.280667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:04.283038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:04.284197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:04.299286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:04.300019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:04.300936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:04.796950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:04.814599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-506a703c-1652-4de5-85fd-f47f05e1f0a8 tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1474 microversion: 2.1 time: 0.566170 Oct 31 14:05:04.815574 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 330/557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:04 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1474 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:04.823348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:04.824007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:04.844701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:04.845441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:04.846074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:04.846962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:04.847578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:04.848160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:05.402226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:05.411065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:05.419859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:05.425083 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e85d12d-51b0-4452-96ee-687115b8c528 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.608754 Oct 31 14:05:05.432513 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 331/558] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:04 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:05.447189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:05.449271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:05.465869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:05.469333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:05.469783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:05.470891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:05.471537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:05.471968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.029538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.049422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.050893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.054915 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c02f898-183f-4aa1-adfc-25698b8f1109 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/01bcabba-e733-4077-b687-f0583600eb29" status: 202 len: 0 microversion: 2.1 time: 3.264996 Oct 31 14:05:06.055503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 228/559] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:05:02 2022] DELETE /compute/v2.1/os-floating-ips/01bcabba-e733-4077-b687-f0583600eb29 => generated 0 bytes in 3266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:05:06.063669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d1974d39-b307-48d9-aaa2-fd05160d7cfe req-72612654-42d8-431d-8aff-9a83871a57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e2d575-4378-4af3-a7df-7cd877f77090", "tag": "304c534a-f4f7-4fee-a9f0-589142a7085e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:06.110477 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8ea636e-01c0-4e67-be35-833d98efba0a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1417 microversion: 2.75 time: 0.674824 Oct 31 14:05:06.131040 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 332/560] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:05 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1417 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:06.136262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:06.137469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:06.144756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.145505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.146088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.147538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.148135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.148701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.199062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d1974d39-b307-48d9-aaa2-fd05160d7cfe req-72612654-42d8-431d-8aff-9a83871a57d1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.200436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d1974d39-b307-48d9-aaa2-fd05160d7cfe req-72612654-42d8-431d-8aff-9a83871a57d1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.200846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d1974d39-b307-48d9-aaa2-fd05160d7cfe req-72612654-42d8-431d-8aff-9a83871a57d1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.222311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.223110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.223694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.224414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lazy-loading 'fault' on Instance uuid e87f117c-9c0e-43a5-9dec-9c824c4cc0af {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:06.257675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d1974d39-b307-48d9-aaa2-fd05160d7cfe req-72612654-42d8-431d-8aff-9a83871a57d1 service nova] Creating event network-changed:304c534a-f4f7-4fee-a9f0-589142a7085e for instance 14e2d575-4378-4af3-a7df-7cd877f77090 on n-h2-863052-1 Oct 31 14:05:06.273762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d1974d39-b307-48d9-aaa2-fd05160d7cfe req-72612654-42d8-431d-8aff-9a83871a57d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217013 Oct 31 14:05:06.278690 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 229/561] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:06.295609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bfe9b16d-6f1e-4afe-bae8-6a56906ebf26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bfe9b16d-6f1e-4afe-bae8-6a56906ebf26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Request method failure captured: Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action HTTP/1.1 Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 34 Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XcIVUUkrzVZQLjmlXcPGLD61QP0sWJnBjYPnu5QiARzGP2hHJhqFLKLk3Th_ut__Pp8dMuSH9-KU-a3eJSux3nXbLYmLD2zil2NqMyzRvoUWzPJ9eg_zxw7pl3hQJ8Pt775qhotkeIlcGsRL-uug2PM9pSlF5qguwm9abRYkydkKE Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:06.311409 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1494b216046e4d228777af0f07af30fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1494b216046e4d228777af0f07af30fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7ed5a0341c0d41edad1c61ca6460d956 Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: {"addFloatingIp": {"address": ""}} Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:05:06.312884 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7e2ca322-fb3a-4360-ac28-1f322c61c634', 'body': {'addFloatingIp': {'address': ''}}} Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '' Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:06.313764 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:05:06.315253 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:05:06.316769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 14:05:06.316769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.316769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bfe9b16d-6f1e-4afe-bae8-6a56906ebf26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:06.316769 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bfe9b16d-6f1e-4afe-bae8-6a56906ebf26 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action" status: 400 len: 142 microversion: 2.1 time: 0.032036 Oct 31 14:05:06.316769 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 230/562] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:05:06 2022] POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action => generated 142 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:05:06.335729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:06.344174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:06.356886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.357420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.357858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.358601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.359063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.359488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.397545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:05:06.397964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquired lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:05:06.455124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0091bea85ad4e77871d537309bdb88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f616fea9c23a4d1bb330aff30f78057d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.470932 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f491adb-ee13-4638-8732-36ec9b8dc3bd tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 200 len: 1309 microversion: 2.1 time: 0.338418 Oct 31 14:05:06.471845 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 333/563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:06 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 1309 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:06.477967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:06.478832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:06.492323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.492817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.493251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.493947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.496651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.497272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.735117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Releasing lock "refresh_cache-7e2ca322-fb3a-4360-ac28-1f322c61c634" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:05:06.736098 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] HTTP exception thrown: floating IP not found Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Request method failure captured: Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action HTTP/1.1 Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 41 Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XcIVUUkrzVZQLjmlXcPGLD61QP0sWJnBjYPnu5QiARzGP2hHJhqFLKLk3Th_ut__Pp8dMuSH9-KU-a3eJSux3nXbLYmLD2zil2NqMyzRvoUWzPJ9eg_zxw7pl3hQJ8Pt775qhotkeIlcGsRL-uug2PM9pSlF5qguwm9abRYkydkKE Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:06.737922 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1494b216046e4d228777af0f07af30fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1494b216046e4d228777af0f07af30fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7ed5a0341c0d41edad1c61ca6460d956 Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:05:06.739333 n-d-863052-1 devstack@n-api.service[120641]: exception: floating IP not found Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7e2ca322-fb3a-4360-ac28-1f322c61c634', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:06.740626 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 31 14:05:06.741714 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.746308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Returning 404 to user: floating IP not found {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:06.747405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c20c563f-0542-4483-a90e-69811badaee9 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action" status: 404 len: 67 microversion: 2.1 time: 0.421801 Oct 31 14:05:06.754807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 231/564] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:05:06 2022] POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action => generated 67 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:06.760587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a075376-3ec8-4f14-9e72-21ad9a52eba4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:06.822123 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3a075376-3ec8-4f14-9e72-21ad9a52eba4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a075376-3ec8-4f14-9e72-21ad9a52eba4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Request method failure captured: Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action HTTP/1.1 Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 44 Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XcIVUUkrzVZQLjmlXcPGLD61QP0sWJnBjYPnu5QiARzGP2hHJhqFLKLk3Th_ut__Pp8dMuSH9-KU-a3eJSux3nXbLYmLD2zil2NqMyzRvoUWzPJ9eg_zxw7pl3hQJ8Pt775qhotkeIlcGsRL-uug2PM9pSlF5qguwm9abRYkydkKE Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:06.824264 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1494b216046e4d228777af0f07af30fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1494b216046e4d228777af0f07af30fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7ed5a0341c0d41edad1c61ca6460d956 Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:05:06.825799 n-d-863052-1 devstack@n-api.service[120641]: exception: Floating IP not found for address 0.0.0.0. Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7e2ca322-fb3a-4360-ac28-1f322c61c634', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:06.826839 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 31 14:05:06.829071 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:06.831610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a075376-3ec8-4f14-9e72-21ad9a52eba4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:06.831610 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a075376-3ec8-4f14-9e72-21ad9a52eba4 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action" status: 404 len: 88 microversion: 2.1 time: 0.073360 Oct 31 14:05:06.831610 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 232/565] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:05:06 2022] POST /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634/action => generated 88 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:06.841049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:06.841553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:06.866246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.866753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.867188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.867890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:06.875532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:06.875986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:06.879173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:06.932105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.934950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:05:06.940933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.942695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:06.944914 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6dd852b0-b69c-4350-965a-fb7420832733 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.471933 Oct 31 14:05:06.945910 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 334/566] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:06 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:07.077461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:07.095761 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-521463ce-fb49-42f7-a172-04eeb3e3552f tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 204 len: 0 microversion: 2.1 time: 0.258693 Oct 31 14:05:07.106574 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 233/567] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:05:06 2022] DELETE /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:05:07.118307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:07.119905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:07.135274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.136080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.137227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.138423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.138964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:07.139342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.139685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:07.140465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.153607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.158505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.159065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.159840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.160370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.160809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.293220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:07.310278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:07.311645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:07.339185 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94fd1d23-c40c-4ad8-80d8-d6bf860d1f15 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1438 microversion: 2.75 time: 0.203349 Oct 31 14:05:07.344504 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 234/568] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:07 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1438 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:07.375700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:07.378530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:07.394121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.394817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.395400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.396818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.397415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.401018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.550113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:07.550559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:07.551025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:07.551431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:07.551832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:07.665265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:07.706682 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c2808be-fffc-4fb3-a823-d89ba75f604c tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1543 microversion: 2.1 time: 0.595742 Oct 31 14:05:07.713016 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 335/569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:07 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1543 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:07.740309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:07.745375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] [instance: e87f117c-9c0e-43a5-9dec-9c824c4cc0af] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:07.772850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:07.776141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.779878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.781293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.782066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.784357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.785351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.785620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.786278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.786663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.788207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.789238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.789952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.832312 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] HTTP exception thrown: Instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af could not be found. Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Request method failure captured: Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af HTTP/1.1 Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XLhpQR8NvdU0ziGhjNWNw2tAvFcCZ3n55BDabYrxNGdqMdzOqVQDMzy--3moliChR-g7hF_np0u84mbrR94st2pGyvdrupKcWjZd_YMdU3kD6_0m3dJJ6x0_nLk4BnHo_n6vFUvRlh7dsYZRE5tmgv6SI7AS2VpnsPDXkX3_qAmyE Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: f616fea9c23a4d1bb330aff30f78057d Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveMigrationNegativeTest-518275990 Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:07.839552 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f616fea9c23a4d1bb330aff30f78057d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f616fea9c23a4d1bb330aff30f78057d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f616fea9c23a4d1bb330aff30f78057d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f616fea9c23a4d1bb330aff30f78057d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveMigrationNegativeTest-518275990 Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: f616fea9c23a4d1bb330aff30f78057d Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-518275990 Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveMigrationNegativeTest-518275990-project Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b0091bea85ad4e77871d537309bdb88f Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveMigrationNegativeTest-518275990-project Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af could not be found. Oct 31 14:05:07.840867 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e87f117c-9c0e-43a5-9dec-9c824c4cc0af'} Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af could not be found. Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:07.841607 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af could not be found. Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af could not be found. Oct 31 14:05:07.844462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:07.845778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] Returning 404 to user: Instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:07.845778 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0c18b06-2172-4147-9432-0bdf8ca2685c tempest-LiveMigrationNegativeTest-518275990 tempest-LiveMigrationNegativeTest-518275990-project] 10.222.0.27 "GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af" status: 404 len: 111 microversion: 2.1 time: 0.125285 Oct 31 14:05:07.845778 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 336/570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:07 2022] GET /compute/v2.1/servers/e87f117c-9c0e-43a5-9dec-9c824c4cc0af => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:07.859560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f5813f83-c912-4ecb-a6fb-9252b7f1123e req-1143da9a-a860-4446-973f-767206a3762a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a58b508-0106-4617-80ee-1ea6ea5d07a9", "tag": "a7bda1ae-3528-4f2d-8709-aed92aab902a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:07.885535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5813f83-c912-4ecb-a6fb-9252b7f1123e req-1143da9a-a860-4446-973f-767206a3762a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:07.886351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5813f83-c912-4ecb-a6fb-9252b7f1123e req-1143da9a-a860-4446-973f-767206a3762a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:07.887688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5813f83-c912-4ecb-a6fb-9252b7f1123e req-1143da9a-a860-4446-973f-767206a3762a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:07.903467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f5813f83-c912-4ecb-a6fb-9252b7f1123e req-1143da9a-a860-4446-973f-767206a3762a service nova] Creating event network-changed:a7bda1ae-3528-4f2d-8709-aed92aab902a for instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 on n-h1-863052-1 Oct 31 14:05:07.916172 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f5813f83-c912-4ecb-a6fb-9252b7f1123e req-1143da9a-a860-4446-973f-767206a3762a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066634 Oct 31 14:05:07.917656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 337/571] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:07.980945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:07.981667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:07.984518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:07.997776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.000685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.001205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.003133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:08.006447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.008471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.010206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.012094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:08.025420 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e49b677d-5c1b-46d6-954c-b5fdc84d226b tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "POST /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2/action" status: 202 len: 1495 microversion: 2.75 time: 0.655706 Oct 31 14:05:08.026068 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 235/572] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:05:07 2022] POST /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2/action => generated 1495 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 31 14:05:08.065228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:08.065848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:08.089881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.090443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.094941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:08.098648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.102190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.104874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:08.283212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.303487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.306255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.322824 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69c8bb0f-10d3-410d-a0ff-178a2232462c tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.269319 Oct 31 14:05:08.343020 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 236/573] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:08 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:08.372094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3d65114f-b83f-4126-8b09-4c5e0ff4ed62 req-1a9d131e-c923-4095-bcd0-46cca14e36fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87f117c-9c0e-43a5-9dec-9c824c4cc0af", "name": "network-vif-deleted", "tag": "8e1e6cae-d2d0-4d6f-bc9f-eaaa4840500a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:08.395055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3d65114f-b83f-4126-8b09-4c5e0ff4ed62 req-1a9d131e-c923-4095-bcd0-46cca14e36fd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.399879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3d65114f-b83f-4126-8b09-4c5e0ff4ed62 req-1a9d131e-c923-4095-bcd0-46cca14e36fd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.401059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3d65114f-b83f-4126-8b09-4c5e0ff4ed62 req-1a9d131e-c923-4095-bcd0-46cca14e36fd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:08.430447 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3d65114f-b83f-4126-8b09-4c5e0ff4ed62 req-1a9d131e-c923-4095-bcd0-46cca14e36fd service nova] Creating event network-vif-deleted:8e1e6cae-d2d0-4d6f-bc9f-eaaa4840500a for instance e87f117c-9c0e-43a5-9dec-9c824c4cc0af on n-h2-863052-1 Oct 31 14:05:08.435965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3d65114f-b83f-4126-8b09-4c5e0ff4ed62 req-1a9d131e-c923-4095-bcd0-46cca14e36fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076518 Oct 31 14:05:08.443679 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 237/574] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:08.485249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.493937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:08.503521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.507578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:08.511150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54158fac-ef59-4a41-a18a-3c133016dbbd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.535949 Oct 31 14:05:08.516231 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 338/575] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:07 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:08.736608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:08.737363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:08.753621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.754955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.757650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:08.758751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:08.759324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:08.761640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:09.354831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:09.356429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:09.376297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:09.377357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:09.377829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:09.378897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:09.379796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:09.388080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:09.389942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:09.390223 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f230ccc0-b919-4bcd-b38c-25ea3cdb18ff tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1543 microversion: 2.1 time: 0.656160 Oct 31 14:05:09.390896 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 238/576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:08 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1543 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:09.544090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:09.545437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:09.555838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:09.557206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:09.567974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:09.573782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:09.575058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:09.576185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:09.788079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:09.814398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:09.816068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:09.829456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7d1c155-fe8c-4cb5-95f4-47fe5d4317c9 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.478950 Oct 31 14:05:09.831864 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 339/577] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:09 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:10.088542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:10.102548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:10.104768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:10.106652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-912efba9-2b90-4551-87e6-332cc6dd0720 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.567531 Oct 31 14:05:10.107707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 239/578] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:09 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:10.420610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:10.421419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:10.432724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:10.433236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:10.433678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:10.434429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:10.434892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:10.435322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:10.864232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:10.865055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:10.867296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:10.871682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:10.893137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:10.893937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:10.894561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:10.898679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:10.899362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:10.899805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:11.087792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.104711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.115275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.125237 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a49433b1-d1cf-48ba-8aca-07050231a182 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.265746 Oct 31 14:05:11.126621 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 240/579] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:10 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:11.132885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-56fb5cd5-58d4-4762-9fc4-e21d9685fff3 req-7fd93f71-7069-4a0a-a505-0b028b63bd76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2ca322-fb3a-4360-ac28-1f322c61c634", "name": "network-vif-deleted", "tag": "888da1e1-02b2-4550-8eb4-450eed6d09a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:11.145721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-56fb5cd5-58d4-4762-9fc4-e21d9685fff3 req-7fd93f71-7069-4a0a-a505-0b028b63bd76 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:11.154283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-56fb5cd5-58d4-4762-9fc4-e21d9685fff3 req-7fd93f71-7069-4a0a-a505-0b028b63bd76 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:11.154283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-56fb5cd5-58d4-4762-9fc4-e21d9685fff3 req-7fd93f71-7069-4a0a-a505-0b028b63bd76 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:11.168463 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-56fb5cd5-58d4-4762-9fc4-e21d9685fff3 req-7fd93f71-7069-4a0a-a505-0b028b63bd76 service nova] Creating event network-vif-deleted:888da1e1-02b2-4550-8eb4-450eed6d09a4 for instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 on n-h1-863052-1 Oct 31 14:05:11.176775 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-56fb5cd5-58d4-4762-9fc4-e21d9685fff3 req-7fd93f71-7069-4a0a-a505-0b028b63bd76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048484 Oct 31 14:05:11.183613 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 241/580] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:11.192550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:11.194448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:11.222502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:11.229492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:11.231337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:11.235240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:11.236964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:11.238649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:11.369881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed5a0341c0d41edad1c61ca6460d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1494b216046e4d228777af0f07af30fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.379193 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0273112f-58a2-41f7-8b94-6e4dbf7793d1 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 200 len: 1543 microversion: 2.1 time: 0.964015 Oct 31 14:05:11.379771 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 340/581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:10 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 1543 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:11.952174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.969510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.975434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:11.978506 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79f672c2-d109-4199-b64c-777497c22da3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.790917 Oct 31 14:05:11.981227 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 242/582] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:11 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:12.156945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:12.157777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:12.169566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:12.170050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:12.183027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:12.184502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:12.185300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:12.185921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:12.316627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:12.325217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:12.338394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:12.344795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5e731e7-08cd-4060-a977-02d8e528979f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.191261 Oct 31 14:05:12.346290 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 341/583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:12 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:12.407865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:12.407865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] [instance: 7e2ca322-fb3a-4360-ac28-1f322c61c634] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:12.416314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:12.419829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:12.420370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:12.423000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:12.423645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:12.424947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:12.447291 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] HTTP exception thrown: Instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 could not be found. Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Request method failure captured: Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 HTTP/1.1 Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XcIVUUkrzVZQLjmlXcPGLD61QP0sWJnBjYPnu5QiARzGP2hHJhqFLKLk3Th_ut__Pp8dMuSH9-KU-a3eJSux3nXbLYmLD2zil2NqMyzRvoUWzPJ9eg_zxw7pl3hQJ8Pt775qhotkeIlcGsRL-uug2PM9pSlF5qguwm9abRYkydkKE Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:12.448978 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1494b216046e4d228777af0f07af30fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1494b216046e4d228777af0f07af30fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1494b216046e4d228777af0f07af30fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1494b216046e4d228777af0f07af30fb Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7ed5a0341c0d41edad1c61ca6460d956 Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:05:12.450464 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 could not be found. Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7e2ca322-fb3a-4360-ac28-1f322c61c634'} Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 could not be found. Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:12.451167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 could not be found. Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 could not be found. Oct 31 14:05:12.452611 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:12.454079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] Returning 404 to user: Instance 7e2ca322-fb3a-4360-ac28-1f322c61c634 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:12.462645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e25ac86d-f565-46ba-b1c7-2ea7f0ca4159 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592 tempest-FloatingIPsAssociationNegativeTestJSON-1700824592-project] 10.222.0.27 "GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634" status: 404 len: 111 microversion: 2.1 time: 0.047814 Oct 31 14:05:12.467830 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 243/584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:12 2022] GET /compute/v2.1/servers/7e2ca322-fb3a-4360-ac28-1f322c61c634 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:13.012937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:13.014851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:13.025201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:13.025988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:13.026909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:13.028056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:13.028896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:13.030575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:13.299227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:13.320632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:13.322333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:13.332280 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0e6c1af-6b9b-46f9-b9e3-4bb6b5b12d85 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.323834 Oct 31 14:05:13.333554 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 342/585] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:13 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:13.377053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:13.377673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:13.386873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:13.387371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:13.390126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:13.392100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:13.392581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:13.395731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:13.685455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:13.699671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:13.708133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:13.729019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ac2cbf5-7af6-49cd-86d2-82a49f25e734 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.356377 Oct 31 14:05:13.732809 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 244/586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:13 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:14.141176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.145216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.145703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.148319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.149097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.149560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.150045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.213044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8ba7cb5-4381-472e-88ec-ee10a503a1ea tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.334164 Oct 31 14:05:14.213632 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 343/587] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:05:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:14.227367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.234421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.235383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.236080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.237233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.238831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.241903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.308213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-307074d9-e35a-4c92-9b2e-627ed19c07ad tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.080408 Oct 31 14:05:14.311520 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 245/588] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:05:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:14.325238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.328846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.329332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.329770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.335094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.335600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.336041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.362682 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adde7770-5fbe-4c69-8c57-d2db43ebf83d tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041209 Oct 31 14:05:14.364051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 344/589] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:05:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:14.365409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.366278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:14.374350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.377182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.377926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.378663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.380963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.382678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.384452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.384841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.385406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.386009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.387619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.388695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.389469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.459704 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-974a73ee-d3e4-40b8-a17e-63dec050bf92 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-863052-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.086192 Oct 31 14:05:14.481302 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 345/590] 10.222.0.27 () {58 vars in 1194 bytes} [Mon Oct 31 14:05:14 2022] GET /compute/v2.1/os-services?host=n-d-863052-1&binary=xxx => generated 16 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 14:05:14.616212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04c21cea-2d5e-4b2e-b566-28073d5010ef tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Action: 'create', calling method: .version_select at 0x7fe107c08310>, body: {"keypair": {"name": "tempest-keypair-1080049311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjau7BxfjjDO4zhwBAA4XRE1brcHIy+/w0E2UuSTYKd776lwD6+V1tGz410tK6lCowaxBwFexxdKsIkrTPVeEDmKM2UJvrDlP6T0//r1uVHLStwSvqUa0GcJBc27L7Bqg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:14.652445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-04c21cea-2d5e-4b2e-b566-28073d5010ef tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Getting quotas for project b2854257058845b7aef6e09aeb02c0e0. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:14.663731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-04c21cea-2d5e-4b2e-b566-28073d5010ef tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Getting quotas for user b9dea5fa185845edb7d86aa1d5c1b4b1 and project b2854257058845b7aef6e09aeb02c0e0. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:14.714884 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04c21cea-2d5e-4b2e-b566-28073d5010ef tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232320 Oct 31 14:05:14.715953 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 346/591] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:05:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:14.729693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.738812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.740533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.742332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.743431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.745951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.746916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.814382 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f72f42f-9fcf-49ba-9734-e49deffa61f3 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.097239 Oct 31 14:05:14.815534 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 347/592] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:05:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:14.826798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:14.827713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:14.843430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.843944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.844551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:14.845403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:14.846031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:14.852029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:15.078456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.086093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.090772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.092229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.107871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.117296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01229869-4dba-4b3a-9986-7e829e2c5872 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.300457 Oct 31 14:05:15.117900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 348/593] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:14 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:15.120010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.121697 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb8e5430-66fe-4529-b76a-87cb7ce01d0e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1567 microversion: 2.25 time: 0.760912 Oct 31 14:05:15.122914 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 246/594] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:14 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1567 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:15.134636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:15.154002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:15.155244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:15.155852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:15.156891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:15.157528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:15.158124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:15.205868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78f66d57-8126-48d9-a7c7-a92feeb8f338 tempest-ServicesAdminNegativeTestJSON-278416550 tempest-ServicesAdminNegativeTestJSON-278416550-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.083111 Oct 31 14:05:15.220381 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 349/595] 10.222.0.27 () {58 vars in 1198 bytes} [Mon Oct 31 14:05:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:05:15.477694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32b07bdd-bdb0-4d80-8476-42a7c5507bb8 tempest-ServicesAdminNegativeTestJSON-525731879 tempest-ServicesAdminNegativeTestJSON-525731879-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:15.481858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32b07bdd-bdb0-4d80-8476-42a7c5507bb8 tempest-ServicesAdminNegativeTestJSON-525731879 tempest-ServicesAdminNegativeTestJSON-525731879-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '74246e898fb346888836efe45be49ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1b220c4fb543f885fd6972b46d4951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32b07bdd-bdb0-4d80-8476-42a7c5507bb8 tempest-ServicesAdminNegativeTestJSON-525731879 tempest-ServicesAdminNegativeTestJSON-525731879-project] Request method failure captured: Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9YYwsyrtVULj0oxRFfP_LWF5TbTzEHoUgD7gQs4SWLl1BaJ-q_UFE5YLDatm9JxmtlbMRtVSmGl5tqqGo1MUKpE2eKw3qNC1cNrdoI1NSkhrYkbik03PEAO8UQecxsuWHtA5ow9wmDWtVSwSuwr5-PlTRlzRhcb6_3wJMK4k0se1QY Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bc1b220c4fb543f885fd6972b46d4951 Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-525731879 Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:15.487015 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc1b220c4fb543f885fd6972b46d4951", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc1b220c4fb543f885fd6972b46d4951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc1b220c4fb543f885fd6972b46d4951"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc1b220c4fb543f885fd6972b46d4951"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-525731879 Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bc1b220c4fb543f885fd6972b46d4951 Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-525731879 Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServicesAdminNegativeTestJSON-525731879-project Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 74246e898fb346888836efe45be49ec9 Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-525731879-project Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 14:05:15.488278 n-d-863052-1 devstack@n-api.service[120641]: action_args: {} Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:05:15.488994 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 14:05:15.490147 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:15.497008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32b07bdd-bdb0-4d80-8476-42a7c5507bb8 tempest-ServicesAdminNegativeTestJSON-525731879 tempest-ServicesAdminNegativeTestJSON-525731879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:15.498745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32b07bdd-bdb0-4d80-8476-42a7c5507bb8 tempest-ServicesAdminNegativeTestJSON-525731879 tempest-ServicesAdminNegativeTestJSON-525731879-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.280776 Oct 31 14:05:15.507163 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 247/596] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:05:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:05:16.145307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:16.145957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:16.158798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:16.160025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:16.160173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:16.160759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:16.162065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:16.163832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:16.167894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:16.168619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:16.172076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:16.172753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:16.173510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:16.176159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:16.176590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:16.177592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:16.431048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:16.441549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:16.443446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:16.453477 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3baf614-b586-4ac0-bc9f-27b939e7b682 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.309978 Oct 31 14:05:16.473001 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 350/597] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:16 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:16.955203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:16.971917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:16.976872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:16.978779 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0210aa05-61b4-4140-ad49-c02729222113 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1557 microversion: 2.25 time: 0.833273 Oct 31 14:05:16.979681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 248/598] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:16 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1557 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:17.014917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aefe1164-459c-4261-ab9d-0493ad1187d7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '.version_select at 0x7fe107b78040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:17.018688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aefe1164-459c-4261-ab9d-0493ad1187d7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:17.019697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aefe1164-459c-4261-ab9d-0493ad1187d7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:17.020147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aefe1164-459c-4261-ab9d-0493ad1187d7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:17.066495 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aefe1164-459c-4261-ab9d-0493ad1187d7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.061875 Oct 31 14:05:17.069625 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 351/599] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 31 14:05:17 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:05:17.084882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:17.092851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:17.102733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:17.104180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:17.105749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:17.108504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:17.109758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:17.110460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:17.197730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:17.491286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:17.493296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:17.509440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:17.511936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:17.512557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:17.513745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:17.514703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:17.520744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:17.645151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 14e2d575-4378-4af3-a7df-7cd877f77090 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:17.675992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:17.691766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:17.693246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:17.727472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b6c26ad-4cf2-4d73-a726-bfb2dd0120db tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.243627 Oct 31 14:05:17.728065 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 352/600] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:17 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:17.908155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6fa24a2a-4689-4f75-a3af-c2360b5d487f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 2049 microversion: 2.25 time: 0.826817 Oct 31 14:05:17.909795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 249/601] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:17 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 2049 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:18.135437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-471988668", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "da8a9929-0ff3-4206-a14a-e0d235fbfab9"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:18.147111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1790424627", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d2840ce8-8e29-4e7a-8617-461972287234"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:18.277851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] validate_networks() for [('d2840ce8-8e29-4e7a-8617-461972287234', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:05:18.279881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] validate_networks() for [('da8a9929-0ff3-4206-a14a-e0d235fbfab9', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:05:19.166375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:19.170056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:19.170637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:19.171057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:19.171473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:19.191176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:19.191664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:19.192099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:19.192873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:19.193324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:19.197449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:19.249895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:19.259294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for user 57251d140f49460087e4cf90f6b94a78 and project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:19.294608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:05:19.307106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:05:19.427630 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44373f44-f15d-4ad6-9545-27b72ea3a515 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.284702 Oct 31 14:05:19.429006 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 250/602] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:05:19.434578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:19.435834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:19.462395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:19.462946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:19.463458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:19.467988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:19.471203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:19.472951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:19.608551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:19.620120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:19.623448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:19.630982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca6bdc9a-0f90-42b9-ae10-5e8d2fe3a3cd tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.200641 Oct 31 14:05:19.639751 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 251/603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:19 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:19.653664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-393ed3bc-c404-4329-b6bc-17f71024b463 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:19.654726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-393ed3bc-c404-4329-b6bc-17f71024b463 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:19.789943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:19.790610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:19.794279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:19.794279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:19.794279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:19.807486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:19.810146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:19.810624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:19.811367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:19.811823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:19.812242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:19.836076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-393ed3bc-c404-4329-b6bc-17f71024b463 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:19.849188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-393ed3bc-c404-4329-b6bc-17f71024b463 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:19.858149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:19.861841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-393ed3bc-c404-4329-b6bc-17f71024b463 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:19.867664 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-393ed3bc-c404-4329-b6bc-17f71024b463 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1262 microversion: 2.25 time: 0.226642 Oct 31 14:05:19.870656 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 252/604] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:19 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1262 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:19.872560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:19.876981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for user 3589cce53cf8492a9a2e05c73f373319 and project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:19.922668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:05:19.929559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:05:20.072849 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-decd9013-8bbb-4fdb-ba67-f0be0527c0fa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.304804 Oct 31 14:05:20.073456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2063497334", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "faa64739-0e19-4ee7-a5f6-b1d4ed444053"}], "security_groups": [{"name": "tempest-securitygroup--2110747075"}], "key_name": "tempest-keypair-1080049311", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:20.075330 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 353/605] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:05:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:05:20.086460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f38b56eb-56d3-4080-b42f-38a907918a5c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:20.087426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f38b56eb-56d3-4080-b42f-38a907918a5c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:20.295794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f38b56eb-56d3-4080-b42f-38a907918a5c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:20.309483 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f38b56eb-56d3-4080-b42f-38a907918a5c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1210 microversion: 2.1 time: 0.226935 Oct 31 14:05:20.322401 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 354/606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:20 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:20.369124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] validate_networks() for [('faa64739-0e19-4ee7-a5f6-b1d4ed444053', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:05:20.668662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:20.669727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:20.686374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:20.687857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:20.688779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:20.690565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:20.691285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:20.692261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:20.826623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:20.845452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:20.850729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:20.865574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6eac7f4-c1e5-492b-bbac-9138bc44e72d tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.205772 Oct 31 14:05:20.870250 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 355/607] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:20 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:20.908905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:20.919057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:20.956487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:20.959052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:20.965834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:20.968943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:20.975547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:20.976356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.231117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:21.245313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:21.251987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:21.253152 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cf61364-51ee-462a-ac18-69849cbdda60 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1314 microversion: 2.25 time: 0.352471 Oct 31 14:05:21.253716 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 356/608] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:20 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:21.365375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:21.368227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:21.377310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:21.378064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:21.379118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.380617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:21.381277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:21.382387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.527771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:21.548894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f25bab2-c1d7-4dcb-b40b-6d02213303a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1206 microversion: 2.1 time: 0.212607 Oct 31 14:05:21.553775 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 357/609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:21 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1206 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:21.687271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Getting quotas for project b2854257058845b7aef6e09aeb02c0e0. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:21.702214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Getting quotas for user b9dea5fa185845edb7d86aa1d5c1b4b1 and project b2854257058845b7aef6e09aeb02c0e0. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:21.743392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:21.744336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:21.747399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:21.755765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:21.758808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:21.777080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:21.782551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:21.784454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.787732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:21.788364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:21.789385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.820961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Getting quotas for project b2854257058845b7aef6e09aeb02c0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:21.826834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Getting quotas for user b9dea5fa185845edb7d86aa1d5c1b4b1 and project b2854257058845b7aef6e09aeb02c0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:21.847436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:05:21.858864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:05:21.904945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:21.908948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:21.950553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:21.952962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:21.956581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.962397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:21.964146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:21.968503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:21.979983 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a48d431-7210-46ea-a450-f615c1a50dd5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.912360 Oct 31 14:05:21.990097 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 253/610] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:05:20 2022] POST /compute/v2.1/servers => generated 407 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:05:21.997752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6855fc20-d1b0-4876-be9a-9a996b73fbe6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:22.002454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6855fc20-d1b0-4876-be9a-9a996b73fbe6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:22.019977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:22.240860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.256350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.261789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.277551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d4f1d49-ee93-4a02-a72a-9a29fed42149 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.382534 Oct 31 14:05:22.278832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 358/611] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:21 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:22.296469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:22.297103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:22.317130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:22.324671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:22.325398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:22.326603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:22.327232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:22.328056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:22.532834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6855fc20-d1b0-4876-be9a-9a996b73fbe6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.554469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.556269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6855fc20-d1b0-4876-be9a-9a996b73fbe6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1270 microversion: 2.1 time: 0.564232 Oct 31 14:05:22.559472 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 254/612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:21 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1270 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:22.577849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:22.578574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:22.584586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.589583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.591500 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e17d77fe-9507-4c76-a0ea-086b160a6c73 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1320 microversion: 2.25 time: 0.311046 Oct 31 14:05:22.592987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:22.593995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:22.595074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:22.597617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:22.598273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:22.600353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:22.605999 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 359/613] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:22 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:22.812301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:22.825553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-739f3064-626d-4bcb-b042-72325423a8e3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1268 microversion: 2.1 time: 0.251729 Oct 31 14:05:22.844851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 255/614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:22 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1268 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:23.312919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:23.313830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:23.324545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.325046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.325561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.326305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.326761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.330899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.559919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.574604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.577480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.585386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:23.586408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:23.588359 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf205ce6-47c9-454d-aee2-88d829b9547a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.278259 Oct 31 14:05:23.590100 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 360/615] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:23 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:23.600521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.601649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.603908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.604848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.605678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.608724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.626822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:23.627542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:23.639441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.640601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.641128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.643772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.644322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.646478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.791081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.797965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d1427bf-ec25-4492-b191-058fe45637e8 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1322 microversion: 2.1 time: 0.216432 Oct 31 14:05:23.816447 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 256/616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:23 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:23.853348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:23.853705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:23.864462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.864963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.865403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.866111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:23.871476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:23.872046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:23.932091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.956516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.958775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:23.974609 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fcf4a7a-5ab8-41a3-a5fe-5c16ac6445cd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.356563 Oct 31 14:05:23.976178 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 361/617] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:23 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:24.285813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:24.303469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca614871-fde8-45de-a0c3-328c1ab9ce4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.455522 Oct 31 14:05:24.304686 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 257/618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:23 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:24.395213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93f8c1b7-f309-4c05-a6e5-b7478803841a tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Calling method '.version_select at 0x7fe107b78e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:24.422155 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-93f8c1b7-f309-4c05-a6e5-b7478803841a tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] HTTP exception thrown: Image not found. Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93f8c1b7-f309-4c05-a6e5-b7478803841a tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Request method failure captured: Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/861d6bde-e78d-49c6-9b1b-dcd47db8cf6b/metadata/os_distro HTTP/1.1 Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Yk24awMAh0tkQXatG4fe2mDvNicfwzz-DR5j4Yi-8plP5oxL0v6KUoZo8lDqgk5xDP2yr7QPpmLrJ4BkTcb2d6NqRgrTiRmfslnWdEePOThywngDrengs3XTshELFK8EmJns0pK0nm5mnVuZbWPzhsoYdQRCZ47IeAEEQzIXXhXVo Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:24.431351 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb49c152d1b148daafe374cf542bdfa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: d8745b5a7c2e4ec9a7b851be3100d432 Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'image_id': '861d6bde-e78d-49c6-9b1b-dcd47db8cf6b', 'id': 'os_distro'} Oct 31 14:05:24.432935 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.433898 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 861d6bde-e78d-49c6-9b1b-dcd47db8cf6b Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.435576 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 861d6bde-e78d-49c6-9b1b-dcd47db8cf6b could not be found. Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:24.439285 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.440445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93f8c1b7-f309-4c05-a6e5-b7478803841a tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:24.441711 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93f8c1b7-f309-4c05-a6e5-b7478803841a tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] 10.222.0.27 "DELETE /compute/v2.1/images/861d6bde-e78d-49c6-9b1b-dcd47db8cf6b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.238415 Oct 31 14:05:24.441711 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 362/619] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 31 14:05:24 2022] DELETE /compute/v2.1/images/861d6bde-e78d-49c6-9b1b-dcd47db8cf6b/metadata/os_distro => generated 62 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:24.447701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab61645d-b410-41eb-9e19-86696873adf9 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Calling method '.version_select at 0x7fe107e949d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:24.471827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-ab61645d-b410-41eb-9e19-86696873adf9 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] HTTP exception thrown: Image not found. Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab61645d-b410-41eb-9e19-86696873adf9 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Request method failure captured: Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/images/4372b890-b1e9-49c2-9765-ed2fc15b344b/metadata/os_version HTTP/1.1 Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Yk24awMAh0tkQXatG4fe2mDvNicfwzz-DR5j4Yi-8plP5oxL0v6KUoZo8lDqgk5xDP2yr7QPpmLrJ4BkTcb2d6NqRgrTiRmfslnWdEePOThywngDrengs3XTshELFK8EmJns0pK0nm5mnVuZbWPzhsoYdQRCZ47IeAEEQzIXXhXVo Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:24.477338 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb49c152d1b148daafe374cf542bdfa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: d8745b5a7c2e4ec9a7b851be3100d432 Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'image_id': '4372b890-b1e9-49c2-9765-ed2fc15b344b', 'id': 'os_version'} Oct 31 14:05:24.478664 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.479459 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4372b890-b1e9-49c2-9765-ed2fc15b344b Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.482593 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4372b890-b1e9-49c2-9765-ed2fc15b344b could not be found. Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:24.483820 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.484884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab61645d-b410-41eb-9e19-86696873adf9 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:24.485893 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab61645d-b410-41eb-9e19-86696873adf9 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] 10.222.0.27 "GET /compute/v2.1/images/4372b890-b1e9-49c2-9765-ed2fc15b344b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.036435 Oct 31 14:05:24.485893 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 258/620] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 31 14:05:24 2022] GET /compute/v2.1/images/4372b890-b1e9-49c2-9765-ed2fc15b344b/metadata/os_version => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:24.491936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0caa30ac-8f3d-427f-9609-f3cdffe712da tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Calling method '.version_select at 0x7fe107af58b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:24.518426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0caa30ac-8f3d-427f-9609-f3cdffe712da tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] HTTP exception thrown: Image not found. Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0caa30ac-8f3d-427f-9609-f3cdffe712da tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Request method failure captured: Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/images/193fe9de-67fb-4e58-987a-335c943141a2/metadata HTTP/1.1 Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Yk24awMAh0tkQXatG4fe2mDvNicfwzz-DR5j4Yi-8plP5oxL0v6KUoZo8lDqgk5xDP2yr7QPpmLrJ4BkTcb2d6NqRgrTiRmfslnWdEePOThywngDrengs3XTshELFK8EmJns0pK0nm5mnVuZbWPzhsoYdQRCZ47IeAEEQzIXXhXVo Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:24.521049 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb49c152d1b148daafe374cf542bdfa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: d8745b5a7c2e4ec9a7b851be3100d432 Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'image_id': '193fe9de-67fb-4e58-987a-335c943141a2'} Oct 31 14:05:24.522409 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.523398 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 193fe9de-67fb-4e58-987a-335c943141a2 Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.524661 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 193fe9de-67fb-4e58-987a-335c943141a2 could not be found. Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:24.525990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.528408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0caa30ac-8f3d-427f-9609-f3cdffe712da tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:24.530346 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0caa30ac-8f3d-427f-9609-f3cdffe712da tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] 10.222.0.27 "GET /compute/v2.1/images/193fe9de-67fb-4e58-987a-335c943141a2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039944 Oct 31 14:05:24.530346 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 363/621] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:05:24 2022] GET /compute/v2.1/images/193fe9de-67fb-4e58-987a-335c943141a2/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:24.541016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1615ba64-119a-41ae-bac9-d1398521dfa2 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Action: 'update_all', calling method: .version_select at 0x7fe107da20d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:24.567463 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1615ba64-119a-41ae-bac9-d1398521dfa2 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] HTTP exception thrown: Image not found. Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1615ba64-119a-41ae-bac9-d1398521dfa2 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Request method failure captured: Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: request: PUT /compute/v2.1/images/201d7531-b27e-4de1-a4c7-699daf68e4b2/metadata HTTP/1.1 Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 57 Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Yk24awMAh0tkQXatG4fe2mDvNicfwzz-DR5j4Yi-8plP5oxL0v6KUoZo8lDqgk5xDP2yr7QPpmLrJ4BkTcb2d6NqRgrTiRmfslnWdEePOThywngDrengs3XTshELFK8EmJns0pK0nm5mnVuZbWPzhsoYdQRCZ47IeAEEQzIXXhXVo Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:24.570041 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb49c152d1b148daafe374cf542bdfa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: d8745b5a7c2e4ec9a7b851be3100d432 Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:05:24.571430 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'image_id': '201d7531-b27e-4de1-a4c7-699daf68e4b2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.572265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 201d7531-b27e-4de1-a4c7-699daf68e4b2 Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.573418 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 201d7531-b27e-4de1-a4c7-699daf68e4b2 could not be found. Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:24.575622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:05:24.576817 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.578010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1615ba64-119a-41ae-bac9-d1398521dfa2 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:24.578010 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1615ba64-119a-41ae-bac9-d1398521dfa2 tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] 10.222.0.27 "PUT /compute/v2.1/images/201d7531-b27e-4de1-a4c7-699daf68e4b2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035355 Oct 31 14:05:24.578010 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 259/622] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:05:24 2022] PUT /compute/v2.1/images/201d7531-b27e-4de1-a4c7-699daf68e4b2/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:24.581127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d57e7925-e543-47af-86f0-56fcb0e14d0c tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Action: 'update', calling method: .version_select at 0x7fe107b28b80>, body: {"meta": {"os_distro": "alt"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:24.604893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d57e7925-e543-47af-86f0-56fcb0e14d0c tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] HTTP exception thrown: Image not found. Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d57e7925-e543-47af-86f0-56fcb0e14d0c tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Request method failure captured: Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/images/83cf03c6-5101-455a-803f-037c886a3d54/metadata/os_distro HTTP/1.1 Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 30 Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Yk24awMAh0tkQXatG4fe2mDvNicfwzz-DR5j4Yi-8plP5oxL0v6KUoZo8lDqgk5xDP2yr7QPpmLrJ4BkTcb2d6NqRgrTiRmfslnWdEePOThywngDrengs3XTshELFK8EmJns0pK0nm5mnVuZbWPzhsoYdQRCZ47IeAEEQzIXXhXVo Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:24.607220 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb49c152d1b148daafe374cf542bdfa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: d8745b5a7c2e4ec9a7b851be3100d432 Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: {"meta": {"os_distro": "alt"}} Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:05:24.608511 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'image_id': '83cf03c6-5101-455a-803f-037c886a3d54', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.609340 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83cf03c6-5101-455a-803f-037c886a3d54 Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.615459 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83cf03c6-5101-455a-803f-037c886a3d54 could not be found. Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:24.618789 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:05:24.622572 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.627375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d57e7925-e543-47af-86f0-56fcb0e14d0c tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:24.627375 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d57e7925-e543-47af-86f0-56fcb0e14d0c tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] 10.222.0.27 "PUT /compute/v2.1/images/83cf03c6-5101-455a-803f-037c886a3d54/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.031599 Oct 31 14:05:24.628971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:24.628971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:24.629282 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 364/623] 10.222.0.27 () {60 vars in 1310 bytes} [Mon Oct 31 14:05:24 2022] PUT /compute/v2.1/images/83cf03c6-5101-455a-803f-037c886a3d54/metadata/os_distro => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:24.630600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1734ba70-044f-4659-91c8-5f494bdb66cf tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Action: 'create', calling method: .version_select at 0x7fe107b78b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:24.634850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:24.635574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:24.636200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:24.637054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:24.637945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:24.638542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:24.711241 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1734ba70-044f-4659-91c8-5f494bdb66cf tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] HTTP exception thrown: Image not found. Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1734ba70-044f-4659-91c8-5f494bdb66cf tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Request method failure captured: Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/images/371bf3c8-3db3-4785-a0c7-64e9fb6f04f5/metadata HTTP/1.1 Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 57 Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Yk24awMAh0tkQXatG4fe2mDvNicfwzz-DR5j4Yi-8plP5oxL0v6KUoZo8lDqgk5xDP2yr7QPpmLrJ4BkTcb2d6NqRgrTiRmfslnWdEePOThywngDrengs3XTshELFK8EmJns0pK0nm5mnVuZbWPzhsoYdQRCZ47IeAEEQzIXXhXVo Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:24.714529 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb49c152d1b148daafe374cf542bdfa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb49c152d1b148daafe374cf542bdfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cb49c152d1b148daafe374cf542bdfa9 Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-598575473 Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: d8745b5a7c2e4ec9a7b851be3100d432 Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-598575473-project Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:05:24.716031 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'image_id': '371bf3c8-3db3-4785-a0c7-64e9fb6f04f5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.717127 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 371bf3c8-3db3-4785-a0c7-64e9fb6f04f5 Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:05:24.718390 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 371bf3c8-3db3-4785-a0c7-64e9fb6f04f5 could not be found. Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:24.719605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:05:24.720896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:24.722328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1734ba70-044f-4659-91c8-5f494bdb66cf tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:24.724591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1734ba70-044f-4659-91c8-5f494bdb66cf tempest-ImagesMetadataNegativeTestJSON-598575473 tempest-ImagesMetadataNegativeTestJSON-598575473-project] 10.222.0.27 "POST /compute/v2.1/images/371bf3c8-3db3-4785-a0c7-64e9fb6f04f5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.097091 Oct 31 14:05:24.725313 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 365/624] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 31 14:05:24 2022] POST /compute/v2.1/images/371bf3c8-3db3-4785-a0c7-64e9fb6f04f5/metadata => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:05:24.798398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:24.812917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:24.815004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:24.821231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:24.822264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:24.829280 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5701309-3f49-4c88-8a0b-453d5361cadf tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.214636 Oct 31 14:05:24.830396 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 260/625] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:24 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:24.831901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:24.833972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:24.846766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:24.847843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:24.849083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:24.849721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:24.855048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:24.957545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e9f3b704-30c2-45a2-af09-910d7f8aa268 req-fcce93b7-2432-442c-8616-da595a8d22d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b9c3a6-7448-4c96-af32-93c724e53d67", "tag": "c312fc2c-6a72-4889-aa42-da10a17782ca"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:24.980668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:24.990021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e9f3b704-30c2-45a2-af09-910d7f8aa268 req-fcce93b7-2432-442c-8616-da595a8d22d6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:24.991703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e9f3b704-30c2-45a2-af09-910d7f8aa268 req-fcce93b7-2432-442c-8616-da595a8d22d6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:24.992873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e9f3b704-30c2-45a2-af09-910d7f8aa268 req-fcce93b7-2432-442c-8616-da595a8d22d6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:24.995892 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0171ad46-a4e3-4221-8ab3-8a729e5b38ad tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1328 microversion: 2.1 time: 0.178881 Oct 31 14:05:24.996468 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 366/626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:24 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:25.009534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:25.010364 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e9f3b704-30c2-45a2-af09-910d7f8aa268 req-fcce93b7-2432-442c-8616-da595a8d22d6 service nova] Creating event network-changed:c312fc2c-6a72-4889-aa42-da10a17782ca for instance 51b9c3a6-7448-4c96-af32-93c724e53d67 on n-h2-863052-1 Oct 31 14:05:25.011007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:25.020958 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e9f3b704-30c2-45a2-af09-910d7f8aa268 req-fcce93b7-2432-442c-8616-da595a8d22d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064965 Oct 31 14:05:25.022394 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 261/627] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:05:25.036211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:25.036979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:25.037475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:25.038555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:25.039104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:25.039715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:25.330969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:25.332287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:25.347527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:25.349072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:25.350636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:25.352279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:25.371693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:25.375869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:25.715793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:25.726604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:25.728679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:25.730249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d2b5cdb-a6d5-47fb-a83e-ea2944b319c0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.727647 Oct 31 14:05:25.733589 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 367/628] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:25 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:25.759105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:25.769388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-024d3853-3511-4722-89f0-d3d2e671bd80 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.446283 Oct 31 14:05:25.771194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 262/629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:25 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:25.859997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:25.861120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:25.869059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:25.869944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:25.870658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:25.871954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:25.872474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:25.873947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:25.982791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:25.992078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:26.002524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:26.017275 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d896d425-3bf8-43dd-80e1-f522b48dce18 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.160788 Oct 31 14:05:26.018081 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 368/630] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:25 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:26.022124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:26.022622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:26.034120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:26.035148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:26.042441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.043300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.043974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.044917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.045753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.046478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.050710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.051204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.052281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.053322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.056305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.057653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.083332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:05:26.222112 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82ff51bd-ee66-4eab-b4e6-d1eabc4590f9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 204 len: 0 microversion: 2.1 time: 0.217670 Oct 31 14:05:26.222744 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 263/631] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:05:26 2022] DELETE /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:05:26.229064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-07fb2cad-6a16-45bb-a6bb-fce5fb5e3331 req-f29cf800-e8dc-46ba-98b8-f8fd39b3521e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3", "tag": "c778a55d-5f99-4c18-922a-7bde2ec40796"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:26.239957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07fb2cad-6a16-45bb-a6bb-fce5fb5e3331 req-f29cf800-e8dc-46ba-98b8-f8fd39b3521e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.240658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07fb2cad-6a16-45bb-a6bb-fce5fb5e3331 req-f29cf800-e8dc-46ba-98b8-f8fd39b3521e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.241276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07fb2cad-6a16-45bb-a6bb-fce5fb5e3331 req-f29cf800-e8dc-46ba-98b8-f8fd39b3521e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.254653 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-07fb2cad-6a16-45bb-a6bb-fce5fb5e3331 req-f29cf800-e8dc-46ba-98b8-f8fd39b3521e service nova] Creating event network-changed:c778a55d-5f99-4c18-922a-7bde2ec40796 for instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 on n-h2-863052-1 Oct 31 14:05:26.260375 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-07fb2cad-6a16-45bb-a6bb-fce5fb5e3331 req-f29cf800-e8dc-46ba-98b8-f8fd39b3521e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035388 Oct 31 14:05:26.261448 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 264/632] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:26.266916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:26.267713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:26.275515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.276083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.276583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.277526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.278190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.279622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.349801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:26.362073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84fe19e5-d396-430a-97e6-5d3e583320cf tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.342657 Oct 31 14:05:26.363555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 369/633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:26 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:26.620190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:26.629173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36793c3c-1084-4566-baf2-39191fea21ee tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1710 microversion: 2.1 time: 0.366307 Oct 31 14:05:26.633980 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 265/634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:26 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1710 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:26.764072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:26.765449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:26.773677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.779096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.779764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.780687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.786805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.787542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.793257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:26.794061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:26.805848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.806423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.806868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:26.807588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:26.808040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:26.809250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:27.256379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.266158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.267665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.269389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3735042-4fa5-4627-83e5-d28fcded7f8d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.511756 Oct 31 14:05:27.270247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 370/635] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:26 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:27.287689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:27.288634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:27.299447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:27.317481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:27.317991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:27.318767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:27.319239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:27.319664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:27.337696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.385395 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c5fb6c4-84c6-41c1-b0d3-630f5962b5a9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.596026 Oct 31 14:05:27.385985 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 266/636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:26 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:27.400110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:27.406754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:27.416669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:27.417561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:27.417561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:27.418313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:27.418760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:27.420472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:27.568292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.590859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.596894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:27.606548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3e3b30a-23d0-4066-96b1-a85b5b17a00f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.323590 Oct 31 14:05:27.625041 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 371/637] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:27 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:27.661714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:27.662894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:27.675474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:27.676018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:27.676826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:27.685003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:27.685491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:27.685925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.081170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.091296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b36a048-594e-4ae7-bb00-213a7228eb20 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1710 microversion: 2.1 time: 0.434249 Oct 31 14:05:28.092056 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 372/638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:27 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1710 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:28.263601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Calling method '.version_select at 0x7fe107c02280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:28.275694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.276193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.276785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.277504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.278131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.278785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.344023 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9a6e3a6-2a53-4cc1-9ed4-610e2dc32f8e tempest-AbsoluteLimitsTestJSON-659227202 tempest-AbsoluteLimitsTestJSON-659227202-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.250721 Oct 31 14:05:28.349690 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 373/639] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 31 14:05:28 2022] GET /compute/v2.1/limits => generated 511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:28.356684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:28.357245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:28.379060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.388171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.388374 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc2f593c-68c9-4541-bf59-13e08b792f1d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.995579 Oct 31 14:05:28.388836 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 267/640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:27 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:28.389302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.389830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.391447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.392832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.394052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.396530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d88d668c-e6a8-4287-a0b8-bc8439cc39cc req-f095ef9b-564f-4380-8df4-823803b2d733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd485178-61c6-4529-973d-660c36a7b16c", "tag": "d707fdf2-6468-4ce7-abf5-14d588531142"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:28.422377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d88d668c-e6a8-4287-a0b8-bc8439cc39cc req-f095ef9b-564f-4380-8df4-823803b2d733 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.423820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d88d668c-e6a8-4287-a0b8-bc8439cc39cc req-f095ef9b-564f-4380-8df4-823803b2d733 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.424499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d88d668c-e6a8-4287-a0b8-bc8439cc39cc req-f095ef9b-564f-4380-8df4-823803b2d733 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.441195 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d88d668c-e6a8-4287-a0b8-bc8439cc39cc req-f095ef9b-564f-4380-8df4-823803b2d733 service nova] Creating event network-changed:d707fdf2-6468-4ce7-abf5-14d588531142 for instance cd485178-61c6-4529-973d-660c36a7b16c on n-h1-863052-1 Oct 31 14:05:28.449875 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d88d668c-e6a8-4287-a0b8-bc8439cc39cc req-f095ef9b-564f-4380-8df4-823803b2d733 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059085 Oct 31 14:05:28.451265 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 268/641] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:28.460970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:28.461846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:28.472001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.472725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.474051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.475356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.476004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.476620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.731171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.747742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.749998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.751900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ab20ed4-2be1-49c5-b50c-18216aa45d51 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.401003 Oct 31 14:05:28.756442 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 374/642] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:28 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:28.761625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:28.762261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:28.768519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.768995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.769430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.770202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:28.771143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:28.771620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:28.851630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.860823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.862807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:28.870349 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9344e53-16b6-47b7-8873-361340b4f058 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.112788 Oct 31 14:05:28.871623 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 375/643] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:28 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:29.119247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:29.120423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:29.130458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.130458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.130458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.130458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.131132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.131132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.225089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:29.233282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69e7984c-5f58-4034-8f1e-a4ced9d31a2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.780503 Oct 31 14:05:29.233855 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 269/644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:28 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:29.337585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:29.347212 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-487d66d5-6c3c-4b94-8369-5bc5ecd22b2e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1710 microversion: 2.1 time: 0.233783 Oct 31 14:05:29.347788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 376/645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:29 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1710 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:29.417108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:29.417731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:29.425750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.427034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.427638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.428510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.429110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.429682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.783820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:29.784717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:29.799044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.799699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.800241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.801083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.802844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.803540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.935867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:29.946673 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5096b1c6-6604-42bb-9bc0-d7d23a772c97 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.531949 Oct 31 14:05:29.947973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 270/646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:29 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:29.953126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:29.953800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:29.974255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.974746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.975360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:29.976512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:29.977118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:29.979748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.022736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:30.148687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.163459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.167803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.171392 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90488771-16fc-4e52-95c4-1d44d376db48 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.391871 Oct 31 14:05:30.178885 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 377/647] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:29 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:30.221467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.260370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:30.261633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:30.265801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.269646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.273974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.274769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.275409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.276387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.277040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.278514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.297696 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-723db265-2011-4760-9463-1ad14de0879a tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.348417 Oct 31 14:05:30.312707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 271/648] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:29 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:30.371514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:30.372318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:30.388477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.389376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.389980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.392748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.393432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.398456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.698617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.711249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f27199da-12ad-4753-905a-96edf9ca70d8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.457663 Oct 31 14:05:30.712603 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 378/649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:30 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:30.825604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:30.840745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1963362-27bf-4c8f-894d-12e0a5438f5f tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1643 microversion: 2.1 time: 0.472855 Oct 31 14:05:30.841351 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 272/650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:30 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1643 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:30.895937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:30.898459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.899158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.900329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.901185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.903324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.904006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:30.938056 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6076991-61af-41a1-8e4f-618b7db4b1ba tempest-AZV2TestJSON-335408286 tempest-AZV2TestJSON-335408286-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.223664 Oct 31 14:05:30.948237 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 379/651] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 31 14:05:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:05:30.972740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:30.974358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:30.993931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:30.994895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:30.998748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.003781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.004577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.005183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.199553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:31.200901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:31.210642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.211616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.212229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.213658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.214390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.214998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.438429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.449691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.451407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.453391 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b45a6d5-32a1-419f-be14-7b1290942333 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.258373 Oct 31 14:05:31.455630 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 380/652] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:31 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:31.472380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c5f7db7b-cef6-4410-93b1-e5fcc414cf94 req-5d10754f-e726-42ed-9e49-bf34991f4650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800d44ad-a714-4a33-a0b0-dc46b4091241", "name": "network-vif-deleted", "tag": "2451e158-5ca6-4a65-a126-d3806a2886a1"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:31.485289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c5f7db7b-cef6-4410-93b1-e5fcc414cf94 req-5d10754f-e726-42ed-9e49-bf34991f4650 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.486542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c5f7db7b-cef6-4410-93b1-e5fcc414cf94 req-5d10754f-e726-42ed-9e49-bf34991f4650 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.487223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c5f7db7b-cef6-4410-93b1-e5fcc414cf94 req-5d10754f-e726-42ed-9e49-bf34991f4650 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.504891 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c5f7db7b-cef6-4410-93b1-e5fcc414cf94 req-5d10754f-e726-42ed-9e49-bf34991f4650 service nova] Creating event network-vif-deleted:2451e158-5ca6-4a65-a126-d3806a2886a1 for instance 800d44ad-a714-4a33-a0b0-dc46b4091241 on n-h1-863052-1 Oct 31 14:05:31.511671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c5f7db7b-cef6-4410-93b1-e5fcc414cf94 req-5d10754f-e726-42ed-9e49-bf34991f4650 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054089 Oct 31 14:05:31.512525 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 381/653] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:31.522018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:31.523119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:31.531632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.532778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.533535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.534767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.537239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.537909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.636530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.648689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.651128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.657051 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb01c4a6-379b-4077-ab9f-b7bb0b44b680 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.143145 Oct 31 14:05:31.658464 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 382/654] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:31 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:31.701255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:31.712794 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c6909061-5482-411f-b440-7c6aec014918 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.744677 Oct 31 14:05:31.714511 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 273/655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:30 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:31.739387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:31.739693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:31.755602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.756344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.756913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.757648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.758183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.758661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.878463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:31.880269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:31.882263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:31.905726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.906264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.906723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:31.907440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:31.907899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:31.908328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.003289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.005101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.006655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.007367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lazy-loading 'fault' on Instance uuid 800d44ad-a714-4a33-a0b0-dc46b4091241 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:32.100612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bd703ae1e47adb054f66e15a943cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfde485f2bc54a4ba158a7297910a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.121260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87324000-3461-4d83-a6de-8ba0840e5ff6 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 200 len: 1351 microversion: 2.1 time: 0.256814 Oct 31 14:05:32.127201 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 274/656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:31 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 1351 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:32.191496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.201822 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef1971a3-ee35-4c40-a6b0-3df1bcc14180 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.470244 Oct 31 14:05:32.204434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 383/657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:31 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:32.487474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:32.488010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:32.500764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.507290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.508066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.515933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.516861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.519217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.592686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=20 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:32.687394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:32.688365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:32.709601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.711020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.711483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.712213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.715097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.723567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.896455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.914413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.916241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.918135 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7adf5209-4035-41e5-9a2f-fdbbafec44e6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.434433 Oct 31 14:05:32.918840 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 275/658] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:32 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:32.925581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:32.926871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:32.960408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.961449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.961914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.962725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:32.963192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:32.963622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:32.966898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.969525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:32.987095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:32.989506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:33.014111 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86132cfe-3c96-4f4f-95d8-41a761bfd6d1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.331100 Oct 31 14:05:33.017215 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 384/659] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:32 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:33.028171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e12ea780-0635-4928-ad39-09107b4278ce req-2a5b8e56-51b6-4e2e-b097-8d192526e976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b9c3a6-7448-4c96-af32-93c724e53d67", "name": "network-vif-plugged", "status": "completed", "tag": "c312fc2c-6a72-4889-aa42-da10a17782ca"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:33.089209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e12ea780-0635-4928-ad39-09107b4278ce req-2a5b8e56-51b6-4e2e-b097-8d192526e976 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.089799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e12ea780-0635-4928-ad39-09107b4278ce req-2a5b8e56-51b6-4e2e-b097-8d192526e976 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.091499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e12ea780-0635-4928-ad39-09107b4278ce req-2a5b8e56-51b6-4e2e-b097-8d192526e976 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.114593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e12ea780-0635-4928-ad39-09107b4278ce req-2a5b8e56-51b6-4e2e-b097-8d192526e976 service nova] Creating event network-vif-plugged:c312fc2c-6a72-4889-aa42-da10a17782ca for instance 51b9c3a6-7448-4c96-af32-93c724e53d67 on n-h2-863052-1 Oct 31 14:05:33.126664 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e12ea780-0635-4928-ad39-09107b4278ce req-2a5b8e56-51b6-4e2e-b097-8d192526e976 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107290 Oct 31 14:05:33.139042 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 385/660] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:33.152059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:33.153539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:33.166211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.167916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.168639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.170446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.171357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.173459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.193152 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 HTTP/1.1 Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:33.217573 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:33.219306 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '800d44ad-a714-4a33-a0b0-dc46b4091241'} Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:33.220022 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:33.223477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.225209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:33.225209 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d00d3d52-b9aa-4ad4-b253-7f6ce088a87e tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 404 len: 111 microversion: 2.1 time: 0.071851 Oct 31 14:05:33.225495 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 386/661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:33 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:05:33.235909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:33.236538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:33.247089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.263409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.264454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.266913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.267449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.267934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.389996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:33.399073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d72c4d9-c324-4fae-93e1-03925a7f59a6 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.478655 Oct 31 14:05:33.403105 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 276/662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:32 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:33.409701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:33.425035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:33.437334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.439888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.440685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.441656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.442894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.443544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.480481 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a HTTP/1.1 Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:33.482223 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.483517 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '60af71f3-df25-4ad4-967b-5414eaf8577a'} Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:33.484201 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.485363 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.489393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:33.489393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67f340a9-c4db-466a-a11e-9d534aac63a9 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 404 len: 111 microversion: 2.1 time: 0.078627 Oct 31 14:05:33.489393 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 277/663] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:05:33 2022] DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:33.493200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:33.493826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:33.518015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.518664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.519126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.522006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.522581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.523029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.548616 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a HTTP/1.1 Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:05:33.562483 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.563939 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '60af71f3-df25-4ad4-967b-5414eaf8577a'} Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:33.564655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:33.568197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:05:33.572521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:33.572521 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ef1a520-8d45-4c0c-a7c6-e7ee3b5c615b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 404 len: 111 microversion: 2.1 time: 0.074707 Oct 31 14:05:33.572521 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 278/664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:33 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:33.584794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-401be308-ba1f-4dd5-a904-b2b92c353230 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '.version_select at 0x7fe107eba3a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:33.638914 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-401be308-ba1f-4dd5-a904-b2b92c353230 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959568785" status: 202 len: 0 microversion: 2.1 time: 0.063330 Oct 31 14:05:33.640077 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 279/665] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959568785 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:05:33.917689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:33.927436 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f849e27a-fa5c-4716-a627-4cc11ad6205f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.700852 Oct 31 14:05:33.928016 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 387/666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:33 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:33.946073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:33.947350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:33.960984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.964545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.965704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:33.966805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:33.968666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:33.969696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:34.052703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:34.053638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:34.064301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:34.065257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:34.065918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:34.070445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:34.071248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:34.071944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:34.244102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:34.260447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:34.266823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:34.281059 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-face8643-2c22-4c6c-b8a8-5c99954319b7 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1447 microversion: 2.75 time: 0.233366 Oct 31 14:05:34.287457 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 388/667] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:34 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1447 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:34.334915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:34.346775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:34.348914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:34.350022 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-731597b0-77b8-4f98-a58b-820db179b185 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1362 microversion: 2.25 time: 0.409078 Oct 31 14:05:34.384004 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 280/668] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:33 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:34.426644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:34.427366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:34.436294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:34.439061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:34.439880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:34.441223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:34.442952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:34.445616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:34.960069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:34.964071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:34.988478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:34.992758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:34.995428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:34.997965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:34.998766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.008171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.157328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.167367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62c19d6b-814c-4d8b-837d-a6afed2dc914 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.744757 Oct 31 14:05:35.168514 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 389/669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:34 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:35.323250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.323970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:35.339058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:35.341249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.346092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.346832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.347890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.348540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.349158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.380575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.392953 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f36de597-c816-4add-aa1a-0037e411f4ab tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.445218 Oct 31 14:05:35.393638 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 281/670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:34 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:35.406479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-202c6505-334a-4842-b64b-fc1b58272888 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.448862 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-202c6505-334a-4842-b64b-fc1b58272888 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1554417832" status: 202 len: 0 microversion: 2.1 time: 0.053962 Oct 31 14:05:35.449303 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 282/671] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:05:35 2022] DELETE /compute/v2.1/flavors/1554417832 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:05:35.453958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.456155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:35.471940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.473528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.477544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.478575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.479195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.479772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.571081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.583533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.587309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.608336 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcf45061-85dd-45fe-8200-c63e76ec79e2 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1453 microversion: 2.75 time: 0.293313 Oct 31 14:05:35.608926 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 390/672] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:35 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1453 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:35.629315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2cac8d0-e05c-436d-a4ad-3168f6614e0d tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.658123 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2cac8d0-e05c-436d-a4ad-3168f6614e0d tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.048099 Oct 31 14:05:35.671208 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 391/673] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:05:35 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:35.683735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-70d018ef-e54e-4921-a3f1-e55295c69622 req-9a4dd869-b97d-4d38-ac26-1bd367241046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd485178-61c6-4529-973d-660c36a7b16c", "name": "network-vif-plugged", "status": "completed", "tag": "d707fdf2-6468-4ce7-abf5-14d588531142"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:35.698564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-70d018ef-e54e-4921-a3f1-e55295c69622 req-9a4dd869-b97d-4d38-ac26-1bd367241046 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.699354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-70d018ef-e54e-4921-a3f1-e55295c69622 req-9a4dd869-b97d-4d38-ac26-1bd367241046 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.700011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-70d018ef-e54e-4921-a3f1-e55295c69622 req-9a4dd869-b97d-4d38-ac26-1bd367241046 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.726416 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-70d018ef-e54e-4921-a3f1-e55295c69622 req-9a4dd869-b97d-4d38-ac26-1bd367241046 service nova] Creating event network-vif-plugged:d707fdf2-6468-4ce7-abf5-14d588531142 for instance cd485178-61c6-4529-973d-660c36a7b16c on n-h1-863052-1 Oct 31 14:05:35.734019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-70d018ef-e54e-4921-a3f1-e55295c69622 req-9a4dd869-b97d-4d38-ac26-1bd367241046 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055048 Oct 31 14:05:35.734660 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 392/674] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:35.740331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c58c612c-db9a-48c6-bebe-04193c7849d3 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.774038 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c58c612c-db9a-48c6-bebe-04193c7849d3 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/222071100" status: 202 len: 0 microversion: 2.1 time: 0.036591 Oct 31 14:05:35.775094 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 393/675] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:05:35 2022] DELETE /compute/v2.1/flavors/222071100 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:05:35.786405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c0eec4e-ed42-4cf7-9475-179110ae77f9 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.823917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c0eec4e-ed42-4cf7-9475-179110ae77f9 tempest-ServersWithSpecificFlavorTestJSON-1739401846 tempest-ServersWithSpecificFlavorTestJSON-1739401846-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044374 Oct 31 14:05:35.824846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 394/676] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:05:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:35.849355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.854283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.855563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:35.860360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.864907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.865396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.865840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.866559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.866862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:35.868060 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-175070eb-5aff-4d56-988f-7f7f942792bf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1557 microversion: 2.25 time: 0.417830 Oct 31 14:05:35.877041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.877876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.878521 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 283/677] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:35 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1557 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:35.896222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.897127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:35.904529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.905017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.905445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.906144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.906628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.906943 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.907061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 HTTP/1.1 Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:35.908693 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.909952 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '800d44ad-a714-4a33-a0b0-dc46b4091241'} Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:35.911303 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.912487 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.917181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:35.917181 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07bb685c-df5b-43ca-956e-44f01f841a19 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 404 len: 111 microversion: 2.1 time: 0.060367 Oct 31 14:05:35.917181 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 395/678] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:05:35 2022] DELETE /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:35.920479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.921098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 800d44ad-a714-4a33-a0b0-dc46b4091241] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:35.928602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.929090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.929521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.930247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.930698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.931114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.947830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 HTTP/1.1 Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:35.949348 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.950700 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '800d44ad-a714-4a33-a0b0-dc46b4091241'} Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:35.951436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. Oct 31 14:05:35.952599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.953636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 800d44ad-a714-4a33-a0b0-dc46b4091241 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:35.953636 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fabc18e2-defc-4fa1-a091-9f4c1b281fcd tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241" status: 404 len: 111 microversion: 2.1 time: 0.034493 Oct 31 14:05:35.953636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 396/679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:35 2022] GET /compute/v2.1/servers/800d44ad-a714-4a33-a0b0-dc46b4091241 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:35.960107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:35.960604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:35.966859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.967494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.967931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.968616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:35.969232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:35.969808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:35.987759 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a HTTP/1.1 Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:35.989725 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:35.991208 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '60af71f3-df25-4ad4-967b-5414eaf8577a'} Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:35.992189 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:35.993511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:35.995825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:35.996886 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f08397e-2714-459a-9248-89ae438e240b tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 404 len: 111 microversion: 2.1 time: 0.041518 Oct 31 14:05:36.001090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 397/680] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:05:35 2022] DELETE /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:05:36.006915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:36.010986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] [instance: 60af71f3-df25-4ad4-967b-5414eaf8577a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:36.019110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.019650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.020776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.021534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.021981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.022442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.040962 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] HTTP exception thrown: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Request method failure captured: Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a HTTP/1.1 Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9WW-0S6qk5Ksg4xbPaTmuaHRGejrehxSP2GsNiXqErjWLGYuA2r_Ha_ij73v7OiZb7XX5Wotbda1xo9-rBiB2ixUQXneF3xW3hs6aR9J82YzdYOsVN-R5pOp6e_UNBNtyozUdxktMYulAQ_GbEp6MyhTJROdrdt3j0eTdLa84Zuydk Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:05:36.042921 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfde485f2bc54a4ba158a7297910a66a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfde485f2bc54a4ba158a7297910a66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cfde485f2bc54a4ba158a7297910a66a Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234 Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 998bd703ae1e47adb054f66e15a943cc Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-600088234-project Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:36.044311 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '60af71f3-df25-4ad4-967b-5414eaf8577a'} Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:05:36.045129 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. Oct 31 14:05:36.046293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:05:36.050287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] Returning 404 to user: Instance 60af71f3-df25-4ad4-967b-5414eaf8577a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:05:36.051665 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b126e0e7-2244-4437-9afd-c62ed6d2b7a8 tempest-ServersWithSpecificFlavorTestJSON-600088234 tempest-ServersWithSpecificFlavorTestJSON-600088234-project] 10.222.0.27 "GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a" status: 404 len: 111 microversion: 2.1 time: 0.049261 Oct 31 14:05:36.056498 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 398/681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:36 2022] GET /compute/v2.1/servers/60af71f3-df25-4ad4-967b-5414eaf8577a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:05:36.188688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:36.199854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:36.201939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:36.224756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.225232 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6137ecf4-50aa-4802-a621-b6a9af851c51 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 2050 microversion: 2.25 time: 0.333089 Oct 31 14:05:36.225354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.225662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.225819 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 284/682] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:35 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 2050 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:36.244242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.244242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.244242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.251011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:36.251864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:36.260214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.260988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.261475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.262808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.263270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.263698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.545623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:36.591331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8633041b-13fd-4d91-83fb-dc6b62938145 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 2050 microversion: 2.25 time: 0.342076 Oct 31 14:05:36.599281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:36.600823 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 285/683] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:36 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 2050 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:36.611451 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04fe480c-5e0f-48a4-b92f-236d182030d5 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1396 microversion: 2.1 time: 0.420300 Oct 31 14:05:36.618390 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 399/684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:36 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1396 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:36.643679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:36.652473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:36.667378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.667868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.668300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.668994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:36.669459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:36.674873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:36.842187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f0e7deb-1899-4220-901f-cd0e9014d53a tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Action: 'create', calling method: .version_select at 0x7fe107e1a700>, body: {"pool": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:37.050352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:37.069186 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7035b70-63c0-4793-91bf-8c964a58d9eb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.449425 Oct 31 14:05:37.091713 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 400/685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:36 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:37.107640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:37.111304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.122124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.123247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.129128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.132082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.132729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.167990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-333c382d-3625-4d01-9ae2-377cf68b540f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.074686 Oct 31 14:05:37.169120 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 401/686] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 31 14:05:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:05:37.175234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:37.177200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:37.185287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.186346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.187991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.188863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.189467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.190035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.311001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:37.332237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:37.342504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:37.366224 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cadac259-44f2-4b05-91aa-45d8d07251f1 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1453 microversion: 2.75 time: 0.195590 Oct 31 14:05:37.372838 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 402/687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:37 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:37.404131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:37.405007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:37.412722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.413575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.414301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.415215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.415870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.416502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.581224 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2a20ea0-ea05-4d7d-9752-c7a653ef6735 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67/action" status: 202 len: 0 microversion: 2.25 time: 0.180340 Oct 31 14:05:37.588863 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 403/688] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:05:37 2022] POST /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:05:37.609574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:37.610451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:37.634718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.639540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.640386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:37.644171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:37.644621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:37.645598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.021210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:38.045639 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c4b9425-c6b0-48ba-a3c8-d27d9d274a74 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 2055 microversion: 2.25 time: 0.455132 Oct 31 14:05:38.046936 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 404/689] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:37 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 2055 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:38.059124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:38.060060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:38.068314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.068804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.069239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.069931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.070412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.070829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.275646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=14 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:38.331808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:38.342920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f63fcc6-4b74-4826-811c-d06ef62f076a tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1577 microversion: 2.1 time: 0.294499 Oct 31 14:05:38.344150 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 405/690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:38 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1577 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:38.354968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e342538c-603f-40e8-b02a-3ae3326b3119 req-dfaae6f1-c74e-487a-a694-06ddd392cb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3", "name": "network-vif-plugged", "status": "completed", "tag": "c778a55d-5f99-4c18-922a-7bde2ec40796"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:38.380184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e342538c-603f-40e8-b02a-3ae3326b3119 req-dfaae6f1-c74e-487a-a694-06ddd392cb93 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.381574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e342538c-603f-40e8-b02a-3ae3326b3119 req-dfaae6f1-c74e-487a-a694-06ddd392cb93 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.382252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e342538c-603f-40e8-b02a-3ae3326b3119 req-dfaae6f1-c74e-487a-a694-06ddd392cb93 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.413062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e342538c-603f-40e8-b02a-3ae3326b3119 req-dfaae6f1-c74e-487a-a694-06ddd392cb93 service nova] Creating event network-vif-plugged:c778a55d-5f99-4c18-922a-7bde2ec40796 for instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 on n-h2-863052-1 Oct 31 14:05:38.429140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e342538c-603f-40e8-b02a-3ae3326b3119 req-dfaae6f1-c74e-487a-a694-06ddd392cb93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083472 Oct 31 14:05:38.429763 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 406/691] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:38.467095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:38.478642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:38.489969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.490759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.491370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.492275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.493731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.494383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.855068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:38.865019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4759485-1adb-4a25-87af-9d1ce0424d3d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1310 microversion: 2.1 time: 0.428354 Oct 31 14:05:38.865827 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 407/692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:38 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1310 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:38.877611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:38.878106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:38.887413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.889525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.890143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:38.892429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:38.895882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:38.896412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:39.055415 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80f80ad1-a99e-463a-9a69-cbf38a752363 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185564 Oct 31 14:05:39.056308 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 408/693] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:05:38 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:39.085078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:39.098626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:39.118616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:39.119111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:39.119545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:39.120246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:39.120694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:39.121108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:39.144570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:39.629767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:39.639053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:39.641034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:39.648228 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a713ac5e-45f4-4b9c-be7d-1288454deac3 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1438 microversion: 2.75 time: 0.590226 Oct 31 14:05:39.662899 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 409/694] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:39 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1438 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:39.679219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:39.680231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:39.688180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:39.688905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:39.689505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:39.690799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:39.691421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:39.692566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:40.572544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:40.600535 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bc22068-007f-475d-b8fb-9f092dfddeb1 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 2035 microversion: 2.25 time: 0.936160 Oct 31 14:05:40.601528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 410/695] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:39 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 2035 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:40.823915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:40.826865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:40.842885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:40.844469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:40.847693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:40.851808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:40.852660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:40.854380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:40.948800 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f0e7deb-1899-4220-901f-cd0e9014d53a tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.346357 Oct 31 14:05:40.956104 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 286/696] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:05:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:40.969766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:40.970880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:41.009677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:41.010964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:41.012465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:41.015428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:41.017975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:41.020678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:41.036788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:41.040450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:41.041071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:41.042896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:41.045828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:41.167510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:41.183769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:41.185084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:41.187304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:41.189105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:41.191114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:41.194372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:41.495783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:41.546761 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cf0b678-d2a9-4d63-b18f-8b9350f3914a tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2/action" status: 202 len: 1942 microversion: 2.75 time: 0.943762 Oct 31 14:05:41.562720 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 411/697] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:05:40 2022] POST /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2/action => generated 1942 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 14:05:41.578755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": "auto"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:41.582661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:41.589819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:41.590584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:41.591243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:41.592156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:41.592849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:41.593505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:41.641667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'flavor' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:41.665056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Going to try to live migrate instance to n-h1-863052-1 {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:05:41.701322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:41.730078 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acc8aa63-4a8d-445c-aff5-2af401d37256 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1493 microversion: 2.1 time: 0.760136 Oct 31 14:05:41.748285 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 287/698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:40 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1493 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:41.757582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2aaf8793-0191-46cf-815f-1614b59cb559 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Action: 'create', calling method: .version_select at 0x7fe10c25c3a0>, body: {"pool": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:44.301723 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8aac511d-3f4c-4d13-9746-f9b6cbd1bda7 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67/action" status: 202 len: 0 microversion: 2.25 time: 2.737345 Oct 31 14:05:44.303655 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 412/699] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:05:41 2022] POST /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67/action => generated 0 bytes in 2740 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:05:44.309042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:44.309926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:44.342185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:44.351366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:44.354643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:44.376057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:44.377321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:44.383349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:44.685299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:44.782511 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad620d6d-ecb9-4d5c-aad7-18b5241331be tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.471478 Oct 31 14:05:44.798478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 413/700] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:44 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:45.065355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:45.066969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:45.074082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.074860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.075485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.076450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.077069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.077691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.224688 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85f88422-953b-42f3-aed3-fc3b4ae6ffe4 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1644 microversion: 2.1 time: 0.420753 Oct 31 14:05:45.225476 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 414/701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:44 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1644 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:45.230567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:45.231169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:45.237228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.237846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.238135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.239429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.239885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.240305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.412665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:45.421705 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c6abb6f-ff45-4da4-a4aa-414237761480 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1577 microversion: 2.1 time: 0.194654 Oct 31 14:05:45.423391 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 415/702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:45 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:45.428940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a501b891-14e6-4885-a819-daeb94852dfd req-4f4811cd-dcbc-4e0b-8322-f293b71eeafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd485178-61c6-4529-973d-660c36a7b16c", "tag": "d707fdf2-6468-4ce7-abf5-14d588531142"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:45.444366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a501b891-14e6-4885-a819-daeb94852dfd req-4f4811cd-dcbc-4e0b-8322-f293b71eeafc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.445196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a501b891-14e6-4885-a819-daeb94852dfd req-4f4811cd-dcbc-4e0b-8322-f293b71eeafc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.445686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a501b891-14e6-4885-a819-daeb94852dfd req-4f4811cd-dcbc-4e0b-8322-f293b71eeafc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.460960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a501b891-14e6-4885-a819-daeb94852dfd req-4f4811cd-dcbc-4e0b-8322-f293b71eeafc service nova] Creating event network-changed:d707fdf2-6468-4ce7-abf5-14d588531142 for instance cd485178-61c6-4529-973d-660c36a7b16c on n-h1-863052-1 Oct 31 14:05:45.466626 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a501b891-14e6-4885-a819-daeb94852dfd req-4f4811cd-dcbc-4e0b-8322-f293b71eeafc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041642 Oct 31 14:05:45.467570 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 416/703] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:45.480859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:45.481807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:45.489972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.490516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.491515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.491645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.492454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.493040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.710259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:45.721423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:45.723578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:45.725057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f83b8b2-d333-48ad-9ace-c30ccc1e8e6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1567 microversion: 2.25 time: 0.255967 Oct 31 14:05:45.738801 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 417/704] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:45 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:45.836327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f863f06-01d3-46be-a7cb-8f5a5d246545 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Action: 'create', calling method: .version_select at 0x7fe107b63700>, body: {"keypair": {"name": "tempest-keypair-1271316180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkkCAOkUTBr6wH3lFY3b0QSNZn6TPAGBcIy1j8g4RzBWCtV3xGq/7oRAyeKkpKhrLrH70AbLy+4AYQ4IkJs6scdYtKOQzK1kMEAsKkF4H3tPtZZI49ekfnXhij7dZoX0Q=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:45.856050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5f863f06-01d3-46be-a7cb-8f5a5d246545 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Getting quotas for project eeccdf8ef7e74647969d606c07c4e0ad. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:45.864181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5f863f06-01d3-46be-a7cb-8f5a5d246545 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Getting quotas for user dee28deb1e94414782841e09e0db6789 and project eeccdf8ef7e74647969d606c07c4e0ad. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:45.928464 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f863f06-01d3-46be-a7cb-8f5a5d246545 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187757 Oct 31 14:05:45.931470 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 418/705] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:05:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:45.936948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:45.937576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:45.947501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.947999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.948435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:45.949138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:45.949682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:45.950107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:46.630051 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b332dfa-11a5-461f-b02a-a89e840b1521 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1644 microversion: 2.1 time: 0.697464 Oct 31 14:05:46.631346 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 419/706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:45 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1644 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:46.636486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:46.637317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:46.643994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:46.644485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:46.644890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:46.645769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:46.646481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:46.647114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:46.757230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:46.779887 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c36dc551-1d01-4dc1-b5f7-5a052f521414 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.147248 Oct 31 14:05:46.780796 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 420/707] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:46 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:46.785968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d0b704a-c76b-4378-ae58-33c1d2bd72fe"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:46.788508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:46.804129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:46.804627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:46.805067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:46.805765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:46.806251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:46.806660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:46.989593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2aaf8793-0191-46cf-815f-1614b59cb559 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.238597 Oct 31 14:05:46.991353 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 288/708] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:05:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:46.993538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:47.004661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:47.015894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:47.016910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:47.017729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:47.018977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:47.019936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:47.021288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:47.082476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dea4c43f-2d58-4008-a512-591bfdb6e0cd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.089132 Oct 31 14:05:47.083423 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 289/709] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:05:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:47.088071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:47.088985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:47.096148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:47.096818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:47.101706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:47.102695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:47.103412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:47.104096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:47.145195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=18 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:47.239910 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9d445a2-edc2-45f2-9160-648de1950547 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "POST /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457513 Oct 31 14:05:47.240533 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 421/710] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:05:46 2022] POST /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:47.252639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3208b0e-d650-44ba-9075-3c425461e542 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Action: 'create', calling method: .version_select at 0x7fe107a680d0>, body: {"pool": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:47.450600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:47.489586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:47.493443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:47.499415 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b726ec3d-21be-47df-87d1-a75c9c0d0cf0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1567 microversion: 2.25 time: 0.414872 Oct 31 14:05:47.500199 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 290/711] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:47 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:47.508781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:47.511986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:47.527556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:47.529329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:47.530297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:47.530489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:47.530938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:47.531529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:48.103581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lazy-loading 'flavor' on Instance uuid e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:48.128420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Going to try to live migrate instance to n-h1-863052-1 {{(pid=120641) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:05:48.224093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:51.393915 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f72ea8f5-e35a-46e9-9f5d-6e2c485ea111 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3/action" status: 202 len: 0 microversion: 2.1 time: 3.890206 Oct 31 14:05:51.397997 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 291/712] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:05:47 2022] POST /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3/action => generated 0 bytes in 3894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:05:51.410808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4f3ab61e-ff5c-4234-ae60-baa8fe47b420 req-996a1836-9b5a-430c-ab2b-451a60696403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b9c3a6-7448-4c96-af32-93c724e53d67", "name": "network-vif-unplugged", "status": "completed", "tag": "c312fc2c-6a72-4889-aa42-da10a17782ca"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:51.434822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4f3ab61e-ff5c-4234-ae60-baa8fe47b420 req-996a1836-9b5a-430c-ab2b-451a60696403 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.435610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4f3ab61e-ff5c-4234-ae60-baa8fe47b420 req-996a1836-9b5a-430c-ab2b-451a60696403 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.436240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4f3ab61e-ff5c-4234-ae60-baa8fe47b420 req-996a1836-9b5a-430c-ab2b-451a60696403 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:51.451646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4f3ab61e-ff5c-4234-ae60-baa8fe47b420 req-996a1836-9b5a-430c-ab2b-451a60696403 service nova] Creating event network-vif-unplugged:c312fc2c-6a72-4889-aa42-da10a17782ca for instance 51b9c3a6-7448-4c96-af32-93c724e53d67 on n-h2-863052-1 Oct 31 14:05:51.458284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4f3ab61e-ff5c-4234-ae60-baa8fe47b420 req-996a1836-9b5a-430c-ab2b-451a60696403 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058275 Oct 31 14:05:51.459520 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 292/713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:51.466708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:51.467819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:51.476741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.477415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.478091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:51.478986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.479657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.480237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:51.710513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:51.727022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3208b0e-d650-44ba-9075-3c425461e542 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.485009 Oct 31 14:05:51.728090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 422/714] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:05:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:51.732916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:51.733822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:51.760238 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da24fd46-04da-4bd3-a510-f266c6a2a7bb tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.299091 Oct 31 14:05:51.768309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.768818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.769798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:51.770649 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 293/715] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:51 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:51.772281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.773998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.775557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:51.781642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:51.782222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:51.800073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.800613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.801054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:51.804394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:51.805949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:51.806426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:52.063431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:52.078063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed454024-3e14-4604-958f-d0d856e34bd6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.305308 Oct 31 14:05:52.081215 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 294/716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:51 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:52.091250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6f6d1e5-5fd1-48b6-a6e5-4d9da341215e tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Action: 'create', calling method: .version_select at 0x7fe107ce3ca0>, body: {"pool": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:52.115178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:52.129548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:52.131873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:52.133707 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7657043a-129e-4f91-b342-e225d1775d97 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1567 microversion: 2.25 time: 0.403945 Oct 31 14:05:52.134694 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 423/717] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:51 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:52.791320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:52.793137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:52.795971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:52.811689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:52.817290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:52.821225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:52.834781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:52.836610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:52.837241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:52.998434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:53.039670 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9ea3bd1-024a-411f-9663-961210063131 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.252025 Oct 31 14:05:53.042731 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 424/718] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:52 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:53.109019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:53.110047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:53.118227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:53.124321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:53.124875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:53.126391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:53.127978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:53.128700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:53.349540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:53.358939 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b360ded-3f9c-4eee-a815-418a265ff39e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.253763 Oct 31 14:05:53.359894 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 425/719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:53 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:05:53.365960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:53.367114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:53.379142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:53.379848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:53.380475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:53.381536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:53.382202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:53.386123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:53.597996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:53.608704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:53.612345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:53.615073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3ef32a0-0c27-4afa-91bf-b37c1e10d83f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1567 microversion: 2.25 time: 0.254106 Oct 31 14:05:53.616336 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 426/720] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:53 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:53.621926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-431acce1-e5b1-4e86-b46b-0a04f2a2e104 req-f71a421c-22d9-4049-824f-e8bc359be939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b9c3a6-7448-4c96-af32-93c724e53d67", "tag": "c312fc2c-6a72-4889-aa42-da10a17782ca"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:53.637320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-431acce1-e5b1-4e86-b46b-0a04f2a2e104 req-f71a421c-22d9-4049-824f-e8bc359be939 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:53.638580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-431acce1-e5b1-4e86-b46b-0a04f2a2e104 req-f71a421c-22d9-4049-824f-e8bc359be939 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:53.639240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-431acce1-e5b1-4e86-b46b-0a04f2a2e104 req-f71a421c-22d9-4049-824f-e8bc359be939 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:53.659877 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-431acce1-e5b1-4e86-b46b-0a04f2a2e104 req-f71a421c-22d9-4049-824f-e8bc359be939 service nova] Creating event network-changed:c312fc2c-6a72-4889-aa42-da10a17782ca for instance 51b9c3a6-7448-4c96-af32-93c724e53d67 on n-h2-863052-1 Oct 31 14:05:53.670074 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-431acce1-e5b1-4e86-b46b-0a04f2a2e104 req-f71a421c-22d9-4049-824f-e8bc359be939 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052258 Oct 31 14:05:53.673130 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 427/721] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:54.075627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:54.076329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:54.085679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:54.086258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:54.086629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:54.087327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:54.087775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:54.090585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:54.346433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:54.402520 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91c7cd3b-4294-4ba5-a70b-e25cc95df98c tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.331122 Oct 31 14:05:54.403875 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 428/722] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:54 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:54.409563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:54.410787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:54.419809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:54.420820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:54.421429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:54.422383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:54.423700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:54.424494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:54.946446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:54.958764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66efec7d-39df-4b06-af6a-303f3679b223 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.553413 Oct 31 14:05:54.979906 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 429/723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:54 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:54.987774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:54.988413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:55.012150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:55.012653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:55.013085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:55.013797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:55.014274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:55.014704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:55.234198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:55.244398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:55.246429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:55.248466 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3d5ce5d-0cb4-43e2-8d62-5ea9fb34b336 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1567 microversion: 2.25 time: 0.266887 Oct 31 14:05:55.249627 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 430/724] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:54 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:55.434302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:55.436153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:55.449418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:55.450380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:55.451335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:55.457700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:55.459462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:55.460354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:55.619755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:55.663408 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c24c6c0-b1a9-4fa6-8841-2c4ac54960d2 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.234623 Oct 31 14:05:55.666271 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 431/725] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:55 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:55.725154 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6f6d1e5-5fd1-48b6-a6e5-4d9da341215e tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.641899 Oct 31 14:05:55.725753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 295/726] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:05:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:55.738806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc092b24-be79-4dd9-98f1-7ebb8adeb70c tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107a7c790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:55.879061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:55.981531 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc092b24-be79-4dd9-98f1-7ebb8adeb70c tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/cac4eef4-f43f-4732-9975-e93ce29594c8" status: 200 len: 142 microversion: 2.1 time: 0.247195 Oct 31 14:05:55.989556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:55.990341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 432/727] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:05:55 2022] GET /compute/v2.1/os-floating-ips/cac4eef4-f43f-4732-9975-e93ce29594c8 => generated 142 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:55.991383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:56.002882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e67b953b-f0ce-451d-b300-523c08767698 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107a74550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:56.010555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:56.017074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:56.018279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:56.020178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:56.023804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:56.025290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:56.027323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:56.348447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:56.359926 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c516026-65cb-4e6f-a4e3-25de733eb12c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.376133 Oct 31 14:05:56.365087 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 296/728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:55 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:56.375179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:56.376131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:56.389809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:56.390742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:56.391414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:56.392461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:56.393444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:56.394225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:56.892976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:56.906691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:56.911120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:56.913324 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a391fee-fba3-48bd-9b06-4899cdb06c86 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1542 microversion: 2.25 time: 0.546180 Oct 31 14:05:56.915626 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 297/729] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:56 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1542 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:56.925323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:56.934928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:56.947965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:56.948520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:56.948969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:56.949683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:56.950146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:56.952935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:57.059353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:05:57.111669 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e67b953b-f0ce-451d-b300-523c08767698 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/cac4eef4-f43f-4732-9975-e93ce29594c8" status: 202 len: 0 microversion: 2.1 time: 1.115370 Oct 31 14:05:57.113646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 433/730] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:05:55 2022] DELETE /compute/v2.1/os-floating-ips/cac4eef4-f43f-4732-9975-e93ce29594c8 => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:05:57.117281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:57.121130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc08f506-b2c7-4923-859b-1ceaf12d6e2f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '.version_select at 0x7fe107c02430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:57.127940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc08f506-b2c7-4923-859b-1ceaf12d6e2f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:57.128732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc08f506-b2c7-4923-859b-1ceaf12d6e2f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:57.129893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc08f506-b2c7-4923-859b-1ceaf12d6e2f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:57.141660 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc08f506-b2c7-4923-859b-1ceaf12d6e2f tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1763 microversion: 2.25 time: 0.026120 Oct 31 14:05:57.143078 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 434/731] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 31 14:05:57 2022] GET /compute/v2.1/os-migrations => generated 1763 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:57.153988 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b5479f7-9d57-442e-abe6-502e1f891378 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.232419 Oct 31 14:05:57.153988 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 298/732] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:56 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:57.159399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28b6ab0e-d7d5-4852-9623-02b513d10413 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107e1a700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:57.166787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:57.167705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:57.176045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:57.176615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:57.177117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:57.177874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:57.178547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:57.179005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:57.349356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:57.365212 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b1665c1-f895-45f4-bcf6-9b2a2103785e tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 2035 microversion: 2.25 time: 0.207318 Oct 31 14:05:57.381806 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 435/733] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:57 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 2035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:05:57.397732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:57.398716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:57.406775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:57.407556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:57.408442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:57.409345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:57.409845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:57.410317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:57.472159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28b6ab0e-d7d5-4852-9623-02b513d10413 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.316321 Oct 31 14:05:57.473414 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 299/734] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 31 14:05:57 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:05:57.479219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4baf6870-a9c3-4e0e-b1d3-608bab072c30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Action: 'create', calling method: .version_select at 0x7fe107ce3040>, body: {"keypair": {"name": "tempest-keypair-84781145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEotUKum1HxMUtprwnpKW5bqqL5YCInScE4NTXm6eBRHpHUlnzTDfZDq/jZGxMBjItBIl7vlyxW4WQdxEp16MKLxt3QTW2gJ/MrCtbSFD2HdEmKdY6dtSRWYrUbiHQGsQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:57.496615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4baf6870-a9c3-4e0e-b1d3-608bab072c30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for project c75cb8d7db204534bc02ad16c859c108. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:57.502552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4baf6870-a9c3-4e0e-b1d3-608bab072c30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for user 57251d140f49460087e4cf90f6b94a78 and project c75cb8d7db204534bc02ad16c859c108. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:57.537553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4baf6870-a9c3-4e0e-b1d3-608bab072c30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.062326 Oct 31 14:05:57.538834 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 300/735] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:05:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:05:57.544326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0f674fa-4b98-47a1-afcf-b585b96477d3 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107c908b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:57.633559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:57.655266 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8acd463e-3516-4541-8061-3346c5fa4a43 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.271998 Oct 31 14:05:57.656102 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 436/736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:57 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:58.028571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0f674fa-4b98-47a1-afcf-b585b96477d3 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.487952 Oct 31 14:05:58.031200 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 301/737] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:05:57 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:05:58.046425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00617214-e096-4126-b36a-7c012da6318d tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107a01e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:58.184132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:58.185422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:58.197772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:58.198863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:58.200357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:58.201932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:58.204638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:58.205526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:58.335090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:05:58.365483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4da4950e-3e8b-4e0f-bc33-d5257562dbe7 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.186282 Oct 31 14:05:58.367601 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 302/738] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:05:58 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:05:58.680537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:58.681280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:05:58.692765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:58.694035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:58.695571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:58.697588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:58.698970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:58.700556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:59.015590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:05:59.035079 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92b0b507-5d7d-48df-baf3-142dc49c11ee tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.357245 Oct 31 14:05:59.037259 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 303/739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:05:58 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:05:59.111599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00617214-e096-4126-b36a-7c012da6318d tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/f8c9b5ac-e894-4439-bdc7-e1887b58dade" status: 202 len: 0 microversion: 2.1 time: 1.069488 Oct 31 14:05:59.114008 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 437/740] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:05:58 2022] DELETE /compute/v2.1/os-floating-ips/f8c9b5ac-e894-4439-bdc7-e1887b58dade => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:05:59.123376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0011cf4d-248a-4720-9b5f-1e2dbeba0727 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107a6dc10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:05:59.212239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-130585119", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:05:59.279417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:05:59.900225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:05:59.900725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:05:59.901310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:05:59.901866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:05:59.902660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:05:59.914116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:59.915111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:59.915465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:59.916651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:05:59.916788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:05:59.934315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:05:59.969586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Getting quotas for project 6fdfa201d3a647e591f61b6c21b473e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:05:59.975923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Getting quotas for user bee3e8acd5f64c249809bc60403e0299 and project 6fdfa201d3a647e591f61b6c21b473e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:05:59.991057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:05:59.994495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:00.004248 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0011cf4d-248a-4720-9b5f-1e2dbeba0727 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/271e3fac-6d61-4a51-a7c8-f29624450992" status: 202 len: 0 microversion: 2.1 time: 0.885214 Oct 31 14:06:00.005005 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 438/741] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:05:59 2022] DELETE /compute/v2.1/os-floating-ips/271e3fac-6d61-4a51-a7c8-f29624450992 => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:06:00.012812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:00.014227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:00.023940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:00.025948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:00.026734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:00.027738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:00.028463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:00.029234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:00.070786 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40b7d1ac-0f52-449d-88ce-95682989edd9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029851 Oct 31 14:06:00.072177 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 304/742] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:00.080017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a26dc874-b211-4c58-be4c-33b7660dc95c req-2631d454-6152-4fd7-8480-e741c251152e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3", "name": "network-vif-unplugged", "status": "completed", "tag": "c778a55d-5f99-4c18-922a-7bde2ec40796"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:00.110913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a26dc874-b211-4c58-be4c-33b7660dc95c req-2631d454-6152-4fd7-8480-e741c251152e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:00.115212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a26dc874-b211-4c58-be4c-33b7660dc95c req-2631d454-6152-4fd7-8480-e741c251152e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:00.117390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a26dc874-b211-4c58-be4c-33b7660dc95c req-2631d454-6152-4fd7-8480-e741c251152e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:00.135653 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a26dc874-b211-4c58-be4c-33b7660dc95c req-2631d454-6152-4fd7-8480-e741c251152e service nova] Creating event network-vif-unplugged:c778a55d-5f99-4c18-922a-7bde2ec40796 for instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 on n-h2-863052-1 Oct 31 14:06:00.135858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:00.145410 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a26dc874-b211-4c58-be4c-33b7660dc95c req-2631d454-6152-4fd7-8480-e741c251152e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069198 Oct 31 14:06:00.146489 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 305/743] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:00.153984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b91c76e-cf69-4f6a-a258-73789075d415 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] Calling method '.version_select at 0x7fe107ccf550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:00.164284 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5686a683-7143-446a-adc7-c6eb5e2dde91 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.157690 Oct 31 14:06:00.171560 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 439/744] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:00 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:00.179016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:00.179944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:00.195265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:00.195765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:00.196383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:00.197200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:00.197665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:00.198092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:00.441955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:00.453574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eab78f3c-4323-4126-b67b-e76d450fc638 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.280217 Oct 31 14:06:00.454533 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 440/745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:00 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:00.460193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3cf71b5-495f-425b-8ac9-6d2c4526b235 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:00.460815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3cf71b5-495f-425b-8ac9-6d2c4526b235 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:00.530480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3cf71b5-495f-425b-8ac9-6d2c4526b235 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:00.538369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3cf71b5-495f-425b-8ac9-6d2c4526b235 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1219 microversion: 2.1 time: 0.082321 Oct 31 14:06:00.539210 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 441/746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:00 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:01.193130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:01.194815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:01.202414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:01.203220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:01.203956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:01.204713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:01.205457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:01.206377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:01.342368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:01.368798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:01.435089 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a250abc-7367-41cf-9e62-e50bd9ab3a62 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.245752 Oct 31 14:06:01.435691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 442/747] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:01 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:01.482806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:01.483529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:01.494082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:01.498518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:01.499326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:01.500080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:01.503110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:01.503769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:01.677353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:01.706919 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e13e1ee-6bbc-4119-886a-1f7aa197a7e0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.214343 Oct 31 14:06:01.718198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 443/748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:01 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:01.718198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:01.718198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:01.719281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:01.719964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:01.720568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:01.721425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:01.722080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:01.722703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:01.808033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:01.822887 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c14be1e-65aa-4fe9-8a1b-0401331963a3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1279 microversion: 2.1 time: 0.113665 Oct 31 14:06:01.835676 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 444/749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:01 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:01.974985 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b91c76e-cf69-4f6a-a258-73789075d415 tempest-FloatingIPDetailsTestJSON-2083901409 tempest-FloatingIPDetailsTestJSON-2083901409-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/85c58e10-e718-4a15-a535-d57bf5e23e43" status: 202 len: 0 microversion: 2.1 time: 1.826165 Oct 31 14:06:01.976487 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 306/750] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:06:00 2022] DELETE /compute/v2.1/os-floating-ips/85c58e10-e718-4a15-a535-d57bf5e23e43 => generated 0 bytes in 1829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:06:01.993256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1282432441", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d2840ce8-8e29-4e7a-8617-461972287234"}], "security_groups": [{"name": "tempest-securitygroup--1854683315"}], "key_name": "tempest-keypair-84781145", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:02.199725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d9cd7058-1fe2-4e3a-a466-c4b92b2050fa req-1fc81a74-6132-4062-a483-6609cd6ee047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3", "tag": "c778a55d-5f99-4c18-922a-7bde2ec40796"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:02.212720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d9cd7058-1fe2-4e3a-a466-c4b92b2050fa req-1fc81a74-6132-4062-a483-6609cd6ee047 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:02.213578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d9cd7058-1fe2-4e3a-a466-c4b92b2050fa req-1fc81a74-6132-4062-a483-6609cd6ee047 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:02.214472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d9cd7058-1fe2-4e3a-a466-c4b92b2050fa req-1fc81a74-6132-4062-a483-6609cd6ee047 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:02.226448 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d9cd7058-1fe2-4e3a-a466-c4b92b2050fa req-1fc81a74-6132-4062-a483-6609cd6ee047 service nova] Creating event network-changed:c778a55d-5f99-4c18-922a-7bde2ec40796 for instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 on n-h2-863052-1 Oct 31 14:06:02.232132 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d9cd7058-1fe2-4e3a-a466-c4b92b2050fa req-1fc81a74-6132-4062-a483-6609cd6ee047 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036107 Oct 31 14:06:02.233416 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 307/751] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:02.366825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] validate_networks() for [('d2840ce8-8e29-4e7a-8617-461972287234', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:02.470471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:02.471692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:02.492651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:02.494262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:02.495127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:02.496016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:02.497493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:02.499929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:02.691020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:02.732458 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70c3c7e0-c144-496f-aa96-2cb52b2e65f8 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.270597 Oct 31 14:06:02.733062 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 308/752] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:02 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:02.746544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:02.746544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:02.755895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:02.756396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:02.761077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:02.761893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:02.762417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:02.762862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:03.156794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:03.168702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf77953f-0c7e-4fbb-bd89-c8d64ec8e524 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.434568 Oct 31 14:06:03.170366 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 309/753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:02 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:03.176254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:03.176918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:03.180227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:03.180728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:03.181283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:03.181763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:03.182272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:03.192188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:03.196598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:03.196774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:03.197086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:03.197288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:03.197518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:03.198278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:03.199048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:03.199765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:03.200266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:03.202479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:03.202962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:03.231149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:03.243168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for user 57251d140f49460087e4cf90f6b94a78 and project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:03.264527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:03.267420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:03.326707 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-823a0c02-e60d-4d2c-9101-b7439330740f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.339383 Oct 31 14:06:03.328146 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 445/754] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:06:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:06:03.342139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec8e82bf-1eb0-4e34-9ea1-eb51bfa7c2bd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:03.343099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec8e82bf-1eb0-4e34-9ea1-eb51bfa7c2bd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:03.359793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:03.384673 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-462e30fe-48d7-4df5-ab96-1b11167da508 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1277 microversion: 2.1 time: 0.213258 Oct 31 14:06:03.385505 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 310/755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:03 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:03.466626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec8e82bf-1eb0-4e34-9ea1-eb51bfa7c2bd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:03.479132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec8e82bf-1eb0-4e34-9ea1-eb51bfa7c2bd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:03.481394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec8e82bf-1eb0-4e34-9ea1-eb51bfa7c2bd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:03.482916 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec8e82bf-1eb0-4e34-9ea1-eb51bfa7c2bd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1284 microversion: 2.25 time: 0.146944 Oct 31 14:06:03.503490 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 446/756] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:03 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:03.763756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:03.764375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:03.775095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:03.781248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:03.783836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:03.785213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:03.785691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:03.786126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.015321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:04.038070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c8b6e3-215f-442b-9b13-3343c05c2807"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:04.040265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:04.059513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.061176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.061628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.064144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.071325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.071887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.076886 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e91477be-a60e-4a90-ac01-387fdbffa7ac tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.317353 Oct 31 14:06:04.077805 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 311/757] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:03 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:04.195512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:04.196965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:04.207254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.209410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.210059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.212442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.213756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.214621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.418648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] HTTP exception thrown: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Request method failure captured: Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments/3d0b704a-c76b-4378-ae58-33c1d2bd72fe HTTP/1.1 Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 74 Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XzYOMazK1GitTzp5A4nHGG1r2iMXIFLP_sXAsS6z4ZX5ANbNdq2YpBzLAaa3gT-c5kEq2d-ojLRHlRe1s8X3MAEddmkTK9BEWxRl2PaqfCufMVKhBj-_JOnMB9s5yFGMazqyWzHiYIiAMBOrv-ELadH-eCDP77VsXAbwmDzNLIa9w Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d2f4edf503b845c78d63c5c1c41558cb Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesAdminNegativeTest-833757371 Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:06:04.422515 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2f4edf503b845c78d63c5c1c41558cb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2f4edf503b845c78d63c5c1c41558cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2f4edf503b845c78d63c5c1c41558cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2f4edf503b845c78d63c5c1c41558cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesAdminNegativeTest-833757371 Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d2f4edf503b845c78d63c5c1c41558cb Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-833757371 Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesAdminNegativeTest-833757371-project-admin Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 5b04bf8196d6446681ceb12f84c6cc26 Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesAdminNegativeTest-833757371-project-admin Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: {"volumeAttachment": {"volumeId": "d7c8b6e3-215f-442b-9b13-3343c05c2807"}} Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:04.424107 n-d-863052-1 devstack@n-api.service[120640]: exception: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': '7a58b508-0106-4617-80ee-1ea6ea5d07a9', 'id': '3d0b704a-c76b-4378-ae58-33c1d2bd72fe', 'body': {'volumeAttachment': {'volumeId': 'd7c8b6e3-215f-442b-9b13-3343c05c2807'}}} Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:06:04.425639 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. (HTTP 404) (Request-ID: req-2dd79f45-cc61-4634-844f-a56062f0a7f1) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:06:04.426831 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:04.428176 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. Oct 31 14:06:04.429638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:04.432445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Returning 400 to user: Volume d7c8b6e3-215f-442b-9b13-3343c05c2807 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:04.432445 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ab3b296-342d-4605-9ca0-47dd93927f90 tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments/3d0b704a-c76b-4378-ae58-33c1d2bd72fe" status: 400 len: 107 microversion: 2.1 time: 0.586180 Oct 31 14:06:04.432445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 447/758] 10.222.0.27 () {60 vars in 1433 bytes} [Mon Oct 31 14:06:03 2022] PUT /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments/3d0b704a-c76b-4378-ae58-33c1d2bd72fe => generated 107 bytes in 591 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:06:04.437846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:04.441487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:04.459381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.459880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.460319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.461023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.461478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.461905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.594101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:04.621212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-464b4b32-dc1e-44d8-b4d4-561c66567920 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.416605 Oct 31 14:06:04.640066 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 312/759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:04 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:04.652653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:04.653719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:04.671993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.672963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.674723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.678657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.680275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.681826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.909774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:04.926535 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-360e6549-61f5-4c45-9682-f67ab967c3e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1319 microversion: 2.1 time: 0.496834 Oct 31 14:06:04.927112 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 448/760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:04 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:04.947712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:04.947712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:04.960928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.961614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.963718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:04.964645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:04.966260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:04.967222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.130091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lazy-loading 'services' on Instance uuid 7a58b508-0106-4617-80ee-1ea6ea5d07a9 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:05.282026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f7830f3-f2f3-4270-a808-efe6bfe09d48 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments/3d0b704a-c76b-4378-ae58-33c1d2bd72fe" status: 202 len: 0 microversion: 2.1 time: 0.353591 Oct 31 14:06:05.282898 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 449/761] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:06:04 2022] DELETE /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments/3d0b704a-c76b-4378-ae58-33c1d2bd72fe => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:06:05.293236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:05.305225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:05.311268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:05.312137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:05.330210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:05.332208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:05.333362 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43630d9b-21c5-44b8-8b65-cfb1b7519e7e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1336 microversion: 2.25 time: 0.691770 Oct 31 14:06:05.333905 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 313/762] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:04 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1336 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:05.338902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.341132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.342222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.344098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.348442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.349132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.354683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-64162e5a-857f-4884-918a-84b505d0c63b req-2be578e6-5b58-438a-a197-e0197c0f242e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b8938b-1c9c-4dcd-9f84-fa01b6737671", "tag": "9c315c3f-9ba7-43f6-9160-0ea8a48122d2"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:05.390107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64162e5a-857f-4884-918a-84b505d0c63b req-2be578e6-5b58-438a-a197-e0197c0f242e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.391268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64162e5a-857f-4884-918a-84b505d0c63b req-2be578e6-5b58-438a-a197-e0197c0f242e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.392570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64162e5a-857f-4884-918a-84b505d0c63b req-2be578e6-5b58-438a-a197-e0197c0f242e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.429706 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-64162e5a-857f-4884-918a-84b505d0c63b req-2be578e6-5b58-438a-a197-e0197c0f242e service nova] Creating event network-changed:9c315c3f-9ba7-43f6-9160-0ea8a48122d2 for instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 on n-h2-863052-1 Oct 31 14:06:05.448644 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-64162e5a-857f-4884-918a-84b505d0c63b req-2be578e6-5b58-438a-a197-e0197c0f242e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098515 Oct 31 14:06:05.452555 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 314/763] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:05.461504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:05.468618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:05.487637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.488285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.488817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.489620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.490204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.490717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.562626 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c836ad41-9729-43a1-924c-e5718b96da7d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108633 Oct 31 14:06:05.563902 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 315/764] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:05 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:05.624463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:05.652406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:05.653110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:05.657836 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34635328-4a66-4db1-a05c-a7bddffe3be3 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.368979 Oct 31 14:06:05.661103 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 450/765] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:05 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:05.671491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.672018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.673088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.673832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.674326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.674796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.948951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:05.950367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:05.960181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.961025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.961933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:05.962904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:05.963585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:05.964430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.199053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:06.208591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5deacb7-0614-4248-8699-ee36a1bdb1c9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1319 microversion: 2.1 time: 0.262742 Oct 31 14:06:06.224942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 451/766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:05 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:06.364425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:06.365500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:06.368018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:06.376717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:06.377503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:06.378250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.379191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:06.379867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:06.380516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.385647 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da715281-b68f-4cb2-b304-4bead969a233 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.736980 Oct 31 14:06:06.386974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 316/767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:05 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:06.464960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:06.480071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:06.482053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:06.483790 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62b6b675-64b5-462b-b92b-8e87769e04c6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1342 microversion: 2.25 time: 0.123916 Oct 31 14:06:06.485104 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 452/768] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:06 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1342 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:06.575445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:06.577829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:06.594254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:06.595010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:06.595682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.597380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:06.598037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:06.598679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.662373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9a901a6-8633-48e9-b3b5-af482da1456d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091174 Oct 31 14:06:06.667495 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 317/769] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:06 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:06.705803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:06.707550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:06.718249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:06.718687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:06.719131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.719851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:06.721072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:06.721507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:06.879918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:06.905934 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17e2604a-5a48-4bed-861d-a8811cf00673 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.205835 Oct 31 14:06:06.907207 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 453/770] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:06 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:07.232116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:07.233151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:07.241322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.241825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.242286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.243022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.250405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.250847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.413537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:07.415625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:07.426795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.427426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.428116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.429062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.429751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.430481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.679842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:07.702037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c28abd95-5353-42e6-9c63-67382e9e7272 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1319 microversion: 2.1 time: 0.470011 Oct 31 14:06:07.703343 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 318/771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:07 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:07.717210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:07.717851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:07.718571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:07.732575 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41969f0e-5fd1-4689-a3c0-ef396c0d8b0f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.323289 Oct 31 14:06:07.733422 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 454/772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:07 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:07.739672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.741199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.742671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.743602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:07.744984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.745694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.745845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:07.746459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.762855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.763639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.764662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.767819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.768773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.769369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.834467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e3fa2d4-3bf7-4b7d-b871-bcb9b6ac1cbf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099539 Oct 31 14:06:07.835749 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 455/773] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:07 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:07.935254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:07.936452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:07.949730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.950596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.951111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:07.951896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:07.952423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:07.952919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:08.089184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:08.111502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-649b12ab-79f2-457b-84cd-3962dbd03524 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1929 microversion: 2.75 time: 0.180938 Oct 31 14:06:08.112973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 456/774] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:07 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:08.728586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:08.729290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:08.749468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:08.749967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:08.750432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:08.759186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:08.764601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:08.772180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:08.856535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:08.873293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:08.880817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:08.882868 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49ef2f8c-2728-4db0-9e3e-8d6ec5e8672d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 1.177082 Oct 31 14:06:08.886519 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 319/775] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:07 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:08.914781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:08.915644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:08.931041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:08.931850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:08.932393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:08.933952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:08.934678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:08.935312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:09.119534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:09.140439 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-539ef056-7fcb-4bad-b819-c1daeb928cac tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1319 microversion: 2.1 time: 0.415645 Oct 31 14:06:09.143922 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 457/776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:08 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:09.168061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:09.174893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:09.192708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:09.197176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:09.205935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:09.205935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:09.205935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:09.205935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:09.296408 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad35486b-cb4d-447c-b62b-89cbcd2fe52e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151245 Oct 31 14:06:09.302904 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 458/777] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:09 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:09.318922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:09.319661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:09.342759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:09.343260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:09.343690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:09.346125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:09.346814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:09.347395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:09.489701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:09.499493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:09.561023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:09.578898 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ab25207-63b0-492b-9443-ea5fbde86227 tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1935 microversion: 2.75 time: 0.272529 Oct 31 14:06:09.590958 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b595f307-1440-4958-953c-ab46a70cc5ce tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.703248 Oct 31 14:06:09.610404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 459/778] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:09 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1935 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:09.610953 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 320/779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:08 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:09.919023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:09.919671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:09.922576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:09.942010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:09.943613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:09.945935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:09.946893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:09.950097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:09.951777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.165086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:10.166897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:10.170737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:10.176105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:10.184636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.187719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.194841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.196130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.196823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.197496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.257605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:10.269099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:10.274782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:10.276173 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-beac724f-fd12-4354-b88f-c78f645f7d2c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.361362 Oct 31 14:06:10.280444 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 460/780] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:09 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:10.323777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:10.326811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:10.334664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.335364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.336917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.338747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.340009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.340770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.378963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d62b6e8-9dde-4ea6-b79b-1d38fd00fbb4 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060222 Oct 31 14:06:10.380299 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 461/781] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:10 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:10.618870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:10.618870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:10.632771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.634213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.636198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.636964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.637469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.638812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.753214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:10.766244 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77abea71-3966-46ca-9396-08e37ed9cab8 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1319 microversion: 2.1 time: 0.605510 Oct 31 14:06:10.766987 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 321/782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:10 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:10.776973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:10.780242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:10.794578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.796851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.797427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.802743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:10.803474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:10.804040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:10.854424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:10.903785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3667b1f-b143-49c4-b0be-d53b934dce1e tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1935 microversion: 2.75 time: 0.289834 Oct 31 14:06:10.906225 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 462/783] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:10 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1935 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:10.996081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6e502311-7bb0-49ba-9434-f9cbf84f4dc2 req-f2401724-231b-41e7-b567-45f177dd3a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b8938b-1c9c-4dcd-9f84-fa01b6737671", "name": "network-vif-plugged", "status": "completed", "tag": "9c315c3f-9ba7-43f6-9160-0ea8a48122d2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:11.016943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6e502311-7bb0-49ba-9434-f9cbf84f4dc2 req-f2401724-231b-41e7-b567-45f177dd3a89 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.017517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6e502311-7bb0-49ba-9434-f9cbf84f4dc2 req-f2401724-231b-41e7-b567-45f177dd3a89 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.018200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6e502311-7bb0-49ba-9434-f9cbf84f4dc2 req-f2401724-231b-41e7-b567-45f177dd3a89 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.065850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6e502311-7bb0-49ba-9434-f9cbf84f4dc2 req-f2401724-231b-41e7-b567-45f177dd3a89 service nova] Creating event network-vif-plugged:9c315c3f-9ba7-43f6-9160-0ea8a48122d2 for instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 on n-h2-863052-1 Oct 31 14:06:11.073961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6e502311-7bb0-49ba-9434-f9cbf84f4dc2 req-f2401724-231b-41e7-b567-45f177dd3a89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082143 Oct 31 14:06:11.079598 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 463/784] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:11.312347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:11.313288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:11.324462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.330150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.331410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.332315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.332924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.333513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.403053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:11.419388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a31d337e-9ad5-4f76-a19c-3334705bb31e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1503 microversion: 2.1 time: 0.651107 Oct 31 14:06:11.434280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 322/785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:10 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1503 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:11.434280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:11.457925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:11.476422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.477063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.477611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.478471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.479060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.479594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.544205 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-946ad020-d6af-44c0-8a5b-d8f67beae9fa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120819 Oct 31 14:06:11.546977 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 323/786] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:11 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:11.597152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:11.610728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:11.613932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:11.615921 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f1bc1ba-3bdd-4872-9dde-31b1110e7623 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.308627 Oct 31 14:06:11.621603 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 464/787] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:11 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:11.790013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:11.790944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:11.807009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.807820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.808846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.812959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.813983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.815053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.940120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:11.946744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:11.956845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.957736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.958778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:11.959968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:11.961127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:11.961878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.091363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] Lazy-loading 'services' on Instance uuid 22563921-992a-4b96-a9f5-af2aab5b17e2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:12.110477 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b51ba84-bdea-42dc-9f95-996e2bfb3eda tempest-ServersAdmin275Test-1500388874 tempest-ServersAdmin275Test-1500388874-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1920 microversion: 2.75 time: 0.176405 Oct 31 14:06:12.111780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 465/788] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:11 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1920 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:12.117113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c6e7289c-8706-43af-b8ee-7ea55b8b8250 req-0d4abf0c-deac-4d71-95eb-9e1c8f8d12bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d6c9d2-b928-495e-a5cf-188bd6f5c7c8", "tag": "3c9ce681-9ef5-4ef2-865a-938931cd612a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:12.140789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c6e7289c-8706-43af-b8ee-7ea55b8b8250 req-0d4abf0c-deac-4d71-95eb-9e1c8f8d12bf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.141277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c6e7289c-8706-43af-b8ee-7ea55b8b8250 req-0d4abf0c-deac-4d71-95eb-9e1c8f8d12bf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.141701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c6e7289c-8706-43af-b8ee-7ea55b8b8250 req-0d4abf0c-deac-4d71-95eb-9e1c8f8d12bf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.153394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:12.162369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d3ca6e0-1be4-4222-9a5b-d80649797931 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1319 microversion: 2.1 time: 0.376135 Oct 31 14:06:12.167320 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 324/789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:11 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:12.179054 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c6e7289c-8706-43af-b8ee-7ea55b8b8250 req-0d4abf0c-deac-4d71-95eb-9e1c8f8d12bf service nova] Creating event network-changed:3c9ce681-9ef5-4ef2-865a-938931cd612a for instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 on n-h1-863052-1 Oct 31 14:06:12.182040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:12.184585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:12.185745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c6e7289c-8706-43af-b8ee-7ea55b8b8250 req-0d4abf0c-deac-4d71-95eb-9e1c8f8d12bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071984 Oct 31 14:06:12.186861 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 466/790] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:12.193275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.193837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.194413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.195226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.195749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.196242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.224776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:12.331229 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e07121e-e851-4c8c-8203-8fc0d35be445 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 204 len: 0 microversion: 2.75 time: 0.160977 Oct 31 14:06:12.333082 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 325/791] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:06:12 2022] DELETE /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:06:12.341796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:12.342633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:12.351909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.352554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.353382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.354210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.354782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.355607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.455936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:12.459321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:12.461333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:12.477932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.478448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.478905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.480771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:12.482250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:12.483895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.485082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.486749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.498628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10aa5359-9b52-4de6-8c4a-418da2cb709f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1444 microversion: 2.75 time: 0.161613 Oct 31 14:06:12.499655 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 467/792] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:12 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:12.558079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:12.560578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:12.571444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.576518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.577014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.577836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.578323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.578758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.629846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2bb1b8b9-087b-4432-b547-9aba83f50649 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075872 Oct 31 14:06:12.631425 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 468/793] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:12 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:12.647844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:12.649393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:12.656182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.657001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.657811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.659557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:12.660575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:12.661190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:12.992610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.017740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.023597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.028057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11dac4ea-6581-4958-92c4-07aab119cc7d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.385116 Oct 31 14:06:13.030892 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 469/794] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:12 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:13.197150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.198537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:13.206662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.207440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.208030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.209095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.209706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.210471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.229430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:13.277240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.285917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15f930a0-3028-4cb4-a562-2c26691d0660 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1493 microversion: 2.1 time: 0.841092 Oct 31 14:06:13.290894 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 326/795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:12 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1493 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:13.313512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8d8dd71-1c9d-48f2-8d52-2673fce4b924 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '.version_select at 0x7fe10c0c6d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.319643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8d8dd71-1c9d-48f2-8d52-2673fce4b924 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.320176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8d8dd71-1c9d-48f2-8d52-2673fce4b924 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.320620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8d8dd71-1c9d-48f2-8d52-2673fce4b924 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.363008 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8d8dd71-1c9d-48f2-8d52-2673fce4b924 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.052347 Oct 31 14:06:13.364360 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 327/796] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:06:13 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:13.378842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.379654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:13.386440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.387258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.387860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.388786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.389399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.389974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.480441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.483060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:13.493896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3066ab52-4600-44d7-868a-2476246319e0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1469 microversion: 2.1 time: 0.300528 Oct 31 14:06:13.495000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 470/797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:13 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:13.743519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.744412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:13.751440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.752055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.752837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.753771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.754361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.754886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.789510 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c4ce16e-8d2c-4a02-9e5e-519d305a9041 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1644 microversion: 2.1 time: 0.414990 Oct 31 14:06:13.798342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:13.802545 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 328/798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:13 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1644 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:13.812867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.813484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:13.828396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.829119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.829719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.830608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.831253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.831832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.910498 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66aadb4f-0fdc-4954-a15e-1741c5b62ce9 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 204 len: 0 microversion: 2.1 time: 0.394363 Oct 31 14:06:13.911534 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 471/799] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:13 2022] DELETE /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:06:13.917399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.919951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:13.927397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.928112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.928780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.929386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.930275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.930880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.931501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.938818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.940752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:13.946913 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-340b99a8-e48f-403d-bf6a-ad196392831e tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1444 microversion: 2.75 time: 0.143235 Oct 31 14:06:13.948751 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 329/800] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:13 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:13.953678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:13.956600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:13.964039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:13.965719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.966434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.967040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.968855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:13.969611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:13.970231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:13.976748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:13.980118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3937cb56-29a0-4046-af11-88d7524c0019 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066621 Oct 31 14:06:13.981138 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 472/801] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:06:13 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:06:13.989951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1466366481", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "da8a9929-0ff3-4206-a14a-e0d235fbfab9"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:14.101017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] validate_networks() for [('da8a9929-0ff3-4206-a14a-e0d235fbfab9', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:14.175126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:14.188881 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f148887a-32d7-49d5-bd46-63e09192db32 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1475 microversion: 2.1 time: 0.238893 Oct 31 14:06:14.189800 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 330/802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:13 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1475 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:14.206670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:14.207291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:14.213810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:14.214588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:14.215213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:14.216093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:14.216706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:14.217291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:14.566876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:14.580401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:14.582843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:14.584216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7a0c6ec-9d52-4146-a35e-3cbab5a4b7f5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.393330 Oct 31 14:06:14.599411 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 331/803] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:14 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:14.608235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-216898111", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "3292b331-9f74-4da0-a73e-1098bacf9c71"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:14.675797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] validate_networks() for [('3292b331-9f74-4da0-a73e-1098bacf9c71', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:14.710448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:14.711020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:14.711331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:14.711714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:14.712306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:14.722583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:14.723328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:14.723911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:14.724796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:14.725422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:14.725837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:14.749682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:14.757380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for user 3589cce53cf8492a9a2e05c73f373319 and project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:14.780523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:14.783772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:14.864676 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1f1d354-1841-4956-a2ab-dac47696834d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881051 Oct 31 14:06:14.865398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 473/804] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:14.877205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd1443f5-db9d-4be8-b779-4bad22896c7c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:14.879259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd1443f5-db9d-4be8-b779-4bad22896c7c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:14.937190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd1443f5-db9d-4be8-b779-4bad22896c7c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:14.945203 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd1443f5-db9d-4be8-b779-4bad22896c7c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1211 microversion: 2.1 time: 0.072523 Oct 31 14:06:14.947089 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 474/805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:14 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:14.982383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:14.982999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:14.992701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:14.993213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:14.995941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:14.996688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:14.997158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:14.997908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:15.116812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.126541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.128604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.155402 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-540b0299-0665-4934-babd-6fecf35a8752 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1444 microversion: 2.75 time: 0.177475 Oct 31 14:06:15.156460 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 475/806] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:14 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:15.213907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:15.214816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:15.227306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:15.227811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:15.228625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:15.229657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:15.230291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:15.231293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:15.404690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.412273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:15.416139 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0fe0a6e-cb89-49cd-beb3-714fcb61d674 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1475 microversion: 2.1 time: 0.205585 Oct 31 14:06:15.417269 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 476/807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:15 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1475 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:15.613157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:15.613791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:15.620214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:15.620901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:15.621510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:15.622398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:15.623257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:15.623834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:15.833931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.853526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.861723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:15.863346 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5de48ae3-49c5-49a5-8ecf-1507fce05f10 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.254392 Oct 31 14:06:15.865039 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 477/808] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:15 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:15.970799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:15.971505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:15.982925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:15.986057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:15.988141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:15.988900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:15.994239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:15.994688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.145519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:16.157562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fb22fb0-480d-4673-9a8e-9f1fb7834f02 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1215 microversion: 2.1 time: 0.191725 Oct 31 14:06:16.158888 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 478/809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:15 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:16.204686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:16.205830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:16.218077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:16.219053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:16.220199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.221827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:16.222735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:16.224864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.530062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:16.531551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:16.532287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:16.532941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:16.534664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:16.564535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:16.566641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:16.567692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.568848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:16.570036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:16.571200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.602511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Getting quotas for project 3b521bd0aac94c2ea9702ae724953dbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:16.611125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Getting quotas for user 525cf99f53e043d39794f8ecf0f739f0 and project 3b521bd0aac94c2ea9702ae724953dbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:16.638562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:16.641644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:16.727220 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c15b459-0492-425a-a727-e993f6c48b20 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126101 Oct 31 14:06:16.729756 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 332/810] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:16.738462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:16.740148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:16.748500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:16.749524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:16.750254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.751210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:16.751884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:16.754118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:16.821611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:16.836438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:16.839518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938121437d8149a094bdac7bd24be209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2622acfc96a9410cb2d2f211b3a539f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:16.853176 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36276d2c-aa0e-4f06-bf07-81d5c5bd068f tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 200 len: 1444 microversion: 2.75 time: 0.664624 Oct 31 14:06:16.854637 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 479/811] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:16 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 1444 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:16.862026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-021fd0ff-09f3-4b3d-8993-a80b83306853 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:16.873997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-021fd0ff-09f3-4b3d-8993-a80b83306853 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:17.272524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-021fd0ff-09f3-4b3d-8993-a80b83306853 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:17.280139 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-021fd0ff-09f3-4b3d-8993-a80b83306853 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1217 microversion: 2.1 time: 0.423635 Oct 31 14:06:17.281115 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 480/812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:16 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1217 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:17.287974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:17.289348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:17.310504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:17.323574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:17.324316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:17.325924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:17.327121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:17.328899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:17.849018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:17.863344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:17.865317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:17.867068 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18d3c691-9af4-4c43-a281-50d6c7a3f713 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.584639 Oct 31 14:06:17.869407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 481/813] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:17 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:17.887026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:17.888175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:17.904052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:17.904549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:17.912389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:17.913483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:17.914119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:17.914727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.022328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:18.033263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9707b87-d706-4ec1-8672-68b580ea8cb2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1269 microversion: 2.1 time: 0.158996 Oct 31 14:06:18.035304 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 482/814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:17 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:18.046658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-45a7640d-ec72-460b-94ca-91ea76940466 req-eb6103b6-81f8-420c-a455-981cef95ea8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b8938b-1c9c-4dcd-9f84-fa01b6737671", "name": "network-vif-deleted", "tag": "9c315c3f-9ba7-43f6-9160-0ea8a48122d2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:18.067827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-45a7640d-ec72-460b-94ca-91ea76940466 req-eb6103b6-81f8-420c-a455-981cef95ea8a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.068315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-45a7640d-ec72-460b-94ca-91ea76940466 req-eb6103b6-81f8-420c-a455-981cef95ea8a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.068746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-45a7640d-ec72-460b-94ca-91ea76940466 req-eb6103b6-81f8-420c-a455-981cef95ea8a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.094642 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-45a7640d-ec72-460b-94ca-91ea76940466 req-eb6103b6-81f8-420c-a455-981cef95ea8a service nova] Creating event network-vif-deleted:9c315c3f-9ba7-43f6-9160-0ea8a48122d2 for instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 on n-h2-863052-1 Oct 31 14:06:18.118660 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-45a7640d-ec72-460b-94ca-91ea76940466 req-eb6103b6-81f8-420c-a455-981cef95ea8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081888 Oct 31 14:06:18.119236 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 483/815] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:18.134241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:18.134955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] [instance: 22563921-992a-4b96-a9f5-af2aab5b17e2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:18.152408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.153047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.153489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.154635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.155557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.155990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.167642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:18.173704 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] HTTP exception thrown: Instance 22563921-992a-4b96-a9f5-af2aab5b17e2 could not be found. Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Request method failure captured: Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 HTTP/1.1 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9YKW3WeOVLwB_g4vgwVgykyBQhnX4pzjePaAQn3Ti3FkJll_vneo4UpvIhP4U1zHCzN-V5wGMmAuYB0V39BzlCuKoLVFY0f_mKpRyyl0Met7hcYB5EBK5VaM6xwgQyHhs3c0X37FJ77Vde3Zepy8uOY-TAnAJ2DP5KKC3FXB10X5is Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.75 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 2622acfc96a9410cb2d2f211b3a539f1 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdmin275Test-1862342782 Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:06:18.175965 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2622acfc96a9410cb2d2f211b3a539f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2622acfc96a9410cb2d2f211b3a539f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2622acfc96a9410cb2d2f211b3a539f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2622acfc96a9410cb2d2f211b3a539f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdmin275Test-1862342782 Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 2622acfc96a9410cb2d2f211b3a539f1 Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdmin275Test-1862342782 Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdmin275Test-1862342782-project Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 938121437d8149a094bdac7bd24be209 Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdmin275Test-1862342782-project Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 22563921-992a-4b96-a9f5-af2aab5b17e2 could not be found. Oct 31 14:06:18.177382 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '22563921-992a-4b96-a9f5-af2aab5b17e2'} Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22563921-992a-4b96-a9f5-af2aab5b17e2 could not be found. Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:18.178147 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22563921-992a-4b96-a9f5-af2aab5b17e2 could not be found. Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22563921-992a-4b96-a9f5-af2aab5b17e2 could not be found. Oct 31 14:06:18.183826 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:18.185670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] Returning 404 to user: Instance 22563921-992a-4b96-a9f5-af2aab5b17e2 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:18.185670 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4673b8bb-b3ab-459b-9416-3a3a335e8d77 tempest-ServersAdmin275Test-1862342782 tempest-ServersAdmin275Test-1862342782-project] 10.222.0.27 "GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2" status: 404 len: 111 microversion: 2.75 time: 0.048910 Oct 31 14:06:18.185670 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 484/816] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:18 2022] GET /compute/v2.1/servers/22563921-992a-4b96-a9f5-af2aab5b17e2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:06:18.189366 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93316f70-f166-4ffb-a47b-56626661605d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 200 len: 1475 microversion: 2.1 time: 1.457986 Oct 31 14:06:18.204130 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 333/817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:16 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 1475 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:18.315435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:18.316398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:18.329003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.329518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.333997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.334761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.335239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.335662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.424779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:18.433476 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2226a0a1-33fc-4f19-b5c3-6a0274532a5d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1269 microversion: 2.1 time: 0.132760 Oct 31 14:06:18.434828 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 485/818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:18 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:18.758116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:18.764270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:18.765271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Searching by: {'deleted': False, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:06:18.773751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.774280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.774715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.775497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.775950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.776642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.875644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:06:18.899586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:18.900930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:18.914852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.917452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.919055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:18.921802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:18.922489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:18.923162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:19.013116 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e703fe6-98f6-44aa-941f-c9def820bc6f tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.260843 Oct 31 14:06:19.014686 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 334/819] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:06:18 2022] GET /compute/v2.1/servers => generated 334 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:19.033441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:19.045563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:19.046356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Searching by: {'deleted': False, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:06:19.058859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:19.059669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:19.060638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:19.061675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:19.062416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:19.063092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:19.178134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:06:19.284938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:19.292738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:19.293470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:19.294107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:19.479648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:19.491476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:19.495858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:19.500254 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20680614-9d6d-4718-9193-5b7fe60b8eec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 0.606918 Oct 31 14:06:19.500831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 486/820] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:18 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:19.512837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:19.513880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:19.532262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:19.538866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:19.540902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:19.542149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:19.545121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:19.545932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:19.770016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:19.783274 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5ff0d4f-3d39-48da-a56a-0738d7fe7801 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.281053 Oct 31 14:06:19.784639 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 487/821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:19 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:19.791978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-125432060", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f02c04de-801c-4398-a296-ce4b97ec80d4"}], "security_groups": [{"name": "tempest-securitygroup--425154563"}], "key_name": "tempest-keypair-1271316180", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9fbe9071-0647-4056-acff-651bc622c580", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:20.025893 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-519265cc-9fec-4a3c-84be-e6abd8d52274 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 1.001098 Oct 31 14:06:20.027000 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 335/822] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:06:19 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:20.032577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:20.033830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:20.044791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.045646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.046399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:20.047122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.048083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.048463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:20.097931 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] HTTP exception thrown: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Request method failure captured: Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 HTTP/1.1 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZFQlxiFv9c_qK6dAhx96rvH8XXhQ1l5LhurjIrNAz3NccjVshyL6q7f8CndoCpQTcVJI7G3gQ_Dm_QMGmnC-uMkD_iJgv9vRYGNJy0U56VOp2o779s3IMZBz6fOuma_LyHp-I110s4sfYR7xDkZI_6GuSYCY8z6ZPeBd-yy9XZqG8 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:20.105008 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fdfa201d3a647e591f61b6c21b473e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bee3e8acd5f64c249809bc60403e0299 Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:20.106389 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e6b8938b-1c9c-4dcd-9f84-fa01b6737671'} Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:20.107144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:20.108343 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:20.111269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Returning 404 to user: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:20.111269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a2151c8-21df-4336-ba1c-ccf35020fcb3 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 404 len: 111 microversion: 2.1 time: 0.082012 Oct 31 14:06:20.111269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 336/823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:20 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:20.123542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:20.123769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:20.141599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.142834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.143385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:20.146113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.147325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.147772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:20.162250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] validate_networks() for [('f02c04de-801c-4398-a296-ce4b97ec80d4', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:20.322805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:20.331740 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81345794-c808-4e2c-ab58-81012760ae9b tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1275 microversion: 2.1 time: 0.218907 Oct 31 14:06:20.347468 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 337/824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:20 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:20.354680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-edd345b8-95fc-4e1e-b3d7-41092e9ec707 req-e5bc2279-5f6c-45e3-a290-fc60cca389b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6c9d2-b928-495e-a5cf-188bd6f5c7c8", "name": "network-vif-plugged", "status": "completed", "tag": "3c9ce681-9ef5-4ef2-865a-938931cd612a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:20.365066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-edd345b8-95fc-4e1e-b3d7-41092e9ec707 req-e5bc2279-5f6c-45e3-a290-fc60cca389b7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.365921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-edd345b8-95fc-4e1e-b3d7-41092e9ec707 req-e5bc2279-5f6c-45e3-a290-fc60cca389b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.366040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-edd345b8-95fc-4e1e-b3d7-41092e9ec707 req-e5bc2279-5f6c-45e3-a290-fc60cca389b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:20.378465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-edd345b8-95fc-4e1e-b3d7-41092e9ec707 req-e5bc2279-5f6c-45e3-a290-fc60cca389b7 service nova] Creating event network-vif-plugged:3c9ce681-9ef5-4ef2-865a-938931cd612a for instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 on n-h1-863052-1 Oct 31 14:06:20.384062 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-edd345b8-95fc-4e1e-b3d7-41092e9ec707 req-e5bc2279-5f6c-45e3-a290-fc60cca389b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034951 Oct 31 14:06:20.385279 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 338/825] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:20.392480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04038e77-54b7-4b80-9bed-0bdf4410ae5d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:20.403204 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04038e77-54b7-4b80-9bed-0bdf4410ae5d tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016453 Oct 31 14:06:20.411021 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 339/826] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:06:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:20.415716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-275732206", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:20.502567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:20.945665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:20.946250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:20.946833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:20.947356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:20.947868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:20.969327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.969852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.970528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:20.972203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:20.972827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:20.973771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:21.002887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Getting quotas for project 6fdfa201d3a647e591f61b6c21b473e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:21.010760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Getting quotas for user bee3e8acd5f64c249809bc60403e0299 and project 6fdfa201d3a647e591f61b6c21b473e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:21.033076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:21.036918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:21.090596 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c3fa383f-60bd-47ee-b0cb-7eaaf59f04de tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684914 Oct 31 14:06:21.091817 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 340/827] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:21.097483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:21.098371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:21.106575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:21.107323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:21.107999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:21.108869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:21.109526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:21.110149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:21.279376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Getting quotas for project eeccdf8ef7e74647969d606c07c4e0ad. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:21.300800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Getting quotas for user dee28deb1e94414782841e09e0db6789 and project eeccdf8ef7e74647969d606c07c4e0ad. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:21.356118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:21.380757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:21.381184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:21.385395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:21.394502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:21.396759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:21.426665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:21.427169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:21.427605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:21.428342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:21.432954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:21.433921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:21.487622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Getting quotas for project eeccdf8ef7e74647969d606c07c4e0ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:21.493606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Getting quotas for user dee28deb1e94414782841e09e0db6789 and project eeccdf8ef7e74647969d606c07c4e0ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:21.649442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:21.651567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9fbe9071-0647-4056-acff-651bc622c580',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:21.962726 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b67dec6a-58a5-454e-859c-3b11c0bbfea8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.176211 Oct 31 14:06:21.963729 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 488/828] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:21.968405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:21.974120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:21.995122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:21.995626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:21.996064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:21.996777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.010803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.011531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.051664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:22.214081 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbcb8375-971f-4626-ab87-a82afff41846 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 204 len: 0 microversion: 2.1 time: 0.249075 Oct 31 14:06:22.214990 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 489/829] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:21 2022] DELETE /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:06:22.234598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:22.237293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:22.247721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.250050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.256235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.263627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.267022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.267923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.381205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:22.399284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:22.403650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:22.404872 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de28738a-2fd9-4625-9991-aed565bf1bde tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1410 microversion: 2.25 time: 1.311912 Oct 31 14:06:22.429911 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 341/830] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:21 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1410 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:06:22.448577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:22.451898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:22.466480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.468636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.475438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.479409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.481240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.481879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.720480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:22.734406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4dafa5ed-af36-4631-9321-c8e4f03d77cf tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1271 microversion: 2.1 time: 0.301932 Oct 31 14:06:22.736843 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 342/831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:22 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:22.751008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:22.751873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:22.761341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.763999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.765546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.767042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:22.767686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:22.769067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:22.872282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:22.881877 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8adea47-26b5-4fb1-88e5-114a07d72bdf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.665551 Oct 31 14:06:22.882890 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 490/832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:22 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:22.889145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75283e1f-0e96-465c-bedc-63db20e2a7ff tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:22.889949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75283e1f-0e96-465c-bedc-63db20e2a7ff tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:22.971039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75283e1f-0e96-465c-bedc-63db20e2a7ff tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:22.980889 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75283e1f-0e96-465c-bedc-63db20e2a7ff tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1121 microversion: 2.1 time: 0.096721 Oct 31 14:06:22.984471 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 491/833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:22 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1121 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:22.992189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4777042c-57a5-4e14-9779-d0adf7d1119f req-1996b2dc-5849-4546-b17d-d1e5551c2e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3818776-b4a5-40bb-88b9-3fba55492c54", "tag": "bf1ad07f-9865-4001-a3f7-890490f3c082"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:23.010234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4777042c-57a5-4e14-9779-d0adf7d1119f req-1996b2dc-5849-4546-b17d-d1e5551c2e4c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.010779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4777042c-57a5-4e14-9779-d0adf7d1119f req-1996b2dc-5849-4546-b17d-d1e5551c2e4c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.011223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4777042c-57a5-4e14-9779-d0adf7d1119f req-1996b2dc-5849-4546-b17d-d1e5551c2e4c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.039548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4777042c-57a5-4e14-9779-d0adf7d1119f req-1996b2dc-5849-4546-b17d-d1e5551c2e4c service nova] Creating event network-changed:bf1ad07f-9865-4001-a3f7-890490f3c082 for instance c3818776-b4a5-40bb-88b9-3fba55492c54 on n-h2-863052-1 Oct 31 14:06:23.045950 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4777042c-57a5-4e14-9779-d0adf7d1119f req-1996b2dc-5849-4546-b17d-d1e5551c2e4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059903 Oct 31 14:06:23.049702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 492/834] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:23.057954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:23.084520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:23.106476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.107169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.107614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.108322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.108787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.109217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.318423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:23.329715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-032265b8-2317-4a30-98a8-ef78431c8f1c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1317 microversion: 2.1 time: 0.590720 Oct 31 14:06:23.330579 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 343/835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:22 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:23.335657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d03a48f6-1320-436f-8dbe-02eb6395a7d3 req-ad570a33-b2a9-4f19-bc2c-52a60f589aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffe82d2-dea9-4ed6-92b6-05bff851e8dc", "tag": "ee385a28-bfce-436b-97c5-f6a8b1851e5d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:23.347261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d03a48f6-1320-436f-8dbe-02eb6395a7d3 req-ad570a33-b2a9-4f19-bc2c-52a60f589aba service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.348331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d03a48f6-1320-436f-8dbe-02eb6395a7d3 req-ad570a33-b2a9-4f19-bc2c-52a60f589aba service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.349052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d03a48f6-1320-436f-8dbe-02eb6395a7d3 req-ad570a33-b2a9-4f19-bc2c-52a60f589aba service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.369468 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d03a48f6-1320-436f-8dbe-02eb6395a7d3 req-ad570a33-b2a9-4f19-bc2c-52a60f589aba service nova] Creating event network-changed:ee385a28-bfce-436b-97c5-f6a8b1851e5d for instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc on n-h2-863052-1 Oct 31 14:06:23.378652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d03a48f6-1320-436f-8dbe-02eb6395a7d3 req-ad570a33-b2a9-4f19-bc2c-52a60f589aba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045739 Oct 31 14:06:23.380351 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 344/836] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:23.440655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:23.442500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:23.451700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.452600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.453970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.456211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.458958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.459694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.816637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:23.826821 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b10b133-a9a0-4c00-b88c-08cd310492dd tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1702 microversion: 2.1 time: 0.774093 Oct 31 14:06:23.827959 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 493/837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:23 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1702 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:23.837448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:23.838484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:23.846751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.847594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.848259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.849312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.850142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.851165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.937401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:23.946361 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fea593c-028e-47a3-afe0-34a61e775ee9 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1277 microversion: 2.1 time: 0.117051 Oct 31 14:06:23.947825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 494/838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:23 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:23.953404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:23.954624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:23.958642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:23.964209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.964943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.965534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.966643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:23.967588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:23.968166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:23.979637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:23.982105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:23.983503 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cde75f93-b110-4953-83c5-4d5c320e69d6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1605 microversion: 2.25 time: 0.553394 Oct 31 14:06:23.999839 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 345/839] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:06:23 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1605 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:06:24.010559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:24.011319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:24.023649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:24.024413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:24.026712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:24.027468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:24.027901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:24.028329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:24.150211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:24.159062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-457e6d2c-8a39-49e7-8669-1c230a8d24ef tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.209031 Oct 31 14:06:24.159663 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 495/840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:23 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:24.164297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:24.164959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:24.171555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:24.172102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:24.172723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:24.173600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:24.174148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:24.174829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:24.191040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:24.204213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84663696-4b55-4dfa-bbae-83dec06394b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.198025 Oct 31 14:06:24.205197 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 346/841] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:06:24 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:06:24.277610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:24.287116 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ffd580e9-6413-4c2d-8253-cfe2251bc4f9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1219 microversion: 2.1 time: 0.126169 Oct 31 14:06:24.302831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 496/842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:24 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:24.353437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:24.354055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:24.362182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:24.362616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:24.363057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:24.364141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:24.374046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-533025064", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:24.378873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:24.382391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:24.454904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:25.147609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:25.148505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:25.149516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:25.150273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:25.151155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:25.166328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.167645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.168889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.170466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.171328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.172101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.196407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Getting quotas for project 502f9205e2f54e15bbe5a8aa67b8e053. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:25.203101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Getting quotas for user a3f8e1f808a64540884dd7be6a92c46d and project 502f9205e2f54e15bbe5a8aa67b8e053. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:25.225841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:25.229029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:25.259735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:25.269012 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74302e9b-b855-4fec-a37b-6b0dc71bceb5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1317 microversion: 2.1 time: 0.919859 Oct 31 14:06:25.269609 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 497/843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:24 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:25.279302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:25.291153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:25.297787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.306027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.306558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.307612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.307997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.308423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.326704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20f542a8-8d86-4af1-a6dc-7a572df15fac tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118979 Oct 31 14:06:25.327549 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 347/844] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:25.332334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:25.332942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:25.341806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.342359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.342801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.343614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.344097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.344514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.598144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:25.614427 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e33cd3d9-75ae-4673-8ada-0fea7b6e8abc tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1277 microversion: 2.1 time: 0.285602 Oct 31 14:06:25.615916 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 348/845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:25 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:25.621522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:25.622147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:25.635550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.636053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.636495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:25.637202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:25.637715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:25.638148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.120486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:26.136274 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-faef60c6-e179-4067-81f0-38f8210dc975 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1702 microversion: 2.1 time: 0.858911 Oct 31 14:06:26.138967 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 498/846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:25 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1702 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:26.150759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:26.151381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:26.171009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.171522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.171976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.172666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.175996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.177997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.368154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:26.380061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c61b2eab-ded1-49e9-ac2c-0365723d8762 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.762588 Oct 31 14:06:26.382747 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 349/847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:25 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:26.408103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:26.410337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:26.433788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.434645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.435330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.448372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.450518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.452043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.531089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:26.539921 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-251eb9b6-31d9-44e0-81a4-c16b6f5ded42 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1237 microversion: 2.1 time: 0.399720 Oct 31 14:06:26.549648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 499/848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:26 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1237 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:26.556028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:26.556778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:26.568454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.568952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.569392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.570097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.574098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.574579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.729160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:26.739063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3651e02-6f8d-4fe5-8151-0d7530ee54ae tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1273 microversion: 2.1 time: 0.353905 Oct 31 14:06:26.739639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 350/849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:26 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:26.750101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:26.758775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:26.780927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.784757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.793860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.797129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:26.797823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:26.798555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:26.803892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:27.027963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:27.043069 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2718cf2b-7de9-4086-b0d8-bc44823fd26d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1277 microversion: 2.1 time: 0.296773 Oct 31 14:06:27.044259 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 351/850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:26 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1277 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:27.137166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-298314467", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "c215db42-8564-459b-9f3c-e55acebc1201"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:27.249394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] validate_networks() for [('c215db42-8564-459b-9f3c-e55acebc1201', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:27.297707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:27.325375 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe3cfeec-e8fc-4600-a15a-6a594486ab6c tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1317 microversion: 2.1 time: 0.777036 Oct 31 14:06:27.326900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 500/851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:26 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:27.347548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:27.366655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:27.382905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:27.389194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:27.390562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:27.396511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:27.396971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:27.397495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:28.091630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dea5fa185845edb7d86aa1d5c1b4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2854257058845b7aef6e09aeb02c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:28.108358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93abec61-ee0b-4068-91d5-2d2a4977069e tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 200 len: 1634 microversion: 2.1 time: 0.778593 Oct 31 14:06:28.120077 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 501/852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:27 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 1634 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:28.134003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-56ef5ce5-afaa-4f26-aa7b-a9660f3d0494 req-a9b6b7c2-501e-438f-b21a-76ed34a9bbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd485178-61c6-4529-973d-660c36a7b16c", "name": "network-vif-deleted", "tag": "d707fdf2-6468-4ce7-abf5-14d588531142"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:28.160717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-56ef5ce5-afaa-4f26-aa7b-a9660f3d0494 req-a9b6b7c2-501e-438f-b21a-76ed34a9bbb7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:28.161472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-56ef5ce5-afaa-4f26-aa7b-a9660f3d0494 req-a9b6b7c2-501e-438f-b21a-76ed34a9bbb7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:28.162682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-56ef5ce5-afaa-4f26-aa7b-a9660f3d0494 req-a9b6b7c2-501e-438f-b21a-76ed34a9bbb7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:28.192892 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-56ef5ce5-afaa-4f26-aa7b-a9660f3d0494 req-a9b6b7c2-501e-438f-b21a-76ed34a9bbb7 service nova] Creating event network-vif-deleted:d707fdf2-6468-4ce7-abf5-14d588531142 for instance cd485178-61c6-4529-973d-660c36a7b16c on n-h1-863052-1 Oct 31 14:06:28.201713 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-56ef5ce5-afaa-4f26-aa7b-a9660f3d0494 req-a9b6b7c2-501e-438f-b21a-76ed34a9bbb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080106 Oct 31 14:06:28.209673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 502/853] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:28.215748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:28.216737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:28.234023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:28.234729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:28.235352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:28.236229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:28.240110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:28.240770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.018893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:29.019450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:29.020023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:29.020537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:29.021292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:29.040192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.042513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.043158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.047480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.048243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.049406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.103199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for project 1430823979f84df092a344321a69fce5. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:29.106597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:29.117512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for user 447b90ed71f148b79158ff5db202f274 and project 1430823979f84df092a344321a69fce5. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:29.117909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3fda44f-706d-4f27-90cf-b808b1ef52c3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.906477 Oct 31 14:06:29.133742 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 503/854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:28 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:29.133742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:29.133742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:29.146024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.146559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.146995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.147701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.148164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.148571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.174789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:29.177010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:29.206558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:29.298109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:29.299293 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2130007-8e2f-4809-9abb-4f9bf9975f62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.253655 Oct 31 14:06:29.309277 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 352/855] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:29.326802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-699a4bee-4182-4946-9807-875306905eae tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1237 microversion: 2.1 time: 0.202690 Oct 31 14:06:29.327896 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 504/856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:29 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:29.338151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:29.339791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:29.340589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:29.343679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:29.356731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.363838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.364269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.364817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.365276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.365543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.365977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.366880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.367894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.368541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.375815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.388906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.706031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:29.719286 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-489a3a05-72cb-4283-bd0c-8d0930f91ce0 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.387427 Oct 31 14:06:29.720446 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 505/857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:29 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:29.734107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:29.735028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:29.744219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.748145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.751495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.753694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.754522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.755122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.888461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:29.905321 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b27ec5f-196f-470a-be9c-b5990c5e8e6c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1279 microversion: 2.1 time: 0.592170 Oct 31 14:06:29.906506 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 353/858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:29 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1279 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:29.918071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:29.927259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] [instance: cd485178-61c6-4529-973d-660c36a7b16c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:29.953801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.956510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.960322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:29.962561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:29.963889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:29.968107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:30.035739 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] HTTP exception thrown: Instance cd485178-61c6-4529-973d-660c36a7b16c could not be found. Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Request method failure captured: Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c HTTP/1.1 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9YayazDDgGdF62E2gDdWJ1xOSWjnlicBVOYa5xJ4S--3TbgSbiyM0NjLpN-YTw9VEfR6euV2AOYyfpEgZ8m36vgrCHoBR3W0FIoT6LMeZ-pObflBTpb-H-tjklhFhb5ugzIEbEgPitweYrZCwZjK98D_bYh0ZRUAeWCBICrtX3zpB8 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b2854257058845b7aef6e09aeb02c0e0 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-850858992 Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:30.039373 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b2854257058845b7aef6e09aeb02c0e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b2854257058845b7aef6e09aeb02c0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b2854257058845b7aef6e09aeb02c0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b2854257058845b7aef6e09aeb02c0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-850858992 Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b2854257058845b7aef6e09aeb02c0e0 Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-850858992 Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-850858992-project Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b9dea5fa185845edb7d86aa1d5c1b4b1 Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-850858992-project Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance cd485178-61c6-4529-973d-660c36a7b16c could not be found. Oct 31 14:06:30.040647 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'cd485178-61c6-4529-973d-660c36a7b16c'} Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd485178-61c6-4529-973d-660c36a7b16c could not be found. Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:30.041394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd485178-61c6-4529-973d-660c36a7b16c could not be found. Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd485178-61c6-4529-973d-660c36a7b16c could not be found. Oct 31 14:06:30.044940 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:30.045955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Returning 404 to user: Instance cd485178-61c6-4529-973d-660c36a7b16c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:30.045955 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aab45125-0f81-4929-91c3-1f843f60b122 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c" status: 404 len: 111 microversion: 2.1 time: 0.133105 Oct 31 14:06:30.048786 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 354/859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:29 2022] GET /compute/v2.1/servers/cd485178-61c6-4529-973d-660c36a7b16c => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:30.066066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-402403fe-e9e3-447b-af0a-93b2ec0ee410 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:30.066768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-402403fe-e9e3-447b-af0a-93b2ec0ee410 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:30.157930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:30.178618 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb6bc42f-5d3d-4ca1-9f0a-14f703cf8675 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1317 microversion: 2.1 time: 0.454079 Oct 31 14:06:30.182270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 506/860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:29 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:30.202296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6845f35a-3cd2-47d3-a293-9a60b8cc16f1 req-f14405a9-5540-4a14-bae1-d68a32d5e3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d6c9d2-b928-495e-a5cf-188bd6f5c7c8", "tag": "3c9ce681-9ef5-4ef2-865a-938931cd612a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:30.273578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6845f35a-3cd2-47d3-a293-9a60b8cc16f1 req-f14405a9-5540-4a14-bae1-d68a32d5e3f6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:30.278796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6845f35a-3cd2-47d3-a293-9a60b8cc16f1 req-f14405a9-5540-4a14-bae1-d68a32d5e3f6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:30.280627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6845f35a-3cd2-47d3-a293-9a60b8cc16f1 req-f14405a9-5540-4a14-bae1-d68a32d5e3f6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:30.321609 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6845f35a-3cd2-47d3-a293-9a60b8cc16f1 req-f14405a9-5540-4a14-bae1-d68a32d5e3f6 service nova] Creating event network-changed:3c9ce681-9ef5-4ef2-865a-938931cd612a for instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 on n-h1-863052-1 Oct 31 14:06:30.337815 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6845f35a-3cd2-47d3-a293-9a60b8cc16f1 req-f14405a9-5540-4a14-bae1-d68a32d5e3f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149305 Oct 31 14:06:30.339119 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 507/861] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:30.362222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e40fae2-7f7e-40c2-8fcc-5ce4e9f18504 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] Calling method '.version_select at 0x7fe1078e9940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:30.413783 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e40fae2-7f7e-40c2-8fcc-5ce4e9f18504 tempest-ServersTestJSON-850858992 tempest-ServersTestJSON-850858992-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080049311" status: 202 len: 0 microversion: 2.1 time: 0.072067 Oct 31 14:06:30.414849 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 508/862] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080049311 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:06:30.433559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:30.434371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:30.453436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:30.458446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:30.458907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:30.459688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:30.460313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:30.460727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:30.493463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-402403fe-e9e3-447b-af0a-93b2ec0ee410 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:30.506404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-402403fe-e9e3-447b-af0a-93b2ec0ee410 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1224 microversion: 2.1 time: 0.450304 Oct 31 14:06:30.506993 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 355/863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:30 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1224 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:30.535226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:30.535847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:30.569291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:30.591035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:30.591742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:30.592663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:30.598855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:30.599312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:31.461793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:31.649515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:31.666120 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64ca4220-3c6e-4de0-bd41-7cca8fd5f0bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1304 microversion: 2.1 time: 1.134791 Oct 31 14:06:31.690843 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 356/864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:30 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1304 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:31.704836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:31.708090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:31.725817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:31.728963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:31.729597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:31.730544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:31.731191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:31.733213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:32.456816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:32.465204 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1df7d3d9-d717-4849-8062-835153e28693 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 2.048734 Oct 31 14:06:32.487571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 509/865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:30 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:32.492636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-43baff90-7462-4a3d-8a5f-c0045108e857 req-98e9238d-10d9-4feb-ba4d-7f4cc3abef20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3818776-b4a5-40bb-88b9-3fba55492c54", "name": "network-vif-plugged", "status": "completed", "tag": "bf1ad07f-9865-4001-a3f7-890490f3c082"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:32.503851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-43baff90-7462-4a3d-8a5f-c0045108e857 req-98e9238d-10d9-4feb-ba4d-7f4cc3abef20 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:32.504788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-43baff90-7462-4a3d-8a5f-c0045108e857 req-98e9238d-10d9-4feb-ba4d-7f4cc3abef20 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:32.505411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-43baff90-7462-4a3d-8a5f-c0045108e857 req-98e9238d-10d9-4feb-ba4d-7f4cc3abef20 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:32.519016 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-43baff90-7462-4a3d-8a5f-c0045108e857 req-98e9238d-10d9-4feb-ba4d-7f4cc3abef20 service nova] Creating event network-vif-plugged:bf1ad07f-9865-4001-a3f7-890490f3c082 for instance c3818776-b4a5-40bb-88b9-3fba55492c54 on n-h2-863052-1 Oct 31 14:06:32.524468 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-43baff90-7462-4a3d-8a5f-c0045108e857 req-98e9238d-10d9-4feb-ba4d-7f4cc3abef20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035700 Oct 31 14:06:32.525404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 510/866] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:32.531620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:32.536278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:32.537250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:32.544323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:32.544824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:32.545255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:32.545954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:32.546452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:32.546878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:32.571368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e7a19bd-daba-401a-92fb-ec25b706ab95 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.879029 Oct 31 14:06:32.571999 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 357/867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:31 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:32.580650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:32.592376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:32.618512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:32.620685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:32.626208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:32.627444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:32.633836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:32.634571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:32.975882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=22 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:33.181462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:33.235548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8045047b-1be9-4062-abb6-cf1269c8ac23 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.702401 Oct 31 14:06:33.242485 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 511/868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:32 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:33.260734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:33.262968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:33.279565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.280066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.280497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.281204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.281652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.282130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.390953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:33.410325 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f00c7b16-09b8-4db1-84f2-4eb6d240f214 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1317 microversion: 2.1 time: 0.834003 Oct 31 14:06:33.411639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 358/869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:32 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1317 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:33.427920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:33.428769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:33.445420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.446977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.447649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.448579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.449270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.454249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.471782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:33.486881 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64785db2-9a27-4c5f-9d8d-1c66e462b030 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1282 microversion: 2.1 time: 0.242091 Oct 31 14:06:33.487984 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 512/870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:33 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:33.498630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:33.499462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:33.513046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.514277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.514963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.515829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.516519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.517127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.779356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:33.796426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2fe12a12-c9fc-45f3-b011-f0d774ddd115 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1304 microversion: 2.1 time: 0.383530 Oct 31 14:06:33.797113 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 359/871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:33 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1304 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:33.804661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:33.813176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:33.831546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.833717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.834460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:33.837681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:33.838442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:33.839121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:34.387856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:34.399782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a9c06cff-2aa1-449c-b6df-337a4cecf05f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.598571 Oct 31 14:06:34.406059 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 360/872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:33 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:34.411176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9e5e06fc-a95a-4516-96c0-41eabc9949fb req-407c5607-b33a-48bc-955a-4561892c035c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82ffe5a-ae4b-48b3-948f-40c4864b284e", "tag": "9755a9f5-c659-4ca0-ac61-bf630116df4d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:34.421357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e5e06fc-a95a-4516-96c0-41eabc9949fb req-407c5607-b33a-48bc-955a-4561892c035c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:34.421842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e5e06fc-a95a-4516-96c0-41eabc9949fb req-407c5607-b33a-48bc-955a-4561892c035c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:34.422318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e5e06fc-a95a-4516-96c0-41eabc9949fb req-407c5607-b33a-48bc-955a-4561892c035c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:34.444443 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9e5e06fc-a95a-4516-96c0-41eabc9949fb req-407c5607-b33a-48bc-955a-4561892c035c service nova] Creating event network-changed:9755a9f5-c659-4ca0-ac61-bf630116df4d for instance e82ffe5a-ae4b-48b3-948f-40c4864b284e on n-h2-863052-1 Oct 31 14:06:34.454369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9e5e06fc-a95a-4516-96c0-41eabc9949fb req-407c5607-b33a-48bc-955a-4561892c035c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046192 Oct 31 14:06:34.455576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 361/873] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:34.463830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:34.464805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:34.477356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:34.478527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:34.479936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:34.480695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:34.481218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:34.482345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:34.785033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:34.793508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b2da564-0201-4d11-95bc-75a1a560a5d5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 1.299492 Oct 31 14:06:34.794090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 513/874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:33 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:34.799192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:34.800010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:34.808114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:34.809668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:34.811798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:34.812518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:34.812984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:34.813533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.071571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:35.080212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e23811b-18b1-49ba-99d4-4f5fd19173b9 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.623318 Oct 31 14:06:35.095601 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 362/875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:34 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:35.103465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:35.104339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:35.110740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.111744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.112359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.113214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.113818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.114414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.238318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:35.249003 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4348e670-2600-4015-91cb-9239ab32e8aa tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1508 microversion: 2.1 time: 0.453570 Oct 31 14:06:35.250318 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 514/876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:34 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:35.257262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6696ed6d-d387-4e33-9a94-98f67562f740 req-53a26379-3b56-49c3-811a-145283ea3a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe82d2-dea9-4ed6-92b6-05bff851e8dc", "name": "network-vif-plugged", "status": "completed", "tag": "ee385a28-bfce-436b-97c5-f6a8b1851e5d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:35.268353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6696ed6d-d387-4e33-9a94-98f67562f740 req-53a26379-3b56-49c3-811a-145283ea3a6a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.269157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6696ed6d-d387-4e33-9a94-98f67562f740 req-53a26379-3b56-49c3-811a-145283ea3a6a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.269760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6696ed6d-d387-4e33-9a94-98f67562f740 req-53a26379-3b56-49c3-811a-145283ea3a6a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.305735 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6696ed6d-d387-4e33-9a94-98f67562f740 req-53a26379-3b56-49c3-811a-145283ea3a6a service nova] Creating event network-vif-plugged:ee385a28-bfce-436b-97c5-f6a8b1851e5d for instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc on n-h2-863052-1 Oct 31 14:06:35.316419 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6696ed6d-d387-4e33-9a94-98f67562f740 req-53a26379-3b56-49c3-811a-145283ea3a6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064505 Oct 31 14:06:35.325708 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 515/877] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:35.332863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:35.333641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:35.348071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.348567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.350549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.351254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.352157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.353619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.808217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:35.816042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:35.818491 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c64d35af-7631-40b8-a09a-a56813522eb3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.491108 Oct 31 14:06:35.819122 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 516/878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:35 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:35.835057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:35.835670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:35.847313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.847897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.848335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:35.849056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:35.851905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:35.852338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.062528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:36.071363 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df964bfa-c4be-44d5-9cd1-2ed73ac09eee tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.974445 Oct 31 14:06:36.075280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 363/879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:35 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:36.082151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c0eebe3f-437c-4063-b180-b2b84e097266 req-aece1485-a7b1-4d92-a8ae-136d36b764d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da372ca0-0c70-473c-8c7e-16033f8ad2c3", "tag": "c0490852-4c5f-4c7c-b617-278b798b4ef7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:36.124636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c0eebe3f-437c-4063-b180-b2b84e097266 req-aece1485-a7b1-4d92-a8ae-136d36b764d4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.125123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c0eebe3f-437c-4063-b180-b2b84e097266 req-aece1485-a7b1-4d92-a8ae-136d36b764d4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.125556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c0eebe3f-437c-4063-b180-b2b84e097266 req-aece1485-a7b1-4d92-a8ae-136d36b764d4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.133897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:36.137461 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c0eebe3f-437c-4063-b180-b2b84e097266 req-aece1485-a7b1-4d92-a8ae-136d36b764d4 service nova] Creating event network-changed:c0490852-4c5f-4c7c-b617-278b798b4ef7 for instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 on n-h1-863052-1 Oct 31 14:06:36.149450 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c0eebe3f-437c-4063-b180-b2b84e097266 req-aece1485-a7b1-4d92-a8ae-136d36b764d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072127 Oct 31 14:06:36.151151 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 364/880] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:36.154933 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ac81099-34a2-4285-b0c6-226a0c3e5675 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.322931 Oct 31 14:06:36.155825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 517/881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:35 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:36.160494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:36.161866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:36.169819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:36.170502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.170739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:36.171452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.172072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.173122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.173790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.174442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.178341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.179011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.180301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.181468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.182870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.183548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.339923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:36.347902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b404fd1c-b3fe-4cdc-b507-07a6481adc26 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.190776 Oct 31 14:06:36.348474 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 518/882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:36 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:36.532946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f4b1f259-5028-4640-9273-9e7fdb2d01f5 req-87cf7c5e-9f7a-432c-b78a-b8334f0b6294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45999f51-af1a-4ad7-bda9-28b183262640", "tag": "90a9817d-062b-427f-8499-cdc224521d8f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:36.542826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f4b1f259-5028-4640-9273-9e7fdb2d01f5 req-87cf7c5e-9f7a-432c-b78a-b8334f0b6294 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.543296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f4b1f259-5028-4640-9273-9e7fdb2d01f5 req-87cf7c5e-9f7a-432c-b78a-b8334f0b6294 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.543903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f4b1f259-5028-4640-9273-9e7fdb2d01f5 req-87cf7c5e-9f7a-432c-b78a-b8334f0b6294 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.556760 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f4b1f259-5028-4640-9273-9e7fdb2d01f5 req-87cf7c5e-9f7a-432c-b78a-b8334f0b6294 service nova] Creating event network-changed:90a9817d-062b-427f-8499-cdc224521d8f for instance 45999f51-af1a-4ad7-bda9-28b183262640 on n-h2-863052-1 Oct 31 14:06:36.562838 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f4b1f259-5028-4640-9273-9e7fdb2d01f5 req-87cf7c5e-9f7a-432c-b78a-b8334f0b6294 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033536 Oct 31 14:06:36.564721 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 519/883] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:36.621089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:36.629895 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-575a5f16-ba97-44a8-9f32-359387d0e021 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.476489 Oct 31 14:06:36.630698 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 365/884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:36 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:36.836376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d5bba39c-1761-4e30-aea8-f123b77868a2"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:36.838782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:36.845545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.846032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.846479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.847173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.847618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.848038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.849645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:36.850296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:36.857709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.858434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.859051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.859996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:36.860845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:36.862091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:36.901324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] HTTP exception thrown: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Request method failure captured: Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54/os-volume_attachments/fc1150d6-443c-4287-b005-3433a18db013 HTTP/1.1 Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 74 Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XzYOMazK1GitTzp5A4nHGG1r2iMXIFLP_sXAsS6z4ZX5ANbNdq2YpBzLAaa3gT-c5kEq2d-ojLRHlRe1s8X3MAEddmkTK9BEWxRl2PaqfCufMVKhBj-_JOnMB9s5yFGMazqyWzHiYIiAMBOrv-ELadH-eCDP77VsXAbwmDzNLIa9w Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d2f4edf503b845c78d63c5c1c41558cb Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesAdminNegativeTest-833757371 Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:06:36.903827 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2f4edf503b845c78d63c5c1c41558cb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2f4edf503b845c78d63c5c1c41558cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2f4edf503b845c78d63c5c1c41558cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2f4edf503b845c78d63c5c1c41558cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesAdminNegativeTest-833757371 Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d2f4edf503b845c78d63c5c1c41558cb Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-833757371 Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesAdminNegativeTest-833757371-project-admin Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 5b04bf8196d6446681ceb12f84c6cc26 Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesAdminNegativeTest-833757371-project-admin Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: {"volumeAttachment": {"volumeId": "d5bba39c-1761-4e30-aea8-f123b77868a2"}} Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:36.905417 n-d-863052-1 devstack@n-api.service[120640]: exception: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': 'c3818776-b4a5-40bb-88b9-3fba55492c54', 'id': 'fc1150d6-443c-4287-b005-3433a18db013', 'body': {'volumeAttachment': {'volumeId': 'd5bba39c-1761-4e30-aea8-f123b77868a2'}}} Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:06:36.906401 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. (HTTP 404) (Request-ID: req-a6c9ea21-bc28-4603-ad3d-4af9e5edfb21) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:06:36.907623 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:36.908938 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. Oct 31 14:06:36.910074 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:36.911233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] Returning 404 to user: Volume fc1150d6-443c-4287-b005-3433a18db013 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:36.911233 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3800321a-3959-4b43-bb66-f406236d801c tempest-VolumesAdminNegativeTest-833757371 tempest-VolumesAdminNegativeTest-833757371-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54/os-volume_attachments/fc1150d6-443c-4287-b005-3433a18db013" status: 404 len: 109 microversion: 2.1 time: 0.075020 Oct 31 14:06:36.916473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 520/885] 10.222.0.27 () {60 vars in 1433 bytes} [Mon Oct 31 14:06:36 2022] PUT /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54/os-volume_attachments/fc1150d6-443c-4287-b005-3433a18db013 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:37.099521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:37.100446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:37.113177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.113662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.114092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.119420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.121421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.121962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.323565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:37.333186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:37.346538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17c688ef-abbd-4940-ae15-d0efaa609c33 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.251977 Oct 31 14:06:37.349381 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0047d74c-ce2e-4ab3-abd0-eb5b9f8384d9 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.503486 Oct 31 14:06:37.359677 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 521/886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:37 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:37.359873 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 366/887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:36 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:37.369079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:37.369079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:37.378388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:37.378388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:37.385625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.387555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.388307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.388992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.389615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.390246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.391118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.391990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.393500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.394120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.394741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.395417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.559045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:37.569154 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17ef8d15-8125-41c6-a86c-38bc788285ca tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.204720 Oct 31 14:06:37.570449 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 522/888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:37 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:37.654708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:37.655790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:37.663921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.664590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.665217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.666642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:37.667364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:37.668011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:37.789486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:37.799747 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c89ef82-4255-42f2-a6f5-5aaa2f6d485e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.428250 Oct 31 14:06:37.805344 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 367/889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:37 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:37.960686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:37.974744 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c193548-516e-4458-9d6c-c77585fd6652 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1311 microversion: 2.1 time: 0.324208 Oct 31 14:06:37.976051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 523/890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:37 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:38.378494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-29c40176-5a05-4899-be6e-7ba14a9ac297 req-25757fdb-d7d8-43bb-99ad-474a0c2b75d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f551d03b-c743-4270-a7d6-a8db15d6358a", "tag": "302d69bd-9717-4197-bcba-80a497e54192"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:38.395147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:38.396104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:38.400505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-29c40176-5a05-4899-be6e-7ba14a9ac297 req-25757fdb-d7d8-43bb-99ad-474a0c2b75d3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.401329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-29c40176-5a05-4899-be6e-7ba14a9ac297 req-25757fdb-d7d8-43bb-99ad-474a0c2b75d3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.403981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-29c40176-5a05-4899-be6e-7ba14a9ac297 req-25757fdb-d7d8-43bb-99ad-474a0c2b75d3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.411652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.412487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.413171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.414003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.418235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.419038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.428715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-29c40176-5a05-4899-be6e-7ba14a9ac297 req-25757fdb-d7d8-43bb-99ad-474a0c2b75d3 service nova] Creating event network-changed:302d69bd-9717-4197-bcba-80a497e54192 for instance f551d03b-c743-4270-a7d6-a8db15d6358a on n-h1-863052-1 Oct 31 14:06:38.435087 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-29c40176-5a05-4899-be6e-7ba14a9ac297 req-25757fdb-d7d8-43bb-99ad-474a0c2b75d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061193 Oct 31 14:06:38.436442 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 368/891] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:38.442955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:38.444013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:38.451363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.452246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.452958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.453913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.454681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.455333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.649093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:38.658283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e13e0b7-6ddc-44f6-ac69-100382913934 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.266586 Oct 31 14:06:38.670412 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 524/892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:38 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:38.670412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:38.670412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:38.682785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.683387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.683895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.684918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.685436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.686000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.828498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:38.840598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c669d305-b977-486f-8f38-cf9a8ee4854c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.180597 Oct 31 14:06:38.841210 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 525/893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:38 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:38.856200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:38.857277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:38.860508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:38.866460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.867529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.867529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.868522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:38.870207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:38.870336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:38.980822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:38.990040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6fc5ae7f-71a1-4940-9fc3-414181e8b5f3 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.552011 Oct 31 14:06:38.993253 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 369/894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:38 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:39.000910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:39.001950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:39.011375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.012134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.012734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.013605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.015651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.016501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.047507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:39.060516 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31e0ac18-de8e-4b82-8055-83b2fd2435f6 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.209116 Oct 31 14:06:39.062511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 526/895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:38 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:39.072316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=12 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:39.573204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-dad01a17-1422-4e73-8cd5-375f0de4f202 req-933d9e2c-9f3b-4196-b44d-0a6a276d50e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82ffe5a-ae4b-48b3-948f-40c4864b284e", "name": "network-vif-plugged", "status": "completed", "tag": "9755a9f5-c659-4ca0-ac61-bf630116df4d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:39.583669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dad01a17-1422-4e73-8cd5-375f0de4f202 req-933d9e2c-9f3b-4196-b44d-0a6a276d50e1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.585694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dad01a17-1422-4e73-8cd5-375f0de4f202 req-933d9e2c-9f3b-4196-b44d-0a6a276d50e1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.585694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dad01a17-1422-4e73-8cd5-375f0de4f202 req-933d9e2c-9f3b-4196-b44d-0a6a276d50e1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.607325 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-dad01a17-1422-4e73-8cd5-375f0de4f202 req-933d9e2c-9f3b-4196-b44d-0a6a276d50e1 service nova] Creating event network-vif-plugged:9755a9f5-c659-4ca0-ac61-bf630116df4d for instance e82ffe5a-ae4b-48b3-948f-40c4864b284e on n-h2-863052-1 Oct 31 14:06:39.623886 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-dad01a17-1422-4e73-8cd5-375f0de4f202 req-933d9e2c-9f3b-4196-b44d-0a6a276d50e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048800 Oct 31 14:06:39.625116 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 527/896] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:39.651931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:39.663376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d05873e-cd9f-482b-8469-83fa4986e46c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1493 microversion: 2.1 time: 0.667738 Oct 31 14:06:39.664078 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 370/897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:38 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1493 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:39.685515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:39.693154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:39.694082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:39.695939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:39.713889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.716115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.716871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.717538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.718535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.719243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.719933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.720630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.721339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.722301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.723765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.728174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.916198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:39.924812 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17fc3c27-ac71-4038-a278-8dce5dfc31eb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.244493 Oct 31 14:06:39.925412 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 528/898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:39 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:39.930424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:39.931425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:39.938312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.939813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.940477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:39.941447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:39.941981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:39.942503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.109344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:40.119268 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0f57140-14ed-47cc-89c2-5981204c39e4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.192473 Oct 31 14:06:40.123256 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 529/899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:39 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:40.128428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.129295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.136325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.137321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.138025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.139092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.139724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.140520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.320299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:40.328313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-635f74cb-3c0b-4bc9-9744-2f98b8d8c9fa tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.203922 Oct 31 14:06:40.329104 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 530/900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:40 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:40.335670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.336288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.343050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.343548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.343997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.344705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.345718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.346187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.495795 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b18caa44-5245-42da-b085-50326001132b tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1644 microversion: 2.1 time: 0.807830 Oct 31 14:06:40.496372 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 371/901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:39 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1644 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:40.503790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.504284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.506021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=28 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:40.518115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.520513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.521115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.522000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.522660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.523287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.524518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:40.528625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:40.535596 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88d1b1e2-d371-4399-947e-e84f5f8293ce tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.202504 Oct 31 14:06:40.536506 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 531/902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:40 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:40.541002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.541612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.548194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.548719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.549152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.549842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.550360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.551600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.564654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:40.705590 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b4125c5-07d6-45d6-a8d8-6a1a44b3ea46 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 204 len: 0 microversion: 2.1 time: 0.204313 Oct 31 14:06:40.708791 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 372/903] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:40 2022] DELETE /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:06:40.719892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.720729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.727933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.728429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.728867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.729574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.730029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.730498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.812924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbdca4ed-5d8b-431b-9710-327023881e25 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1644 microversion: 2.1 time: 0.275245 Oct 31 14:06:40.830975 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 532/904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:40 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1644 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:40.840867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.845156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.845867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.846578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.847523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.848169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.848788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.875930 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6051acfc-9e82-4e2e-954f-b41e7d5f09bd tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038581 Oct 31 14:06:40.884376 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 533/905] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:06:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:40.890160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:40.890741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.902275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:40.903527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.904267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.904934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.905965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.906702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.907371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.913912 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-562cee4b-e189-4fc5-bafd-908982af5fe5 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1514 microversion: 2.1 time: 0.198147 Oct 31 14:06:40.914888 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 373/906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:40 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:40.951136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:40.951766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:40.961400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.961924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.963233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.964367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:40.965131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:40.965935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:40.980680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:40.997459 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cd58d4a-b2ba-41f9-83c0-18a47807f9cc tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.110711 Oct 31 14:06:41.002487 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 534/907] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:06:40 2022] POST /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:06:41.011595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:41.012227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:41.019779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.020183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.020623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.021321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.021775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.022215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.143921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:41.155196 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-341c7f4e-91f0-4d21-8355-d26f36b4bf8d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.210194 Oct 31 14:06:41.156032 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 374/908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:40 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:41.162463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:41.163819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:41.172837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.174199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.174681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.175788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.176513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.177159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.294759 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5895791c-b936-4304-b683-2de10bcda0ad tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1649 microversion: 2.1 time: 0.290668 Oct 31 14:06:41.296559 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 535/909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:41 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1649 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:41.356776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:41.357394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:41.364785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.365303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.365900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.367300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.367775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.368251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.389538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:41.397936 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f1b549c-ca36-4c2b-8e15-ea734d8a62a7 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.240560 Oct 31 14:06:41.402205 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 375/910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:41 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:41.559730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:41.561062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:41.567684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.568357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.568781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.569555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.570575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.570575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.613849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:41.625354 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba08430a-1ea9-4894-909f-a7a4a42aa4a7 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.273911 Oct 31 14:06:41.627454 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 536/911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:41 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:41.799268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:41.809859 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-362e5692-130d-4573-beaf-b8c327079ee5 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.254221 Oct 31 14:06:41.810807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 376/912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:41 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:41.937046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:41.937779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:41.944698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.945235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.946270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:41.947231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:41.947911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:41.948587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.177158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:42.178181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:42.185600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.186472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.187142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.188089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.188738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.189820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.199769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:42.208623 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d1e9c015-758f-4d5c-989e-77158e4e0fb6 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1514 microversion: 2.1 time: 0.275773 Oct 31 14:06:42.209614 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 537/913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:41 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:42.323508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:42.324148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:42.330805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.331385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.332055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.332845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.333371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.333888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.409986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:42.421625 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-666f434a-44ab-44ea-948a-f8c804d9cb0e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.248029 Oct 31 14:06:42.422662 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 377/914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:42 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:42.434624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:42.434624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:42.436321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.436466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.440237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.440237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.440237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.440237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.497821 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33474315-983a-4ba2-9844-9f495679ed45 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1649 microversion: 2.1 time: 0.177487 Oct 31 14:06:42.506975 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 538/915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:42 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1649 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:42.661621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:42.662241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:42.662918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:42.670296 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82ae04b5-976f-4ebe-825b-18afb208faf4 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1319 microversion: 2.1 time: 0.246567 Oct 31 14:06:42.689901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 378/916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:42 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:42.693585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.694458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.699121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.700132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.700704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.701602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.834328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:42.834949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:42.845187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.849463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.849976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.850802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:42.851275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:42.851706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:42.994565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:43.006341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efdd6d80-b327-4b1e-a95f-48ab6c797aa8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.359498 Oct 31 14:06:43.007339 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 539/917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:42 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:43.127219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:43.144301 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db29de37-16dc-4ff0-a192-91ca85a87892 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.313832 Oct 31 14:06:43.146159 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 379/918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:42 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:43.234518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:43.235385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:43.246274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.247060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.248347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.249342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.251035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.252220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.377784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-369a7853-2428-4444-b2bf-bb9ce005150c req-5dfb6644-b6c2-4507-84c1-cc90b8b0762e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3818776-b4a5-40bb-88b9-3fba55492c54", "name": "network-vif-deleted", "tag": "bf1ad07f-9865-4001-a3f7-890490f3c082"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:43.390537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-369a7853-2428-4444-b2bf-bb9ce005150c req-5dfb6644-b6c2-4507-84c1-cc90b8b0762e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.391026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-369a7853-2428-4444-b2bf-bb9ce005150c req-5dfb6644-b6c2-4507-84c1-cc90b8b0762e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.391465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-369a7853-2428-4444-b2bf-bb9ce005150c req-5dfb6644-b6c2-4507-84c1-cc90b8b0762e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.404505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:43.405930 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-369a7853-2428-4444-b2bf-bb9ce005150c req-5dfb6644-b6c2-4507-84c1-cc90b8b0762e service nova] Creating event network-vif-deleted:bf1ad07f-9865-4001-a3f7-890490f3c082 for instance c3818776-b4a5-40bb-88b9-3fba55492c54 on n-h2-863052-1 Oct 31 14:06:43.412337 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-369a7853-2428-4444-b2bf-bb9ce005150c req-5dfb6644-b6c2-4507-84c1-cc90b8b0762e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038917 Oct 31 14:06:43.416566 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 380/919] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:43.418558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6bbe49b-8344-44f7-bdb7-7ebae05b25bd tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1472 microversion: 2.1 time: 0.190593 Oct 31 14:06:43.422311 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 540/920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:43 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:43.451995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:43.452852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:43.468909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.469487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.469940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.472493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.472982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.473421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.489449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7842ad0d-2f72-4588-9575-7f569e03e751 req-4047908f-40a4-4767-be5c-398966582b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da372ca0-0c70-473c-8c7e-16033f8ad2c3", "name": "network-vif-plugged", "status": "completed", "tag": "c0490852-4c5f-4c7c-b617-278b798b4ef7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:43.510208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7842ad0d-2f72-4588-9575-7f569e03e751 req-4047908f-40a4-4767-be5c-398966582b67 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.510697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7842ad0d-2f72-4588-9575-7f569e03e751 req-4047908f-40a4-4767-be5c-398966582b67 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.511129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7842ad0d-2f72-4588-9575-7f569e03e751 req-4047908f-40a4-4767-be5c-398966582b67 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.528906 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7842ad0d-2f72-4588-9575-7f569e03e751 req-4047908f-40a4-4767-be5c-398966582b67 service nova] Creating event network-vif-plugged:c0490852-4c5f-4c7c-b617-278b798b4ef7 for instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 on n-h1-863052-1 Oct 31 14:06:43.535924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7842ad0d-2f72-4588-9575-7f569e03e751 req-4047908f-40a4-4767-be5c-398966582b67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050178 Oct 31 14:06:43.537086 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 541/921] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:43.544628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:43.557104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:43.573950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.575077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.575800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.576580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.577122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.577726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.763884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:43.769172 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5d0933a-4a79-4763-9e75-be26b29fad1e tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1629 microversion: 2.1 time: 0.230254 Oct 31 14:06:43.770347 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 542/922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:43 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1629 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:43.775206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:43.776056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:43.782734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.783422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.784050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.784749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.785200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.785624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.791971 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d35614a9-1c36-4c62-80a6-7d48c77c8de0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.347390 Oct 31 14:06:43.793018 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 381/923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:43 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:43.801910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:43.808241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:43.816445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.817134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.817641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.818458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:43.818983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:43.819497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:43.847817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lazy-loading 'flavor' on Instance uuid 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:43.862536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Going to try to live migrate instance to n-h1-863052-1 {{(pid=120641) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:06:43.994544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:44.004712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d380291-95c2-411b-b12c-7ab3a00ffb2f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1468 microversion: 2.1 time: 0.233119 Oct 31 14:06:44.019952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 543/924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:43 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:44.029147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:44.030335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.038865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.039897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.040774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.041749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.042295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.042953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.186484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:44.199175 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-716f5e37-3e80-49ce-a1e8-468233721c1b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.173894 Oct 31 14:06:44.200221 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 544/925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:44 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:44.222835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:44.225310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.231549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.232252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.232876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.233579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.234040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.234494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.323963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53175551-e85b-4596-90ce-af4da41b00e3 tempest-DeleteServersAdminTestJSON-1837003345 tempest-DeleteServersAdminTestJSON-1837003345-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e/action" status: 202 len: 0 microversion: 2.1 time: 0.105035 Oct 31 14:06:44.327881 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 545/926] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:06:44 2022] POST /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:06:44.331207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:44.331818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.337975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.338604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.339719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.340656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.341126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.341859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.488758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:44.497505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a57e3c9-14b6-43f9-bbc2-d6d7d057a22c tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1321 microversion: 2.1 time: 0.171448 Oct 31 14:06:44.502273 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 546/927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:44 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:44.503481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:44.504117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.510106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.510465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.511081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.511697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.512157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.512575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.548948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.549433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.549866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.551137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lazy-loading 'fault' on Instance uuid e82ffe5a-ae4b-48b3-948f-40c4864b284e {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:44.686078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:44.697005 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31a6b92b-cca0-4b2a-b8ed-fcd72b3ea49f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1451 microversion: 2.1 time: 0.197127 Oct 31 14:06:44.702206 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 547/928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:44 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:44.703693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:44.704336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.710797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.711282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.711727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.712418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.713002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.713456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.750195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.750697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.751350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.751801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lazy-loading 'fault' on Instance uuid c3818776-b4a5-40bb-88b9-3fba55492c54 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:44.795167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:44.803378 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5f43192-1bf6-4cf8-985b-ecf7468e176d tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1307 microversion: 2.1 time: 0.104158 Oct 31 14:06:44.803947 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 548/929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:44 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:44.808369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:44.808858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.814842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.815321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.815952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.816642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.817092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.817514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.845600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:44.848490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:44.923656 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf190cb9-7789-4ea5-a0ef-0466dd6946dd tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 204 len: 0 microversion: 2.1 time: 0.118294 Oct 31 14:06:44.924762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 549/930] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:44 2022] DELETE /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:06:44.929807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:44.930524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:44.936177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.936654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.937082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:44.937815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:44.938282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:44.938738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.137369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:45.148624 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-328df495-0cd6-4c6d-9bf2-9c62b6f1e9f5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.222683 Oct 31 14:06:45.149911 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 550/931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:44 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:45.157049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:45.158427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:45.164713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.165218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.166030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.167123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.167811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.169092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.203586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.204082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.205064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.205504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lazy-loading 'fault' on Instance uuid e82ffe5a-ae4b-48b3-948f-40c4864b284e {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:45.431898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:45.440477 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77d84e27-5b1a-44a8-9d49-3daa4dbd2510 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1457 microversion: 2.1 time: 0.288924 Oct 31 14:06:45.441148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 551/932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:45 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1457 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:45.460168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:45.460712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:45.466839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.467332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.467759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.468778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.469286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.469654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.616526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:45.624867 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bd5ce2c-abb3-4505-99c6-5948b7c0e3bd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.168839 Oct 31 14:06:45.625429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 552/933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:45 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:45.640158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:45.640158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:45.640158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.640158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.640556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.641085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.641630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.642158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.792573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:45.802095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3532126c-798e-4707-8fa2-0ee99cb8249d tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1470 microversion: 2.1 time: 0.173944 Oct 31 14:06:45.803067 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 553/934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:45 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:45.808089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1aa2d217-9578-4b84-a9b1-13065d17739e req-351ad261-a9f4-4250-aaa9-e30e55e6c15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f551d03b-c743-4270-a7d6-a8db15d6358a", "name": "network-vif-plugged", "status": "completed", "tag": "302d69bd-9717-4197-bcba-80a497e54192"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:45.820373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1aa2d217-9578-4b84-a9b1-13065d17739e req-351ad261-a9f4-4250-aaa9-e30e55e6c15e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.821126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1aa2d217-9578-4b84-a9b1-13065d17739e req-351ad261-a9f4-4250-aaa9-e30e55e6c15e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.821760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1aa2d217-9578-4b84-a9b1-13065d17739e req-351ad261-a9f4-4250-aaa9-e30e55e6c15e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.835832 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1aa2d217-9578-4b84-a9b1-13065d17739e req-351ad261-a9f4-4250-aaa9-e30e55e6c15e service nova] Creating event network-vif-plugged:302d69bd-9717-4197-bcba-80a497e54192 for instance f551d03b-c743-4270-a7d6-a8db15d6358a on n-h1-863052-1 Oct 31 14:06:45.840937 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1aa2d217-9578-4b84-a9b1-13065d17739e req-351ad261-a9f4-4250-aaa9-e30e55e6c15e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Oct 31 14:06:45.841795 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 554/935] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:45.847973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:45.848951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:45.864753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.865902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.866527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.867738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.868586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.869583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.914673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:45.915256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:45.915766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:45.916334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lazy-loading 'fault' on Instance uuid c3818776-b4a5-40bb-88b9-3fba55492c54 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:45.967494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:45.976125 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ae8c613-e4e2-493b-a0e0-b20a865b7f7e tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 200 len: 1307 microversion: 2.1 time: 0.132890 Oct 31 14:06:45.991797 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 555/936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:45 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:46.281280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a75557dc-34c6-48d5-9dd9-82f0d3cd430a tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:46.282105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a75557dc-34c6-48d5-9dd9-82f0d3cd430a tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] [instance: ef749745-5ff1-4f6f-af7f-1194fd91c71c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:46.288019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a75557dc-34c6-48d5-9dd9-82f0d3cd430a tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] HTTP exception thrown: Instance ef749745-5ff1-4f6f-af7f-1194fd91c71c could not be found. Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a75557dc-34c6-48d5-9dd9-82f0d3cd430a tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Request method failure captured: Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/ef749745-5ff1-4f6f-af7f-1194fd91c71c/action HTTP/1.1 Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 15 Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ZfuIFaxe5vX2nttq5ISKubcFwpkO0mFGp1eJPlKlR9VHZNrAQXurh09M562PPp_ADCaKN_j-Jxjajf2gLbXm1hyd7X4DgARtnlkTVY7LBTK454P-HWfUvFrLEiF-DZ_XX50Hfos9q8y6yjuncoO19WsLazLRU4NAL4wUR0oYsyqSg Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:06:46.289923 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9bae9404a5944749219fd3e560f3ed9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 6244771b328a4f27a497e242f9252d19 Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: {"migrate": {}} Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:46.291568 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ef749745-5ff1-4f6f-af7f-1194fd91c71c could not be found. Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ef749745-5ff1-4f6f-af7f-1194fd91c71c', 'body': {'migrate': {}}} Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef749745-5ff1-4f6f-af7f-1194fd91c71c could not be found. Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:46.292470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef749745-5ff1-4f6f-af7f-1194fd91c71c could not be found. Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef749745-5ff1-4f6f-af7f-1194fd91c71c could not be found. Oct 31 14:06:46.293958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:46.296183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a75557dc-34c6-48d5-9dd9-82f0d3cd430a tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Returning 404 to user: Instance ef749745-5ff1-4f6f-af7f-1194fd91c71c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:46.297225 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a75557dc-34c6-48d5-9dd9-82f0d3cd430a tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ef749745-5ff1-4f6f-af7f-1194fd91c71c/action" status: 404 len: 111 microversion: 2.1 time: 0.318784 Oct 31 14:06:46.298885 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 556/937] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:06:45 2022] POST /compute/v2.1/servers/ef749745-5ff1-4f6f-af7f-1194fd91c71c/action => generated 111 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:46.320189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:46.321060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:46.333368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:46.337392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:46.338472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:46.339856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:46.341121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:46.342527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:46.588471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:46.603082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a306656-84fe-481d-8a93-ec444cb63a7f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1324 microversion: 2.1 time: 0.302703 Oct 31 14:06:46.604277 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 557/938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:46 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:46.609879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1417297915", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:46.683937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:46.738006 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2c19b21-f81f-4538-93a9-8a40e43ecd13 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc/action" status: 202 len: 0 microversion: 2.1 time: 2.942545 Oct 31 14:06:46.739574 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 382/939] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:06:43 2022] POST /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc/action => generated 0 bytes in 2946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:06:46.746837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:46.750342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:46.779766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:46.780601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:46.784459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:46.786485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:46.787146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:46.788710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:46.864666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:46.865601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:46.866285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:46.867003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lazy-loading 'fault' on Instance uuid e82ffe5a-ae4b-48b3-948f-40c4864b284e {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:46.989836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:06:46.990294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:06:46.990953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:06:46.994810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:06:46.995315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:06:47.008136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.009061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.009757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.011084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.025893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.026322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.046365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Getting quotas for project 502f9205e2f54e15bbe5a8aa67b8e053. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:06:47.052251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Getting quotas for user a3f8e1f808a64540884dd7be6a92c46d and project 502f9205e2f54e15bbe5a8aa67b8e053. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:06:47.066709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:06:47.069182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:06:47.154933 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-928b02af-030c-4bef-8009-e08d5f2a4168 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549278 Oct 31 14:06:47.162385 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 558/940] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:06:47.167359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:47.168799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:47.179265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.180697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.180697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.181211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.181745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.182271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.209736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:47.218787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a01ad145-68b9-4547-ba92-c9570088d87d tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1457 microversion: 2.1 time: 0.477950 Oct 31 14:06:47.222457 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 383/941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:46 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1457 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:47.233120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:47.233960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:47.249869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.250421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.253401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.272280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.274636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.275103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.445231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:47.461538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1156f49-e75d-47d3-a350-1215a97201f8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.302851 Oct 31 14:06:47.464800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 559/942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:47 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:47.476343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:47.477072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: c3818776-b4a5-40bb-88b9-3fba55492c54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:47.488305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.490706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.491541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.492532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.493156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.495167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.513888 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] HTTP exception thrown: Instance c3818776-b4a5-40bb-88b9-3fba55492c54 could not be found. Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Request method failure captured: Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 HTTP/1.1 Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Xf4kFmSR_1ThVfZCT9FGagiBytpaLyLVGdPfizbRMiNL19QXNswt1RJmw9e2CDa9F0Y_db4J4t3TU9_BJweziGhyMne9J4F4T17cMY5al8byoifLACgi2GPquXAL7YdYtUxK-8HFKem8ziQuP7GuRiSz0WB4aqJ3w7Mc0FYsSoK5A Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 3b521bd0aac94c2ea9702ae724953dbf Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesAdminNegativeTest-1433141442 Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:06:47.518273 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b521bd0aac94c2ea9702ae724953dbf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b521bd0aac94c2ea9702ae724953dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b521bd0aac94c2ea9702ae724953dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b521bd0aac94c2ea9702ae724953dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesAdminNegativeTest-1433141442 Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 3b521bd0aac94c2ea9702ae724953dbf Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1433141442 Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesAdminNegativeTest-1433141442-project Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 525cf99f53e043d39794f8ecf0f739f0 Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesAdminNegativeTest-1433141442-project Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance c3818776-b4a5-40bb-88b9-3fba55492c54 could not be found. Oct 31 14:06:47.520021 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c3818776-b4a5-40bb-88b9-3fba55492c54'} Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3818776-b4a5-40bb-88b9-3fba55492c54 could not be found. Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:47.520942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3818776-b4a5-40bb-88b9-3fba55492c54 could not be found. Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3818776-b4a5-40bb-88b9-3fba55492c54 could not be found. Oct 31 14:06:47.523444 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:47.526906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Returning 404 to user: Instance c3818776-b4a5-40bb-88b9-3fba55492c54 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:47.528377 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81770d2f-3497-455c-8264-b41597909989 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54" status: 404 len: 111 microversion: 2.1 time: 0.062045 Oct 31 14:06:47.532730 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 560/943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:47 2022] GET /compute/v2.1/servers/c3818776-b4a5-40bb-88b9-3fba55492c54 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:47.547003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4ddd781-ae9a-45ea-96d4-c5103b6e2bd2 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:47.547930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4ddd781-ae9a-45ea-96d4-c5103b6e2bd2 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:47.572762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:47.776384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4ddd781-ae9a-45ea-96d4-c5103b6e2bd2 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:47.791792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4ddd781-ae9a-45ea-96d4-c5103b6e2bd2 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1222 microversion: 2.1 time: 0.257795 Oct 31 14:06:47.795601 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 561/944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:47 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1222 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:47.813024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:47.816573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:47.843199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.843991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.844585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:47.845478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:47.846078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:47.846681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.121489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:48.130642 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2159d514-2731-4951-bbed-424af15537dc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.333724 Oct 31 14:06:48.137876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 562/945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:47 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:48.149050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ab9233f4-f16b-4ab2-a98e-b866006bad19 req-2d7b9213-652a-4c42-bd7d-dbbb4abd058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45999f51-af1a-4ad7-bda9-28b183262640", "name": "network-vif-plugged", "status": "completed", "tag": "90a9817d-062b-427f-8499-cdc224521d8f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:48.175936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab9233f4-f16b-4ab2-a98e-b866006bad19 req-2d7b9213-652a-4c42-bd7d-dbbb4abd058a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.176842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab9233f4-f16b-4ab2-a98e-b866006bad19 req-2d7b9213-652a-4c42-bd7d-dbbb4abd058a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.177425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab9233f4-f16b-4ab2-a98e-b866006bad19 req-2d7b9213-652a-4c42-bd7d-dbbb4abd058a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.191809 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ab9233f4-f16b-4ab2-a98e-b866006bad19 req-2d7b9213-652a-4c42-bd7d-dbbb4abd058a service nova] Creating event network-vif-plugged:90a9817d-062b-427f-8499-cdc224521d8f for instance 45999f51-af1a-4ad7-bda9-28b183262640 on n-h2-863052-1 Oct 31 14:06:48.198629 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ab9233f4-f16b-4ab2-a98e-b866006bad19 req-2d7b9213-652a-4c42-bd7d-dbbb4abd058a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059004 Oct 31 14:06:48.199899 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 563/946] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:48.222061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:48.223423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:48.232874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.233841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.234556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.236638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.237270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.237902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.498944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:48.522058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-366ddd38-ebf4-444f-8ca0-e781cf1d2c42 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 1.295988 Oct 31 14:06:48.530959 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 384/947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:47 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:48.535892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:48.541189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:48.555788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:48.561005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.561762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.562473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.564649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.565763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5953960-f62f-4488-8cbb-5c40620a9c72 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.364097 Oct 31 14:06:48.566549 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 564/948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:48 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:48.566769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.568069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.582628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:48.584445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:48.590666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.591372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.591988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.592841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.593300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.593728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.602905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:48.647038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.647776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.648363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.648963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lazy-loading 'fault' on Instance uuid e82ffe5a-ae4b-48b3-948f-40c4864b284e {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:48.752607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:48.769347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4502d631-5eea-44d5-8794-09d80da0e25f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1415 microversion: 2.1 time: 0.241020 Oct 31 14:06:48.775360 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 385/949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:48 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1415 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:48.803307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e05dd25e-828b-43c6-affc-d13f2ea03d64 req-018d3a19-1d32-4ce4-8414-7fe78cf126b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82ffe5a-ae4b-48b3-948f-40c4864b284e", "name": "network-vif-deleted", "tag": "9755a9f5-c659-4ca0-ac61-bf630116df4d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:48.855315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e05dd25e-828b-43c6-affc-d13f2ea03d64 req-018d3a19-1d32-4ce4-8414-7fe78cf126b5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.857557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e05dd25e-828b-43c6-affc-d13f2ea03d64 req-018d3a19-1d32-4ce4-8414-7fe78cf126b5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.858727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e05dd25e-828b-43c6-affc-d13f2ea03d64 req-018d3a19-1d32-4ce4-8414-7fe78cf126b5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.889633 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e05dd25e-828b-43c6-affc-d13f2ea03d64 req-018d3a19-1d32-4ce4-8414-7fe78cf126b5 service nova] Creating event network-vif-deleted:9755a9f5-c659-4ca0-ac61-bf630116df4d for instance e82ffe5a-ae4b-48b3-948f-40c4864b284e on n-h2-863052-1 Oct 31 14:06:48.898262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e05dd25e-828b-43c6-affc-d13f2ea03d64 req-018d3a19-1d32-4ce4-8414-7fe78cf126b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121298 Oct 31 14:06:48.899364 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 386/950] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:48.906707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:48.908041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-779cde92-1198-43e6-9025-10c44ad18e5c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1990911166", "metadata": {"": ""}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-779cde92-1198-43e6-9025-10c44ad18e5c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action HTTP/1.1 Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 107 Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:48.914647 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1990911166", "metadata": {"": ""}}} Oct 31 14:06:48.916034 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1990911166', 'metadata': {'': ''}}}} Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'': ''} Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:48.916790 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.918126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-779cde92-1198-43e6-9025-10c44ad18e5c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:48.924237 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-779cde92-1198-43e6-9025-10c44ad18e5c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action" status: 400 len: 170 microversion: 2.1 time: 0.014573 Oct 31 14:06:48.925348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b48ebbdd-326f-4720-b0cf-2905420376a0 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1292 microversion: 2.1 time: 0.348457 Oct 31 14:06:48.925517 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 387/951] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 31 14:06:48 2022] POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action => generated 170 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:06:48.925517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:48.925517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:48.929646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.930134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.930487 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 565/952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:48 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1292 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:48.930653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.931532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.931985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.932407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.935270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:48.935881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:48.951596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.952091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.952529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:48.953236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:48.953687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:48.954207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.056385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:49.068328 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8bbd052-0847-43ba-9905-695c5bf728c7 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1274 microversion: 2.1 time: 0.150078 Oct 31 14:06:49.069189 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 388/953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:48 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:49.131183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:49.139397 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-461920bf-2f36-4df7-93a4-76877458f7e7 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.207806 Oct 31 14:06:49.139974 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 566/954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:48 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:49.164710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:49.165341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:49.172089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.172661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.173147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.173862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.174720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.175158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.455038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:49.480845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-057dc021-594e-48ef-980f-978695f264ed tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.320467 Oct 31 14:06:49.483943 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 389/955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:49 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:49.507906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a520f1d-69ad-400a-af7f-a399f0d2af76 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2034076645", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a520f1d-69ad-400a-af7f-a399f0d2af76 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action HTTP/1.1 Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 619 Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:06:49.515003 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:49.516653 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:49.517346 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2034076645", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 31 14:06:49.517346 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:49.517346 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2034076645', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 31 14:06:49.517610 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:49.518399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.519378 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:49.520168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:49.520168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:49.520168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:06:49.520168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:06:49.520168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:06:49.520168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:49.521451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a520f1d-69ad-400a-af7f-a399f0d2af76 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:49.523517 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a520f1d-69ad-400a-af7f-a399f0d2af76 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action" status: 400 len: 938 microversion: 2.1 time: 0.020346 Oct 31 14:06:49.524022 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 567/956] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 31 14:06:49 2022] POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:06:49.533316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:49.533941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:49.540343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.540933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.541387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.542075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.543832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.543967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.550151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:49.550800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:49.567191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.567683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.568123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.568831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.569284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.569713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.819348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:49.827857 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f7da4be-fefd-415e-9f65-45d1742616e6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.282744 Oct 31 14:06:49.829001 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 568/957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:49 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:49.835220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:49.836035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:49.842519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.843236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.843987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.845139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.845753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.846363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.885138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.885645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.886082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.886579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lazy-loading 'fault' on Instance uuid e82ffe5a-ae4b-48b3-948f-40c4864b284e {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:06:49.889601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:49.935740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3e8acd5f64c249809bc60403e0299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdfa201d3a647e591f61b6c21b473e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:49.953864 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2224039-b96e-4bd2-bfa6-4e408139cafa tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 200 len: 1309 microversion: 2.1 time: 0.123042 Oct 31 14:06:49.957268 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 569/958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:49 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:49.970601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:49.971514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:49.983877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.985437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.987161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:49.989257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:49.989738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:49.990153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.150120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:50.158555 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c8da362-5591-4b47-a15c-0247c3002e44 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.629957 Oct 31 14:06:50.159138 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 390/959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:49 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:50.182965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:50.185644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:50.186471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:50.194452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.195222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.195899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.196786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.197670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.198333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.210189 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc61c8e5-ba37-42cf-9fde-63a05c20f1c5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1482 microversion: 2.1 time: 0.251550 Oct 31 14:06:50.220411 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 570/960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:49 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1482 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:50.238717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:50.239581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:50.246586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.248859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.253823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.254570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.255054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.255476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.345941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:50.355515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8acb748-131c-4a22-bd87-45c445ea9ee0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1280 microversion: 2.1 time: 0.179857 Oct 31 14:06:50.356245 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 391/961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:50 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:50.364041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:50.364790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:50.371415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.372364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.373047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.373858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.374441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.374953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.472675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:50.480881 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10b50d92-bef7-4bc6-8551-76e169019c81 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.259137 Oct 31 14:06:50.494764 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 571/962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:50 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:50.504828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7ac5653-cb01-4efe-92cb-29f173421da1 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7ac5653-cb01-4efe-92cb-29f173421da1 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action HTTP/1.1 Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 285 Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:06:50.508601 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:50.510230 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:06:50.511066 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:06:50.511806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:06:50.513321 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:06:50.514309 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:06:50.514309 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:50.514309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7ac5653-cb01-4efe-92cb-29f173421da1 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:50.514309 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7ac5653-cb01-4efe-92cb-29f173421da1 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action" status: 400 len: 619 microversion: 2.1 time: 0.009724 Oct 31 14:06:50.514748 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 572/963] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 31 14:06:50 2022] POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:06:50.518549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:50.519153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:50.526348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.526848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.527934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.528836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.529441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.530027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.605604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-005fa79c-5b26-42dc-9867-73c8d2d25edb tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248132 Oct 31 14:06:50.606228 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 392/964] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:06:50 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:50.827756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:50.840213 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b65213cb-5b74-430f-a8a0-67354f95406d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.324256 Oct 31 14:06:50.842202 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 573/965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:50 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:50.863714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:50.864336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:50.873011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:50.873539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:50.884039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.884550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.884989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.885717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.886196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.886629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.901744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.903866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.904318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:50.905043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:50.905508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:50.905935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.443384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:51.452266 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4330e8b0-f3df-4d4c-8ffa-333b60a198f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.592497 Oct 31 14:06:51.459093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 393/966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:50 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:51.468451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:51.469316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:51.483933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.484427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.486748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.490548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.491208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.491794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.524148 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] HTTP exception thrown: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Request method failure captured: Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e HTTP/1.1 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZFQlxiFv9c_qK6dAhx96rvH8XXhQ1l5LhurjIrNAz3NccjVshyL6q7f8CndoCpQTcVJI7G3gQ_Dm_QMGmnC-uMkD_iJgv9vRYGNJy0U56VOp2o779s3IMZBz6fOuma_LyHp-I110s4sfYR7xDkZI_6GuSYCY8z6ZPeBd-yy9XZqG8 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:51.525707 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fdfa201d3a647e591f61b6c21b473e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bee3e8acd5f64c249809bc60403e0299 Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.527505 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e82ffe5a-ae4b-48b3-948f-40c4864b284e'} Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:51.528317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.529699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.530927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Returning 404 to user: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:51.530927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-adeed8c2-3afe-4fcb-8be9-0df28fbd5933 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 404 len: 111 microversion: 2.1 time: 0.066804 Oct 31 14:06:51.530927 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 394/967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:51 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:51.554916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e5be0593-7715-4cf5-8962-dfeff1b85081 req-d7f710f2-61d2-41b1-9dcc-af68f532a798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe82d2-dea9-4ed6-92b6-05bff851e8dc", "name": "network-vif-unplugged", "status": "completed", "tag": "ee385a28-bfce-436b-97c5-f6a8b1851e5d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:51.583822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:51.595698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e5be0593-7715-4cf5-8962-dfeff1b85081 req-d7f710f2-61d2-41b1-9dcc-af68f532a798 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.596474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e5be0593-7715-4cf5-8962-dfeff1b85081 req-d7f710f2-61d2-41b1-9dcc-af68f532a798 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.597075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e5be0593-7715-4cf5-8962-dfeff1b85081 req-d7f710f2-61d2-41b1-9dcc-af68f532a798 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.639588 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e5be0593-7715-4cf5-8962-dfeff1b85081 req-d7f710f2-61d2-41b1-9dcc-af68f532a798 service nova] Creating event network-vif-unplugged:ee385a28-bfce-436b-97c5-f6a8b1851e5d for instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc on n-h2-863052-1 Oct 31 14:06:51.656057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e5be0593-7715-4cf5-8962-dfeff1b85081 req-d7f710f2-61d2-41b1-9dcc-af68f532a798 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125150 Oct 31 14:06:51.656909 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 395/968] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:51.662311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:51.663534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:51.670692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:51.672585 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5dd0e61-f763-4f9a-963c-6ed168b19051 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.805218 Oct 31 14:06:51.677128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 574/969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:50 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:51.682393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.682393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.694152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:51.694424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.695433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.695996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.696512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.700104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:51.716650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.717572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.718309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.719248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.722805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.723493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.748705 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] HTTP exception thrown: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Request method failure captured: Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e HTTP/1.1 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ZFQlxiFv9c_qK6dAhx96rvH8XXhQ1l5LhurjIrNAz3NccjVshyL6q7f8CndoCpQTcVJI7G3gQ_Dm_QMGmnC-uMkD_iJgv9vRYGNJy0U56VOp2o779s3IMZBz6fOuma_LyHp-I110s4sfYR7xDkZI_6GuSYCY8z6ZPeBd-yy9XZqG8 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:06:51.750793 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fdfa201d3a647e591f61b6c21b473e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bee3e8acd5f64c249809bc60403e0299 Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.752724 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e82ffe5a-ae4b-48b3-948f-40c4864b284e'} Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:51.753477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.754687 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.755915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Returning 404 to user: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:51.755915 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9dfaf42-504d-43cf-9e79-a7fd569c7e4f tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 404 len: 111 microversion: 2.1 time: 0.068130 Oct 31 14:06:51.755915 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 575/970] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:51 2022] DELETE /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:51.758730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1989386850"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:51.761475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:51.768280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.769024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.769646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.771295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.771957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.772644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.877798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:51.889510 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17642b4b-18ca-4dbf-93ef-10ff3f436b01 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1280 microversion: 2.1 time: 0.231112 Oct 31 14:06:51.894989 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 396/971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:51 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:51.904272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:51.908737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e82ffe5a-ae4b-48b3-948f-40c4864b284e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:51.924519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.925026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.928335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.929168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:51.929653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:51.934474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:51.966676 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] HTTP exception thrown: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Request method failure captured: Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e HTTP/1.1 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZFQlxiFv9c_qK6dAhx96rvH8XXhQ1l5LhurjIrNAz3NccjVshyL6q7f8CndoCpQTcVJI7G3gQ_Dm_QMGmnC-uMkD_iJgv9vRYGNJy0U56VOp2o779s3IMZBz6fOuma_LyHp-I110s4sfYR7xDkZI_6GuSYCY8z6ZPeBd-yy9XZqG8 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:51.968473 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fdfa201d3a647e591f61b6c21b473e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bee3e8acd5f64c249809bc60403e0299 Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.970412 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e82ffe5a-ae4b-48b3-948f-40c4864b284e'} Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:51.971134 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. Oct 31 14:06:51.972491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:51.973553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Returning 404 to user: Instance e82ffe5a-ae4b-48b3-948f-40c4864b284e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:51.973553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f8dfa88-c0b7-4797-aac3-638579010b1c tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e" status: 404 len: 111 microversion: 2.1 time: 0.071364 Oct 31 14:06:51.981658 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 397/972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:51 2022] GET /compute/v2.1/servers/e82ffe5a-ae4b-48b3-948f-40c4864b284e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:51.989594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:51.990100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:52.003628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.009263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.009908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.010856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.011473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.012340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.046525 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] HTTP exception thrown: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Request method failure captured: Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 HTTP/1.1 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZFQlxiFv9c_qK6dAhx96rvH8XXhQ1l5LhurjIrNAz3NccjVshyL6q7f8CndoCpQTcVJI7G3gQ_Dm_QMGmnC-uMkD_iJgv9vRYGNJy0U56VOp2o779s3IMZBz6fOuma_LyHp-I110s4sfYR7xDkZI_6GuSYCY8z6ZPeBd-yy9XZqG8 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:52.052353 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fdfa201d3a647e591f61b6c21b473e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bee3e8acd5f64c249809bc60403e0299 Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.054089 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e6b8938b-1c9c-4dcd-9f84-fa01b6737671'} Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:52.055144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.056550 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.060298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Returning 404 to user: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:52.064465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58c73c71-7677-4af6-8a4b-424b22bb80f1 tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 404 len: 111 microversion: 2.1 time: 0.076488 Oct 31 14:06:52.075706 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 398/973] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:51 2022] DELETE /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:52.081834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:52.085612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] [instance: e6b8938b-1c9c-4dcd-9f84-fa01b6737671] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:52.098073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.099766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.100435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.101811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.102727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.103398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.128761 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1899c222-7567-499f-a534-f0329929f28e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action" status: 202 len: 0 microversion: 2.1 time: 0.373653 Oct 31 14:06:52.129857 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 576/974] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:06:51 2022] POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:06:52.152368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] HTTP exception thrown: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Request method failure captured: Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 HTTP/1.1 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZFQlxiFv9c_qK6dAhx96rvH8XXhQ1l5LhurjIrNAz3NccjVshyL6q7f8CndoCpQTcVJI7G3gQ_Dm_QMGmnC-uMkD_iJgv9vRYGNJy0U56VOp2o779s3IMZBz6fOuma_LyHp-I110s4sfYR7xDkZI_6GuSYCY8z6ZPeBd-yy9XZqG8 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:06:52.154585 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fdfa201d3a647e591f61b6c21b473e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fdfa201d3a647e591f61b6c21b473e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6fdfa201d3a647e591f61b6c21b473e0 Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1193907882 Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bee3e8acd5f64c249809bc60403e0299 Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersAdminTestJSON-1193907882-project Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.156035 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e6b8938b-1c9c-4dcd-9f84-fa01b6737671'} Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:52.156760 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. Oct 31 14:06:52.158505 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.160988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1141347954"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:52.161920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] Returning 404 to user: Instance e6b8938b-1c9c-4dcd-9f84-fa01b6737671 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:52.166152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4bc03b8-8fff-4ca4-a481-761635cb5eff tempest-DeleteServersAdminTestJSON-1193907882 tempest-DeleteServersAdminTestJSON-1193907882-project] 10.222.0.27 "GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671" status: 404 len: 111 microversion: 2.1 time: 0.088066 Oct 31 14:06:52.167268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 399/975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:52 2022] GET /compute/v2.1/servers/e6b8938b-1c9c-4dcd-9f84-fa01b6737671 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:06:52.195755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:52.200010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:52.200964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:52.210846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.215791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.217805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.219493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.220640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.221145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.221588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.221876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.222320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.222892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.237174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.240031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.312299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:52.359556 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Cannot 'createImage' instance f551d03b-c743-4270-a7d6-a8db15d6358a while it is in task_state image_snapshot_pending Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action HTTP/1.1 Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 85 Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:06:52.361542 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1141347954"}} Oct 31 14:06:52.363292 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot 'createImage' instance f551d03b-c743-4270-a7d6-a8db15d6358a while it is in task_state image_snapshot_pending Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1141347954'}}} Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f551d03b-c743-4270-a7d6-a8db15d6358a in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:52.364089 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f551d03b-c743-4270-a7d6-a8db15d6358a while it is in task_state image_snapshot_pending Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f551d03b-c743-4270-a7d6-a8db15d6358a while it is in task_state image_snapshot_pending Oct 31 14:06:52.365265 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:52.387589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 409 to user: Cannot 'createImage' instance f551d03b-c743-4270-a7d6-a8db15d6358a while it is in task_state image_snapshot_pending {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:52.389222 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bf1f5b5-30ea-4781-a00b-adf1b117d3d5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action" status: 409 len: 167 microversion: 2.1 time: 0.252385 Oct 31 14:06:52.393088 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 577/976] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:06:52 2022] POST /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a/action => generated 167 bytes in 257 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:06:52.415725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:52.418329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:52.431513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.445435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.449046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.455886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.457037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.458146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.541342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-782c53a7-c9f9-4718-b751-f37de1034081 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 204 len: 0 microversion: 2.1 time: 0.346313 Oct 31 14:06:52.542562 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 400/977] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:52 2022] DELETE /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:06:52.564063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c901301c-03d9-4e54-8090-96752c25c49a req-f208123e-2628-409c-a1bd-77c8113eff2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45999f51-af1a-4ad7-bda9-28b183262640", "tag": "90a9817d-062b-427f-8499-cdc224521d8f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:52.582039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c901301c-03d9-4e54-8090-96752c25c49a req-f208123e-2628-409c-a1bd-77c8113eff2b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:52.582906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c901301c-03d9-4e54-8090-96752c25c49a req-f208123e-2628-409c-a1bd-77c8113eff2b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:52.587654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c901301c-03d9-4e54-8090-96752c25c49a req-f208123e-2628-409c-a1bd-77c8113eff2b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:52.698681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c901301c-03d9-4e54-8090-96752c25c49a req-f208123e-2628-409c-a1bd-77c8113eff2b service nova] Creating event network-changed:90a9817d-062b-427f-8499-cdc224521d8f for instance 45999f51-af1a-4ad7-bda9-28b183262640 on n-h2-863052-1 Oct 31 14:06:52.717616 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c901301c-03d9-4e54-8090-96752c25c49a req-f208123e-2628-409c-a1bd-77c8113eff2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163986 Oct 31 14:06:52.719287 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 401/978] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:52.733150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-266c791b-ce8c-421c-899c-b25ae4c109d3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '.version_select at 0x7fe107afc160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:53.095068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:53.107197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8229e54a-1612-44e7-9053-6fd2782846ef tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1482 microversion: 2.1 time: 0.705375 Oct 31 14:06:53.110084 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 578/979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:52 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1482 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:53.115735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:53.116604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:53.134696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.135583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.138936 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-266c791b-ce8c-421c-899c-b25ae4c109d3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/images/3f092cb4-1a0f-4110-9162-757689256859" status: 204 len: 0 microversion: 2.1 time: 0.412785 Oct 31 14:06:53.141201 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 402/980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:52 2022] DELETE /compute/v2.1/images/3f092cb4-1a0f-4110-9162-757689256859 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:06:53.142035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.147553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.147889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:53.148553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.148673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:53.149235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.170771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.171611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.173836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.175025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.178136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.178818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.429530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:53.443860 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f30a079a-a122-4083-acc0-ed813fb68f56 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.332087 Oct 31 14:06:53.445342 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 579/981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:53 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:53.454608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:53.462023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:53.490913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.491711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.492538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.493371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.493966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.494522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.951832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:53.961681 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0efdaf0-5739-45ad-ac50-1b0989173484 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.515054 Oct 31 14:06:53.966350 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 580/982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:53 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:53.972176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:53.972974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:53.984206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.985468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.986848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:53.987750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:53.988382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:53.989138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:54.167514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:54.186331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab85196f-87e7-48ae-a045-abf1d0eea9de tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1682 microversion: 2.1 time: 1.042922 Oct 31 14:06:54.187177 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 403/983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:53 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1682 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:54.210100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f04310f3-644c-4c7c-ab7e-67119126aacf req-e57946d5-67ef-4c2c-be09-1913c61fa01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffe82d2-dea9-4ed6-92b6-05bff851e8dc", "tag": "ee385a28-bfce-436b-97c5-f6a8b1851e5d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:54.225305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f04310f3-644c-4c7c-ab7e-67119126aacf req-e57946d5-67ef-4c2c-be09-1913c61fa01d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:54.226879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f04310f3-644c-4c7c-ab7e-67119126aacf req-e57946d5-67ef-4c2c-be09-1913c61fa01d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:54.227595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f04310f3-644c-4c7c-ab7e-67119126aacf req-e57946d5-67ef-4c2c-be09-1913c61fa01d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:54.244544 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f04310f3-644c-4c7c-ab7e-67119126aacf req-e57946d5-67ef-4c2c-be09-1913c61fa01d service nova] Creating event network-changed:ee385a28-bfce-436b-97c5-f6a8b1851e5d for instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc on n-h2-863052-1 Oct 31 14:06:54.253373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f04310f3-644c-4c7c-ab7e-67119126aacf req-e57946d5-67ef-4c2c-be09-1913c61fa01d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064545 Oct 31 14:06:54.255380 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 404/984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:54.472111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:54.472855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:54.480515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:54.481023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:54.481988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:54.482242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:54.482668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:54.483695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:54.781597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:54.796632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-724870c4-309c-4872-9942-23565c459f14 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1533 microversion: 2.1 time: 0.828821 Oct 31 14:06:54.810606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 581/985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:53 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1533 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:54.992932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:54.993734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:55.006289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:55.007013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:55.008090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:55.009318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:55.011321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:55.012254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:55.123315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:55.137536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50c80d7b-8d2d-45a5-befd-4ee4757dfb8c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.672230 Oct 31 14:06:55.139208 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 405/986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:54 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:55.210974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:55.211596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:55.227596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:55.228108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:55.228551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:55.229289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:55.229737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:55.230192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:55.351152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:55.366966 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44db586b-c55b-487b-9386-486ff686cac0 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.377936 Oct 31 14:06:55.367546 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 582/987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:54 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:55.824271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:55.825936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:55.833786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:55.834530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:55.836293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:55.837800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:55.838485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:55.839357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:56.008108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:56.018847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b76f0663-6b83-432a-b561-d0a113845a28 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1539 microversion: 2.1 time: 0.198462 Oct 31 14:06:56.019463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 583/988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:55 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:56.171835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:56.173552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:56.181324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:56.181815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:56.182281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:56.182977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:56.183448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:56.183868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:56.307316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:56.316986 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-017a80a6-c5b4-488f-bcbe-ab721dc946b2 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1682 microversion: 2.1 time: 1.109739 Oct 31 14:06:56.319878 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 406/989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:55 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1682 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:56.330983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-cf35cd07-a7e4-4f64-a973-645745df2d30 req-0b8058e3-1807-49c0-91d9-f2bbfacaa4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59", "tag": "1c433475-3e57-4152-accf-cd96071a28ac"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:56.345929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cf35cd07-a7e4-4f64-a973-645745df2d30 req-0b8058e3-1807-49c0-91d9-f2bbfacaa4f1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:56.346444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cf35cd07-a7e4-4f64-a973-645745df2d30 req-0b8058e3-1807-49c0-91d9-f2bbfacaa4f1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:56.346880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cf35cd07-a7e4-4f64-a973-645745df2d30 req-0b8058e3-1807-49c0-91d9-f2bbfacaa4f1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:56.359331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-cf35cd07-a7e4-4f64-a973-645745df2d30 req-0b8058e3-1807-49c0-91d9-f2bbfacaa4f1 service nova] Creating event network-changed:1c433475-3e57-4152-accf-cd96071a28ac for instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 on n-h2-863052-1 Oct 31 14:06:56.360578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:56.365677 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-cf35cd07-a7e4-4f64-a973-645745df2d30 req-0b8058e3-1807-49c0-91d9-f2bbfacaa4f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043994 Oct 31 14:06:56.366539 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 407/990] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:56.370457 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62e13cde-9d48-4193-b928-08b061283102 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.209131 Oct 31 14:06:56.371331 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 584/991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:56 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:06:56.395903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:56.399612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:56.412830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:56.413326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:56.413984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:56.414512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:56.414964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:56.416231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:56.442279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:56.822012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:56.831091 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ca3c6f0-8082-4d75-8ed6-4defb64df391 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.442565 Oct 31 14:06:56.831822 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 408/992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:56 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:57.044781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:57.050109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:57.052716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:57.061036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.061729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.062355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.063241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.063843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.064282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.253950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:57.289652 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a59b7e4-e5b0-4472-9353-c333ab98134e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1521 microversion: 2.1 time: 0.240944 Oct 31 14:06:57.290673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 585/993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:57 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:57.322102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:57.323978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:57.340311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:57.341142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:57.341503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.342196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.342831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.344654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.345521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.347117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.352737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.354413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.355065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.356825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.357516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.358145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.401269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:57.423392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:06:57.497907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:57.516096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-027662e1-8496-4ff3-a1c3-930192421688 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1615 microversion: 2.1 time: 0.179632 Oct 31 14:06:57.517587 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 586/994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:57 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1615 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:57.522424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:57.534833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:57.544423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.554472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.555026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.555667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.556321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.556747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.586478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a19ba2d-0074-4819-a54a-b7b0209931d6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 204 len: 0 microversion: 2.1 time: 0.270080 Oct 31 14:06:57.587513 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 409/995] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:06:57 2022] DELETE /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:06:57.607927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8f4f1be4-0eb4-499b-a099-7c9403c57b21 req-3687e02e-d5f9-4fd3-ae4f-a14bc317118a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f551d03b-c743-4270-a7d6-a8db15d6358a", "name": "network-vif-plugged", "status": "completed", "tag": "302d69bd-9717-4197-bcba-80a497e54192"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:57.659971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8f4f1be4-0eb4-499b-a099-7c9403c57b21 req-3687e02e-d5f9-4fd3-ae4f-a14bc317118a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.660746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8f4f1be4-0eb4-499b-a099-7c9403c57b21 req-3687e02e-d5f9-4fd3-ae4f-a14bc317118a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.661391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8f4f1be4-0eb4-499b-a099-7c9403c57b21 req-3687e02e-d5f9-4fd3-ae4f-a14bc317118a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.683286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8f4f1be4-0eb4-499b-a099-7c9403c57b21 req-3687e02e-d5f9-4fd3-ae4f-a14bc317118a service nova] Creating event network-vif-plugged:302d69bd-9717-4197-bcba-80a497e54192 for instance f551d03b-c743-4270-a7d6-a8db15d6358a on n-h1-863052-1 Oct 31 14:06:57.702693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8f4f1be4-0eb4-499b-a099-7c9403c57b21 req-3687e02e-d5f9-4fd3-ae4f-a14bc317118a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113241 Oct 31 14:06:57.703319 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 410/996] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:57.716711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:57.717978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:57.737808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.738406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.738849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.739574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.741001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.742433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.781712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:57.846820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:57.872162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a425fa07-4a27-4ece-847c-401f27659f99 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.352969 Oct 31 14:06:57.873437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 587/997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:57 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:57.879158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:57.880285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:57.887555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.888441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.889966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:57.890886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:57.891550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:57.892365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:58.131547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:58.144812 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be244392-4ac9-4a54-ade7-3bf56e6357b9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1527 microversion: 2.1 time: 0.437063 Oct 31 14:06:58.145430 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 411/998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:57 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1527 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:58.159450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:58.167766 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65a360fd-f574-4692-83aa-285e1baf6607 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.293283 Oct 31 14:06:58.168345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 588/999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:57 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:58.619038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-396978168", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "74d67dec-3e9a-4b4a-99cc-f50517507db2"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:58.706160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] validate_networks() for [('74d67dec-3e9a-4b4a-99cc-f50517507db2', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:06:58.754154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0afadc1b-854c-4aef-872a-b9395b2f48ee tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1063109172", "id": 915962583, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:58.790706 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0afadc1b-854c-4aef-872a-b9395b2f48ee tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.398283 Oct 31 14:06:58.791870 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 589/1000] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:58 2022] POST /compute/v2.1/flavors => generated 436 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:06:58.805232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:58.806217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:58.822634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:58.825173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:58.825765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:58.828556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:58.830455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:58.831254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:58.972753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:58.981325 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3885ed13-94f7-4b2e-b187-0f934b26797f tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1615 microversion: 2.1 time: 0.188109 Oct 31 14:06:58.981933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 590/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:58 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1615 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:59.004010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b94dddd8-cfc7-4619-9285-b05b211f222f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:59.123819 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b94dddd8-cfc7-4619-9285-b05b211f222f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/915962583/action" status: 200 len: 96 microversion: 2.1 time: 0.140769 Oct 31 14:06:59.125055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 591/1002] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:06:58 2022] POST /compute/v2.1/flavors/915962583/action => generated 96 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:06:59.130346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3771ee0c-6916-437e-8273-ae6f090ba84c req-01676202-00f2-4f5d-8c89-64c278a4c248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a58b508-0106-4617-80ee-1ea6ea5d07a9", "name": "network-vif-deleted", "tag": "a7bda1ae-3528-4f2d-8709-aed92aab902a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:59.140634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3771ee0c-6916-437e-8273-ae6f090ba84c req-01676202-00f2-4f5d-8c89-64c278a4c248 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.141611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3771ee0c-6916-437e-8273-ae6f090ba84c req-01676202-00f2-4f5d-8c89-64c278a4c248 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.142264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3771ee0c-6916-437e-8273-ae6f090ba84c req-01676202-00f2-4f5d-8c89-64c278a4c248 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:59.155716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3771ee0c-6916-437e-8273-ae6f090ba84c req-01676202-00f2-4f5d-8c89-64c278a4c248 service nova] Creating event network-vif-deleted:a7bda1ae-3528-4f2d-8709-aed92aab902a for instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 on n-h1-863052-1 Oct 31 14:06:59.165402 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3771ee0c-6916-437e-8273-ae6f090ba84c req-01676202-00f2-4f5d-8c89-64c278a4c248 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038332 Oct 31 14:06:59.167167 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 592/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:06:59.173059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:59.173963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:59.192842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.194159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.194880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:59.195943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.197076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.197860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:59.405164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:59.415773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d233eb7-3cfb-4fb5-88d4-4bd8ed8d576e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.247206 Oct 31 14:06:59.432143 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 593/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:59 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:59.446916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db7b3a2e-6abc-44f3-9f9a-f0dd4e373582 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:06:59.533223 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-db7b3a2e-6abc-44f3-9f9a-f0dd4e373582 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 7ff91a24875743b28ca0ebb3b52a80dd combination. Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db7b3a2e-6abc-44f3-9f9a-f0dd4e373582 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Request method failure captured: Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/flavors/915962583/action HTTP/1.1 Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 67 Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aBY206Ej6mJaICXiSOCCr7ijRNnZ_FJeDq0bNdusdasdJU3tKOV_na-H-nOFYYnJ-0e5fPKoUphr6l-BXoYIIpN3MWC2AvO2Hw-EO5Nk4K_2OB2n0BFycXjJUn8SkM4jYhNsS0g4euP4MkuRtcPWVfmicrcbRrfmPY60C_Vj8j_N4 Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 10b8ff71f27d44bfba3112522add3fca Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:06:59.537086 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b8ff71f27d44bfba3112522add3fca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 10b8ff71f27d44bfba3112522add3fca Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ae932dbeb768439e9a0806f28d50b8ce Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: {"addTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} Oct 31 14:06:59.538505 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor access already exists for flavor 35 and project 7ff91a24875743b28ca0ebb3b52a80dd combination. Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '915962583', 'body': {'addTenantAccess': {'tenant': '7ff91a24875743b28ca0ebb3b52a80dd'}}} Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result.read() Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:06:59.539316 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-7ff91a24875743b28ca0ebb3b52a80dd' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:06:59.540399 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:06:59.541564 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:06:59.544759 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result.read() Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-7ff91a24875743b28ca0ebb3b52a80dd' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 14, 6, 59, 526982), 'updated_at': None, 'flavor_id': 35, 'project_id': '7ff91a24875743b28ca0ebb3b52a80dd'}] Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:59.548059 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 7ff91a24875743b28ca0ebb3b52a80dd combination. Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:59.551416 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 7ff91a24875743b28ca0ebb3b52a80dd combination. Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:06:59.554795 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:06:59.559431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 7ff91a24875743b28ca0ebb3b52a80dd combination. Oct 31 14:06:59.559431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:06:59.559431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db7b3a2e-6abc-44f3-9f9a-f0dd4e373582 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 7ff91a24875743b28ca0ebb3b52a80dd combination. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:06:59.559431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db7b3a2e-6abc-44f3-9f9a-f0dd4e373582 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/915962583/action" status: 409 len: 152 microversion: 2.1 time: 0.123418 Oct 31 14:06:59.564578 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 594/1005] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:06:59 2022] POST /compute/v2.1/flavors/915962583/action => generated 152 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:06:59.572876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:59.574141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:59.583794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.584824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.585588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:59.586696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.587430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.588233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:59.816252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:06:59.825649 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d35966b2-de3f-4698-83a3-6c38604f8229 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1527 microversion: 2.1 time: 0.258276 Oct 31 14:06:59.826523 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 595/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:59 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1527 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:06:59.833400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:06:59.834402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:06:59.842916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.843643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.845073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:06:59.846215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:06:59.846817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:06:59.847605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.040504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:00.049052 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ecf78738-3507-4289-80ca-4c40c0c33dbd tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.220850 Oct 31 14:07:00.049786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 596/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:06:59 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:00.055592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22aec651-5c38-4c34-814b-e9d0cfeb125e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:00.075414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:00.076658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:00.077847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:00.079393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:00.080503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:00.095443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.096227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.096951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.098082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.098857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.099603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.124140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Getting quotas for project bc3a9fdc8f75484689226be682d36a8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:00.132661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Getting quotas for user b6fbd9e9348c4b6990940fa41c870407 and project bc3a9fdc8f75484689226be682d36a8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:00.151058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:00.154722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:00.157512 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22aec651-5c38-4c34-814b-e9d0cfeb125e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/915962583/action" status: 200 len: 21 microversion: 2.1 time: 0.106487 Oct 31 14:07:00.163026 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 597/1008] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:07:00 2022] POST /compute/v2.1/flavors/915962583/action => generated 21 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:07:00.166912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-83830117-de26-4a76-911b-b06565e66306 req-3f3f316a-3668-47d1-ba44-916350438166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f551d03b-c743-4270-a7d6-a8db15d6358a", "name": "network-vif-unplugged", "status": "completed", "tag": "302d69bd-9717-4197-bcba-80a497e54192"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:00.179582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-83830117-de26-4a76-911b-b06565e66306 req-3f3f316a-3668-47d1-ba44-916350438166 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.180378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-83830117-de26-4a76-911b-b06565e66306 req-3f3f316a-3668-47d1-ba44-916350438166 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.181444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-83830117-de26-4a76-911b-b06565e66306 req-3f3f316a-3668-47d1-ba44-916350438166 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.199087 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-83830117-de26-4a76-911b-b06565e66306 req-3f3f316a-3668-47d1-ba44-916350438166 service nova] Creating event network-vif-unplugged:302d69bd-9717-4197-bcba-80a497e54192 for instance f551d03b-c743-4270-a7d6-a8db15d6358a on n-h1-863052-1 Oct 31 14:07:00.218033 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-83830117-de26-4a76-911b-b06565e66306 req-3f3f316a-3668-47d1-ba44-916350438166 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057853 Oct 31 14:07:00.220511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 598/1009] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:00.222550 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0c19158-f012-4b23-a6e2-0070f9a8b140 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075542 Oct 31 14:07:00.223810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 412/1010] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:00.226866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.227743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:00.229862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c4d291a-8aba-4fb8-ad62-0c26b924101d tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.236368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.237437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.238463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.239390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.240093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.240705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.296772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c4d291a-8aba-4fb8-ad62-0c26b924101d tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/915962583" status: 202 len: 0 microversion: 2.1 time: 0.069400 Oct 31 14:07:00.299739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.300589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.302441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.303074 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 413/1011] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:07:00 2022] DELETE /compute/v2.1/flavors/915962583 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:00.303880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lazy-loading 'fault' on Instance uuid 7a58b508-0106-4617-80ee-1ea6ea5d07a9 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:00.311321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df40cdc8-6e3c-4dea-a3e8-785b81aa671b tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.312639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df40cdc8-6e3c-4dea-a3e8-785b81aa671b tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:00.389813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cf99f53e043d39794f8ecf0f739f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b521bd0aac94c2ea9702ae724953dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:00.411960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a23e530f-39fa-4e15-84e9-9e7e5c342620 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 200 len: 1332 microversion: 2.1 time: 0.190107 Oct 31 14:07:00.418309 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 599/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 1332 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:00.440532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df40cdc8-6e3c-4dea-a3e8-785b81aa671b tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:00.450898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66d05b57-5646-4e02-a5c7-71b2bc756e3b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.457632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df40cdc8-6e3c-4dea-a3e8-785b81aa671b tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1224 microversion: 2.1 time: 0.152628 Oct 31 14:07:00.462135 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 414/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:00.476181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.483131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:00.499360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.500239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.501599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.502647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.503605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.505040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.507726 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66d05b57-5646-4e02-a5c7-71b2bc756e3b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074495 Oct 31 14:07:00.510034 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 600/1014] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:00.536460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e116f59-981c-4b68-ad61-a2458abf8711 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-171241475", "id": 1562791862, "os-flavor-access:is_public": "True"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:00.576962 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e116f59-981c-4b68-ad61-a2458abf8711 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.046011 Oct 31 14:07:00.581099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 601/1015] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:00 2022] POST /compute/v2.1/flavors => generated 437 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:00.595371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5672592a-7afc-49fa-a216-03a57963372b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.603837 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5672592a-7afc-49fa-a216-03a57963372b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5672592a-7afc-49fa-a216-03a57963372b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Request method failure captured: Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/flavors/1562791862/os-flavor-access HTTP/1.1 Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aBY206Ej6mJaICXiSOCCr7ijRNnZ_FJeDq0bNdusdasdJU3tKOV_na-H-nOFYYnJ-0e5fPKoUphr6l-BXoYIIpN3MWC2AvO2Hw-EO5Nk4K_2OB2n0BFycXjJUn8SkM4jYhNsS0g4euP4MkuRtcPWVfmicrcbRrfmPY60C_Vj8j_N4 Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 10b8ff71f27d44bfba3112522add3fca Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:07:00.605883 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b8ff71f27d44bfba3112522add3fca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 10b8ff71f27d44bfba3112522add3fca Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ae932dbeb768439e9a0806f28d50b8ce Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: exception: Access list not available for public flavors. Oct 31 14:07:00.607624 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'flavor_id': '1562791862'} Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 31 14:07:00.608754 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:00.611231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5672592a-7afc-49fa-a216-03a57963372b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:00.611549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5672592a-7afc-49fa-a216-03a57963372b tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1562791862/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.018885 Oct 31 14:07:00.612696 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 602/1016] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/flavors/1562791862/os-flavor-access => generated 91 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:07:00.622331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-788eb2b1-bb9e-4507-a811-cfc46b1a7aac tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.630407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:00.654498 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-788eb2b1-bb9e-4507-a811-cfc46b1a7aac tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1562791862" status: 202 len: 0 microversion: 2.1 time: 0.036978 Oct 31 14:07:00.665784 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 603/1017] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:07:00 2022] DELETE /compute/v2.1/flavors/1562791862 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:00.681999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af799cda-cf58-4e4e-b766-b60e342a4161 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.721488 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af799cda-cf58-4e4e-b766-b60e342a4161 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054348 Oct 31 14:07:00.726983 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 604/1018] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:00.752343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-682b4dff-16d9-4acc-997b-d20bd1564944 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-315552807", "id": 23977069, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:00.776752 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-682b4dff-16d9-4acc-997b-d20bd1564944 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.033072 Oct 31 14:07:00.777780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 605/1019] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:00 2022] POST /compute/v2.1/flavors => generated 432 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:00.897330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:00.906323 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2cdde96-874d-49c2-9e3c-e8f18b8974a2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1503 microversion: 2.1 time: 0.442389 Oct 31 14:07:00.910534 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 415/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:00.917915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:00.920971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:00.935208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.937856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.939051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:00.939943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:00.940567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:00.943836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.002193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06768789-9d4b-45db-9e17-5ff7581745ac tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:01.005623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06768789-9d4b-45db-9e17-5ff7581745ac tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '75298cf16f2e4abb91ca8dd27145e663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff91a24875743b28ca0ebb3b52a80dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06768789-9d4b-45db-9e17-5ff7581745ac tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Request method failure captured: Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/flavors/23977069/action HTTP/1.1 Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 67 Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aAf-6A_rAuhnTLRdvWg3OvC_NMNtQbEUqUoMCqD5EMjSgceSinTHWbreE_3neffQbM6NSCUcPek8s5vTActGgMxVMiFdZZlJ7vVX1yFzOTBqp6zrNRbiMQZqEW81Ioxzrl0YVZSEfPfvaqlbYV73RdhNObCfy_Pgm-RVT7j-0wapE Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7ff91a24875743b28ca0ebb3b52a80dd Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-429098562 Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:01.016079 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ff91a24875743b28ca0ebb3b52a80dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ff91a24875743b28ca0ebb3b52a80dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ff91a24875743b28ca0ebb3b52a80dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ff91a24875743b28ca0ebb3b52a80dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-429098562 Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7ff91a24875743b28ca0ebb3b52a80dd Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-429098562 Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsAccessNegativeTestJSON-429098562-project Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 75298cf16f2e4abb91ca8dd27145e663 Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-429098562-project Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: {"addTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} Oct 31 14:07:01.018388 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '23977069', 'body': {'addTenantAccess': {'tenant': '7ff91a24875743b28ca0ebb3b52a80dd'}}} Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:07:01.020359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 14:07:01.021593 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.025788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06768789-9d4b-45db-9e17-5ff7581745ac tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:01.025788 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06768789-9d4b-45db-9e17-5ff7581745ac tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] 10.222.0.27 "POST /compute/v2.1/flavors/23977069/action" status: 403 len: 130 microversion: 2.1 time: 0.226258 Oct 31 14:07:01.025788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 606/1021] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:07:00 2022] POST /compute/v2.1/flavors/23977069/action => generated 130 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:01.031422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff287ffa-7fdc-4688-b39b-4a5badf2c65f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.062561 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff287ffa-7fdc-4688-b39b-4a5badf2c65f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/23977069" status: 202 len: 0 microversion: 2.1 time: 0.032072 Oct 31 14:07:01.063772 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 607/1022] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:07:01 2022] DELETE /compute/v2.1/flavors/23977069 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:01.072569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9931ded9-89e7-4555-8cb8-daa59968d212 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.101675 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9931ded9-89e7-4555-8cb8-daa59968d212 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032901 Oct 31 14:07:01.110306 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 608/1023] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:01.120635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.121356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:01.131001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.131934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.132594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.133719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.134304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.134798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.324155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:01.336537 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34d21647-060b-492b-96f9-0373c4f52a4c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1527 microversion: 2.1 time: 0.424708 Oct 31 14:07:01.342437 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 416/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:00 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1527 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:01.347707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-932250e2-9e5b-4084-9acb-fa77c12525cd tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1901831839", "id": 788392973, "os-flavor-access:is_public": "False"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:01.393852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-932250e2-9e5b-4084-9acb-fa77c12525cd tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.050252 Oct 31 14:07:01.395222 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 417/1025] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:01.407768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a5a86c8f-162d-4b45-9cdf-ee4154b49ebb req-a1964c0a-753b-4dd6-9da5-f8ea98f40494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f551d03b-c743-4270-a7d6-a8db15d6358a", "name": "network-vif-deleted", "tag": "302d69bd-9717-4197-bcba-80a497e54192"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:01.417048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:01.422954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a5a86c8f-162d-4b45-9cdf-ee4154b49ebb req-a1964c0a-753b-4dd6-9da5-f8ea98f40494 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.425578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a5a86c8f-162d-4b45-9cdf-ee4154b49ebb req-a1964c0a-753b-4dd6-9da5-f8ea98f40494 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.426117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a5a86c8f-162d-4b45-9cdf-ee4154b49ebb req-a1964c0a-753b-4dd6-9da5-f8ea98f40494 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.433112 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35abd3d6-1c20-401b-8de4-8ba62d80e262 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.320242 Oct 31 14:07:01.447300 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a5a86c8f-162d-4b45-9cdf-ee4154b49ebb req-a1964c0a-753b-4dd6-9da5-f8ea98f40494 service nova] Creating event network-vif-deleted:302d69bd-9717-4197-bcba-80a497e54192 for instance f551d03b-c743-4270-a7d6-a8db15d6358a on n-h1-863052-1 Oct 31 14:07:01.451496 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 609/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:01 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:01.462215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1cef921-ae8b-4eb6-890f-a48693862d9c tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:01.464384 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a5a86c8f-162d-4b45-9cdf-ee4154b49ebb req-a1964c0a-753b-4dd6-9da5-f8ea98f40494 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067693 Oct 31 14:07:01.465002 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 418/1027] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:01.484433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.485151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] [instance: 7a58b508-0106-4617-80ee-1ea6ea5d07a9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:01.502061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.507124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.507761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.508603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.509083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.509507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.546132 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] HTTP exception thrown: Instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 could not be found. Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Request method failure captured: Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 HTTP/1.1 Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Xf4kFmSR_1ThVfZCT9FGagiBytpaLyLVGdPfizbRMiNL19QXNswt1RJmw9e2CDa9F0Y_db4J4t3TU9_BJweziGhyMne9J4F4T17cMY5al8byoifLACgi2GPquXAL7YdYtUxK-8HFKem8ziQuP7GuRiSz0WB4aqJ3w7Mc0FYsSoK5A Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 3b521bd0aac94c2ea9702ae724953dbf Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesAdminNegativeTest-1433141442 Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:07:01.550501 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b521bd0aac94c2ea9702ae724953dbf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b521bd0aac94c2ea9702ae724953dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b521bd0aac94c2ea9702ae724953dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b521bd0aac94c2ea9702ae724953dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesAdminNegativeTest-1433141442 Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 3b521bd0aac94c2ea9702ae724953dbf Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1433141442 Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesAdminNegativeTest-1433141442-project Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 525cf99f53e043d39794f8ecf0f739f0 Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesAdminNegativeTest-1433141442-project Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 could not be found. Oct 31 14:07:01.552230 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7a58b508-0106-4617-80ee-1ea6ea5d07a9'} Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 could not be found. Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:01.552983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 could not be found. Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 could not be found. Oct 31 14:07:01.554285 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.560148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Returning 404 to user: Instance 7a58b508-0106-4617-80ee-1ea6ea5d07a9 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:01.561911 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17df944c-086f-4275-b046-7f35df9d3caf tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9" status: 404 len: 111 microversion: 2.1 time: 0.092618 Oct 31 14:07:01.563753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 419/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:01 2022] GET /compute/v2.1/servers/7a58b508-0106-4617-80ee-1ea6ea5d07a9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:01.572758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.574294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:01.583924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.584422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.585039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.585686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.586157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.586725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.624533 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1cef921-ae8b-4eb6-890f-a48693862d9c tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/788392973/action" status: 200 len: 96 microversion: 2.1 time: 0.171576 Oct 31 14:07:01.631511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 610/1029] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:07:01 2022] POST /compute/v2.1/flavors/788392973/action => generated 96 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:07:01.643289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1efcaa0b-e512-4dd9-95b8-907ebcf1b744 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] Calling method '.version_select at 0x7fe1077cd3a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.691403 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1efcaa0b-e512-4dd9-95b8-907ebcf1b744 tempest-VolumesAdminNegativeTest-1433141442 tempest-VolumesAdminNegativeTest-1433141442-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340831913" status: 202 len: 0 microversion: 2.1 time: 0.064022 Oct 31 14:07:01.692657 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 611/1030] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:07:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340831913 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:01.698269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8bee533a-c161-4d89-9778-031a12701c17 tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:01.711518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8bee533a-c161-4d89-9778-031a12701c17 tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '75298cf16f2e4abb91ca8dd27145e663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff91a24875743b28ca0ebb3b52a80dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8bee533a-c161-4d89-9778-031a12701c17 tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Request method failure captured: Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/flavors/788392973/action HTTP/1.1 Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 70 Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aAf-6A_rAuhnTLRdvWg3OvC_NMNtQbEUqUoMCqD5EMjSgceSinTHWbreE_3neffQbM6NSCUcPek8s5vTActGgMxVMiFdZZlJ7vVX1yFzOTBqp6zrNRbiMQZqEW81Ioxzrl0YVZSEfPfvaqlbYV73RdhNObCfy_Pgm-RVT7j-0wapE Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7ff91a24875743b28ca0ebb3b52a80dd Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-429098562 Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:01.713707 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ff91a24875743b28ca0ebb3b52a80dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ff91a24875743b28ca0ebb3b52a80dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ff91a24875743b28ca0ebb3b52a80dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ff91a24875743b28ca0ebb3b52a80dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-429098562 Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7ff91a24875743b28ca0ebb3b52a80dd Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-429098562 Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsAccessNegativeTestJSON-429098562-project Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 75298cf16f2e4abb91ca8dd27145e663 Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-429098562-project Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: {"removeTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} Oct 31 14:07:01.715281 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '788392973', 'body': {'removeTenantAccess': {'tenant': '7ff91a24875743b28ca0ebb3b52a80dd'}}} Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can( Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:07:01.716100 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 14:07:01.717592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:01.723529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8bee533a-c161-4d89-9778-031a12701c17 tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:01.724768 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8bee533a-c161-4d89-9778-031a12701c17 tempest-FlavorsAccessNegativeTestJSON-429098562 tempest-FlavorsAccessNegativeTestJSON-429098562-project] 10.222.0.27 "POST /compute/v2.1/flavors/788392973/action" status: 403 len: 133 microversion: 2.1 time: 0.030839 Oct 31 14:07:01.726512 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 612/1031] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:07:01 2022] POST /compute/v2.1/flavors/788392973/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:01.735981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29904dea-9495-4be4-bc49-e7851b769b6f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7ff91a24875743b28ca0ebb3b52a80dd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:01.774630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:01.785739 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e10c8d36-5a21-4d6b-9ad0-be95c66bdb3a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1276 microversion: 2.1 time: 0.220614 Oct 31 14:07:01.787527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 420/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:01 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:01.856732 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29904dea-9495-4be4-bc49-e7851b769b6f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/788392973/action" status: 200 len: 21 microversion: 2.1 time: 0.126302 Oct 31 14:07:01.857769 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 613/1033] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:07:01 2022] POST /compute/v2.1/flavors/788392973/action => generated 21 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:07:01.869515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9afb60d-60b5-44e5-b7ce-e2fc8b006653 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.897262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9afb60d-60b5-44e5-b7ce-e2fc8b006653 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/788392973" status: 202 len: 0 microversion: 2.1 time: 0.032097 Oct 31 14:07:01.897855 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 421/1034] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:07:01 2022] DELETE /compute/v2.1/flavors/788392973 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:01.906499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa0f7a4c-c3e4-4b37-94af-b7f44c594d2a tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.937142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:01.939350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:01.953470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.954302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.955290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.961173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:01.961883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:01.963015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:01.978130 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa0f7a4c-c3e4-4b37-94af-b7f44c594d2a tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075525 Oct 31 14:07:01.983580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 614/1035] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:02.006694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32382349-2da1-4e05-8aca-77d4f15ee70f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1358413811", "id": 412684127, "os-flavor-access:is_public": "False"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:02.049019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32382349-2da1-4e05-8aca-77d4f15ee70f tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.045285 Oct 31 14:07:02.059172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 615/1036] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:02 2022] POST /compute/v2.1/flavors => generated 436 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:02.066578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59b7befc-c1c2-49ae-8921-9f858cd7a38e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "18c1201e98054992ac760b02df421812"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:02.186906 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-59b7befc-c1c2-49ae-8921-9f858cd7a38e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] HTTP exception thrown: Flavor access not found for 39 / 18c1201e98054992ac760b02df421812 combination. Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59b7befc-c1c2-49ae-8921-9f858cd7a38e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Request method failure captured: Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/flavors/412684127/action HTTP/1.1 Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 70 Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aBY206Ej6mJaICXiSOCCr7ijRNnZ_FJeDq0bNdusdasdJU3tKOV_na-H-nOFYYnJ-0e5fPKoUphr6l-BXoYIIpN3MWC2AvO2Hw-EO5Nk4K_2OB2n0BFycXjJUn8SkM4jYhNsS0g4euP4MkuRtcPWVfmicrcbRrfmPY60C_Vj8j_N4 Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 10b8ff71f27d44bfba3112522add3fca Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:07:02.189130 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b8ff71f27d44bfba3112522add3fca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b8ff71f27d44bfba3112522add3fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 10b8ff71f27d44bfba3112522add3fca Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-666771747 Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ae932dbeb768439e9a0806f28d50b8ce Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: {"removeTenantAccess": {"tenant": "18c1201e98054992ac760b02df421812"}} Oct 31 14:07:02.190616 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor access not found for 39 / 18c1201e98054992ac760b02df421812 combination. Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '412684127', 'body': {'removeTenantAccess': {'tenant': '18c1201e98054992ac760b02df421812'}}} Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 31 14:07:02.191369 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 18c1201e98054992ac760b02df421812 combination. Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 18c1201e98054992ac760b02df421812 combination. Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:02.192718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:02.194055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:02.194055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:02.194055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:02.194055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:02.194055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 18c1201e98054992ac760b02df421812 combination. Oct 31 14:07:02.194055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:02.195520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59b7befc-c1c2-49ae-8921-9f858cd7a38e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Returning 404 to user: Flavor access not found for 39 / 18c1201e98054992ac760b02df421812 combination. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:02.196385 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59b7befc-c1c2-49ae-8921-9f858cd7a38e tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/412684127/action" status: 404 len: 124 microversion: 2.1 time: 0.136173 Oct 31 14:07:02.197136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 616/1037] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 31 14:07:02 2022] POST /compute/v2.1/flavors/412684127/action => generated 124 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:02.212849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-147e4716-49e1-47e0-9758-0d06a295c29a tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.238332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-147e4716-49e1-47e0-9758-0d06a295c29a tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/412684127" status: 202 len: 0 microversion: 2.1 time: 0.035128 Oct 31 14:07:02.238926 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 617/1038] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:07:02 2022] DELETE /compute/v2.1/flavors/412684127 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:02.247638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5b8ff6f-6e40-468a-96cf-a8e0c1522075 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.268313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5b8ff6f-6e40-468a-96cf-a8e0c1522075 tempest-FlavorsAccessNegativeTestJSON-666771747 tempest-FlavorsAccessNegativeTestJSON-666771747-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024501 Oct 31 14:07:02.269124 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 618/1039] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:02.273882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-89e472a8-e4d9-46ca-a658-2a4f2c1c209f req-3ff2564f-6656-43f6-bf80-59b66aad007f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59", "name": "network-vif-plugged", "status": "completed", "tag": "1c433475-3e57-4152-accf-cd96071a28ac"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:02.300581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-89e472a8-e4d9-46ca-a658-2a4f2c1c209f req-3ff2564f-6656-43f6-bf80-59b66aad007f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.305291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-89e472a8-e4d9-46ca-a658-2a4f2c1c209f req-3ff2564f-6656-43f6-bf80-59b66aad007f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.306029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-89e472a8-e4d9-46ca-a658-2a4f2c1c209f req-3ff2564f-6656-43f6-bf80-59b66aad007f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.320459 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-89e472a8-e4d9-46ca-a658-2a4f2c1c209f req-3ff2564f-6656-43f6-bf80-59b66aad007f service nova] Creating event network-vif-plugged:1c433475-3e57-4152-accf-cd96071a28ac for instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 on n-h2-863052-1 Oct 31 14:07:02.331674 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-89e472a8-e4d9-46ca-a658-2a4f2c1c209f req-3ff2564f-6656-43f6-bf80-59b66aad007f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061090 Oct 31 14:07:02.332279 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 619/1040] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:02.365219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.365917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:02.381033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.381539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.381980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.382715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.383173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.383598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.409186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:02.432977 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f816c47f-a2d2-4365-859d-d9612c63a240 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1478 microversion: 2.1 time: 0.489204 Oct 31 14:07:02.433663 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 422/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:01 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1478 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:02.461562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.462438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:02.476787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.477325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.477733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.478217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lazy-loading 'fault' on Instance uuid f551d03b-c743-4270-a7d6-a8db15d6358a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:02.482333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.484405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.484938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.490251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.490820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.491291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.608320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:02.618774 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f300e51a-ca34-4394-aeb0-f3940f8febd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 200 len: 1314 microversion: 2.1 time: 0.257760 Oct 31 14:07:02.619360 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 620/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:02 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:02.638958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0dd79be9-ed7b-427e-a539-5375ac64d228 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '.version_select at 0x7fe1078bf160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.643131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dd79be9-ed7b-427e-a539-5375ac64d228 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.643619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dd79be9-ed7b-427e-a539-5375ac64d228 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.644046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dd79be9-ed7b-427e-a539-5375ac64d228 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.660810 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0dd79be9-ed7b-427e-a539-5375ac64d228 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.035062 Oct 31 14:07:02.667751 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 621/1043] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:07:02 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:02.682953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.683888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:02.693606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.694366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.694965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.695834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:02.696448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:02.697058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:02.977522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:02.986780 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2af1ddd1-fb36-4207-8eb9-fdc6e33204df tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1322 microversion: 2.1 time: 0.531273 Oct 31 14:07:02.987972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 423/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:02 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:02.993025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:02.993636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:03.002095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:03.002849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:03.003438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:03.004290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:03.004913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:03.005341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:03.048163 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bac3b6b6-92a8-41ce-80ea-ee1bb302f740 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1629 microversion: 2.1 time: 0.369057 Oct 31 14:07:03.049122 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 622/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:02 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1629 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:03.081352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a46233fa-62f5-495f-838b-19862841ff03 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Action: 'create', calling method: .version_select at 0x7fe107871550>, body: {"keypair": {"name": "tempest-keypair-955721238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnzE7NmCTRQGfitIoRqzN/k5coRzynZDzayy4vThAwCsc3q3TF5uTpE8x4YQwB4y7sJoOXnRPay2fcql708ou3aDbHrg7S6hUxAOoK1VivKMmIqaTxv2W2UqIDeRSgs4w=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:03.099359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a46233fa-62f5-495f-838b-19862841ff03 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:03.105280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a46233fa-62f5-495f-838b-19862841ff03 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for user 3589cce53cf8492a9a2e05c73f373319 and project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:03.106240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:03.117905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-baa96828-7725-4e83-a0d5-499156da0365 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1282 microversion: 2.1 time: 0.128418 Oct 31 14:07:03.134196 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 424/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:02 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:03.146317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a46233fa-62f5-495f-838b-19862841ff03 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069636 Oct 31 14:07:03.146932 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 623/1047] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:07:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:03.643659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:03.644166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:03.651273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:03.651859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:03.652376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:03.653351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:03.653697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:03.654384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:03.672287 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a HTTP/1.1 Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:07:03.674285 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:07:03.675983 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a'} Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:03.676801 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:07:03.678044 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:03.679157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:03.679157 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0b53438-5119-4c21-a5bf-925ae7207b2b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 404 len: 111 microversion: 2.1 time: 0.036755 Oct 31 14:07:03.679157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 425/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:03 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:03.688900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1778e6cc-658a-4218-bf5d-f64bb560a68e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'create', calling method: .version_select at 0x7fe107800040>, body: {"keypair": {"name": "tempest-keypair-1594381695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATTm59cVYG4rdnJPZtotsWIEbIo0Le8H36QFGwaplsCRbOMZa/hvjde+5mkfsRLO2yTs1PiKOW8c8MOgtmoDtAeRMXNpajHOA2VbLHvgz47A3onK+2BQoUjI+D8PTortA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:03.711963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1778e6cc-658a-4218-bf5d-f64bb560a68e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for project 1430823979f84df092a344321a69fce5. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:03.717851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1778e6cc-658a-4218-bf5d-f64bb560a68e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for user 447b90ed71f148b79158ff5db202f274 and project 1430823979f84df092a344321a69fce5. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:03.772764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1778e6cc-658a-4218-bf5d-f64bb560a68e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088368 Oct 31 14:07:03.783079 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 624/1049] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:07:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:04.013832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:04.014687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:04.019970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:04.025641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.026581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.027046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.028834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.029649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.030156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.143560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:04.144276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:04.156177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.157366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.158087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.160300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.161691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.164767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.372783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:04.384203 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d5044f8-750e-4e4d-b604-f06fddbb0ad4 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1472 microversion: 2.1 time: 0.375623 Oct 31 14:07:04.385221 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 426/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:04 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:04.410130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:04.410987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:04.417621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.418463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.419099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.419997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.420640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.421919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.455120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lazy-loading 'flavor' on Instance uuid e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:04.493446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:04.506636 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-614a066b-a939-4953-8e13-8ce448ee1bfd tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.364814 Oct 31 14:07:04.519498 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 625/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:04 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:04.557113 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c7408e9-9699-421a-a0c3-b20ea7af42b5 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59/action" status: 202 len: 0 microversion: 2.1 time: 0.150281 Oct 31 14:07:04.558525 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 427/1052] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:07:04 2022] POST /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:07:04.568032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:04.568824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:04.586080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.586490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.586932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:04.587782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:04.588263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:04.588668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:05.292799 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-540bb5b1-ae2d-4125-be51-8cc3955ecdc4 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1631 microversion: 2.1 time: 0.729573 Oct 31 14:07:05.305455 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 626/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:04 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1631 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:05.531690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:05.532417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:05.546985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:05.547533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:05.547973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:05.548685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:05.549330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:05.551559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:05.908614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f7d0b60d-448b-4039-ba20-330d72e66d0c req-cc005804-8d20-4315-8b64-363c9e499b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b40a30-5bc9-4096-8111-8ba75ca2d278", "tag": "f1555281-9e5c-4096-a8cf-b2df76d26cfa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:05.930841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f7d0b60d-448b-4039-ba20-330d72e66d0c req-cc005804-8d20-4315-8b64-363c9e499b03 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:05.931613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f7d0b60d-448b-4039-ba20-330d72e66d0c req-cc005804-8d20-4315-8b64-363c9e499b03 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:05.932216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f7d0b60d-448b-4039-ba20-330d72e66d0c req-cc005804-8d20-4315-8b64-363c9e499b03 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:05.951171 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f7d0b60d-448b-4039-ba20-330d72e66d0c req-cc005804-8d20-4315-8b64-363c9e499b03 service nova] Creating event network-changed:f1555281-9e5c-4096-a8cf-b2df76d26cfa for instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 on n-h2-863052-1 Oct 31 14:07:05.956722 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f7d0b60d-448b-4039-ba20-330d72e66d0c req-cc005804-8d20-4315-8b64-363c9e499b03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051862 Oct 31 14:07:05.957820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 627/1054] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:06.112457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:06.128459 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c94bdb9c-9428-482b-8101-71489d610a62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.600957 Oct 31 14:07:06.147947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 428/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:05 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:06.320138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:06.321882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:06.342250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:06.343053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:06.344918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:06.345688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:06.346155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:06.347321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:06.787843 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30358370-0306-4012-9f15-ec87244fd974 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1614 microversion: 2.1 time: 0.474170 Oct 31 14:07:06.803203 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 628/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:06 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1614 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:06.813429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:06.814685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:06.847044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:06.850350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:06.850917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:06.853608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:06.854257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:06.854757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:06.950926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:06.974418 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] HTTP exception thrown: Cannot 'migrate' instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 while it is in vm_state suspended Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Request method failure captured: Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59/action HTTP/1.1 Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 15 Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZfuIFaxe5vX2nttq5ISKubcFwpkO0mFGp1eJPlKlR9VHZNrAQXurh09M562PPp_ADCaKN_j-Jxjajf2gLbXm1hyd7X4DgARtnlkTVY7LBTK454P-HWfUvFrLEiF-DZ_XX50Hfos9q8y6yjuncoO19WsLazLRU4NAL4wUR0oYsyqSg Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:07:06.976494 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9bae9404a5944749219fd3e560f3ed9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 6244771b328a4f27a497e242f9252d19 Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: {"migrate": {}} Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:06.978128 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'migrate' instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 while it is in vm_state suspended Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59', 'body': {'migrate': {}}} Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 in vm_state suspended. Cannot resize while the instance is in this state. Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:06.979066 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 while it is in vm_state suspended Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:06.981651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 while it is in vm_state suspended Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Returning 409 to user: Cannot 'migrate' instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 while it is in vm_state suspended {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65185afe-cb46-4fc0-9ef3-72d1b96c4513 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59/action" status: 409 len: 148 microversion: 2.1 time: 0.169576 Oct 31 14:07:06.984509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 429/1057] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:07:06 2022] POST /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59/action => generated 148 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:07:06.994759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e424650-c8ae-404d-b19d-c4c1c6d0a755 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e424650-c8ae-404d-b19d-c4c1c6d0a755 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Request method failure captured: Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3/action HTTP/1.1 Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 39 Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ZfuIFaxe5vX2nttq5ISKubcFwpkO0mFGp1eJPlKlR9VHZNrAQXurh09M562PPp_ADCaKN_j-Jxjajf2gLbXm1hyd7X4DgARtnlkTVY7LBTK454P-HWfUvFrLEiF-DZ_XX50Hfos9q8y6yjuncoO19WsLazLRU4NAL4wUR0oYsyqSg Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:07:07.002202 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9bae9404a5944749219fd3e560f3ed9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 6244771b328a4f27a497e242f9252d19 Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: {"os-resetState": {"state": "invalid"}} Oct 31 14:07:07.003614 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'da372ca0-0c70-473c-8c7e-16033f8ad2c3', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:07.004352 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:07:07.005677 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 14:07:07.007019 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.009358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e424650-c8ae-404d-b19d-c4c1c6d0a755 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:07.010592 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e424650-c8ae-404d-b19d-c4c1c6d0a755 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3/action" status: 400 len: 144 microversion: 2.1 time: 0.020270 Oct 31 14:07:07.012023 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 629/1058] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:07:06 2022] POST /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3/action => generated 144 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:07:07.024090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d798c086-41af-4865-ab57-db6315893a76 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d798c086-41af-4865-ab57-db6315893a76 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Request method failure captured: Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3/action HTTP/1.1 Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 31 Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ZfuIFaxe5vX2nttq5ISKubcFwpkO0mFGp1eJPlKlR9VHZNrAQXurh09M562PPp_ADCaKN_j-Jxjajf2gLbXm1hyd7X4DgARtnlkTVY7LBTK454P-HWfUvFrLEiF-DZ_XX50Hfos9q8y6yjuncoO19WsLazLRU4NAL4wUR0oYsyqSg Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:07:07.027981 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9bae9404a5944749219fd3e560f3ed9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 6244771b328a4f27a497e242f9252d19 Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: {"os-resetState": {"state": 1}} Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:07.029509 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'da372ca0-0c70-473c-8c7e-16033f8ad2c3', 'body': {'os-resetState': {'state': 1}}} Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 1 Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:07.039875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 14:07:07.041269 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.044410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d798c086-41af-4865-ab57-db6315893a76 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:07.044410 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d798c086-41af-4865-ab57-db6315893a76 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3/action" status: 400 len: 120 microversion: 2.1 time: 0.009256 Oct 31 14:07:07.044410 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 430/1059] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:07:07 2022] POST /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:07:07.046245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92c21643-4401-4ad9-9193-fe799078e954 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:07.048809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92c21643-4401-4ad9-9193-fe799078e954 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Failed to fetch instance by id 999 {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:07:07.049319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-92c21643-4401-4ad9-9193-fe799078e954 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92c21643-4401-4ad9-9193-fe799078e954 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Request method failure captured: Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 37 Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ZfuIFaxe5vX2nttq5ISKubcFwpkO0mFGp1eJPlKlR9VHZNrAQXurh09M562PPp_ADCaKN_j-Jxjajf2gLbXm1hyd7X4DgARtnlkTVY7LBTK454P-HWfUvFrLEiF-DZ_XX50Hfos9q8y6yjuncoO19WsLazLRU4NAL4wUR0oYsyqSg Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:07:07.051900 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9bae9404a5944749219fd3e560f3ed9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9bae9404a5944749219fd3e560f3ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c9bae9404a5944749219fd3e560f3ed9 Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28681925 Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 6244771b328a4f27a497e242f9252d19 Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28681925-project-admin Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: {"os-resetState": {"state": "error"}} Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:07.053375 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 999 could not be found. Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:07:07.059605 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92c21643-4401-4ad9-9193-fe799078e954 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:07.062385 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92c21643-4401-4ad9-9193-fe799078e954 tempest-ServersAdminNegativeTestJSON-28681925 tempest-ServersAdminNegativeTestJSON-28681925-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.013912 Oct 31 14:07:07.065655 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 630/1060] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Oct 31 14:07:07 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:07:07.065827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:07.066338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:07.074265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:07.074265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:07.074885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:07.075718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:07.076601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:07.077497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:07.113465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:07:07.151842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:07.152460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:07.155846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:07.159806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:07.169936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:07.170824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:07.171806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:07.172657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:07.173282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:07.301677 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a242bc3-c3ca-49c3-a812-caaa1e9e3b00 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 204 len: 0 microversion: 2.1 time: 0.241165 Oct 31 14:07:07.302920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 431/1061] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:07:07 2022] DELETE /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:07.316602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:07.318955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:07.341230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:07.342031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:07.345579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:07.346455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:07.347225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:07.348572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:07.490306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:07.496019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:07.505820 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca24c3cc-4178-40b6-97f9-b3f9fc59ee70 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.358032 Oct 31 14:07:07.506983 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 631/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:07 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:07.555769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-724961600", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "da8a9929-0ff3-4206-a14a-e0d235fbfab9"}], "security_groups": [{"name": "tempest-securitygroup--927240954"}], "key_name": "tempest-keypair-955721238", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:07.706934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] validate_networks() for [('da8a9929-0ff3-4206-a14a-e0d235fbfab9', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:08.046430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:08.062149 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1fee9a9-3779-4965-98b1-0513eeb729a1 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1469 microversion: 2.1 time: 0.754884 Oct 31 14:07:08.063291 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 432/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:07 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1469 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:08.331254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1907164374", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:08.334538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:08.342782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:08.344956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:08.349719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:08.350493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:08.364085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:08.369261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:08.370236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:08.371072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:08.373463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:08.373946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:08.411235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:08.416412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] validate_networks() for [('c215db42-8564-459b-9f3c-e55acebc1201', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:08.419420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for user 3589cce53cf8492a9a2e05c73f373319 and project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:08.450892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:08.454276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:08.526869 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94c1f85e-b8f4-411a-966c-4cb09876928c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974501 Oct 31 14:07:08.527807 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 632/1064] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:08.532765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:08.533503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:08.540960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:08.541494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:08.542473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:08.544298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:08.545086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:08.546129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:08.719039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:08.726847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-689af408-315e-44c9-9cfb-954bc09daf62 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.198011 Oct 31 14:07:08.728921 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 633/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:08 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:08.748939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-976ae529-8548-4ad9-93cc-b2c4cdcb9eed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:08.749690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-976ae529-8548-4ad9-93cc-b2c4cdcb9eed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:08.871086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-976ae529-8548-4ad9-93cc-b2c4cdcb9eed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:08.891021 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-976ae529-8548-4ad9-93cc-b2c4cdcb9eed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1233 microversion: 2.1 time: 0.160584 Oct 31 14:07:08.891601 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 634/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:08 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1233 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:09.094219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.095053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:09.101995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.102724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.103348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.104233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.104842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.105415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.216695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:09.218017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:09.218699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:09.219813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:09.220385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:09.248952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.251745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.252407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.253386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.255636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.256084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.311649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for project 1430823979f84df092a344321a69fce5. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:09.327117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for user 447b90ed71f148b79158ff5db202f274 and project 1430823979f84df092a344321a69fce5. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:09.348616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:09.354329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:09.414911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:09.425744 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c4c6412-a73b-4771-8881-ff51b0fecd82 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1469 microversion: 2.1 time: 0.335421 Oct 31 14:07:09.435988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 635/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1469 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:09.463032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-225d88bb-d264-4d13-a9e5-766693d93e36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.139327 Oct 31 14:07:09.465730 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 433/1068] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:09.478105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea256927-ccb8-41c7-8a05-da4ce94c34d9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.479019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea256927-ccb8-41c7-8a05-da4ce94c34d9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:09.621130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea256927-ccb8-41c7-8a05-da4ce94c34d9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:09.635387 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea256927-ccb8-41c7-8a05-da4ce94c34d9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1225 microversion: 2.1 time: 0.161267 Oct 31 14:07:09.637304 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 434/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:09.669968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Calling method '.version_select at 0x7fe1077ce670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.672866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.673724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.674451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.700343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.701179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.702008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.715461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.716511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.717532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.725167 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1433b2c8-0335-4128-babf-7faa180d301c tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.287620 Oct 31 14:07:09.730863 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 636/1070] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:09.738155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Calling method '.version_select at 0x7fe107a0ed30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.740215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.740902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.741445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.754846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.757151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:09.770296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.772041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.772569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.773518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.774223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.774896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.779033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.779486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.780124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.826158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.838640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.839422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.850662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-518e2945-785c-4119-a2a4-f206d121d849 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-863052-1/servers" status: 200 len: 354 microversion: 2.1 time: 0.116900 Oct 31 14:07:09.860066 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 435/1071] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-863052-1/servers => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:09.865526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Calling method '.version_select at 0x7fe10c44e5e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.869596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.873862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.874564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.902242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.916027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.916418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.935166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.935664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.936104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.960642 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c02569fe-aafd-49a2-8ca8-bda441c635fc tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.099137 Oct 31 14:07:09.963301 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 436/1072] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:09.974992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:09.976143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:09.990063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.990885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.991500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:09.992419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:09.993180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:09.993988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.163391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:10.181775 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41f0488e-e960-48ef-b6fa-89af4e1f8c9e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1285 microversion: 2.1 time: 0.215111 Oct 31 14:07:10.182906 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 437/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:10.189306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Calling method '.version_select at 0x7fe107ab8f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:10.191473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.192404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.193124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.208427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.209536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.211250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.220209 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8e6e22a-3b67-47e9-8261-9b42199922b8 tempest-HypervisorAdminUnderV252Test-2064281889 tempest-HypervisorAdminUnderV252Test-2064281889-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-863052-1/search" status: 200 len: 104 microversion: 2.1 time: 0.035738 Oct 31 14:07:10.222024 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 438/1074] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 31 14:07:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-863052-1/search => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:10.229336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:10.231068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:10.239525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.240620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.241933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.242863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.244383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.245802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.418746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:10.433452 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-176e4194-78b4-44f0-875c-afe99c58ec2d tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.677916 Oct 31 14:07:10.434135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 637/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:09 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:10.465594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:10.466456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:10.485909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.487296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.499712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.502719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.505897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.509774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.720747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:10.732111 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93328e5c-6c13-4262-b18e-d181d43f6427 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1427 microversion: 2.1 time: 0.272780 Oct 31 14:07:10.740997 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 638/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:10 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1427 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:10.746012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:10.756006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:10.774749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.775245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.775688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.776380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:10.776831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:10.777252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:10.928035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:10.952529 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d88d9bcb-093e-47da-9f3d-e31cad169dba tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1277 microversion: 2.1 time: 0.210151 Oct 31 14:07:10.966331 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 639/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:10 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:10.996549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:11.032818 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd12af43-3d2e-4564-9086-28bcd5fcd2ae tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 2342 microversion: 2.25 time: 0.809205 Oct 31 14:07:11.038842 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 439/1078] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:10 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 2342 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:11.054885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e37c7b93-0674-44b4-9fe3-a0a916110fc8 req-6c5b5b83-bb8b-456a-8ce4-c4963f7778f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59", "name": "network-vif-deleted", "tag": "1c433475-3e57-4152-accf-cd96071a28ac"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:11.070936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:11.074225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e37c7b93-0674-44b4-9fe3-a0a916110fc8 req-6c5b5b83-bb8b-456a-8ce4-c4963f7778f4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.074715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e37c7b93-0674-44b4-9fe3-a0a916110fc8 req-6c5b5b83-bb8b-456a-8ce4-c4963f7778f4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.075144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e37c7b93-0674-44b4-9fe3-a0a916110fc8 req-6c5b5b83-bb8b-456a-8ce4-c4963f7778f4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.090428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.092015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.093991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.095138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.096197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.097924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.107177 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e37c7b93-0674-44b4-9fe3-a0a916110fc8 req-6c5b5b83-bb8b-456a-8ce4-c4963f7778f4 service nova] Creating event network-vif-deleted:1c433475-3e57-4152-accf-cd96071a28ac for instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 on n-h2-863052-1 Oct 31 14:07:11.121367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e37c7b93-0674-44b4-9fe3-a0a916110fc8 req-6c5b5b83-bb8b-456a-8ce4-c4963f7778f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066015 Oct 31 14:07:11.122734 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 640/1079] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:11.153199 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8ca6586-555f-4e40-891d-7b7d9e030d79 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093315 Oct 31 14:07:11.154526 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 440/1080] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 31 14:07:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:07:11.209964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:11.210649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:11.219327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.220073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.220907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.221867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.222594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.224156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.420865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:11.440237 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da02cf74-a49d-48b9-9db6-7b6602f3adaa tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1291 microversion: 2.1 time: 0.234989 Oct 31 14:07:11.443169 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 641/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:11 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1291 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:11.464798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:11.465587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:11.486243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.486882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.487374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.488722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.489399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.490006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.693751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-50c37dcd-6eb7-4167-ae2c-474a15320bf2 req-154a979a-54e1-48a6-804e-4775f89feb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b40a30-5bc9-4096-8111-8ba75ca2d278", "name": "network-vif-plugged", "status": "completed", "tag": "f1555281-9e5c-4096-a8cf-b2df76d26cfa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:11.726745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-50c37dcd-6eb7-4167-ae2c-474a15320bf2 req-154a979a-54e1-48a6-804e-4775f89feb42 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.727478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-50c37dcd-6eb7-4167-ae2c-474a15320bf2 req-154a979a-54e1-48a6-804e-4775f89feb42 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.727930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-50c37dcd-6eb7-4167-ae2c-474a15320bf2 req-154a979a-54e1-48a6-804e-4775f89feb42 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.765517 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-50c37dcd-6eb7-4167-ae2c-474a15320bf2 req-154a979a-54e1-48a6-804e-4775f89feb42 service nova] Creating event network-vif-plugged:f1555281-9e5c-4096-a8cf-b2df76d26cfa for instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 on n-h2-863052-1 Oct 31 14:07:11.777782 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-50c37dcd-6eb7-4167-ae2c-474a15320bf2 req-154a979a-54e1-48a6-804e-4775f89feb42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087959 Oct 31 14:07:11.779854 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 642/1082] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:11.794725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:11.795507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:11.803507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.804529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.805216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.806460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.807144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.808275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.852962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:11.853553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:11.854093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:11.854804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lazy-loading 'fault' on Instance uuid e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:12.196409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:12.212751 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44c53c49-d1c4-411e-ad63-e5607ff6858f tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 200 len: 1312 microversion: 2.1 time: 0.425824 Oct 31 14:07:12.213927 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 643/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:11 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:12.221230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:12.222048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:12.229023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:12.229733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:12.230386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:12.231724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:12.233307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:12.233923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:12.268299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:12.285645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fdec6c68-d5b7-4667-89b8-2dcbe41de320 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.828723 Oct 31 14:07:12.299380 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 441/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:11 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:12.358866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:12.376070 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f20548c7-15e4-4584-bf2b-013995d089ea tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1283 microversion: 2.1 time: 0.159628 Oct 31 14:07:12.376658 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 644/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:12 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:12.471391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:12.473277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:12.486567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:12.487604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:12.498813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:12.500644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:12.501692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:12.502849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:12.622035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:12.638535 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-184ddcac-557e-4869-9b00-837d69e70464 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1291 microversion: 2.1 time: 0.170804 Oct 31 14:07:12.640693 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 442/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:12 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1291 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:13.237533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:13.238931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:13.251058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.253344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.254023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.255000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.255764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.256938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.294027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] HTTP exception thrown: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 could not be found. Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Request method failure captured: Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 HTTP/1.1 Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Ze2CpuKaXOtTrEtChx64rLjqEguN8WTD3j_QKshgn_FIugTprYTXi-6Ken_GYlf9VM4LXRME0F0bM5tq7j7drtH8OSi5KXvZiHhLxp9wEUUfVM8oWbrxPrwpIamQnbRG0uwXsVQin4YNDa-1-xzpQtSjQXExZUFmAikHKxBEXVDKY Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 502f9205e2f54e15bbe5a8aa67b8e053 Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1068807968 Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:13.296336 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_502f9205e2f54e15bbe5a8aa67b8e053", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/502f9205e2f54e15bbe5a8aa67b8e053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/502f9205e2f54e15bbe5a8aa67b8e053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/502f9205e2f54e15bbe5a8aa67b8e053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1068807968 Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 502f9205e2f54e15bbe5a8aa67b8e053 Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1068807968 Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminNegativeTestJSON-1068807968-project Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a3f8e1f808a64540884dd7be6a92c46d Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1068807968-project Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 could not be found. Oct 31 14:07:13.298645 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59'} Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 could not be found. Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:13.299592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 could not be found. Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 could not be found. Oct 31 14:07:13.303502 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:13.305066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Returning 404 to user: Instance e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:13.305066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-133a43e7-5d13-428f-96cc-409b28f8f760 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59" status: 404 len: 111 microversion: 2.1 time: 0.069448 Oct 31 14:07:13.305484 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 645/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:13 2022] GET /compute/v2.1/servers/e1c7d1d7-a5ed-48ca-985f-d81c8a63ee59 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:13.316253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:13.316964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:13.318586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:13.319373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:13.325953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.326632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.327099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.327896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.329038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.329171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.329679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.330147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.331030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.332005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.332670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.333331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.371954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:07:13.500392 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ea7bf11-3f53-4440-b19b-889f72bcf975 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 204 len: 0 microversion: 2.1 time: 0.186409 Oct 31 14:07:13.501916 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 646/1088] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:07:13 2022] DELETE /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:13.509926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:13.511145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:13.520663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.521346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.521939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.524136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.524836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.525421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.768962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:13.783919 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94b5991a-5080-466d-928b-7b8e3d7a7295 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.279976 Oct 31 14:07:13.785818 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 647/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:13 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:13.794006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:13.795152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:13.806856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.809293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.809951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:13.811289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:13.811774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:13.812545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.074060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:14.088321 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84fb060c-0a40-4884-85ad-05a952eb631e tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1476 microversion: 2.1 time: 0.300952 Oct 31 14:07:14.088712 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 648/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:13 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:14.105139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:14.110701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:14.118330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:14.119144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:14.119299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.120011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:14.121108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:14.121984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.229874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:14.240963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99bfa71d-fe0f-4d5c-951f-e4c0e323c316 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1324 microversion: 2.1 time: 0.931550 Oct 31 14:07:14.257043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 443/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:13 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1324 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:14.265196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f2f248-5e8c-436d-8604-63520bc8689d", "device": "/dev/xvdb"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:14.273411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:14.287524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:14.288496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:14.289174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.290527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:14.291272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:14.291916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.577141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:14.586686 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91a69256-cfd8-4d77-8d26-2580ee34ba47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.492954 Oct 31 14:07:14.587287 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 649/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:14 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:14.814495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:14.815121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:14.832736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:14.837575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:14.838622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.841453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:14.842477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:14.843016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:14.970560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:14.996324 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1b1449b6-0952-4af5-af1d-2bf862548e0a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "POST /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.724282 Oct 31 14:07:15.008048 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 444/1093] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 31 14:07:14 2022] POST /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:07:15.116089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:15.119777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:15.172333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.174285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:15.176869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:15.179296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.180441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:15.183493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:15.376001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:15.392537 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0f59fbc-b5d6-4553-830d-a2650e5def2a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.578325 Oct 31 14:07:15.410379 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 650/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:14 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:15.429195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:15.438565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:15.451120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.451617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:15.452093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:15.453676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.454812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:15.457502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:15.889211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:15.904488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:15.916582 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-760c9d8c-2dc0-459f-a35f-6b575b5af682 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1522 microversion: 2.1 time: 0.503511 Oct 31 14:07:15.917052 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30054322-0927-47b1-94c5-db5b37d5a095 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1476 microversion: 2.1 time: 0.800307 Oct 31 14:07:15.919785 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 651/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:15 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:15.936360 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 445/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:15 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1476 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:15.939330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:15.940639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:15.956868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.959071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:15.959792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:15.961217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.963937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:15.964847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:15.973197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:15.974758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:15.993059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:15.997363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.002084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.002988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.003472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.003905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.017819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:16.095479 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] HTTP exception thrown: Action 999 not found Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Request method failure captured: Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278/os-instance-actions/999 HTTP/1.1 Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9aBQYt8dmAOFjdQmi3BcmJ2YrjsjUTLJRfEMHS1RV1fSWFvt0IIhGxmxFZ99_2bJQr-1ijPXs2w2u2HTiP2P3NZPHRWIC2UE5nBYqZPb6DPVR7BrYwKF7MMy6uDm1Zu5xI-k6Pxgf2Pwg4HfhYtSxLdl-BAsyWcHG_DQFPzn0eZroE Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bc3a9fdc8f75484689226be682d36a8f Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:07:16.116603 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc3a9fdc8f75484689226be682d36a8f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bc3a9fdc8f75484689226be682d36a8f Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-InstanceActionsNegativeTestJSON-1817110632-project Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b6fbd9e9348c4b6990940fa41c870407 Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1817110632-project Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: exception: Action 999 not found Oct 31 14:07:16.118259 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '89b40a30-5bc9-4096-8111-8ba75ca2d278', 'id': '999'} Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 31 14:07:16.119246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.124872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Returning 404 to user: Action 999 not found {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:16.125921 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93bdda91-4e75-4d59-a8f7-da03a22d4d00 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.168066 Oct 31 14:07:16.134822 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 446/1097] 10.222.0.27 () {58 vars in 1308 bytes} [Mon Oct 31 14:07:15 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278/os-instance-actions/999 => generated 66 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:07:16.148182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-251ca4d8-54f4-4f83-b78b-32a458e76382 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '.version_select at 0x7fe1079b9040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:16.151732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-251ca4d8-54f4-4f83-b78b-32a458e76382 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: e6df9508-78e0-4934-9cb7-a12b6319cd03] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:16.168000 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-251ca4d8-54f4-4f83-b78b-32a458e76382 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] HTTP exception thrown: Instance e6df9508-78e0-4934-9cb7-a12b6319cd03 could not be found. Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-251ca4d8-54f4-4f83-b78b-32a458e76382 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Request method failure captured: Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e6df9508-78e0-4934-9cb7-a12b6319cd03/os-instance-actions HTTP/1.1 Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9aBQYt8dmAOFjdQmi3BcmJ2YrjsjUTLJRfEMHS1RV1fSWFvt0IIhGxmxFZ99_2bJQr-1ijPXs2w2u2HTiP2P3NZPHRWIC2UE5nBYqZPb6DPVR7BrYwKF7MMy6uDm1Zu5xI-k6Pxgf2Pwg4HfhYtSxLdl-BAsyWcHG_DQFPzn0eZroE Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bc3a9fdc8f75484689226be682d36a8f Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:07:16.171409 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc3a9fdc8f75484689226be682d36a8f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bc3a9fdc8f75484689226be682d36a8f Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-InstanceActionsNegativeTestJSON-1817110632-project Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b6fbd9e9348c4b6990940fa41c870407 Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1817110632-project Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e6df9508-78e0-4934-9cb7-a12b6319cd03 could not be found. Oct 31 14:07:16.173336 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': 'e6df9508-78e0-4934-9cb7-a12b6319cd03'} Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6df9508-78e0-4934-9cb7-a12b6319cd03 could not be found. Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:07:16.174119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6df9508-78e0-4934-9cb7-a12b6319cd03 could not be found. Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6df9508-78e0-4934-9cb7-a12b6319cd03 could not be found. Oct 31 14:07:16.175397 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:16.180728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-251ca4d8-54f4-4f83-b78b-32a458e76382 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Returning 404 to user: Instance e6df9508-78e0-4934-9cb7-a12b6319cd03 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:16.181990 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-251ca4d8-54f4-4f83-b78b-32a458e76382 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/e6df9508-78e0-4934-9cb7-a12b6319cd03/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043977 Oct 31 14:07:16.183787 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 447/1098] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 31 14:07:16 2022] GET /compute/v2.1/servers/e6df9508-78e0-4934-9cb7-a12b6319cd03/os-instance-actions => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:16.195552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:16.196608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:16.205228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.206031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.206717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.207633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.208423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.208975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.245330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:07:16.316751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:16.336692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-365e3dd3-6f34-4a02-9f76-7306680280f3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.409813 Oct 31 14:07:16.336692 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 652/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:15 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:16.417903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:16.418681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:16.420016 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cad44cdd-3722-4f2b-9eae-714b6fa44750 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 204 len: 0 microversion: 2.1 time: 0.228502 Oct 31 14:07:16.420646 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 448/1100] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:07:16 2022] DELETE /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:16.429366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.431498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.431973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.434563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.435046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.435223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:16.435481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.435949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:16.451375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.451962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.452572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.453874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.454386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.454832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.774462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:16.785363 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86fb956a-94d0-4898-849b-9ae7c341cc9b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.372186 Oct 31 14:07:16.786160 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 653/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:16 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:16.790120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:16.798084 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1596c68-f94c-4db4-9563-dff1a6f0881a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1528 microversion: 2.1 time: 0.369986 Oct 31 14:07:16.805106 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 449/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:16 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:16.833712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-25d2a36d-3241-4748-842d-d7663881738c req-747f8741-4f2c-4c39-b2d2-b757247babd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da372ca0-0c70-473c-8c7e-16033f8ad2c3", "name": "network-vif-deleted", "tag": "c0490852-4c5f-4c7c-b617-278b798b4ef7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:16.862537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-25d2a36d-3241-4748-842d-d7663881738c req-747f8741-4f2c-4c39-b2d2-b757247babd8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.863621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-25d2a36d-3241-4748-842d-d7663881738c req-747f8741-4f2c-4c39-b2d2-b757247babd8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.865408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-25d2a36d-3241-4748-842d-d7663881738c req-747f8741-4f2c-4c39-b2d2-b757247babd8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.897330 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-25d2a36d-3241-4748-842d-d7663881738c req-747f8741-4f2c-4c39-b2d2-b757247babd8 service nova] Creating event network-vif-deleted:c0490852-4c5f-4c7c-b617-278b798b4ef7 for instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 on n-h1-863052-1 Oct 31 14:07:16.906572 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-25d2a36d-3241-4748-842d-d7663881738c req-747f8741-4f2c-4c39-b2d2-b757247babd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077247 Oct 31 14:07:16.911516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 654/1103] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:16.963994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:16.964626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:16.973045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.973544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.974448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:16.975754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:16.976218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:16.976647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:17.225912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f8e1f808a64540884dd7be6a92c46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f9205e2f54e15bbe5a8aa67b8e053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:17.236725 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a225ecf9-5e31-4575-8da0-379ded134984 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 200 len: 1306 microversion: 2.1 time: 0.276953 Oct 31 14:07:17.256730 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 450/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:16 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 1306 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:17.363353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:17.364612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:17.398522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:17.398522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:17.398522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:17.400435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:17.402426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:17.403699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:17.888692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6dae2007-547e-46ee-8eeb-ad8d7c069e37 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:17.892026 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6dae2007-547e-46ee-8eeb-ad8d7c069e37 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6dae2007-547e-46ee-8eeb-ad8d7c069e37 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin] Request method failure captured: Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9aVdY2aZj2qlikOioDoF7khLLxCfkCayg-fboKOLV8bw8_0SQbfiBuKSWUDdRhemQsb9NHipapMGkw4Md08s5iK_q5J4aR295L1UCoro-GXDNHiTt6vDN89hBTUBDDk9-6k03lyrxQj8H516w2HDcNPTzfas0v8d_V_CfKQWcYbzfE Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 10934776a429439a8d1c7cda2c828041 Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:07:17.901654 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10934776a429439a8d1c7cda2c828041", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10934776a429439a8d1c7cda2c828041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10934776a429439a8d1c7cda2c828041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10934776a429439a8d1c7cda2c828041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 10934776a429439a8d1c7cda2c828041 Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b1a0b4bc383b405db8c5f478b14332df Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:17.903305 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid timestamp for date invalid_time Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'invalid_time'} Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:17.904045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 31 14:07:17.905227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:17.907730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6dae2007-547e-46ee-8eeb-ad8d7c069e37 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:17.908891 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6dae2007-547e-46ee-8eeb-ad8d7c069e37 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098 tempest-InstanceUsageAuditLogNegativeTestJSON-1765396098-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.284482 Oct 31 14:07:17.909674 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 451/1105] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 31 14:07:17 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:17.914621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:17.919292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:17.934673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:17.936998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:17.938729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:17.940604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:17.945857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:17.946524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:18.248177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:18.260240 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-91cda489-597d-4d98-a797-3d572d9fd834 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.349099 Oct 31 14:07:18.262107 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 452/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:17 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:18.270785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:18.272831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:18.275077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:18.284527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:18.286533 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e59ecc49-571f-429e-841a-7614fcf7918a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.929097 Oct 31 14:07:18.286671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:18.287422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:18.288504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:18.288971 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 655/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:17 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:18.289528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:18.290184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:18.383927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:18.474293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-554ad4bf-4362-4f3e-931d-d6dfa2e39036 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:18.478987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-554ad4bf-4362-4f3e-931d-d6dfa2e39036 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '07900c4e2a874b5f8813a86e71ec0279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbd2f05f5bf46be89c9f40346e6eec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-554ad4bf-4362-4f3e-931d-d6dfa2e39036 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Request method failure captured: Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aU2FuoJY7CUYTxnHkGXkMfnyori_dtYoCzaVUkuXwS_xhHOYJBn1IxxUu6kHkGeQs5T4kWouaxI1zA9_fl7TCajxlJ5E__02UisK7x2MBdPny2ufsLAP1vLbJ20y5_ne0blPZhpdacVO7OGGa8VzDz58v7-ML0VJlrJuF5Twb7FeU Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6dbd2f05f5bf46be89c9f40346e6eec0 Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:18.481386 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6dbd2f05f5bf46be89c9f40346e6eec0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6dbd2f05f5bf46be89c9f40346e6eec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6dbd2f05f5bf46be89c9f40346e6eec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6dbd2f05f5bf46be89c9f40346e6eec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6dbd2f05f5bf46be89c9f40346e6eec0 Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 07900c4e2a874b5f8813a86e71ec0279 Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project Oct 31 14:07:18.482767 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:07:18.483781 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 14:07:18.485328 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.488411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-554ad4bf-4362-4f3e-931d-d6dfa2e39036 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:18.490906 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-554ad4bf-4362-4f3e-931d-d6dfa2e39036 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.200933 Oct 31 14:07:18.493022 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 656/1108] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:07:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:18.505163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:18.509060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] [instance: da372ca0-0c70-473c-8c7e-16033f8ad2c3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:18.531466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:18.533232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:18.534051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:18.537124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:18.538044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:18.539244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:18.577612 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] HTTP exception thrown: Instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 could not be found. Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Request method failure captured: Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 HTTP/1.1 Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Ze2CpuKaXOtTrEtChx64rLjqEguN8WTD3j_QKshgn_FIugTprYTXi-6Ken_GYlf9VM4LXRME0F0bM5tq7j7drtH8OSi5KXvZiHhLxp9wEUUfVM8oWbrxPrwpIamQnbRG0uwXsVQin4YNDa-1-xzpQtSjQXExZUFmAikHKxBEXVDKY Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 502f9205e2f54e15bbe5a8aa67b8e053 Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1068807968 Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:18.589758 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_502f9205e2f54e15bbe5a8aa67b8e053", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/502f9205e2f54e15bbe5a8aa67b8e053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/502f9205e2f54e15bbe5a8aa67b8e053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/502f9205e2f54e15bbe5a8aa67b8e053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1068807968 Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 502f9205e2f54e15bbe5a8aa67b8e053 Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1068807968 Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminNegativeTestJSON-1068807968-project Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a3f8e1f808a64540884dd7be6a92c46d Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1068807968-project Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 could not be found. Oct 31 14:07:18.591372 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'da372ca0-0c70-473c-8c7e-16033f8ad2c3'} Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 could not be found. Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:18.592140 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 could not be found. Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 could not be found. Oct 31 14:07:18.593325 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.598790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] Returning 404 to user: Instance da372ca0-0c70-473c-8c7e-16033f8ad2c3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:18.604137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e75c061b-b594-469e-8e49-937068557649 tempest-ServersAdminNegativeTestJSON-1068807968 tempest-ServersAdminNegativeTestJSON-1068807968-project] 10.222.0.27 "GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3" status: 404 len: 111 microversion: 2.1 time: 0.108131 Oct 31 14:07:18.606156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 657/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:18 2022] GET /compute/v2.1/servers/da372ca0-0c70-473c-8c7e-16033f8ad2c3 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:18.623638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21bc7b72-5f65-4f3f-b9a1-da061025d957 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:18.630212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-21bc7b72-5f65-4f3f-b9a1-da061025d957 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '07900c4e2a874b5f8813a86e71ec0279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbd2f05f5bf46be89c9f40346e6eec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21bc7b72-5f65-4f3f-b9a1-da061025d957 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Request method failure captured: Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2014:07:18 HTTP/1.1 Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aU2FuoJY7CUYTxnHkGXkMfnyori_dtYoCzaVUkuXwS_xhHOYJBn1IxxUu6kHkGeQs5T4kWouaxI1zA9_fl7TCajxlJ5E__02UisK7x2MBdPny2ufsLAP1vLbJ20y5_ne0blPZhpdacVO7OGGa8VzDz58v7-ML0VJlrJuF5Twb7FeU Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6dbd2f05f5bf46be89c9f40346e6eec0 Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:18.632868 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6dbd2f05f5bf46be89c9f40346e6eec0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6dbd2f05f5bf46be89c9f40346e6eec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6dbd2f05f5bf46be89c9f40346e6eec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6dbd2f05f5bf46be89c9f40346e6eec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6dbd2f05f5bf46be89c9f40346e6eec0 Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 07900c4e2a874b5f8813a86e71ec0279 Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project Oct 31 14:07:18.634326 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2022-10-31 14:07:18'} Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:07:18.635017 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 14:07:18.636322 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:18.639495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21bc7b72-5f65-4f3f-b9a1-da061025d957 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:18.644015 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21bc7b72-5f65-4f3f-b9a1-da061025d957 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799 tempest-InstanceUsageAuditLogNegativeTestJSON-382358799-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31 14:07:18" status: 403 len: 128 microversion: 2.1 time: 0.030692 Oct 31 14:07:18.649743 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 658/1110] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:07:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2014%3A07%3A18 => generated 128 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:18.723881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:18.739156 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d663a87-6061-405e-a10f-caa6e24ac32a tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1528 microversion: 2.1 time: 0.475419 Oct 31 14:07:18.742145 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 453/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:18 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1528 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:18.958583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:18.963309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9faf7890-5c09-4c6e-89f9-5ed76813731c", "tag": "ce5bb72e-fd10-46e7-9de4-397c9fd6374e"}, {"name": "network-changed", "server_uuid": "2e80907a-572f-4a2a-a43e-5abbf33c2881", "tag": "ab0bff5f-49c6-4d14-a9bc-170121dda5aa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:18.987686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:18.989832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:18.990490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.032256 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] Creating event network-changed:ce5bb72e-fd10-46e7-9de4-397c9fd6374e for instance 9faf7890-5c09-4c6e-89f9-5ed76813731c on n-h2-863052-1 Oct 31 14:07:19.032974 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] Creating event network-changed:ab0bff5f-49c6-4d14-a9bc-170121dda5aa for instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 on n-h1-863052-1 Oct 31 14:07:19.051939 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7aa39a8e-348b-4e71-a3a2-7ab534669c3b req-93869930-59f0-490b-ad4f-85f5ba3a2d42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093705 Oct 31 14:07:19.053030 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 659/1112] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:19.287663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:19.288914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:19.299728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.301956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.302598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.303506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.304276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.312734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:19.314065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:19.320693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.332413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.334765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.341067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.342987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.346580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.347115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.588855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:19.600089 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-300af826-8a6e-45a1-8ce9-5f724e70a08e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.316510 Oct 31 14:07:19.604435 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 454/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:19 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:19.754506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:19.772184 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10ffabb9-ea8d-4135-823a-d67231e9efe6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.466258 Oct 31 14:07:19.772788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 660/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:19 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:19.773411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:19.774912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:19.784519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:19.788582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.789834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.791699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.792517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.794799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.795704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.796848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a86baaa4-ae28-44e8-ab96-32c6d3ce5c02 req-eba158bb-1dfa-43f3-ac3d-0ad5f1e26183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b40a30-5bc9-4096-8111-8ba75ca2d278", "name": "network-vif-deleted", "tag": "f1555281-9e5c-4096-a8cf-b2df76d26cfa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:19.842862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a86baaa4-ae28-44e8-ab96-32c6d3ce5c02 req-eba158bb-1dfa-43f3-ac3d-0ad5f1e26183 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:19.845066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a86baaa4-ae28-44e8-ab96-32c6d3ce5c02 req-eba158bb-1dfa-43f3-ac3d-0ad5f1e26183 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:19.847824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a86baaa4-ae28-44e8-ab96-32c6d3ce5c02 req-eba158bb-1dfa-43f3-ac3d-0ad5f1e26183 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:19.879868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a86baaa4-ae28-44e8-ab96-32c6d3ce5c02 req-eba158bb-1dfa-43f3-ac3d-0ad5f1e26183 service nova] Creating event network-vif-deleted:f1555281-9e5c-4096-a8cf-b2df76d26cfa for instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 on n-h2-863052-1 Oct 31 14:07:19.895078 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a86baaa4-ae28-44e8-ab96-32c6d3ce5c02 req-eba158bb-1dfa-43f3-ac3d-0ad5f1e26183 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105492 Oct 31 14:07:19.898902 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 661/1115] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:20.382473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fbd9e9348c4b6990940fa41c870407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3a9fdc8f75484689226be682d36a8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:20.397162 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-62a127fa-2ea5-4152-a4ca-04e46de6c651 tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 200 len: 1486 microversion: 2.1 time: 0.628694 Oct 31 14:07:20.399679 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 455/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:19 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 1486 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:20.628677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:20.630280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:20.640669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:20.641501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:20.642216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:20.643348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:20.644050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:20.644683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:20.799899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:20.800523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:20.807043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:20.808786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:20.811359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:20.812526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:20.815925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:20.816575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:20.919142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:20.935526 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d1bb4ec-721c-43df-8e6f-c622707baf0c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.312421 Oct 31 14:07:20.939801 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 662/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:20 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:21.113611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:21.328539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:21.340822 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dc32c213-7989-4c65-8db2-0c8cf2b87e15 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.545525 Oct 31 14:07:21.341611 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 456/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:20 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:21.426080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:21.427169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] [instance: 89b40a30-5bc9-4096-8111-8ba75ca2d278] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:21.440362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:21.443942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:21.445394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:21.446702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:21.450424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:21.450995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:21.505572 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] HTTP exception thrown: Instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 could not be found. Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Request method failure captured: Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 HTTP/1.1 Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aBQYt8dmAOFjdQmi3BcmJ2YrjsjUTLJRfEMHS1RV1fSWFvt0IIhGxmxFZ99_2bJQr-1ijPXs2w2u2HTiP2P3NZPHRWIC2UE5nBYqZPb6DPVR7BrYwKF7MMy6uDm1Zu5xI-k6Pxgf2Pwg4HfhYtSxLdl-BAsyWcHG_DQFPzn0eZroE Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: bc3a9fdc8f75484689226be682d36a8f Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:21.512664 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc3a9fdc8f75484689226be682d36a8f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc3a9fdc8f75484689226be682d36a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: bc3a9fdc8f75484689226be682d36a8f Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1817110632 Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-InstanceActionsNegativeTestJSON-1817110632-project Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b6fbd9e9348c4b6990940fa41c870407 Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1817110632-project Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 could not be found. Oct 31 14:07:21.514280 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '89b40a30-5bc9-4096-8111-8ba75ca2d278'} Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 could not be found. Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:21.515385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 could not be found. Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 could not be found. Oct 31 14:07:21.516803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:21.517950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] Returning 404 to user: Instance 89b40a30-5bc9-4096-8111-8ba75ca2d278 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:21.517950 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49b3d744-0af3-463f-ba74-1d32f5a875ca tempest-InstanceActionsNegativeTestJSON-1817110632 tempest-InstanceActionsNegativeTestJSON-1817110632-project] 10.222.0.27 "GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278" status: 404 len: 111 microversion: 2.1 time: 0.094347 Oct 31 14:07:21.520496 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 663/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:21 2022] GET /compute/v2.1/servers/89b40a30-5bc9-4096-8111-8ba75ca2d278 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:21.964617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:21.965988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:21.974526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:21.977134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:21.979337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:21.980282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:21.983725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:21.984428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:22.321263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:22.335984 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c1b9ed3-df74-45a1-b739-ac59e20a1091 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.374423 Oct 31 14:07:22.338446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 457/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:21 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:22.378538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:22.379518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:22.413759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:22.418821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:22.420115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:22.424266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:22.425889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:22.426795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:22.808337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:22.820376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f90f97a-02eb-483c-89bf-2b8b583474d1 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.454578 Oct 31 14:07:22.821454 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 458/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:22 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:22.875934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1040386988", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:22.965956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:23.242398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:23.242869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:23.243332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:23.243749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:23.244156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:23.262385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.262385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.262385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:23.262385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.262697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.262697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:23.276043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Getting quotas for project 35c83f504b5e41169372fb73cffd18a5. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:23.281530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Getting quotas for user dfe88786f3e240739b5f84f1f0f43ed4 and project 35c83f504b5e41169372fb73cffd18a5. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:23.293482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:23.294859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:23.297307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:23.353067 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c397d51-50e0-46b0-b25e-e3cf2aac6312 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298865 Oct 31 14:07:23.354445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 664/1122] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:07:23.364184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:23.364912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:23.370998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60cd434d-f402-471a-bbaf-166736ee407d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:23.371938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60cd434d-f402-471a-bbaf-166736ee407d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:23.373469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.377408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.378771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:23.381111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.383572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.384268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:23.527183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60cd434d-f402-471a-bbaf-166736ee407d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:23.541551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60cd434d-f402-471a-bbaf-166736ee407d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1217 microversion: 2.1 time: 0.177072 Oct 31 14:07:23.543855 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 665/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:23 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:23.741936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-52bd5b88-acfd-4603-bcd8-3adc955f8e5b req-339275ac-803f-40b7-9036-602a24dcb671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e80907a-572f-4a2a-a43e-5abbf33c2881", "name": "network-vif-plugged", "status": "completed", "tag": "ab0bff5f-49c6-4d14-a9bc-170121dda5aa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:23.783680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52bd5b88-acfd-4603-bcd8-3adc955f8e5b req-339275ac-803f-40b7-9036-602a24dcb671 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.784190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52bd5b88-acfd-4603-bcd8-3adc955f8e5b req-339275ac-803f-40b7-9036-602a24dcb671 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.784633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52bd5b88-acfd-4603-bcd8-3adc955f8e5b req-339275ac-803f-40b7-9036-602a24dcb671 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:23.804967 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-52bd5b88-acfd-4603-bcd8-3adc955f8e5b req-339275ac-803f-40b7-9036-602a24dcb671 service nova] Creating event network-vif-plugged:ab0bff5f-49c6-4d14-a9bc-170121dda5aa for instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 on n-h1-863052-1 Oct 31 14:07:23.818118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-52bd5b88-acfd-4603-bcd8-3adc955f8e5b req-339275ac-803f-40b7-9036-602a24dcb671 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083006 Oct 31 14:07:23.819591 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 666/1124] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:23.845208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:23.846175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:23.860827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.861282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.861731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:23.862493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:23.862955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:23.863386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:24.140294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:24.148860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00c3e297-ea94-45bd-9452-0bae4b8cd43f tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.789579 Oct 31 14:07:24.152885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 459/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:23 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:24.195448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:24.215796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ff51391-c179-468b-9903-b063798dc424 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1358 microversion: 2.1 time: 0.374773 Oct 31 14:07:24.216397 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 667/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:23 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:24.565497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:24.566737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:24.578923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:24.581866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:24.582522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:24.583407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:24.584049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:24.584637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:24.734513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:24.745695 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a6f8737-e161-438e-809a-4eda261fae0d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1213 microversion: 2.1 time: 0.184578 Oct 31 14:07:24.746312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 460/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:24 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:25.176297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:25.177345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:25.181084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:25.195431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.203788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.204973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.207394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.211753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.212627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.469784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-838305418", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:25.593407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:25.594235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:25.594954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:25.595556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:25.596155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:25.625630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.626242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.626754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.627562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.628082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.631275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.684582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Getting quotas for project 5f608aadb2fa45aa9080f7c3e325d9ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:25.691604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Getting quotas for user bffcda2a16454874b56ed8359c5e4932 and project 5f608aadb2fa45aa9080f7c3e325d9ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:25.725670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:25.728109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:25.741143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:25.749585 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5e166b7e-9f9c-42f1-9012-98c560ba541d tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.579815 Oct 31 14:07:25.752214 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 461/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:25 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:25.756861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:25.757471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:25.763715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.764111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.765110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.774761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.775265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.775715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.836656 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66754473-0345-4cc7-8f51-20edcba07679 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.890622 Oct 31 14:07:25.837329 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 668/1129] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:07:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:07:25.850917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:25.852167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:25.863233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.863952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.864544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:25.865406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:25.866076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:25.866946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:26.024098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:26.037287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7e8a67e-e417-43ba-9404-4057839c55e4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1275 microversion: 2.1 time: 0.195201 Oct 31 14:07:26.038781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 669/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:25 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:26.057507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-781d6912-dbec-435b-97de-bc6146221cef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:26.058431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-781d6912-dbec-435b-97de-bc6146221cef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:26.191189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-781d6912-dbec-435b-97de-bc6146221cef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:26.203528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-781d6912-dbec-435b-97de-bc6146221cef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:26.208405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-781d6912-dbec-435b-97de-bc6146221cef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:26.226530 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-781d6912-dbec-435b-97de-bc6146221cef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1452 microversion: 2.91 time: 0.185525 Oct 31 14:07:26.228929 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 670/1131] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:26 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:26.254279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-06799273-54a3-49d8-b89f-1bb59ecdbb81 req-2e1d735f-df68-4b2e-aa87-09586617d262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf7890-5c09-4c6e-89f9-5ed76813731c", "name": "network-vif-plugged", "status": "completed", "tag": "ce5bb72e-fd10-46e7-9de4-397c9fd6374e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:26.277686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-06799273-54a3-49d8-b89f-1bb59ecdbb81 req-2e1d735f-df68-4b2e-aa87-09586617d262 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:26.278604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-06799273-54a3-49d8-b89f-1bb59ecdbb81 req-2e1d735f-df68-4b2e-aa87-09586617d262 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:26.279216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-06799273-54a3-49d8-b89f-1bb59ecdbb81 req-2e1d735f-df68-4b2e-aa87-09586617d262 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:26.295382 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-06799273-54a3-49d8-b89f-1bb59ecdbb81 req-2e1d735f-df68-4b2e-aa87-09586617d262 service nova] Creating event network-vif-plugged:ce5bb72e-fd10-46e7-9de4-397c9fd6374e for instance 9faf7890-5c09-4c6e-89f9-5ed76813731c on n-h2-863052-1 Oct 31 14:07:26.303442 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-06799273-54a3-49d8-b89f-1bb59ecdbb81 req-2e1d735f-df68-4b2e-aa87-09586617d262 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052559 Oct 31 14:07:26.305135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 671/1132] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:26.519870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85e24d7d-137c-4f40-bd4c-53ca18876128 tempest-NetworksTest-1247845739 tempest-NetworksTest-1247845739-project-admin] Calling method '.version_select at 0x7fe1077a29d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:26.546291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:26.556465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-abb99eb5-3f79-4224-8809-afec8437f24c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1540 microversion: 2.1 time: 0.803181 Oct 31 14:07:26.557541 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 462/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:25 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1540 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:26.583954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:26.584756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:26.592349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:26.593262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:26.594359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:26.595296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:26.595974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:26.596617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:26.600451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:26.733259 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f177b1a8-ea5a-4552-bb43-b70b55756b17 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155850 Oct 31 14:07:26.734100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 463/1134] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:07:26 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:26.777568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:26.779031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:26.786805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:26.787656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:26.788359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:26.789297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:26.790014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:26.790729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:26.932324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85e24d7d-137c-4f40-bd4c-53ca18876128 tempest-NetworksTest-1247845739 tempest-NetworksTest-1247845739-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6749 microversion: 2.1 time: 0.566504 Oct 31 14:07:26.935641 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 672/1135] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:07:26 2022] GET /compute/v2.1/os-networks => generated 6749 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:26.945819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f81f93a6-7caa-4470-afc6-5e37e30233d8 tempest-NetworksTest-1247845739 tempest-NetworksTest-1247845739-project-admin] Calling method '.version_select at 0x7fe1077a2040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:27.082026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f81f93a6-7caa-4470-afc6-5e37e30233d8 tempest-NetworksTest-1247845739 tempest-NetworksTest-1247845739-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/1bd3be27-dc2f-4849-b93b-48f92e845229" status: 200 len: 652 microversion: 2.1 time: 0.140505 Oct 31 14:07:27.086449 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 673/1136] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:07:26 2022] GET /compute/v2.1/os-networks/1bd3be27-dc2f-4849-b93b-48f92e845229 => generated 652 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:27.092476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:27.093405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:27.101261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:27.101749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:27.102192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:27.102899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:27.103670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:27.104260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:27.179954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:27.192556 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f93727c-194d-43b9-ae0b-a43eec250eab tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1325 microversion: 2.1 time: 0.419219 Oct 31 14:07:27.193940 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 464/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:26 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:27.201040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:27.201385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06978a3b-674e-444b-b0c6-743959773f18 tempest-NetworksTest-1247845739 tempest-NetworksTest-1247845739-project-admin] Calling method '.version_select at 0x7fe107a19310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:27.220840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e3637135-3128-4e59-b72f-c301d5b0dddc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1275 microversion: 2.1 time: 0.136452 Oct 31 14:07:27.236823 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 674/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:27 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:27.258964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:27.259724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:27.268542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:27.269167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:27.269695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:27.272280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:27.274000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:27.274764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:27.370362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:27.380037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:27.381478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:27.386844 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-658ed89c-aace-4692-9297-7fdc0f7e7601 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1504 microversion: 2.91 time: 0.134060 Oct 31 14:07:27.394741 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 675/1139] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:27 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1504 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:27.782825 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06978a3b-674e-444b-b0c6-743959773f18 tempest-NetworksTest-1247845739 tempest-NetworksTest-1247845739-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6749 microversion: 2.1 time: 0.587456 Oct 31 14:07:27.783530 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 465/1140] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:07:27 2022] GET /compute/v2.1/os-networks => generated 6749 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:28.221209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:28.222609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:28.228468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.228988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.229521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.230258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.230936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.231387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.256660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:28.259078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:28.274543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.275763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.276579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.277961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.278539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.279060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.469732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:28.489087 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a5764eb-4f5c-4dad-9c35-3b42930017cf tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1522 microversion: 2.1 time: 0.272995 Oct 31 14:07:28.489683 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 676/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:28 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:28.497781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:28.498840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:28.509444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.510265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.510897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.511979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.512593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.513693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.599753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:28.610556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:28.612514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:28.618846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8f6e6b7-9276-4907-a6e3-f7bc326f7917 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1510 microversion: 2.91 time: 0.125372 Oct 31 14:07:28.619440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 677/1142] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:28 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1510 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:28.635147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:28.636319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:28.655468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.656692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.658085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.660852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.662043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.662726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.836265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:28.840674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:28.848786 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2960ab3-12ed-4a98-ae94-69cf636aecfe tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1522 microversion: 2.1 time: 0.227893 Oct 31 14:07:28.849788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 678/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:28 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:28.873107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-129069675"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:28.877549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:28.889561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.890419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.891179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:28.892057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:28.892668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:28.893258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.203796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e9a4775-4ff4-429c-9b4a-477ec2d1207e tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c/action" status: 202 len: 0 microversion: 2.1 time: 0.334445 Oct 31 14:07:29.212610 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 679/1144] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:07:28 2022] POST /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 31 14:07:29.218625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cdac185-0e56-48f3-a133-63af21199ea9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '.version_select at 0x7fe10784f310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:29.293508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:29.320310 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77b4c729-85e7-4712-89a8-5cb401393e84 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1317 microversion: 2.1 time: 1.073901 Oct 31 14:07:29.322246 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 466/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:28 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1317 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:29.451709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cdac185-0e56-48f3-a133-63af21199ea9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6" status: 204 len: 0 microversion: 2.1 time: 0.236871 Oct 31 14:07:29.463148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 680/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:29 2022] DELETE /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:29.463814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be28fafd-b866-459d-8f0c-522704fec0b5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '.version_select at 0x7fe1079341f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:29.504255 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-be28fafd-b866-459d-8f0c-522704fec0b5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Image not found. Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be28fafd-b866-459d-8f0c-522704fec0b5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 HTTP/1.1 Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:07:29.506618 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b7267dd4-c7e3-4c7a-a605-b72e6500ddf6'} Oct 31 14:07:29.508748 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:07:29.510333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:07:29.512174 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 could not be found. Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:07:29.514617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:29.516608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be28fafd-b866-459d-8f0c-522704fec0b5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:29.517801 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be28fafd-b866-459d-8f0c-522704fec0b5 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6" status: 404 len: 62 microversion: 2.1 time: 0.051052 Oct 31 14:07:29.523172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:29.524222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:29.524626 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 467/1147] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:29 2022] GET /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:07:29.533457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:29.534781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:29.535505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.537147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:29.538002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:29.539070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.648165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:29.649808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:29.666951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:29.667759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:29.668405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.669320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:29.670889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:29.679317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.811908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:29.827103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:29.830006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:29.843494 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9557364d-1a7b-4846-a089-23eab777302c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1510 microversion: 2.91 time: 0.198887 Oct 31 14:07:29.845370 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 468/1148] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:29 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:07:29.855580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:29.857950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:29.869774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:29.870362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:29.870809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.871777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:29.872241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:29.872672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:29.894971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:29.903551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ca2240d-5a9e-4e5f-ba82-cadf73ca6590 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1534 microversion: 2.1 time: 0.386880 Oct 31 14:07:29.904562 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 681/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:29 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1534 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:30.272055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:30.309283 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df487969-2775-4ff7-baf7-79c6dca69657 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 2420 microversion: 2.25 time: 0.461025 Oct 31 14:07:30.315059 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 469/1150] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:29 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 2420 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:30.352337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:30.353313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:30.354088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-1", "block_migration": "auto"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:30.362075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:30.376492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:30.377101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:30.381263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:30.383132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:30.384250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:30.384690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:30.385233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:30.385831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:30.389037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:30.391011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:30.394853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:30.396350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:30.476428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'flavor' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:30.503513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Going to try to live migrate instance to n-h2-863052-1 {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:07:31.007206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:31.022048 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ae97bd7-5f17-456e-942d-18b73d97e084 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1317 microversion: 2.1 time: 0.670086 Oct 31 14:07:31.023015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 470/1151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:30 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:31.033298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:31.066009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:31.067207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Searching by: {'deleted': False, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:07:31.090832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.091534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.095118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:31.098366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.098894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.099551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:31.150479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:07:31.205819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70f0773a-9538-4984-8614-2f26c49c359e tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.178243 Oct 31 14:07:31.211153 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 471/1152] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:07:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:31.247764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ead33331-7ed6-4935-a174-85ed965a0aac req-4f236c50-d480-451a-978e-6ec199448299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e80907a-572f-4a2a-a43e-5abbf33c2881", "tag": "ab0bff5f-49c6-4d14-a9bc-170121dda5aa"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:31.292593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ead33331-7ed6-4935-a174-85ed965a0aac req-4f236c50-d480-451a-978e-6ec199448299 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.294767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ead33331-7ed6-4935-a174-85ed965a0aac req-4f236c50-d480-451a-978e-6ec199448299 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.295434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ead33331-7ed6-4935-a174-85ed965a0aac req-4f236c50-d480-451a-978e-6ec199448299 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:31.326208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ead33331-7ed6-4935-a174-85ed965a0aac req-4f236c50-d480-451a-978e-6ec199448299 service nova] Creating event network-changed:ab0bff5f-49c6-4d14-a9bc-170121dda5aa for instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 on n-h1-863052-1 Oct 31 14:07:31.346099 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ead33331-7ed6-4935-a174-85ed965a0aac req-4f236c50-d480-451a-978e-6ec199448299 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131581 Oct 31 14:07:31.347416 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 472/1153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:31.355216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:31.356142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:31.363740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.364476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.365079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:31.366030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.366753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.367338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:31.541898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:31.557113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:31.564500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:31.617797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d4d50cc5-d070-40a8-a9cc-22e09d53cfb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1531 microversion: 2.91 time: 0.268801 Oct 31 14:07:31.622013 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 473/1154] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:31 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1531 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:31.655735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:31.662934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:31.681293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.690038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.691914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:31.696040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:31.697304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:31.705802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:32.693477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:32.705890 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29c12b90-8b84-49ea-a061-d11e988ed7da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1540 microversion: 2.1 time: 1.080054 Oct 31 14:07:32.707130 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 474/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:31 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1540 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:32.714453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:32.722742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:32.724118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Searching by: {'deleted': False, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:07:32.732219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:32.732935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:32.734720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:32.736178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:32.736872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:32.737567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:32.772958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:07:32.820535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:32.827776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:32.828466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:32.828903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:33.105554 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-649d6fd9-7255-4843-99e0-5f6c469c10a0 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/action" status: 202 len: 0 microversion: 2.25 time: 2.765110 Oct 31 14:07:33.110954 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 682/1156] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:07:30 2022] POST /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/action => generated 0 bytes in 2771 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:33.408848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:33.409724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:33.416255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:33.417087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:33.417901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:33.418850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:33.419519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:33.420155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:33.716118 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46d21d73-12a1-4558-aeba-e2e366bb167d tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.007550 Oct 31 14:07:33.717453 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 475/1157] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:07:32 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:33.722594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:33.723454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:33.730399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:33.731199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:33.732176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:33.733110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:33.734508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:33.735157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:33.798690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lazy-loading 'services' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:33.820769 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb37d2c4-af0a-4c62-84bb-0248ce283016 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1936 microversion: 2.91 time: 0.708397 Oct 31 14:07:33.837340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 683/1158] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:33 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1936 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:33.963044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:33.973474 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9a6c357-2db0-406d-8396-450dbd35c514 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1317 microversion: 2.1 time: 0.254508 Oct 31 14:07:33.974945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 476/1159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:33 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:33.997213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:33.998624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.010386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.012296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.012861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.015704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.018054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.020676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.052809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aadab105-eed3-4682-8539-1363dad7eb7f tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] Calling method '.version_select at 0x7fe107834e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.067484 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aadab105-eed3-4682-8539-1363dad7eb7f tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.228456 Oct 31 14:07:34.068063 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 684/1160] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:07:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:34.073048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c16fc17a-1ac0-4fda-b86e-84cf95c97cf0 req-bbb4b3f4-b7c1-458c-88ff-7214b574b766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:34.083283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c16fc17a-1ac0-4fda-b86e-84cf95c97cf0 req-bbb4b3f4-b7c1-458c-88ff-7214b574b766 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.083761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c16fc17a-1ac0-4fda-b86e-84cf95c97cf0 req-bbb4b3f4-b7c1-458c-88ff-7214b574b766 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.084181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c16fc17a-1ac0-4fda-b86e-84cf95c97cf0 req-bbb4b3f4-b7c1-458c-88ff-7214b574b766 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.096017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c16fc17a-1ac0-4fda-b86e-84cf95c97cf0 req-bbb4b3f4-b7c1-458c-88ff-7214b574b766 service nova] Creating event network-changed:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:07:34.101459 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c16fc17a-1ac0-4fda-b86e-84cf95c97cf0 req-bbb4b3f4-b7c1-458c-88ff-7214b574b766 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 Oct 31 14:07:34.102671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 685/1161] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:34.107829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.109749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.116444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.116934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.117363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.118045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.119147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.119851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.170727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:34.181455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:34.183391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:34.184772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0685c103-4354-44b7-bb02-d0a63ec0f6e3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.208039 Oct 31 14:07:34.185517 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 477/1162] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:33 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:34.190221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9bfe6a20-4332-40f1-872f-28c6e7884965 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.198769 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9bfe6a20-4332-40f1-872f-28c6e7884965 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011930 Oct 31 14:07:34.206358 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 478/1163] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:34.206358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.206358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.211191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.211685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.212220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.212923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.213377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.214010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.290310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lazy-loading 'services' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:34.316354 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f094bd4-7c05-42b3-b111-2e38e1b744e6 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1936 microversion: 2.91 time: 0.115697 Oct 31 14:07:34.316973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 479/1164] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1936 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:34.321514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28d75d0a-a141-49cb-9fec-0bf735fea599 tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] Action: 'update', calling method: .version_select at 0x7fe107a0eee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:34.390798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:34.402699 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7167314-9557-426e-bbaa-a3faa05a7bb8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1522 microversion: 2.1 time: 0.298625 Oct 31 14:07:34.415458 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 686/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:34.427350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.431258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.431963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.432384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.433270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.433877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.434596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.466353 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68fd8bcc-0df7-46c1-83ae-5c23ce467715 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.049560 Oct 31 14:07:34.467318 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 687/1166] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:07:34.472996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.473690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.479950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.480739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.481177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.481876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.482356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.482785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.511637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:07:34.601161 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28d75d0a-a141-49cb-9fec-0bf735fea599 tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.282877 Oct 31 14:07:34.601927 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 480/1167] 10.222.0.27 () {60 vars in 1206 bytes} [Mon Oct 31 14:07:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:34.607274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:34.608510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.615111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.615890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.616552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.617169 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6efb2e4-038e-4530-9814-849d2f12ca36 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 204 len: 0 microversion: 2.1 time: 0.147685 Oct 31 14:07:34.617707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.618310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 688/1168] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:07:34 2022] DELETE /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:34.618690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.619340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.626064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.626814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.634847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.634847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.635250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.636004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.636549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.636881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.654631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lazy-loading 'flavor' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:34.669404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:07:34.767991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:34.774878 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-136846d9-557a-46f6-86df-53e3879763bf tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "DELETE /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 204 len: 0 microversion: 2.1 time: 0.154931 Oct 31 14:07:34.775770 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 689/1169] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:07:34 2022] DELETE /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:34.781902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2df091d-eb52-411e-aa27-47e006a17a9d tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] Calling method '.version_select at 0x7fe1077b20d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.798663 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2df091d-eb52-411e-aa27-47e006a17a9d tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021679 Oct 31 14:07:34.799864 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 690/1170] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:34.804598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:34.805528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:34.812135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.812847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.813277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.814120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:34.814753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:34.815176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:34.996276 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd76dfde-0a7a-4f15-af91-d1e72b2f94fd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action" status: 202 len: 0 microversion: 2.91 time: 0.392732 Oct 31 14:07:34.997637 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 481/1171] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:07:34 2022] POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:07:35.006902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:35.008076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:35.019099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.020005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.020798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.023163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.024249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.025574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.071102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.087132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c49b9205-05a8-4841-afd3-1b49ad12a455 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1528 microversion: 2.1 time: 0.286044 Oct 31 14:07:35.102578 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 691/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1528 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:35.107572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-260e4f78-01ff-424d-bac4-adf4ff43adf1 tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] Action: 'update', calling method: .version_select at 0x7fe1077959d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:35.154560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:35.269060 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-260e4f78-01ff-424d-bac4-adf4ff43adf1 tempest-QuotaClassesAdminTestJSON-814189266 tempest-QuotaClassesAdminTestJSON-814189266-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.165080 Oct 31 14:07:35.269757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 692/1173] 10.222.0.27 () {60 vars in 1206 bytes} [Mon Oct 31 14:07:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:35.281488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:35.284267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:35.293425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.304188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.304934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.305786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.308494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.310419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.313795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.321507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75eddf40-4f59-4dfa-84ca-97058abd9a34 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1607 microversion: 2.1 time: 0.321382 Oct 31 14:07:35.341569 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 482/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:34 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1607 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:35.346599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:35.347211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:35.358944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.359952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.359952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.360682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.361149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.361546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.494710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.508485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.509945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.517904 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f20b50e3-ecc2-4562-9616-2bb370f05c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.175105 Oct 31 14:07:35.520047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 483/1175] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:35 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:35.530735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:35.530735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:35.532207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.532701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.533139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.533839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:35.534333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:35.538697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:35.615963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.619896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:35.625862 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99baa98c-8411-4854-9ea7-9d7807fdaa9b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1317 microversion: 2.1 time: 0.350349 Oct 31 14:07:35.633506 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 693/1176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:35 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:35.786340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.800253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.804427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:35.805917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a70c56b-4b66-4041-8091-e4631cbb9900 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.286227 Oct 31 14:07:35.809877 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 484/1177] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:35 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:36.121163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:36.122492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:36.130301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.131459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.132101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.133053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.133672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.134319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.344305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:36.349763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:36.350420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:36.353861 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b988aea3-99ac-41b0-b04a-888217e631cc tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1528 microversion: 2.1 time: 0.240910 Oct 31 14:07:36.354500 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 694/1178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:36 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:36.371324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:36.375457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.376220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.377214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.377829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.378444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.378897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.549576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:36.552989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:36.563367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.563863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.564481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.565205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.565657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.566083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.652431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:36.654382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:36.668502 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-027e3acd-ae6b-4aeb-ad9c-a0db594466ba tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1607 microversion: 2.1 time: 0.323497 Oct 31 14:07:36.668722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:36.671339 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 485/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:36 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1607 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:36.673650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:36.677957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:36.679060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:36.685452 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8bb974f9-2eef-4d5e-971e-41b3a1d79923 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.140890 Oct 31 14:07:36.687194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.688424 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 695/1180] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:36 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:36.688678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.689351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.690282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.691030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.691680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.833252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:36.834737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:36.843786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.844605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.845351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.846275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:36.846916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:36.847505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:36.953649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:36.991167 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec9251bf-14b4-4ce2-8e05-ea41517375d6 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1317 microversion: 2.1 time: 0.317852 Oct 31 14:07:36.993631 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 486/1181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:36 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:37.172164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:37.182631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:37.184471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:37.185867 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aef5053a-6c74-458d-92a8-3dbe278190e2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.356563 Oct 31 14:07:37.189093 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 696/1182] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:36 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:07:37.378988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:37.383850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:37.398021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:37.400234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:37.407461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:37.408299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:37.408855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:37.411255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:37.705886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:37.707326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:37.743312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:37.749609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:37.752382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:37.753259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:37.755700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:37.760410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.220465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:38.229821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0be753ba-cc57-46e0-94cc-b3812b771def tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1528 microversion: 2.1 time: 0.855690 Oct 31 14:07:38.231932 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 487/1183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:37 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1528 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:38.245718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:38.246898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:38.261067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.261570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.262014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.262762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.263221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.263643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.503431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:38.517978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:38.529765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:38.535315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed8cc8de-da70-404d-988f-50e0a2328efd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.301080 Oct 31 14:07:38.536378 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 488/1184] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:38 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:38.554575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3fe79fce-2a23-44bf-b0a8-66e14f03d8ca req-aa87d3ff-b1e7-4f92-9291-44e38654af20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "name": "network-vif-plugged", "status": "completed", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:38.564587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:38.571272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3fe79fce-2a23-44bf-b0a8-66e14f03d8ca req-aa87d3ff-b1e7-4f92-9291-44e38654af20 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.574159 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-479869c5-898e-4088-83ce-43980ae33512 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1607 microversion: 2.1 time: 0.880844 Oct 31 14:07:38.578408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3fe79fce-2a23-44bf-b0a8-66e14f03d8ca req-aa87d3ff-b1e7-4f92-9291-44e38654af20 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.578612 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 697/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:37 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1607 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:38.579315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3fe79fce-2a23-44bf-b0a8-66e14f03d8ca req-aa87d3ff-b1e7-4f92-9291-44e38654af20 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.592880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:38.593426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:38.602075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3fe79fce-2a23-44bf-b0a8-66e14f03d8ca req-aa87d3ff-b1e7-4f92-9291-44e38654af20 service nova] Creating event network-vif-plugged:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:07:38.604086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.604592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.605037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.605983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.606210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.606739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.609382 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3fe79fce-2a23-44bf-b0a8-66e14f03d8ca req-aa87d3ff-b1e7-4f92-9291-44e38654af20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071618 Oct 31 14:07:38.610000 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 489/1186] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:38.624693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:38.625397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:38.662312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.664008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.665397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:38.668546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:38.669351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:38.670013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.089158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.100487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.102589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97bb365b-480a-4fc4-9fc1-31bd8f8e6c24 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1317 microversion: 2.1 time: 0.520757 Oct 31 14:07:39.103504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 698/1187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:38 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:39.153006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.155688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.158692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ee5ba76b-d7fb-4789-ab2f-597b9274581b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.539609 Oct 31 14:07:39.159620 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 490/1188] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:38 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:39.256252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:39.256894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:39.271006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:39.272413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:39.273045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.273946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:39.274623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:39.275249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.472504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.485772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd6b0378-7cfc-444b-be9a-30513d196ee0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1486 microversion: 2.1 time: 0.234282 Oct 31 14:07:39.493832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 699/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:39 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1486 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:39.568450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:39.569202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:39.587929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:39.594633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:39.599635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.607123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:39.608037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:39.616088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:39.616924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:39.620365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.633775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:39.634861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:39.635425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.637878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:39.651029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:39.658741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:39.959932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.982460 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-122f287b-e78e-46b7-81f2-a5ef817dd2a4 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1540 microversion: 2.1 time: 0.379463 Oct 31 14:07:39.989312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:39.994123 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 700/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:39 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1540 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:40.008565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:40.017461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7f9466b0-836b-4547-a35a-c42072e5dcb6 req-f19bf4db-c957-43bd-8b97-ec2f2f90468a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf7890-5c09-4c6e-89f9-5ed76813731c", "name": "network-vif-deleted", "tag": "ce5bb72e-fd10-46e7-9de4-397c9fd6374e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:40.020577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:40.043864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da840c5a-4443-4271-bd1b-fd39b08b3e42 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.480048 Oct 31 14:07:40.047536 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 491/1191] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:39 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:40.061684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7f9466b0-836b-4547-a35a-c42072e5dcb6 req-f19bf4db-c957-43bd-8b97-ec2f2f90468a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.062225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7f9466b0-836b-4547-a35a-c42072e5dcb6 req-f19bf4db-c957-43bd-8b97-ec2f2f90468a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.062644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7f9466b0-836b-4547-a35a-c42072e5dcb6 req-f19bf4db-c957-43bd-8b97-ec2f2f90468a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.125460 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7f9466b0-836b-4547-a35a-c42072e5dcb6 req-f19bf4db-c957-43bd-8b97-ec2f2f90468a service nova] Creating event network-vif-deleted:ce5bb72e-fd10-46e7-9de4-397c9fd6374e for instance 9faf7890-5c09-4c6e-89f9-5ed76813731c on n-h2-863052-1 Oct 31 14:07:40.131991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:40.132615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:40.133870 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7f9466b0-836b-4547-a35a-c42072e5dcb6 req-f19bf4db-c957-43bd-8b97-ec2f2f90468a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133950 Oct 31 14:07:40.134865 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 701/1192] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:40.140203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.149205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.150614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.153029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.153864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.156341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.209882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:40.211096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:40.234053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.235975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.236770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.245114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.247344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.249239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.555024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:40.568095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:40.570345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:40.571799 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33cf0801-dc30-4f89-b6ba-64e56604982a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.366978 Oct 31 14:07:40.588012 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 702/1193] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:40 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:40.668174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:40.696040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa5c058e-7a79-416a-8884-0a1c62068bc2 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1466 microversion: 2.1 time: 0.565529 Oct 31 14:07:40.698311 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 492/1194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:40 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1466 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:40.710779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:40.716602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:40.735297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.737875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.739658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.741502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.747114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.748707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.853537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:40.855145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:40.855781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:40.856585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lazy-loading 'fault' on Instance uuid 9faf7890-5c09-4c6e-89f9-5ed76813731c {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:40.928871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Action: 'update', calling method: .version_select at 0x7fe107760430>, body: {"quota_set": {"ram": "5120"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:41.005259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:41.018582 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c8a4991-3511-48e3-a3c6-89251f050791 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 200 len: 1315 microversion: 2.1 time: 0.315830 Oct 31 14:07:41.020516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 493/1195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:40 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:41.031283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-873666408", "metadata": {"image_type": "test"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:41.034104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:41.047748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.048611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.049275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.050227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.051217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.051819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.090266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.090766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.091210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.091939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.096423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.097079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.133689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Getting quotas for project 35c83f504b5e41169372fb73cffd18a5. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:41.144357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Getting quotas for user dfe88786f3e240739b5f84f1f0f43ed4 and project 35c83f504b5e41169372fb73cffd18a5. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:41.200035 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19470780-814a-48d0-8e8c-459081f9749e tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47" status: 200 len: 148 microversion: 2.57 time: 0.610898 Oct 31 14:07:41.221550 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 703/1196] 10.222.0.27 () {62 vars in 1303 bytes} [Mon Oct 31 14:07:40 2022] PUT /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47 => generated 148 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:07:41.232366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:41.233339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:41.247519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.251964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.252626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.253552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.254209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.259193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.404386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:41.421229 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7fb2fec-701c-4825-9d2c-84c761ebcd23 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.196774 Oct 31 14:07:41.421762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 704/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:41 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:41.429214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:41.432337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:41.447505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.450325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.450965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.456125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.456652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.457257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.531494 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce4ec82c-277b-4ee1-92d2-48f1fc2ee802 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "POST /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad/action" status: 202 len: 0 microversion: 2.1 time: 0.508823 Oct 31 14:07:41.534707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 494/1198] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:07:41 2022] POST /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:07:41.540942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Calling method '.version_select at 0x7fe1078458b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:41.603199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:41.616331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:41.620572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:41.632844 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-495b4791-6750-41ec-84c6-8668cb2ecd53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.210001 Oct 31 14:07:41.633451 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 705/1199] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:41 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:41.646824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d30bb297-3081-4581-b975-4847a32d1646 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10776be50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:41.716020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.716499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.716953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.722648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.723026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.723465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.747319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d30bb297-3081-4581-b975-4847a32d1646 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.112733 Oct 31 14:07:41.748305 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 706/1200] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:41 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:41.769507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:41.780441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:41.783875 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77c07fe1-fd4e-4a80-9a0d-e5284d4a4dcf tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47/detail" status: 200 len: 463 microversion: 2.57 time: 0.244522 Oct 31 14:07:41.784612 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 495/1201] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 31 14:07:41 2022] GET /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47/detail => generated 463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:07:41.797836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.807837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.808963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.810447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:41.811701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:41.812518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:41.980591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7d7835e-e693-4ccc-80bf-c42d79692ef4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'create', calling method: .version_select at 0x7fe107845a60>, body: {"keypair": {"name": "tempest-keypair-1298726212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZFbXZSxAZWTrnRgDdlRqeJsmQ53C0op/9JMdLH0+C0uXPjsm9Gucs2FfHpmqGVVrezSe3JhYDQy9dI1n86/nvFf3DOPJiasx+8ywwRlKXBox13J7N4pyHu8L4hjh5Img=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:42.014938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f7d7835e-e693-4ccc-80bf-c42d79692ef4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for project 43d946eea72d40e08829491c65b4e750. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:42.025379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f7d7835e-e693-4ccc-80bf-c42d79692ef4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for user f6d0e8b2b04b47e69d87f436eb387941 and project 43d946eea72d40e08829491c65b4e750. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:42.069466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7d7835e-e693-4ccc-80bf-c42d79692ef4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177098 Oct 31 14:07:42.071842 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 496/1202] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:07:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:42.077637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Action: 'update', calling method: .version_select at 0x7fe1079393a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:42.179975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.180752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.182194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.187456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.188250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.188869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.297612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.298263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.299866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.309822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.310585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.312253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.334149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:42.470987 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca02712a-fe8b-4a3f-838d-cb78c28e31e5 tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47?user_id=505cfd694d7444a186d47a1b1aaabe68" status: 200 len: 148 microversion: 2.57 time: 0.397621 Oct 31 14:07:42.471644 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 497/1203] 10.222.0.27 () {62 vars in 1384 bytes} [Mon Oct 31 14:07:42 2022] PUT /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47?user_id=505cfd694d7444a186d47a1b1aaabe68 => generated 148 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:07:42.476177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:42.476915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:42.499097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.499610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.503340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.504141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.504617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.505058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.522879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c HTTP/1.1 Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:07:42.524598 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:07:42.526016 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9faf7890-5c09-4c6e-89f9-5ed76813731c'} Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:42.526836 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:07:42.529630 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:07:42.532662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:42.532662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae8a7aa4-1b87-47fc-86ab-928d1150bb62 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 404 len: 111 microversion: 2.1 time: 0.053501 Oct 31 14:07:42.532662 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 498/1204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:42 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:07:42.538360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:42.541203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:42.550480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.551241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.551826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.552696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.553160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.553589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.612078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:42.631460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:42.635517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:42.637175 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b76418f1-352f-4c11-bae5-d227d8bda576 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.878888 Oct 31 14:07:42.640526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 707/1205] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:41 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:42.651310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6587ac36-c0c8-41e9-a7e5-99bac14d1aed tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] Calling method '.version_select at 0x7fe1077c6820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:42.696454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:42.720529 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fc820565-27b8-47fe-8823-0cdb0468d857 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.191284 Oct 31 14:07:42.722094 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 499/1206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:42 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:42.739302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fd8f7877-be18-4b78-a5a1-63eb72210395 req-67c1f868-107e-44b1-86c8-471c28f883a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45999f51-af1a-4ad7-bda9-28b183262640", "name": "network-vif-deleted", "tag": "90a9817d-062b-427f-8499-cdc224521d8f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:42.784569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fd8f7877-be18-4b78-a5a1-63eb72210395 req-67c1f868-107e-44b1-86c8-471c28f883a1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.789989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fd8f7877-be18-4b78-a5a1-63eb72210395 req-67c1f868-107e-44b1-86c8-471c28f883a1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.790753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fd8f7877-be18-4b78-a5a1-63eb72210395 req-67c1f868-107e-44b1-86c8-471c28f883a1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.803671 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fd8f7877-be18-4b78-a5a1-63eb72210395 req-67c1f868-107e-44b1-86c8-471c28f883a1 service nova] Creating event network-vif-deleted:90a9817d-062b-427f-8499-cdc224521d8f for instance 45999f51-af1a-4ad7-bda9-28b183262640 on n-h2-863052-1 Oct 31 14:07:42.813718 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fd8f7877-be18-4b78-a5a1-63eb72210395 req-67c1f868-107e-44b1-86c8-471c28f883a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090046 Oct 31 14:07:42.816853 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 500/1207] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:42.832460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:42.833490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:42.844299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.846461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.847119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.849017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:42.850884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:42.852849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:42.856678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6587ac36-c0c8-41e9-a7e5-99bac14d1aed tempest-QuotasAdminTestV257-409559169 tempest-QuotasAdminTestV257-409559169-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47?user_id=505cfd694d7444a186d47a1b1aaabe68" status: 200 len: 190 microversion: 2.57 time: 0.213892 Oct 31 14:07:42.860781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 708/1208] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 31 14:07:42 2022] GET /compute/v2.1/os-quota-sets/33c40b1618464efc84b0c245a9258e47?user_id=505cfd694d7444a186d47a1b1aaabe68 => generated 190 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:07:42.868783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74f055c7-1c97-4d3a-8b60-a804ef61bfb1 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077b54c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:42.950141 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74f055c7-1c97-4d3a-8b60-a804ef61bfb1 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.087932 Oct 31 14:07:42.951152 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 709/1209] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:42 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:42.975667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1273585042", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:43.010265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:43.032727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:43.037827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:43.052112 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-979aec6d-c58a-4c27-b0fb-8e8185b73c8e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.233996 Oct 31 14:07:43.066828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 501/1210] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:42 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:43.149092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] validate_networks() for [('c215db42-8564-459b-9f3c-e55acebc1201', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:43.677142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:43.677765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:43.690765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:43.691273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:43.691719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:43.692432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:43.701306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:43.701811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:43.953981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:43.954994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:43.955798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:43.956376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:43.956952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:43.970696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:43.971428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:43.972075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:43.973043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:43.973683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:43.974309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:43.995594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for project 1430823979f84df092a344321a69fce5. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:44.001386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Getting quotas for user 447b90ed71f148b79158ff5db202f274 and project 1430823979f84df092a344321a69fce5. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:44.016358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:44.019049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:44.064101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.089389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73cc7323-0990-4933-83fa-0adfbcaa4c63 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.124523 Oct 31 14:07:44.090898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.091804 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 710/1211] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:44.095837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.097298 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65286037-6ac6-4bc1-9bf6-a6407e1be96d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.425263 Oct 31 14:07:44.100816 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 502/1212] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:43 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:07:44.102435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:44.104358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:44.114447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:44.118825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73b058cf-cef1-4a90-a805-a21c7f2ef13d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107845790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:44.124586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:44.125054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:44.127491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:44.127686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:44.128053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:44.245664 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73b058cf-cef1-4a90-a805-a21c7f2ef13d tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.143313 Oct 31 14:07:44.246827 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 503/1213] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:44 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:44.258933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.259146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:44.259614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:44.273016 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8081707e-956c-4c30-8127-e243b5c476f6 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.179481 Oct 31 14:07:44.273625 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 711/1214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:44 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:44.279349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:44.281100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:44.283668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:44.284633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:44.286912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:44.289084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:44.292707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87b63d2a-feac-44a0-8cb2-9d13a2426f6b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:44.293360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87b63d2a-feac-44a0-8cb2-9d13a2426f6b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:44.450293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87b63d2a-feac-44a0-8cb2-9d13a2426f6b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.459019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87b63d2a-feac-44a0-8cb2-9d13a2426f6b tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1225 microversion: 2.1 time: 0.184129 Oct 31 14:07:44.459592 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 712/1215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:44 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:44.460535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.482502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.486277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:44.499668 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-653503c7-6d12-4aa9-8aae-97c731167984 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.250004 Oct 31 14:07:44.503532 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 504/1216] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:44 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:44.999310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-974575659", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "726ec790-fa70-4df0-af4a-a3e3b994a919"}], "security_groups": [{"name": "tempest-securitygroup--736207434"}], "key_name": "tempest-keypair-1298726212", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:45.126486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:45.127056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:45.134224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:45.134729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:45.135173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:45.135899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:45.136353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:45.136785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:45.279463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] validate_networks() for [('726ec790-fa70-4df0-af4a-a3e3b994a919', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:45.821174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:45.847590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:45.857040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:45.863204 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c5c36d6-a50d-46a1-b726-65ba4c82e750 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.739621 Oct 31 14:07:45.884485 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 505/1217] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:45 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:07:45.898634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7baa0b5-004f-4f09-b99f-36b9eaec4f3b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10785aee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:46.017847 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7baa0b5-004f-4f09-b99f-36b9eaec4f3b tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.129210 Oct 31 14:07:46.019359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 506/1218] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:45 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:46.028340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:46.034797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:46.049188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.053021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.053938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.055059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.055769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.056450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.230754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:46.244708 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69a9ed8e-255d-4902-9693-6aa471a4be13 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.223507 Oct 31 14:07:46.249965 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 507/1219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:46 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:46.266890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:46.268379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:46.281643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.282464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.283076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.285214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.285860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.287582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.462270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:46.463219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:46.464166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:46.465011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:46.465783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:46.466562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:46.471716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd31cbaf-9a2f-4a28-9d01-8181504df0bb tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1277 microversion: 2.1 time: 0.219876 Oct 31 14:07:46.472646 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 508/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:46 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:46.478034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:46.478815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:46.505790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.507442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.514917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.515702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.516188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.516628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.519933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.520530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.521380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.523076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.523724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.525016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.574030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=9,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:46.596071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:46.607397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for user f6d0e8b2b04b47e69d87f436eb387941 and project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:46.645923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:46.648150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:46.790509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:46.801986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:46.811093 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b14d15db-f266-4061-8c3f-956c7eecd071 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.817048 Oct 31 14:07:46.812065 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 713/1221] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:46.815715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:46.824478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebb3f636-6da7-4e92-99ac-2f79d1ecc949 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.350483 Oct 31 14:07:46.825096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f92dc4c6-c8a1-4bdb-9e36-9fcd5fbeae7f req-c7bc8752-a21d-4a5b-accb-e872cdbd8db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "name": "network-vif-plugged", "status": "completed", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:46.825870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 509/1222] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:46 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:46.844152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a4031ee-c867-41f8-865c-c05ca01cac46 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:46.851423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a4031ee-c867-41f8-865c-c05ca01cac46 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:46.858864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:46.883982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f92dc4c6-c8a1-4bdb-9e36-9fcd5fbeae7f req-c7bc8752-a21d-4a5b-accb-e872cdbd8db1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.886847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f92dc4c6-c8a1-4bdb-9e36-9fcd5fbeae7f req-c7bc8752-a21d-4a5b-accb-e872cdbd8db1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.891281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f92dc4c6-c8a1-4bdb-9e36-9fcd5fbeae7f req-c7bc8752-a21d-4a5b-accb-e872cdbd8db1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.923969 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f92dc4c6-c8a1-4bdb-9e36-9fcd5fbeae7f req-c7bc8752-a21d-4a5b-accb-e872cdbd8db1 service nova] Creating event network-vif-plugged:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:07:46.944101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f92dc4c6-c8a1-4bdb-9e36-9fcd5fbeae7f req-c7bc8752-a21d-4a5b-accb-e872cdbd8db1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130576 Oct 31 14:07:46.948826 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 714/1223] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:46.961434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:46.970389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:46.985049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.988323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.989891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:46.992729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:46.993309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:46.994904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a4031ee-c867-41f8-865c-c05ca01cac46 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:46.995575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:47.002759 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a4031ee-c867-41f8-865c-c05ca01cac46 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1238 microversion: 2.1 time: 0.174888 Oct 31 14:07:47.014864 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 510/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:46 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1238 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:47.036318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28ebfa85-1773-40c6-a6b9-0208c82963e7 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107899310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:47.144550 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28ebfa85-1773-40c6-a6b9-0208c82963e7 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.112097 Oct 31 14:07:47.148791 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 511/1225] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:47 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:47.280413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:47.281739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:47.294281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:47.296811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:47.302923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:47.303929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:47.304572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:47.305197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:47.489900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:47.504823 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d071628c-8792-4ac2-8e5a-98ab3f2468b5 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.236618 Oct 31 14:07:47.505441 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 512/1226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:47 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:47.524292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:47.524960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:47.543304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:47.543891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:47.544289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:47.557993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:47.560610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:47.563304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:47.563768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:47.578476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:47.580890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:47.592357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01a21819-ab3c-4110-a1b2-b1a67eba2c6d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.640997 Oct 31 14:07:47.596051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 715/1227] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:46 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:47.835524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:47.844094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b2acb86-ce31-4a4c-adbe-2638d6230985 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1283 microversion: 2.1 time: 0.337627 Oct 31 14:07:47.844685 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 513/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:47 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1283 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:47.863706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:47.864710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:47.876276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:47.876807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:47.891977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:47.892755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:47.893236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:47.893671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.027395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95db42fa-6abf-4aae-9146-bd1394d9ec92 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:48.028116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95db42fa-6abf-4aae-9146-bd1394d9ec92 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:48.143962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.153674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.156069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.164290 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e4f71d5-79a6-42f7-a325-215a5db56f5c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.310216 Oct 31 14:07:48.166078 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 716/1229] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:47 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:48.172948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5bb0053-4015-47c3-822d-d09667c530f3 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107768160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:48.269403 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5bb0053-4015-47c3-822d-d09667c530f3 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.101954 Oct 31 14:07:48.271109 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 717/1230] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:48 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:48.334091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95db42fa-6abf-4aae-9146-bd1394d9ec92 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.343124 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95db42fa-6abf-4aae-9146-bd1394d9ec92 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1238 microversion: 2.1 time: 0.319457 Oct 31 14:07:48.348420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 514/1231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:48 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1238 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:48.530647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:48.531383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:48.552010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:48.552820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:48.553462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.554431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:48.555115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:48.555761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.624919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:48.625957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:48.642027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:48.646771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:48.647431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.648451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:48.649076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:48.649728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.774090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.779180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:48.803665 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41f6baca-ee8b-4776-96fe-48713d27e72b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.275185 Oct 31 14:07:48.814747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 718/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:48 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:48.873187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:48.874086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:48.883434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:48.884308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:48.885010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.885807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:48.886417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:48.887524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:48.977312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.992295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:48.997195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:49.001379 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00d144f2-b775-414d-9b76-48c10e0b093d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.380755 Oct 31 14:07:49.005939 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 515/1233] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:48 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:49.198367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:49.199016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:49.216773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:49.217369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:49.217852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:49.218667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:49.219130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:49.219568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:49.501383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:49.522002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:49.526202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:49.533688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0c53ebb6-4a51-4f9c-8049-d384f88845d3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.339426 Oct 31 14:07:49.557431 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 516/1234] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:49 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:49.567437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fc83195d-cb65-4003-88cc-f2c0a561648a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1078b3dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:49.648407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:49.653155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fc83195d-cb65-4003-88cc-f2c0a561648a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.092623 Oct 31 14:07:49.653830 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 517/1235] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:49 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:49.663456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e378cab-b203-4a5a-8138-6d6c4016c849 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.791652 Oct 31 14:07:49.664548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 719/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:48 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:49.681879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:49.683390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:49.695068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:49.696780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:49.700034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:49.704566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:49.706379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:49.707053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:49.832780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:49.833449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:49.848408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:49.848916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:49.849357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:49.850498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:49.852086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:49.852559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:49.856907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:49.865991 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47c91316-0c56-4d8f-8215-9b8f95a37391 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1296 microversion: 2.1 time: 0.205266 Oct 31 14:07:49.867753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 518/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:49 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1296 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:49.995141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:50.010652 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31045738-b06f-4856-911a-a1e21a8b533b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.181542 Oct 31 14:07:50.013539 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 720/1238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:49 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:50.034978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:50.035822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:50.045607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.046578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.047824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:50.048894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.049582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.050562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:50.516219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:50.534816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:50.539460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:50.542739 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-53997018-c16c-4b95-853e-ec7638b38e08 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.511594 Oct 31 14:07:50.546856 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 519/1239] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:50 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:50.574031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:50.574674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:50.585165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.588250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.588896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:50.590460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.599756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.600589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:50.633005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-079ff515-5276-4b41-a23c-b34ba064b3d3 req-911d8609-a217-448d-b498-402198d55ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1", "tag": "0ba09d4a-0778-409d-a6cf-7029a790ab9d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:50.657431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-079ff515-5276-4b41-a23c-b34ba064b3d3 req-911d8609-a217-448d-b498-402198d55ac5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.658060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-079ff515-5276-4b41-a23c-b34ba064b3d3 req-911d8609-a217-448d-b498-402198d55ac5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.661153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-079ff515-5276-4b41-a23c-b34ba064b3d3 req-911d8609-a217-448d-b498-402198d55ac5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:50.716817 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-079ff515-5276-4b41-a23c-b34ba064b3d3 req-911d8609-a217-448d-b498-402198d55ac5 service nova] Creating event network-changed:0ba09d4a-0778-409d-a6cf-7029a790ab9d for instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 on n-h1-863052-1 Oct 31 14:07:50.752932 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-079ff515-5276-4b41-a23c-b34ba064b3d3 req-911d8609-a217-448d-b498-402198d55ac5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126366 Oct 31 14:07:50.759649 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 520/1240] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:07:50.783716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c607b69-1cbd-40c7-86cf-d62079cd2365 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107813ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:50.857862 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c607b69-1cbd-40c7-86cf-d62079cd2365 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.096351 Oct 31 14:07:50.859151 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 521/1241] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:50 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:50.869528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:50.870583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:50.883496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.884262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.884898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:50.885966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:50.886622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:50.887241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:51.120752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:51.134796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:51.136248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:51.152534 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50b1e0de-a69c-41eb-bff6-999b6cd789ef tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.579586 Oct 31 14:07:51.153206 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 721/1242] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:50 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:51.163385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:51.164016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:51.179887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:51.180396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:51.180839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:51.181556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:51.182044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:51.188516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:51.521716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:51.533432 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6caa1870-60cf-49ca-9b1e-934d65650967 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.671332 Oct 31 14:07:51.546325 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 522/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:50 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:51.725053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-623987383", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:51.829493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:51.870221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:51.882589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec633612-7fc6-426f-928d-23d513fdcf95 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 0.727448 Oct 31 14:07:51.886417 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 722/1244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:51 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:51.908413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:51.910933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:51.924620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:51.929165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:51.929814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:51.930783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:51.933355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:51.934515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.091253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.108578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e387f862-cfd3-4648-ab70-d9c850d5ddd8 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1252 microversion: 2.1 time: 0.216598 Oct 31 14:07:52.110234 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 723/1245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:51 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1252 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:52.115904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:52.116788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:52.124817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.126724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.127776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.128775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.129456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.130109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.274376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:52.275040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:52.275578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:52.276072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:52.276563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:52.294562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.296008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.296762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.297969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.298653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.299275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.309233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=12 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:52.326789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Getting quotas for project 76489790a3e4477aba14b231646a3f98. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:52.334896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Getting quotas for user 1526c17fd6164655852807d8be044072 and project 76489790a3e4477aba14b231646a3f98. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:52.350108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:52.353138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:52.380687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.390250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.397954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.398846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a716eec-e5d8-4efe-a338-7ce70083b6eb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.287051 Oct 31 14:07:52.401706 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 724/1246] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:52 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:52.406395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bbb40c92-8109-4ecb-9519-f8144506d3cd tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077b29d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:52.459744 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37d257e9-c9a2-4503-93ba-cfdb60f42a47 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909587 Oct 31 14:07:52.460695 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 523/1247] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:52.469393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:52.470016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:52.514662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.515179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.515636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.516367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.516864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.517324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.520909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bbb40c92-8109-4ecb-9519-f8144506d3cd tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.117969 Oct 31 14:07:52.526211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:52.542586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 725/1248] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:52 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:52.548386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c78fcf1c-eca8-4218-8095-22301450eaaa req-ec1948bf-3954-4329-801c-37cca3e7e047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:52.570225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c78fcf1c-eca8-4218-8095-22301450eaaa req-ec1948bf-3954-4329-801c-37cca3e7e047 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.571029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c78fcf1c-eca8-4218-8095-22301450eaaa req-ec1948bf-3954-4329-801c-37cca3e7e047 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.571567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c78fcf1c-eca8-4218-8095-22301450eaaa req-ec1948bf-3954-4329-801c-37cca3e7e047 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.599598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c78fcf1c-eca8-4218-8095-22301450eaaa req-ec1948bf-3954-4329-801c-37cca3e7e047 service nova] Creating event network-changed:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:07:52.610019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c78fcf1c-eca8-4218-8095-22301450eaaa req-ec1948bf-3954-4329-801c-37cca3e7e047 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065842 Oct 31 14:07:52.614275 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 726/1249] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:07:52.629846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:52.632712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:52.651862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.652641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.653264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.654503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:52.656152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:52.656759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:52.695103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.745047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.751542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:52.763482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-703dd93b-96d9-473c-ac25-af31ee7eafbe tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.301717 Oct 31 14:07:52.764672 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 524/1250] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:52 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:52.772548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-432513219", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:07:52.908600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:07:53.022605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:53.050771 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c39fe21c-e38f-488b-80f8-719db6e18d8a tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.434121 Oct 31 14:07:53.066825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 727/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:52 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:53.075791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:53.078094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:53.105533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.131315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.131954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.134035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.134648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.135185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.498590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:53.508940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a092a936-d3fb-4fac-bec7-7c766c1f3964 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 0.456062 Oct 31 14:07:53.528305 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 728/1252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:53 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:53.539025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:53.540263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:53.549840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.550362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.550967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.551879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.553233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.554320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.613666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.614348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.614811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.615259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lazy-loading 'fault' on Instance uuid 45999f51-af1a-4ad7-bda9-28b183262640 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:53.638098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:07:53.638653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:07:53.639054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:07:53.639466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:07:53.639877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:07:53.654187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.655220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.655662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.656399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.656858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.657282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.677365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:53.697263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2964bd92-1507-42d3-868e-05074ab76288 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1257 microversion: 2.1 time: 0.166787 Oct 31 14:07:53.698352 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 729/1253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:53 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:53.699823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Getting quotas for project 76489790a3e4477aba14b231646a3f98. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:07:53.705602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:53.706751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:53.713593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.714391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.714987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.715878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.717570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.718016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Getting quotas for user 1526c17fd6164655852807d8be044072 and project 76489790a3e4477aba14b231646a3f98. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:07:53.718946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.742033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:07:53.752505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:07:53.858951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29b7378e-11fd-446f-af8f-dfe41b41efcd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092403 Oct 31 14:07:53.862781 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 525/1254] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:07:53.868052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70a165de-51f9-4006-8117-012cf8efb859 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107813ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:53.968224 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70a165de-51f9-4006-8117-012cf8efb859 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.104066 Oct 31 14:07:53.968801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 526/1255] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:53 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:53.971835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:53.977593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:53.978241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:53.990261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:53.991988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.992484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.993138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:53.995408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:53.996399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:53.996884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:53.997010 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-772ddfb1-98ed-4779-80a3-ce61449a7b99 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.297180 Oct 31 14:07:53.997315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.004898 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 730/1256] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:53 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:54.020429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-051206f4-72d8-4309-8375-f146eba8d3f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:54.022429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-051206f4-72d8-4309-8375-f146eba8d3f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:54.136430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-051206f4-72d8-4309-8375-f146eba8d3f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.139340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=49 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:54.157971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-051206f4-72d8-4309-8375-f146eba8d3f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1213 microversion: 2.1 time: 0.146717 Oct 31 14:07:54.174947 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 731/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:54 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:54.190404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:54.191286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:54.206649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.207265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.207810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.208630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.209196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.209729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.218987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.228227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.241412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.261096 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd76d4a1-5e72-445c-b7f0-b8d9ed7bc561 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.291044 Oct 31 14:07:54.265714 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 527/1258] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:53 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:54.407138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.419070 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c99b2316-9689-4a95-bcc7-350ebb54f4c0 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.236054 Oct 31 14:07:54.419867 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 732/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:54 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:54.536500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:54.537384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:54.548871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.549581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.550282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.551098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.551511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.552122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.724633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:54.725517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:54.726387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.735474 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4186017a-140d-4d8c-b200-4604062af0c0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 0.204387 Oct 31 14:07:54.737353 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 528/1260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:54 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:54.740813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.741315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.741761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.742506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.743010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.743413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.805446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:54.805945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:54.806418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:54.806882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lazy-loading 'fault' on Instance uuid 45999f51-af1a-4ad7-bda9-28b183262640 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:07:54.878054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee28deb1e94414782841e09e0db6789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeccdf8ef7e74647969d606c07c4e0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:54.891245 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-227b29c6-0ac0-4f96-8862-e98c76624a7b tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 200 len: 1257 microversion: 2.1 time: 0.170602 Oct 31 14:07:54.892083 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 733/1261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:54 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:54.994859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d67482d-0afa-43f3-accf-6544521229e8 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107899040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.023707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.024366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:55.038337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.039121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.039343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.040138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.040643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.041140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.092088 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d67482d-0afa-43f3-accf-6544521229e8 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.111457 Oct 31 14:07:55.098501 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 529/1262] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:54 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:55.187398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.188374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:55.195860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.196875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.197544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.198560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.199289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.200295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.319511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.328294 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1c27378a-9f30-4f5f-bfd7-c1e76fb2feef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1265 microversion: 2.1 time: 0.145436 Oct 31 14:07:55.331547 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 530/1263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:55 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:55.338520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.340079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:55.355262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.355838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.356702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.357985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.358552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.366102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.374651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.385513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.396756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.398018 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-338dfb74-8224-4a8e-af52-06926d718ea2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.378642 Oct 31 14:07:55.399114 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 734/1264] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:55 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:55.446120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.446782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:55.461621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.462119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.462606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.463309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.463763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.464193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.487211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.502010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.503727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.511684 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc6661aa-8ff0-43d4-9c43-3a4ad6753d99 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.177682 Oct 31 14:07:55.523317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 531/1265] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:55 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:55.692562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:55.721096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c03c31e-e793-42ec-8998-87b0160e3ab4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.272238 Oct 31 14:07:55.723567 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 735/1266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:55 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:55.768006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.768006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:55.787913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.788579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.800058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.801049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.803733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.809052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.919382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:55.920290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] [instance: 45999f51-af1a-4ad7-bda9-28b183262640] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:55.937104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.942896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.946577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:55.947585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:55.951094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:55.955331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.017049 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] HTTP exception thrown: Instance 45999f51-af1a-4ad7-bda9-28b183262640 could not be found. Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Request method failure captured: Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 HTTP/1.1 Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Y4o2HFCNnevySN2szEO398vyeJrCBdgG8hzdj_i2TMDvTZ_gHo6YC2cGGfbigikX881QOx0TxPa5CksfBFKf-pL-S9qIlXYAu_IZWW1X6TiRGrrQq_cA5F00u9EDl9s80ovA5rwGHpDHsrwj2BTw5szVfAi92StfEKnutfZZqtxHo Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: eeccdf8ef7e74647969d606c07c4e0ad Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestBootFromVolume-1851883232 Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:07:56.021443 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeccdf8ef7e74647969d606c07c4e0ad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeccdf8ef7e74647969d606c07c4e0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeccdf8ef7e74647969d606c07c4e0ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeccdf8ef7e74647969d606c07c4e0ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestBootFromVolume-1851883232 Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: eeccdf8ef7e74647969d606c07c4e0ad Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1851883232 Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestBootFromVolume-1851883232-project Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: dee28deb1e94414782841e09e0db6789 Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestBootFromVolume-1851883232-project Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 45999f51-af1a-4ad7-bda9-28b183262640 could not be found. Oct 31 14:07:56.023217 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '45999f51-af1a-4ad7-bda9-28b183262640'} Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45999f51-af1a-4ad7-bda9-28b183262640 could not be found. Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:07:56.024137 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45999f51-af1a-4ad7-bda9-28b183262640 could not be found. Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45999f51-af1a-4ad7-bda9-28b183262640 could not be found. Oct 31 14:07:56.025634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:07:56.033177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Returning 404 to user: Instance 45999f51-af1a-4ad7-bda9-28b183262640 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:07:56.034442 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e384af70-c272-4ee9-9aa7-19bd04603c24 tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640" status: 404 len: 111 microversion: 2.1 time: 0.121045 Oct 31 14:07:56.042571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 736/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:55 2022] GET /compute/v2.1/servers/45999f51-af1a-4ad7-bda9-28b183262640 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:07:56.066399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d1b8618d-bd04-4cf0-ad95-3d6eb22bcdbd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] Calling method '.version_select at 0x7fe107834160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:56.119544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d1b8618d-bd04-4cf0-ad95-3d6eb22bcdbd tempest-ServersTestBootFromVolume-1851883232 tempest-ServersTestBootFromVolume-1851883232-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271316180" status: 202 len: 0 microversion: 2.1 time: 0.075568 Oct 31 14:07:56.145210 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 737/1268] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:07:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271316180 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:07:56.162297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e61a8d00-0ee7-4564-9389-05c02ee977df tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10777e550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:56.266961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e61a8d00-0ee7-4564-9389-05c02ee977df tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.117951 Oct 31 14:07:56.277159 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 738/1269] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:56 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:56.325955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:56.336836 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6078861-6a52-447b-a853-3a67e7f917c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 0.575570 Oct 31 14:07:56.342857 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 532/1270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:55 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:56.354843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:56.355362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:56.372083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:56.372591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:56.375820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.377547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:56.378051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:56.381166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.425131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:56.425754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:56.436274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:56.436780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:56.437228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.445024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:56.445532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:56.445981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.549973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:56.728033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:56.753886 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-890ebce5-0ee0-49e3-9c47-664485b40909 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1271 microversion: 2.1 time: 0.402033 Oct 31 14:07:56.760834 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 739/1271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:56 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1271 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:56.781483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:56.787210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:56.805415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:56.806282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:56.807139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.808674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:56.809552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:56.813004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:56.828213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:56.993247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.009761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.016845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.024286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36666816-1cdd-46f1-b15b-5e57910ee465 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.603069 Oct 31 14:07:57.030072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 533/1272] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:56 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:07:57.045800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:57.051583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:57.065999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:57.066772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:57.067519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:57.068501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:57.069112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:57.069693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:57.106734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.119082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.124294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.139223 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-036c3ec7-a1e4-42cd-82a0-0123cddb2d0b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.374655 Oct 31 14:07:57.139835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 740/1273] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:56 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:57.282985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eddd91e8-e030-46d1-97f2-ba99f7656bf4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077600d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:57.387632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eddd91e8-e030-46d1-97f2-ba99f7656bf4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.108369 Oct 31 14:07:57.394276 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 741/1274] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:57 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:07:57.406010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:57.410144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:57.422448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:57.430802 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f318542b-21c0-41ec-92a1-c4abecf46010 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.399312 Oct 31 14:07:57.431378 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 534/1275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:57 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:57.448923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:57.453707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:57.454464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:57.455405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:57.456027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:57.456620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:57.784731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:57.785532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:57.801498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:57.802004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:57.802543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:57.803273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:57.803733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:57.804160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.061368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.107929 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-55ec1251-38ef-4cdf-84a5-ecbe8f466d66 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1271 microversion: 2.1 time: 0.326672 Oct 31 14:07:58.114420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 535/1276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:57 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:58.131635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:58.135164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:58.149574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:58.152226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:58.153461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.155890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:58.156605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:58.157234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.359282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.372669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.381643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.385568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.390923 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb01ea8b-1511-49f3-8f00-8daf023eb59c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.274412 Oct 31 14:07:58.404552 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 536/1277] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:58 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:58.404786 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-609463a2-7c52-46bc-9bbe-70e2e26c5c43 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 1.005774 Oct 31 14:07:58.404786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 742/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:57 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:58.412605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:58.419955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-825b76fa-38a8-46ea-8cbd-dbe35520105a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077609d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:58.420805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:58.427965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:58.428467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:58.428904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.429609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:58.430066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:58.430521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.506843 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-825b76fa-38a8-46ea-8cbd-dbe35520105a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.098035 Oct 31 14:07:58.507474 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 743/1279] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:07:58 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:58.526504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:58.530100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:58.544532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:58.545665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:58.546644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.548548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:58.549537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:58.550239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:58.593263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.609911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.611409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.631377 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f0138cb-a860-4670-a040-750e2358a062 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.238235 Oct 31 14:07:58.631634 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 537/1280] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:58 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:07:58.828288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:58.837610 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99ec94f9-071c-4f06-ad46-e3a5a2163924 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.328736 Oct 31 14:07:58.845131 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 744/1281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:58 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:59.139456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:59.140073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:59.159173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:59.159674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:59.165451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:59.166276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:59.168864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:59.169340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:59.418581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:59.421641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:59.433125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:59.433836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:59.438055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:59.439420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:59.442533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:59.443173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:59.506759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:59.518527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b929338-f866-47ae-a7c8-fdd295a2abd3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.383227 Oct 31 14:07:59.522802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 538/1282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:59 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:07:59.539508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:07:59.543675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:07:59.564753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:59.565292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:59.566968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:59.567724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:07:59.570339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:07:59.571014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:07:59.969733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:07:59.990407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.006459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.007806 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-728f57d5-dd9f-4112-9ce7-5a94953946fa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.593239 Oct 31 14:08:00.014513 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 745/1283] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:07:59 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:00.024253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28201f4d-ca0f-4791-9a5c-fdfbd7b304ab tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077609d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:00.117036 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28201f4d-ca0f-4791-9a5c-fdfbd7b304ab tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.101334 Oct 31 14:08:00.120499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 746/1284] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:00 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:00.143200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:00.144016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:00.162032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.162708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.163242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.164058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.172565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.173167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.305776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.320338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.321903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.333619 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b2eee23-8b28-4784-9516-4607743a6c8a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.211506 Oct 31 14:08:00.354197 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 747/1285] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:00 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:00.354197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:00.354197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:00.367735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.367735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.367735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.367735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.368232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.368232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.650717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.670438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50488d53-c3ca-4b2a-a5a1-a788d2fdec6a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 1.141774 Oct 31 14:08:00.686691 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 539/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:07:59 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:00.692445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:00.694109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:00.704041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.705167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.705797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.706709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.707340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.707943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.887478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:00.909559 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45092f92-2c32-49a8-bd6e-efa7fef10599 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.565761 Oct 31 14:08:00.912464 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 748/1287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:00 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:00.922340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-dd0edc81-b70f-4e2a-af35-5e2df0f37ca1 req-831ba5a5-9036-4245-8eac-4b6859a8b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-plugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:00.934670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dd0edc81-b70f-4e2a-af35-5e2df0f37ca1 req-831ba5a5-9036-4245-8eac-4b6859a8b104 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:00.936022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dd0edc81-b70f-4e2a-af35-5e2df0f37ca1 req-831ba5a5-9036-4245-8eac-4b6859a8b104 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:00.936629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dd0edc81-b70f-4e2a-af35-5e2df0f37ca1 req-831ba5a5-9036-4245-8eac-4b6859a8b104 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:00.952412 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-dd0edc81-b70f-4e2a-af35-5e2df0f37ca1 req-831ba5a5-9036-4245-8eac-4b6859a8b104 service nova] Creating event network-vif-plugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:08:00.958110 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-dd0edc81-b70f-4e2a-af35-5e2df0f37ca1 req-831ba5a5-9036-4245-8eac-4b6859a8b104 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044095 Oct 31 14:08:00.959408 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 749/1288] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:01.038833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:01.039919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:01.054017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.054825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.055447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.056348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.057016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.057607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.404998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.414252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.416609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.417108 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1faf5519-7f08-4e18-869a-eeca1e946a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.383497 Oct 31 14:08:01.442743 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 750/1289] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:01 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:08:01.455635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0528776-a79f-4ff3-a0fc-3fac3c87ec67 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077120d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:01.531441 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0528776-a79f-4ff3-a0fc-3fac3c87ec67 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.087402 Oct 31 14:08:01.539695 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 751/1290] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:01 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:01.544129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.546568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:01.547289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:01.557878 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8a11e5b-0533-4797-8101-5443981f0dd1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.869582 Oct 31 14:08:01.560172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.566788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.567377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.568523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.569096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.569629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.578073 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 540/1291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:00 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:01.686844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.695504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:01.696131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:01.704318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.706035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:01.707707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.708195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.710372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.712303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4688010b-4e3f-4287-bb4e-033c1f6d0419 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.178852 Oct 31 14:08:01.712965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.713457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.713891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.722107 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 752/1292] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:01 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:01.937004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:01.937892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:01.958463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.959579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.966127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:01.967065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:01.967603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:01.968103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:02.028977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:02.040089 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8561490-3361-4ad2-b8b4-3badb5363ea9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 0.350962 Oct 31 14:08:02.043658 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 541/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:01 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:02.447355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:02.448026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:02.469013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:02.469511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:02.478898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:02.479952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:02.480590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:02.481182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:02.743225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:02.762130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:02.764521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:02.765923 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d82f768-d666-4dda-800c-ebeab9719567 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.323609 Oct 31 14:08:02.768870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 542/1294] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:02 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:02.773688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7f9b3b9b-f1c8-47a6-9944-cd465fa4e06a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1078199d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:02.840909 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7f9b3b9b-f1c8-47a6-9944-cd465fa4e06a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.070674 Oct 31 14:08:02.848973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 543/1295] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:02 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:02.854424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:02.855180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:02.867060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:02.873757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:02.875697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:02.879082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:02.879681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:02.880209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:02.922430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:02.983569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:03.008424 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49e42463-203a-4b22-b6a5-73f21de13126 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 1.076535 Oct 31 14:08:03.022387 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 753/1296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:01 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:03.030511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:03.031517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:03.048808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.049622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.050272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.051273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.051957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.052609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.235846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:03.236013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:03.248612 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-88991928-b19f-4810-9ad8-6337ff750513 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.404223 Oct 31 14:08:03.249217 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 544/1297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:02 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:03.252644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:03.255077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:03.258408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-da336331-f66b-4087-84ac-ac5994e00818 req-977a0de9-d650-4039-bee2-431d1950e222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1", "name": "network-vif-plugged", "status": "completed", "tag": "0ba09d4a-0778-409d-a6cf-7029a790ab9d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:03.261983 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-888c0f80-198b-4650-9f06-e896d6c14dae tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.238192 Oct 31 14:08:03.262849 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 754/1298] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:03 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:03.267896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f964ea16-79c5-4019-a41f-861085ea90eb req-f617b2e0-b746-40b6-b85a-a1cf7501b1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0631634-74b7-48fd-b6af-148d5db7360e", "tag": "2da7be65-1a9e-457a-a807-9448f6870119"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:03.277128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:03.280640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f964ea16-79c5-4019-a41f-861085ea90eb req-f617b2e0-b746-40b6-b85a-a1cf7501b1b7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.281416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f964ea16-79c5-4019-a41f-861085ea90eb req-f617b2e0-b746-40b6-b85a-a1cf7501b1b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.282093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f964ea16-79c5-4019-a41f-861085ea90eb req-f617b2e0-b746-40b6-b85a-a1cf7501b1b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.282351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:03.287342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da336331-f66b-4087-84ac-ac5994e00818 req-977a0de9-d650-4039-bee2-431d1950e222 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.287342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da336331-f66b-4087-84ac-ac5994e00818 req-977a0de9-d650-4039-bee2-431d1950e222 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.287607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da336331-f66b-4087-84ac-ac5994e00818 req-977a0de9-d650-4039-bee2-431d1950e222 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.311160 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f964ea16-79c5-4019-a41f-861085ea90eb req-f617b2e0-b746-40b6-b85a-a1cf7501b1b7 service nova] Creating event network-changed:2da7be65-1a9e-457a-a807-9448f6870119 for instance f0631634-74b7-48fd-b6af-148d5db7360e on n-h2-863052-1 Oct 31 14:08:03.318068 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f964ea16-79c5-4019-a41f-861085ea90eb req-f617b2e0-b746-40b6-b85a-a1cf7501b1b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053726 Oct 31 14:08:03.319748 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 755/1299] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:03.325378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:03.326537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:03.333593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.334544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.335320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.336255 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-da336331-f66b-4087-84ac-ac5994e00818 req-977a0de9-d650-4039-bee2-431d1950e222 service nova] Creating event network-vif-plugged:0ba09d4a-0778-409d-a6cf-7029a790ab9d for instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 on n-h1-863052-1 Oct 31 14:08:03.336524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.337188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.337897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.353628 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-da336331-f66b-4087-84ac-ac5994e00818 req-977a0de9-d650-4039-bee2-431d1950e222 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099840 Oct 31 14:08:03.354512 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 545/1300] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:03.386201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:03.388049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:03.396750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.397291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.397895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.401359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.401359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.401359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.674735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:03.733610 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6f959ad-3248-4dbc-aaff-de4de106b88d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1809 microversion: 2.1 time: 0.354161 Oct 31 14:08:03.756903 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 546/1301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:03 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:03.766065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:03.770936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.771717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.772384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.773391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.774087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.796466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.798709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:03.877830 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-59c4eef3-d75e-41c2-a88c-5fe306402f38 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.117599 Oct 31 14:08:03.891033 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 547/1302] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:08:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:03.897115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:03.897995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:03.909181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.909937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.916825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:03.917939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:03.919248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:03.920477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.147388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.168239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.171677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.173139 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d6b8429-a059-42cb-adad-86341a0ba1e4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.280695 Oct 31 14:08:04.174019 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 548/1303] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:03 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:04.182529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5908f442-1e6f-4650-8560-d352c372278e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107864ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:04.207184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:04.263152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5908f442-1e6f-4650-8560-d352c372278e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.088048 Oct 31 14:08:04.275207 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 549/1304] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:04 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:04.275207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:04.275207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:04.291589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:04.292986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:04.293440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.294199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:04.295212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:04.295649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.541308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.559465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc7ddf44-0dad-4b6f-8457-4e97550053da tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1325 microversion: 2.1 time: 0.290226 Oct 31 14:08:04.572174 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 550/1305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:04 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1325 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:04.572174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:04.572174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:04.576614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:04.576614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:04.576614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.579262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:04.579262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:04.579816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.722072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.737132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab63db7e-f554-40ec-ad34-e54921dfd01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1363 microversion: 2.1 time: 1.414423 Oct 31 14:08:04.755680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 756/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:03 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1363 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:04.761831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:04.762734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:04.769729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:04.770596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:04.771240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.772126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:04.772742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:04.773349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:04.800756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.812658 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cc48f3c-528a-402f-bc19-dc53a1fadb6d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.250778 Oct 31 14:08:04.813892 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 551/1307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:04 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:04.916194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.928137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.930772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:04.942852 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b047cd17-c977-4593-8b71-bab84c301cc9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.184731 Oct 31 14:08:04.943941 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 757/1308] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:04 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:05.199021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:05.200039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:05.212590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:05.218125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:05.221802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:05.222897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:05.224036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:05.224696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:05.286910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aed15781-2368-4347-9599-0de2d84ff6bc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10771db80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:05.366946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aed15781-2368-4347-9599-0de2d84ff6bc tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.086524 Oct 31 14:08:05.372997 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 758/1309] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:05 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:05.587636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:05.588261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:05.602862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:05.603612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:05.604047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:05.604768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:05.605227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:05.605656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:05.834978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:05.850600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:05.852328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:05.859681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5773bb72-423b-4298-ab6e-940ba919ef5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.664329 Oct 31 14:08:05.860593 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 552/1310] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:05 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:05.883419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:05.886856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:05.917200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:05.921926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:05.925980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:05.927000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:05.927653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:05.931119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.221707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:06.241593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eeb83cd1-a6ff-4f12-8aeb-026c6b0da826 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1522 microversion: 2.1 time: 0.657914 Oct 31 14:08:06.255807 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 759/1311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:05 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:06.271343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:06.272366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:06.280134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.280856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.281510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.282228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.282836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.283412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.432975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:06.445667 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80112a36-e0f1-4d14-9489-50b832f01f8a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1549 microversion: 2.1 time: 0.583816 Oct 31 14:08:06.448570 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 553/1312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:05 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1549 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:06.458103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63894684-26f1-4c97-99c4-7026983ea01e", "tag": "b69c64f3-b22b-46c4-8bbc-2f57a49803cf"}, {"server_uuid": "60d6c9d2-b928-495e-a5cf-188bd6f5c7c8", "name": "network-vif-unplugged", "status": "completed", "tag": "3c9ce681-9ef5-4ef2-865a-938931cd612a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:06.491637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.492363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.493637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.526331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] Creating event network-changed:b69c64f3-b22b-46c4-8bbc-2f57a49803cf for instance 63894684-26f1-4c97-99c4-7026983ea01e on n-h2-863052-1 Oct 31 14:08:06.526845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] Creating event network-vif-unplugged:3c9ce681-9ef5-4ef2-865a-938931cd612a for instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 on n-h1-863052-1 Oct 31 14:08:06.562002 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2b6cc25e-0262-4826-8953-a65eaa8e97e0 req-8e506944-20b5-4dcb-a1cc-4af93f080a63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.109893 Oct 31 14:08:06.562642 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 554/1313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:06.577032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:06.577731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:06.609848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.610383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.610828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.611536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.611995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.612423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.690207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:06.698609 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-476fe09c-40c9-4d76-af04-bf10288be5c4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.441412 Oct 31 14:08:06.703055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 760/1314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:06 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:06.708388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:06.709090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:06.715440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.716138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.717887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.718876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:06.719496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:06.720125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:06.786488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:08:06.800044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:06.843872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:06.854788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:06.876883 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16912cfc-94df-439c-8953-becb0369f85c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1558 microversion: 2.91 time: 0.306918 Oct 31 14:08:06.885153 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 555/1315] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:06 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1558 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:06.912154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f0bad7c-e1ac-4458-8f26-144859b1ea21 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107821af0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:06.963888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:06.981727 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f0bad7c-e1ac-4458-8f26-144859b1ea21 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1421 microversion: 2.1 time: 0.081320 Oct 31 14:08:06.991632 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 556/1316] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:06 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:06.998152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:06.998990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:07.007186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.008314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.009100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.010530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.011220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.012002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.083935 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9fb423e4-27f1-4887-9b88-edbdca4d9fd3 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 204 len: 0 microversion: 2.1 time: 0.379189 Oct 31 14:08:07.088004 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 761/1317] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:08:06 2022] DELETE /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:07.095488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12be9bb2-e0e0-4b82-a171-7c04fe8e399a", "device": "/dev/xvdb"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:07.107313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:07.117287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.119138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.120043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.121264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.121937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.123145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.202978 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-080c1e8e-4244-45c2-8697-17e1f3fc4f23 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209753 Oct 31 14:08:07.215489 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 557/1318] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:08:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:07.227340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:07.227340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:07.254937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.257398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.257785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.258660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.270443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.271464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.611473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:07.627662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:07.632026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:07.633599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4dda3088-ca27-4d06-91b2-888f3ac83a30 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.416898 Oct 31 14:08:07.636763 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 558/1319] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:07 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:07.655875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:07.656828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:07.672020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.675233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.675940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:07.676891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:07.684261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:07.686704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.067817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:08.090690 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75e8d92d-e723-4c18-8208-2fe002661101 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1528 microversion: 2.1 time: 0.450865 Oct 31 14:08:08.095836 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 559/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:07 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1528 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:08.119333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:08.122823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:08.152120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.154529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.159161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.160282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.160760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.161194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.494834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:08.525828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd3847cb-97f0-4b95-8ac7-91d36e05e756 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.428613 Oct 31 14:08:08.526600 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 560/1321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:08 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:08.541249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:08.542419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:08.571251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.572124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.572905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.574219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.574912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.576142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.702658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:08.718496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:08.724562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:08.731480 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f94208a-59f3-4ab6-96f2-a256ae54680c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.203161 Oct 31 14:08:08.733310 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 561/1322] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:08 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:08.736395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1790318-8150-404f-a65f-11b848870b65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "POST /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.646749 Oct 31 14:08:08.737090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 762/1323] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:08:07 2022] POST /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 194 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:08.747276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3cf447f-7cc7-4178-8b0e-44129d1ba87c tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10785a430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:08.758291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f28f5cf6-50d2-434c-985f-745b0f0fe1b4 req-89ce640f-c99c-4571-8606-103ef24fd1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0631634-74b7-48fd-b6af-148d5db7360e", "name": "network-vif-plugged", "status": "completed", "tag": "2da7be65-1a9e-457a-a807-9448f6870119"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:08.772598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f28f5cf6-50d2-434c-985f-745b0f0fe1b4 req-89ce640f-c99c-4571-8606-103ef24fd1d0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.773273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f28f5cf6-50d2-434c-985f-745b0f0fe1b4 req-89ce640f-c99c-4571-8606-103ef24fd1d0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.773887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f28f5cf6-50d2-434c-985f-745b0f0fe1b4 req-89ce640f-c99c-4571-8606-103ef24fd1d0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.801456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f28f5cf6-50d2-434c-985f-745b0f0fe1b4 req-89ce640f-c99c-4571-8606-103ef24fd1d0 service nova] Creating event network-vif-plugged:2da7be65-1a9e-457a-a807-9448f6870119 for instance f0631634-74b7-48fd-b6af-148d5db7360e on n-h2-863052-1 Oct 31 14:08:08.815711 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f28f5cf6-50d2-434c-985f-745b0f0fe1b4 req-89ce640f-c99c-4571-8606-103ef24fd1d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073004 Oct 31 14:08:08.819677 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 763/1324] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:08.822594 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3cf447f-7cc7-4178-8b0e-44129d1ba87c tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1430 microversion: 2.1 time: 0.087530 Oct 31 14:08:08.823287 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 562/1325] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:08 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1430 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:08.832583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-50f6fb31-4f06-4115-b8a8-3b099ace7d3d req-1d21582a-6b17-4ca2-864b-be9be26377bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d6c9d2-b928-495e-a5cf-188bd6f5c7c8", "tag": "3c9ce681-9ef5-4ef2-865a-938931cd612a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:08.847054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:08.848019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-50f6fb31-4f06-4115-b8a8-3b099ace7d3d req-1d21582a-6b17-4ca2-864b-be9be26377bc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.848727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-50f6fb31-4f06-4115-b8a8-3b099ace7d3d req-1d21582a-6b17-4ca2-864b-be9be26377bc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.849323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-50f6fb31-4f06-4115-b8a8-3b099ace7d3d req-1d21582a-6b17-4ca2-864b-be9be26377bc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.849710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:08.856689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.858968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.859620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.873336 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-50f6fb31-4f06-4115-b8a8-3b099ace7d3d req-1d21582a-6b17-4ca2-864b-be9be26377bc service nova] Creating event network-changed:3c9ce681-9ef5-4ef2-865a-938931cd612a for instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 on n-h1-863052-1 Oct 31 14:08:08.880103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:08.880103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:08.881638 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-50f6fb31-4f06-4115-b8a8-3b099ace7d3d req-1d21582a-6b17-4ca2-864b-be9be26377bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059800 Oct 31 14:08:08.882803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:08.883021 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 764/1326] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:08.890306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a0f5512-099f-4b3f-bbe4-f260f5ca46ff tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077b54c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:09.012911 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a0f5512-099f-4b3f-bbe4-f260f5ca46ff tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 200 len: 1430 microversion: 2.1 time: 0.127878 Oct 31 14:08:09.014124 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 765/1327] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:08 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 1430 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:09.032749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:09.034622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:09.046000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.046561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.052389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.053224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.053731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.057201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.286844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:09.301621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a99db7d9-cd48-4336-8022-dcd85fb9dc8f tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1479 microversion: 2.1 time: 0.273493 Oct 31 14:08:09.317023 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 766/1328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:09 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1479 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:09.327369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:09.328105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:09.334925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.335521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.336184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.336977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.337501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.338294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.535338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:09.550507 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-909f6af4-2c4d-4911-9bf4-f3362de14d95 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1528 microversion: 2.1 time: 0.231660 Oct 31 14:08:09.551367 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 767/1329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:09 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1528 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:09.556550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:09.557300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:09.563938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.564923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.565506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.566414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.567158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.567756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.798750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:09.816808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52e62f83-502c-45e5-af93-3221f16e337e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 0.264124 Oct 31 14:08:09.835253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 768/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:09 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:09.850636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:09.851349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:09.862719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.863451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.864179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.866963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:09.867461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:09.867943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:09.941910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:09.952330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:09.964559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:09.967110 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb31fabd-16ee-4ed9-ba32-bd52313cf14a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 1.142756 Oct 31 14:08:09.972308 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 563/1331] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:08 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:09.982053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:10.006621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:10.008425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:10.024573 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40081c06-4898-4495-b537-ebff47e88582 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.187454 Oct 31 14:08:10.025727 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 769/1332] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:09 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:10.329918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:10.330574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:10.342150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.342739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.343243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:10.343964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.344427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.344856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:10.661242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:10.673672 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c4ba958-b67c-4de9-b231-de3c28de6c28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1466 microversion: 2.1 time: 0.344688 Oct 31 14:08:10.674552 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 770/1333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:10 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1466 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:10.701124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5b45a9a5-393b-4f57-9126-3b8600fc8c38 req-e233da68-afeb-4da1-b398-2d41ba593943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:10.702726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:10.706745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:10.718435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5b45a9a5-393b-4f57-9126-3b8600fc8c38 req-e233da68-afeb-4da1-b398-2d41ba593943 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.718917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5b45a9a5-393b-4f57-9126-3b8600fc8c38 req-e233da68-afeb-4da1-b398-2d41ba593943 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.723142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5b45a9a5-393b-4f57-9126-3b8600fc8c38 req-e233da68-afeb-4da1-b398-2d41ba593943 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:10.725409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.726107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.726630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:10.727404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.728062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.728522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:10.746344 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5b45a9a5-393b-4f57-9126-3b8600fc8c38 req-e233da68-afeb-4da1-b398-2d41ba593943 service nova] Creating event network-changed:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:08:10.764687 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5b45a9a5-393b-4f57-9126-3b8600fc8c38 req-e233da68-afeb-4da1-b398-2d41ba593943 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.488862 Oct 31 14:08:10.766688 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 564/1334] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:10.772093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5f123aa-074a-4982-92b0-e3cdb7e260c1 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107813e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:10.846430 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5f123aa-074a-4982-92b0-e3cdb7e260c1 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/cf380c16-a362-46be-bffa-e45fdf8f7e66" status: 200 len: 784 microversion: 2.1 time: 0.078253 Oct 31 14:08:10.847798 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 565/1335] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:10 2022] GET /compute/v2.1/images/cf380c16-a362-46be-bffa-e45fdf8f7e66 => generated 784 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:10.860725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:10.861728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:10.878543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.879581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.880637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:10.881877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:10.882592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:10.883228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:11.106213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.116716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b0f9938-01ff-49d2-a398-d08843c5a2aa tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1528 microversion: 2.1 time: 0.424386 Oct 31 14:08:11.121955 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 771/1336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:10 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:11.128235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10f228cf-c737-42be-9cbe-c3179ccf9539 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:11.148856 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10f228cf-c737-42be-9cbe-c3179ccf9539 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024281 Oct 31 14:08:11.151779 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 772/1337] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:08:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:11.168481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:11.171690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:11.186937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:11.187724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:11.190798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:11.191723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:11.192363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:11.192989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:11.564459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.580150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.581635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.588487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3897dfd5-8b99-41be-887a-06652eed0f58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.423672 Oct 31 14:08:11.589345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 773/1338] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:11 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:11.594102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:11.594774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:11.641957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:11.642574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:11.643030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:11.645886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:11.646605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:11.647926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:11.827842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.839800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.841687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:11.855387 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03e536ae-cf83-4531-95b2-0e008b215687 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.264982 Oct 31 14:08:11.859290 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 774/1339] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:11 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:11.869896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c6420c6-6ada-4fe2-8b1c-3eb69fbeb174 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077b2f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:12.660840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:12.676266 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44c300c0-0a8d-4672-afa6-83b8a9a30493 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1313 microversion: 2.1 time: 1.827010 Oct 31 14:08:12.677189 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 566/1340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:10 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1313 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:12.699733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:12.700446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:12.719873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:12.720382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:12.720832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:12.721560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:12.722027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:12.728503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:12.939891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447b90ed71f148b79158ff5db202f274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1430823979f84df092a344321a69fce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:12.964105 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3afaa466-88fc-4058-b495-ff673fff31a4 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 200 len: 1310 microversion: 2.1 time: 0.272294 Oct 31 14:08:12.969209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 567/1341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:12 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:12.985208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:12.986044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:12.999769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.001492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.002105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.003033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.003646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.004784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.017952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:13.454152 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c6420c6-6ada-4fe2-8b1c-3eb69fbeb174 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "DELETE /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 204 len: 0 microversion: 2.1 time: 1.593105 Oct 31 14:08:13.455580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 775/1342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:11 2022] DELETE /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 0 bytes in 1596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:13.463313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3e1f1b04-5d64-4672-b883-d8ed3a674fea req-6cb8ef2f-1642-4588-a81f-674924241052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63894684-26f1-4c97-99c4-7026983ea01e", "name": "network-vif-plugged", "status": "completed", "tag": "b69c64f3-b22b-46c4-8bbc-2f57a49803cf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:13.488983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3e1f1b04-5d64-4672-b883-d8ed3a674fea req-6cb8ef2f-1642-4588-a81f-674924241052 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.490849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3e1f1b04-5d64-4672-b883-d8ed3a674fea req-6cb8ef2f-1642-4588-a81f-674924241052 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.494606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3e1f1b04-5d64-4672-b883-d8ed3a674fea req-6cb8ef2f-1642-4588-a81f-674924241052 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.526862 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3e1f1b04-5d64-4672-b883-d8ed3a674fea req-6cb8ef2f-1642-4588-a81f-674924241052 service nova] Creating event network-vif-plugged:b69c64f3-b22b-46c4-8bbc-2f57a49803cf for instance 63894684-26f1-4c97-99c4-7026983ea01e on n-h2-863052-1 Oct 31 14:08:13.542058 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3e1f1b04-5d64-4672-b883-d8ed3a674fea req-6cb8ef2f-1642-4588-a81f-674924241052 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082450 Oct 31 14:08:13.543582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 776/1343] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:13.598707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:13.611098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:13.611299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:13.621511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:13.623494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:13.625481 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4595d3ad-c348-4b0e-a762-a76669b7d8f1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.654509 Oct 31 14:08:13.626701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 568/1344] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:12 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:13.645894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.648742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.650877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.652105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.653316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.654544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.676996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b34168c9-9d3f-4f1d-a674-56150f6c61cd req-6175b59e-6257-4a7e-94f9-1ae313e3cdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1", "name": "network-vif-deleted", "tag": "0ba09d4a-0778-409d-a6cf-7029a790ab9d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:13.703219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b34168c9-9d3f-4f1d-a674-56150f6c61cd req-6175b59e-6257-4a7e-94f9-1ae313e3cdd8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.711216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b34168c9-9d3f-4f1d-a674-56150f6c61cd req-6175b59e-6257-4a7e-94f9-1ae313e3cdd8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.712106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b34168c9-9d3f-4f1d-a674-56150f6c61cd req-6175b59e-6257-4a7e-94f9-1ae313e3cdd8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.731583 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b34168c9-9d3f-4f1d-a674-56150f6c61cd req-6175b59e-6257-4a7e-94f9-1ae313e3cdd8 service nova] Creating event network-vif-deleted:0ba09d4a-0778-409d-a6cf-7029a790ab9d for instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 on n-h1-863052-1 Oct 31 14:08:13.752292 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b34168c9-9d3f-4f1d-a674-56150f6c61cd req-6175b59e-6257-4a7e-94f9-1ae313e3cdd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123845 Oct 31 14:08:13.754540 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 569/1345] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:13.770947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5cb9ef95-d8ca-4325-87ff-81a8e1829805 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107819670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:13.809551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-5cb9ef95-d8ca-4325-87ff-81a8e1829805 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] HTTP exception thrown: Image not found. Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5cb9ef95-d8ca-4325-87ff-81a8e1829805 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Request method failure captured: Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 HTTP/1.1 Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9aZ9H5BxmJiunt4P3zXGBZZ4_toFj7Wj0xmCM6qHrK1TSB6njHQ8Ag9JH0acYER273i7cM3kGtFdllXCvbXGNOQXloy_qDcdp2ZAu9UFC0FnHoxRe-74wZ7I4I3CpR3jxDOt5oP7LPSmTl3XyHjsmzdnsJYO9c0YVEtgHWYqevKGmk Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 35c83f504b5e41169372fb73cffd18a5 Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:13.812421 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35c83f504b5e41169372fb73cffd18a5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 35c83f504b5e41169372fb73cffd18a5 Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerTestJSON-481285090-project Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: dfe88786f3e240739b5f84f1f0f43ed4 Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerTestJSON-481285090-project Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '37e07ca5-3fe3-43d1-a9e4-56ce42be0715'} Oct 31 14:08:13.814132 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:08:13.815217 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37e07ca5-3fe3-43d1-a9e4-56ce42be0715 Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:08:13.816627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37e07ca5-3fe3-43d1-a9e4-56ce42be0715 could not be found. Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:13.818286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5cb9ef95-d8ca-4325-87ff-81a8e1829805 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:13.819918 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5cb9ef95-d8ca-4325-87ff-81a8e1829805 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 404 len: 62 microversion: 2.1 time: 0.061484 Oct 31 14:08:13.821789 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 570/1346] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:13 2022] GET /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:08:13.829046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:13.830087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:13.847229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.852551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.853339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.854277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:13.854926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:13.855530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:13.857703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:13.935202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:13.949418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:13.955948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:13.973545 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-030019ef-4ea9-4571-a565-7aa8a39add4d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.427602 Oct 31 14:08:13.977535 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 777/1347] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:13 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:13.995334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2073079418"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:14.007782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:14.021932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.022717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.026604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.027652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.028949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.029554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.148607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:14.166192 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c6672f35-e9b3-4d78-94bb-102ddf945de2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1463 microversion: 2.1 time: 0.342812 Oct 31 14:08:14.172466 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 571/1348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:13 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1463 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:14.177578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.191056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:14.214232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.214746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.215193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.215984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.216946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.217377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.273171 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 could not be found. Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 HTTP/1.1 Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:14.275047 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 could not be found. Oct 31 14:08:14.276717 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1'} Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 could not be found. Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:14.277666 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 could not be found. Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 could not be found. Oct 31 14:08:14.279797 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.281849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance 1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:14.282883 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-251c8dcf-f16d-4731-a2a3-bf55fa29f915 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1" status: 404 len: 111 microversion: 2.1 time: 0.109230 Oct 31 14:08:14.283603 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 572/1349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:14 2022] GET /compute/v2.1/servers/1e8c6df3-42bc-4030-96b6-8a5fbc2d0ed1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:14.291273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.304260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:14.322808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.323533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.324051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.325075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.326132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.327248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.546603 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5caa70f6-23ae-4852-a745-eb00023815a4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "POST /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad/action" status: 202 len: 0 microversion: 2.1 time: 0.566431 Oct 31 14:08:14.554059 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 778/1350] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:13 2022] POST /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:08:14.570666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e32e65ee-8898-4278-a583-3d001c1e9c46 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '.version_select at 0x7fe107739f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.611074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:14.620617 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-187b452b-3d0b-47cc-a417-5d52b2f66113 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1313 microversion: 2.1 time: 0.332994 Oct 31 14:08:14.621499 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 573/1351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:14 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:14.640185 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e32e65ee-8898-4278-a583-3d001c1e9c46 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Image not found. Oct 31 14:08:14.643414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bba3f259-e391-49a8-b9f9-1a039796a8f5 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107821160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e32e65ee-8898-4278-a583-3d001c1e9c46 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 HTTP/1.1 Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:08:14.644022 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b7267dd4-c7e3-4c7a-a605-b72e6500ddf6'} Oct 31 14:08:14.645982 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 to delete Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.647031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 could not be found. Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:14.648449 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:08:14.652755 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.654597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e32e65ee-8898-4278-a583-3d001c1e9c46 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:14.656990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e32e65ee-8898-4278-a583-3d001c1e9c46 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6" status: 404 len: 62 microversion: 2.1 time: 0.100906 Oct 31 14:08:14.658159 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 779/1352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:14 2022] DELETE /compute/v2.1/images/b7267dd4-c7e3-4c7a-a605-b72e6500ddf6 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:08:14.666624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.667572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:14.676528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.677349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.678017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.679592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.680261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.680890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.744308 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bba3f259-e391-49a8-b9f9-1a039796a8f5 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.121745 Oct 31 14:08:14.747658 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 574/1353] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:14 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:14.761735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.769579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:14.792825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.794749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.799189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.800488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.802834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.805578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.853166 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c HTTP/1.1 Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:14.858019 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.859652 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9faf7890-5c09-4c6e-89f9-5ed76813731c'} Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:14.860588 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.862028 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.863521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:14.863521 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98f148ef-e6d6-4d4f-a43c-9761a89456a9 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 404 len: 111 microversion: 2.1 time: 0.110913 Oct 31 14:08:14.866626 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 575/1354] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:08:14 2022] DELETE /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:14.878992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:14.879899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: 9faf7890-5c09-4c6e-89f9-5ed76813731c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:14.895979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.896746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.899426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.900420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:14.904107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:14.904759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:14.938476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c HTTP/1.1 Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:14.942341 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.944477 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9faf7890-5c09-4c6e-89f9-5ed76813731c'} Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:14.945243 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. Oct 31 14:08:14.946633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:14.960349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance 9faf7890-5c09-4c6e-89f9-5ed76813731c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:14.962058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b56efd15-0707-45c2-9987-53cce4e797e6 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c" status: 404 len: 111 microversion: 2.1 time: 0.094352 Oct 31 14:08:14.966157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 576/1355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:14 2022] GET /compute/v2.1/servers/9faf7890-5c09-4c6e-89f9-5ed76813731c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:14.971963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61ed4de-c2a1-4301-ab46-7d3a8c160e35 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '.version_select at 0x7fe1079b9a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:15.017447 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f61ed4de-c2a1-4301-ab46-7d3a8c160e35 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594381695" status: 202 len: 0 microversion: 2.1 time: 0.049850 Oct 31 14:08:15.018405 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 577/1356] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594381695 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:15.051133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:15.052277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:15.061655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:15.062137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:15.062682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:15.063594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:15.064047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:15.064737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:15.264507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:15.278923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:15.292989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:15.314468 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae295044-1910-4fa4-a091-b6c490d6eb08 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.294537 Oct 31 14:08:15.315891 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 578/1357] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:15 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:15.383715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:15.394866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:15.396334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:15.397696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4a0dfa0-a792-4e3d-8bed-0712649b77a4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.737804 Oct 31 14:08:15.412243 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 780/1358] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:14 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:15.605717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-cb92b419-b703-42e6-afc7-e107ab91401b req-bff0ebf0-3b3a-47eb-83a1-5ea13f26f09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "name": "network-vif-unplugged", "status": "completed", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:15.637101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cb92b419-b703-42e6-afc7-e107ab91401b req-bff0ebf0-3b3a-47eb-83a1-5ea13f26f09e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:15.646919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:15.648152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:15.659558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cb92b419-b703-42e6-afc7-e107ab91401b req-bff0ebf0-3b3a-47eb-83a1-5ea13f26f09e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:15.660018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cb92b419-b703-42e6-afc7-e107ab91401b req-bff0ebf0-3b3a-47eb-83a1-5ea13f26f09e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:15.664045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:15.669817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:15.675687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:15.678007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:15.680035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:15.680668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:15.695470 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-cb92b419-b703-42e6-afc7-e107ab91401b req-bff0ebf0-3b3a-47eb-83a1-5ea13f26f09e service nova] Creating event network-vif-unplugged:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:08:15.710038 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-cb92b419-b703-42e6-afc7-e107ab91401b req-bff0ebf0-3b3a-47eb-83a1-5ea13f26f09e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107480 Oct 31 14:08:15.716685 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 579/1359] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:15.724537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:15.765337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b094e476-32d2-4747-9f3f-12af8edcbc07 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10783c1f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:15.859495 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b094e476-32d2-4747-9f3f-12af8edcbc07 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.100077 Oct 31 14:08:15.860476 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 580/1360] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:15 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:16.208234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:16.218391 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97901873-79e7-4ad7-af2a-73cdb45bc74c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1462 microversion: 2.1 time: 0.577357 Oct 31 14:08:16.224834 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 781/1361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:15 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1462 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:16.323327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f99bbe47-78e5-42e6-91e2-1a58c875e80c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '.version_select at 0x7fe10783f040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:16.351030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:16.351828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:16.357404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f99bbe47-78e5-42e6-91e2-1a58c875e80c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Image not found. Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f99bbe47-78e5-42e6-91e2-1a58c875e80c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/3f092cb4-1a0f-4110-9162-757689256859 HTTP/1.1 Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:16.361803 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3f092cb4-1a0f-4110-9162-757689256859'} Oct 31 14:08:16.363505 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3f092cb4-1a0f-4110-9162-757689256859 to delete Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.364491 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f092cb4-1a0f-4110-9162-757689256859 could not be found. Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:16.365916 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:08:16.367535 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.369615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f99bbe47-78e5-42e6-91e2-1a58c875e80c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:16.371502 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f99bbe47-78e5-42e6-91e2-1a58c875e80c tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/images/3f092cb4-1a0f-4110-9162-757689256859" status: 404 len: 62 microversion: 2.1 time: 0.052469 Oct 31 14:08:16.375352 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 581/1362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:16 2022] DELETE /compute/v2.1/images/3f092cb4-1a0f-4110-9162-757689256859 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:08:16.376817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.377569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.382756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.388555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:16.389018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.389959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.390715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.397933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:16.415716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.416776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.434272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.440330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.445530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.446985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.500862 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a HTTP/1.1 Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:16.502897 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.504437 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a'} Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:16.505242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.507148 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.508465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:16.508465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb1dcc20-f9e4-4075-b7e4-525e390bb246 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 404 len: 111 microversion: 2.1 time: 0.127560 Oct 31 14:08:16.508465 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 582/1363] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:08:16 2022] DELETE /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:16.514082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:16.514891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:16.544117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.544842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.545706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.546470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.546935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.547785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.584686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:16.600908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:16.604565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:16.614140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7238c069-4802-4caa-b5f4-c8b9576aed9d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.271494 Oct 31 14:08:16.615077 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 782/1364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:16 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:16.625057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:16.625962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] [instance: f551d03b-c743-4270-a7d6-a8db15d6358a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:16.632480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.633145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.633579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.634316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:16.635480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:16.635480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:16.659045 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] HTTP exception thrown: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Request method failure captured: Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a HTTP/1.1 Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9Zi0qojchOluYde3yyDZAXxZEqAblFz2UpnCa3iIr0YiUQoh33bBzwv0JxWcK77--JAsp8Ym34Ow1VwOiAeqzAbjddWAzEse8wF1DnGbNId8ZSI6nX_wgfYzFMv9o4ieNKnciB9ftV5KHh1ufGdjhH0w6ljslrE7w3z9NlP2cB_Njc Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:08:16.660772 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1430823979f84df092a344321a69fce5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1430823979f84df092a344321a69fce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1430823979f84df092a344321a69fce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 1430823979f84df092a344321a69fce5 Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-945436554 Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 447b90ed71f148b79158ff5db202f274 Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-945436554-project Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.662141 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f551d03b-c743-4270-a7d6-a8db15d6358a'} Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:16.662963 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. Oct 31 14:08:16.664229 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:16.665337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] Returning 404 to user: Instance f551d03b-c743-4270-a7d6-a8db15d6358a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:16.665337 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d51d65a7-3426-4c8b-b1bf-985a308a95e8 tempest-ImagesOneServerNegativeTestJSON-945436554 tempest-ImagesOneServerNegativeTestJSON-945436554-project] 10.222.0.27 "GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a" status: 404 len: 111 microversion: 2.1 time: 0.046148 Oct 31 14:08:16.666809 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 783/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:16 2022] GET /compute/v2.1/servers/f551d03b-c743-4270-a7d6-a8db15d6358a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:16.672176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-366288554", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "63894684-26f1-4c97-99c4-7026983ea01e"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:16.757877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:08:17.186318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:17.200460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:17.205923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:17.207365 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3adfbe02-4708-4cfe-82ea-a110bcd20648 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.698325 Oct 31 14:08:17.209795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 583/1366] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:16 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:17.223789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d73b10a1-1004-42eb-b88e-636a65269acf tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107821160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:17.365469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d73b10a1-1004-42eb-b88e-636a65269acf tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.154287 Oct 31 14:08:17.366245 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 584/1367] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:17 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:17.561061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:08:17.561772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:08:17.562448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:08:17.562872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:08:17.563256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:08:17.577059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:17.577535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:17.578183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:17.579086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:17.579739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:17.580320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:17.601540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Getting quotas for project 76489790a3e4477aba14b231646a3f98. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:17.608621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Getting quotas for user 1526c17fd6164655852807d8be044072 and project 76489790a3e4477aba14b231646a3f98. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:17.625402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:08:17.628444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:08:17.653073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:17.654355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:17.682714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:17.685849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:17.688099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:17.688997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:17.691738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:17.692367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:17.709092 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02fd4eff-e836-4a6a-b116-29d33198f738 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041151 Oct 31 14:08:17.714000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 784/1368] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:08:17.722581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-063dcd15-6973-48ab-8ea0-44ec60ebdebc tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:17.723455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-063dcd15-6973-48ab-8ea0-44ec60ebdebc tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:17.936391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:17.945042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:17.955765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:17.968417 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c75eba6-222e-4e30-91c2-48c62b969781 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.324020 Oct 31 14:08:17.972335 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 585/1369] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:17 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:18.036468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-063dcd15-6973-48ab-8ea0-44ec60ebdebc tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:18.046156 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-063dcd15-6973-48ab-8ea0-44ec60ebdebc tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1213 microversion: 2.1 time: 0.327830 Oct 31 14:08:18.055811 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 785/1370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:17 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1213 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:18.238984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:18.239601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:18.250438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:18.250996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:18.251434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:18.252133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:18.254401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:18.254846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:18.383036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5232daac-ff15-4013-9d89-ec5f25910553 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1076c1700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:18.470525 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5232daac-ff15-4013-9d89-ec5f25910553 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.091971 Oct 31 14:08:18.471994 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 786/1371] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:18 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:19.000311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:19.002002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:19.018907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:19.022411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:19.024437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:19.030818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:19.032461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:19.034776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:19.357503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.372234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.381024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.422126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c10fe38f-28d9-467f-8a63-3cca6e8e3a96 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.427770 Oct 31 14:08:19.427476 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 787/1372] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:18 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:08:19.432746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:19.435645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:19.451716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:19.452506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:19.455002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:19.456063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:19.458321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:19.459048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:19.713275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.722806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.724255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.725551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f37d3bf-bd0e-4a46-8f2d-849cdc3c2bc6 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 1.490810 Oct 31 14:08:19.726120 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 586/1373] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:18 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:19.751328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e4b127c7-48e7-47cf-83d7-316c505ba982 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe10783f5e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:19.935010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:19.954601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9fb4d61-fefa-4024-a321-c017d45e122b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1209 microversion: 2.1 time: 0.514383 Oct 31 14:08:19.955555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 788/1374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:19 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1209 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:20.460385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:20.461831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:20.490445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:20.494478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:20.500998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:20.503422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:20.505553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:20.507603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:21.619892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:21.645202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:21.647457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:21.657300 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-969743f5-d6ff-4ae1-be04-d0e9c796fcf4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 1.201884 Oct 31 14:08:21.680931 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 789/1375] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:20 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:08:21.695083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:21.696230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:21.703147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:21.704000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:21.705947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:21.707392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:21.708146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:21.708794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:22.301744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:22.314201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:22.327449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:22.334127 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76abc2fa-5f18-48d6-9b5c-7ca3218a96ec tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.644102 Oct 31 14:08:22.335308 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 790/1376] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:21 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:22.348456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:22.350491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:22.375326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:22.375832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:22.378459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:22.379327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:22.379815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:22.380234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:23.056298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.066343 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61261bf0-94f3-46a7-9488-5f2f0eef304d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.729303 Oct 31 14:08:23.086684 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 791/1377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:22 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:23.099146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:23.101504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:23.109997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:23.122521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:23.124089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:23.125200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:23.127877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:23.128530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:23.130331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:23.353868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.368776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.381268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.393785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff7f5c31-4d6f-456d-8923-91dde5416c0d tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.305655 Oct 31 14:08:23.401929 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 792/1378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:23 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:23.409113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:23.421378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:23.447267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:23.448131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:23.448759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:23.451490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:23.452156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:23.452770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:23.809320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.830700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.839379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:23.841068 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ece0c91-93cb-438e-ab2b-636cd08c36c4 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.437780 Oct 31 14:08:23.845894 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 793/1379] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:23 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:24.101160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:24.101873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:24.125485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:24.125984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:24.126454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:24.127166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:24.127623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:24.128048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:25.107138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:25.124714 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0c5be0c-07d9-440d-a6ad-50c257627496 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 1.028294 Oct 31 14:08:25.150385 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 794/1380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:24 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:25.384161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-97c4beee-21f8-4868-8da7-8a2436dd8074 req-a78e14f3-75ac-4867-aa66-24b960c195b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "name": "network-vif-plugged", "status": "completed", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:25.420899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-97c4beee-21f8-4868-8da7-8a2436dd8074 req-a78e14f3-75ac-4867-aa66-24b960c195b1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:25.427832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-97c4beee-21f8-4868-8da7-8a2436dd8074 req-a78e14f3-75ac-4867-aa66-24b960c195b1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:25.428703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-97c4beee-21f8-4868-8da7-8a2436dd8074 req-a78e14f3-75ac-4867-aa66-24b960c195b1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:25.471422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-97c4beee-21f8-4868-8da7-8a2436dd8074 req-a78e14f3-75ac-4867-aa66-24b960c195b1 service nova] Creating event network-vif-plugged:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:08:25.491044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-97c4beee-21f8-4868-8da7-8a2436dd8074 req-a78e14f3-75ac-4867-aa66-24b960c195b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337868 Oct 31 14:08:25.496434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 795/1381] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:25.512885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:25.513521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:25.533801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:25.537592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:25.538384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:25.541074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:25.541810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:25.544381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:25.853297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:25.867979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:25.871552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:25.904514 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b510eaa-24fc-4a02-96bb-69a3bca8dfc8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.406430 Oct 31 14:08:25.935346 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 796/1382] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:25 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:25.944255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:25.946463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:25.979693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:25.980629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:25.981325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:25.982254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:25.982871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:25.989068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:26.573172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:26.585101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:26.595987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:26.606689 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fd2aaba-1e98-40a2-adff-1a8353da3a8b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.667927 Oct 31 14:08:26.619228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 797/1383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:25 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:26.643718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:26.644518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:26.663672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:26.664352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:26.666962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:26.671687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:26.680569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:26.685187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:27.448410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:27.464522 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-638715aa-603f-4505-bdb2-49f13b4414d0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.828137 Oct 31 14:08:27.471052 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 798/1384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:26 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:27.494498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:27.496303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:27.520076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:27.523901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:27.525497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:27.527165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:27.529686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:27.532400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:27.600774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:27.822441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:27.849780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:27.860582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:27.870319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f581df69-9075-40d2-872f-cd946c73a2d9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.397228 Oct 31 14:08:27.882593 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 799/1385] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:27 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:27.893887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:27.893887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:27.922323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:27.922866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:27.931663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:27.933108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:27.940531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:27.941565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:28.045875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:28.244399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:28.443262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:28.460152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:28.461743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:28.463667 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6fa3a62-c86d-4ac5-991c-cc7b538f8566 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1811 microversion: 2.25 time: 0.582164 Oct 31 14:08:28.473519 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 800/1386] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:27 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1811 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:28.478879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-82abc342-c8f9-4525-b9fe-6b4508ecabc5 req-6d89e392-1669-451f-8a2f-307708fc6725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12fede62-46c1-490c-8a44-56615f520b2a", "tag": "7bdc8469-39d0-4334-b8f1-8d3d0f7ef18e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:28.517932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-82abc342-c8f9-4525-b9fe-6b4508ecabc5 req-6d89e392-1669-451f-8a2f-307708fc6725 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:28.518912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-82abc342-c8f9-4525-b9fe-6b4508ecabc5 req-6d89e392-1669-451f-8a2f-307708fc6725 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:28.519617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-82abc342-c8f9-4525-b9fe-6b4508ecabc5 req-6d89e392-1669-451f-8a2f-307708fc6725 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:28.537902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-82abc342-c8f9-4525-b9fe-6b4508ecabc5 req-6d89e392-1669-451f-8a2f-307708fc6725 service nova] Creating event network-changed:7bdc8469-39d0-4334-b8f1-8d3d0f7ef18e for instance 12fede62-46c1-490c-8a44-56615f520b2a on n-h2-863052-1 Oct 31 14:08:28.547874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-82abc342-c8f9-4525-b9fe-6b4508ecabc5 req-6d89e392-1669-451f-8a2f-307708fc6725 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076707 Oct 31 14:08:28.548917 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 801/1387] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:28.560904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:28.572382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:28.600063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:28.601077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:28.602306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:28.603346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:28.604671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:28.605405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:28.947318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:28.954234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:28.957085 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b2ff829-eaa4-48ee-b571-6028ddbd57ed tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.406667 Oct 31 14:08:28.972047 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 802/1388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:28 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:28.987399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:28.988380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:29.019394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:29.020183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:29.021049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:29.023035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:29.030526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:29.031332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:29.245513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:29.265211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:29.267770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:29.281981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88abc939-8214-45f8-a154-5f0a1b78af86 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.308123 Oct 31 14:08:29.295850 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 803/1389] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:28 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:29.442181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:29.442884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:29.451422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:29.454112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:29.458908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:29.462028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:29.463068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:29.464117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:29.717934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=52 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:30.507691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7004bdff-aa01-4cbe-8f1e-57be5d672242 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1855 microversion: 2.1 time: 1.069477 Oct 31 14:08:30.512396 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 804/1390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:29 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1855 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:30.529256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:30.532463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:30.564877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:30.565393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:30.569563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:30.570438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:30.570929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:30.571385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:31.646956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:31.662074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:31.663779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:31.664994 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6be9ac5-0f4d-46f9-9e6e-1a92b98c894d tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1801 microversion: 2.25 time: 1.149380 Oct 31 14:08:31.674803 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 805/1391] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:30 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1801 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:31.681303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:31.689575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:31.708994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:31.711463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:31.713320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:31.717419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:31.718729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:31.721026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:32.074857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:32.084704 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed4c888d-1a8e-47a6-953b-e9cbdab0af30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.408574 Oct 31 14:08:32.090416 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 806/1392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:31 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:32.095891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:32.102914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:32.119584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:32.120277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:32.123510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:32.124433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:32.125060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:32.125653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:32.315103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:32.323583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:32.325146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:32.342546 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a82ecdf-797d-49b9-a944-357a5e3e1810 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.250682 Oct 31 14:08:32.369145 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 807/1393] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:32 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:32.377120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:32.379720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:32.407508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:32.408009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:32.410681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:32.411304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:32.411953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:32.412606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:32.483387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lazy-loading 'flavor' on Instance uuid 2e80907a-572f-4a2a-a43e-5abbf33c2881 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:08:32.513158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Going to try to live migrate instance to n-h2-863052-1 {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:08:36.232576 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e4b127c7-48e7-47cf-83d7-316c505ba982 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 16.495604 Oct 31 14:08:36.234963 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 587/1394] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:19 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 16500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:36.251533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd50c184-b46e-410b-a70f-0667ab7d1480 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '.version_select at 0x7fe107839430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:36.257122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd50c184-b46e-410b-a70f-0667ab7d1480 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.257928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd50c184-b46e-410b-a70f-0667ab7d1480 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.258859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd50c184-b46e-410b-a70f-0667ab7d1480 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:36.276469 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd323a4b-06d6-4b60-bad4-1e4d96dad9e8 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/action" status: 202 len: 0 microversion: 2.1 time: 3.901894 Oct 31 14:08:36.280203 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 808/1395] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:32 2022] POST /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/action => generated 0 bytes in 3908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:36.281119 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd50c184-b46e-410b-a70f-0667ab7d1480 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2535 microversion: 2.25 time: 0.040722 Oct 31 14:08:36.294330 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 588/1396] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 31 14:08:36 2022] GET /compute/v2.1/os-migrations => generated 2535 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:36.295987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1057945252", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "efe29414-97fa-488a-9176-019700247d55"}, {"uuid": "d7a9d7ed-2366-4e7e-ba0b-b0bc4034acfa"}, {"uuid": "efe29414-97fa-488a-9176-019700247d55"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:36.299762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:36.300576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:36.308581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.309866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.310666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:36.311822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.312576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.313192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:36.507871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:36.515219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] validate_networks() for [('efe29414-97fa-488a-9176-019700247d55', None, None, None, None, None), ('d7a9d7ed-2366-4e7e-ba0b-b0bc4034acfa', None, None, None, None, None), ('efe29414-97fa-488a-9176-019700247d55', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:08:36.518308 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68673d26-3cb0-4f8f-a429-039a836489bd tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.222473 Oct 31 14:08:36.518901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 589/1397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:36 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:36.540035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:36.540660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:36.554716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.555213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.555648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:36.556357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.559566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.560262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:36.727933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:36.745049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:36.748183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:36.767267 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d05f4105-cefd-4a4b-ad42-d20bb5fd0b25 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.247282 Oct 31 14:08:36.778283 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 590/1398] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:36 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:36.795215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:36.797889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:36.814502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.815236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.818128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:36.819141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:36.819812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:36.820442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:37.610213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:37.650435 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-111e8845-e823-4719-95b9-981696dc6f26 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.878421 Oct 31 14:08:37.681937 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 591/1399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:36 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:37.694781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:37.695559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:37.717403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:37.718182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:37.718940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:37.720758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:37.721458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:37.722265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:38.516666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:08:38.517241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:08:38.518212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:08:38.518816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:08:38.519327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:08:38.545657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:38.546796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:38.547989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:38.551881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:38.552507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:38.553045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:38.588567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Getting quotas for project 58ee6fca78314de1ae6f33dd2b433a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:38.596588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Getting quotas for user 78f86aaab2684cf6b1fcdefc1d0996f6 and project 58ee6fca78314de1ae6f33dd2b433a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:38.616086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:08:38.620485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:08:38.733597 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88f80dd0-353d-4dd5-bd09-0fcabba75f3c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454502 Oct 31 14:08:38.747021 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 809/1400] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:08:38.945064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:08:38.988202 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6406127a-cfe3-49b5-ac50-625030e77ddd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 2420 microversion: 2.25 time: 1.304337 Oct 31 14:08:39.010200 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 592/1401] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:37 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 2420 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:39.010828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2618e06-5716-4d17-8504-b745a5cef759 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107845dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:39.045317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33d00d43-a744-412a-9684-dd6849fe8aa4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe1077121f0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIQwgdKJgD36Y1yyQuWE+wCE6bt9TMh1CFkAsB2Vd+mwTnaJi9yXcA0gCkBZ9P0TMQIr2XZBUnSAJ90aTp1oRiB+IR2gUx8iDFfW/pJ8BpurhCvbRKr2HdxlH1/TyWiag=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33d00d43-a744-412a-9684-dd6849fe8aa4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 257 Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:08:39.049944 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:08:39.051730 n-d-863052-1 devstack@n-api.service[120640]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIQwgdKJgD36Y1yyQuWE+wCE6bt9TMh1CFkAsB2Vd+mwTnaJi9yXcA0gCkBZ9P0TMQIr2XZBUnSAJ90aTp1oRiB+IR2gUx8iDFfW/pJ8BpurhCvbRKr2HdxlH1/TyWiag=="}} Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIQwgdKJgD36Y1yyQuWE+wCE6bt9TMh1CFkAsB2Vd+mwTnaJi9yXcA0gCkBZ9P0TMQIr2XZBUnSAJ90aTp1oRiB+IR2gUx8iDFfW/pJ8BpurhCvbRKr2HdxlH1/TyWiag=='}}} Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:39.052621 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:39.054250 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:08:39.056105 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:08:39.057903 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 14:08:39.057903 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:39.064501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33d00d43-a744-412a-9684-dd6849fe8aa4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:39.068830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33d00d43-a744-412a-9684-dd6849fe8aa4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.320439 Oct 31 14:08:39.076528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 810/1402] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:38 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 329 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:08:39.094110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:39.096345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:39.116817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.117335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.117778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.124443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.126457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.127696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.146321 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2618e06-5716-4d17-8504-b745a5cef759 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.143342 Oct 31 14:08:39.147622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 593/1403] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:39 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:39.156615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:39.157512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:39.166495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.167430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.168197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.169746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.170462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.171565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.304588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:39.327658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:39.333662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:39.350057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34020d2c-247d-4108-9a00-a794682c5d73 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1538 microversion: 2.91 time: 0.200527 Oct 31 14:08:39.356090 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 594/1404] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:39 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1538 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:39.403196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:39.404143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:39.426308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.427109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.427765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.431334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.433429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.434651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.672160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:39.683142 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b625a7e-c55f-495f-a89a-f0d5e9ec8ad1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.604394 Oct 31 14:08:39.684536 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 811/1405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:39 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:39.707855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-dceb242b-c7ff-4978-9b2c-1d507a6f4440 req-576f0692-124e-4a47-a0be-b7e19d693150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12fede62-46c1-490c-8a44-56615f520b2a", "name": "network-vif-plugged", "status": "completed", "tag": "7bdc8469-39d0-4334-b8f1-8d3d0f7ef18e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:39.719494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dceb242b-c7ff-4978-9b2c-1d507a6f4440 req-576f0692-124e-4a47-a0be-b7e19d693150 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.720342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dceb242b-c7ff-4978-9b2c-1d507a6f4440 req-576f0692-124e-4a47-a0be-b7e19d693150 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.721098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dceb242b-c7ff-4978-9b2c-1d507a6f4440 req-576f0692-124e-4a47-a0be-b7e19d693150 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.736493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-dceb242b-c7ff-4978-9b2c-1d507a6f4440 req-576f0692-124e-4a47-a0be-b7e19d693150 service nova] Creating event network-vif-plugged:7bdc8469-39d0-4334-b8f1-8d3d0f7ef18e for instance 12fede62-46c1-490c-8a44-56615f520b2a on n-h2-863052-1 Oct 31 14:08:39.743844 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-dceb242b-c7ff-4978-9b2c-1d507a6f4440 req-576f0692-124e-4a47-a0be-b7e19d693150 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040625 Oct 31 14:08:39.745142 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 812/1406] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:39.757962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:39.759774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:39.768863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.769628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.770322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.771316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.771992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.772821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.797604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:39.812054 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e5ebcd2-6af4-4806-a781-1363d5add525 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.454626 Oct 31 14:08:39.813120 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 595/1407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:39 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:39.818134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:39.818948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:39.826203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.827034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.827336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.828624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:39.828746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:39.829240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:39.864518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:39.890968 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12b900a0-c92d-4ff7-b856-e4e0bbfa7825 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1217 microversion: 2.1 time: 0.142957 Oct 31 14:08:39.897827 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 813/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:39 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:39.913652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe1078715e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1139058257", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:39.975534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:39.998230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for user f5a8d71ace8d499d821695f596be737b and project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:40.051349 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 2167 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1139058257", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:08:40.063490 n-d-863052-1 devstack@n-api.service[120640]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1139058257', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:40.066214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.071002 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.076971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:40.078031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0564fec8-9da2-4c06-85df-2582a7a014be tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.178556 Oct 31 14:08:40.078540 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 814/1409] 10.222.0.27 () {60 vars in 1160 bytes} [Mon Oct 31 14:08:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:40.094254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:40.108388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:40.118490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.122298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.123049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.125548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.126402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.130650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.190427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-863052-1". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 14:08:40.298005 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-555e28fc-dfbb-44e9-ad34-7060181bf291 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action" status: 202 len: 0 microversion: 2.91 time: 0.218037 Oct 31 14:08:40.299370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:08:40.300374 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 815/1410] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:08:40 2022] POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:40.311568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f00c7344-decf-4275-ab15-93369db5ac13 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe107871b80>, body: {"keypair": {"name": "tempest-keypair-389426627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdoojwZbiFIsEueaE7m5a0uL64VxmVb7+XrC1AiIntGyN15Q7Uayv6ujxSl8gWGkBE6SceBC1uu4THgckxewMSuSuRfZG5hV1Kyd+fJL8oX5mTzOzFGIF8nH9DvcAimSQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:40.321111 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1e067c2-e352-4357-a8d8-e8e5aaf04cac tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 2420 microversion: 2.25 time: 0.506903 Oct 31 14:08:40.321675 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 596/1411] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:39 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 2420 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:40.336453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5eac6320-8d14-4dd5-93cf-ade3eda73bfb tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1078b3280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:40.353944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f00c7344-decf-4275-ab15-93369db5ac13 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:40.381324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f00c7344-decf-4275-ab15-93369db5ac13 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for user f5a8d71ace8d499d821695f596be737b and project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:40.450377 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f00c7344-decf-4275-ab15-93369db5ac13 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146956 Oct 31 14:08:40.453442 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 816/1412] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:40.466583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:40.467458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:40.476647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.477326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.477993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.479179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.479817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.480442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.480933 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5eac6320-8d14-4dd5-93cf-ade3eda73bfb tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.152568 Oct 31 14:08:40.494015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 597/1413] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:40 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:40.499300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe1077e6430>, body: {"keypair": {"name": "tempest-keypair-389426627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv6fqzYAF1J989UZ5omzNRUFCiwuZOnf/WyyCnTRvXZUijLw+GpohrDZ7z4ASxZuCFct5Iyyvz1zIJM+rkuw8VbaucK5vLNRT+37ktG1a9+eJhYoAadVLoizJ5IurSgvA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:40.546003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:40.553742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for user f5a8d71ace8d499d821695f596be737b and project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:40.571468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:40.584570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:40.586778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:40.588048 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] HTTP exception thrown: Key pair 'tempest-keypair-389426627' already exists. Oct 31 14:08:40.596581 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3ff3d91-7b75-41ec-985b-983c62958e61 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1486 microversion: 2.91 time: 0.139796 Oct 31 14:08:40.597191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 817/1414] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:40 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1486 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 272 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: {"keypair": {"name": "tempest-keypair-389426627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv6fqzYAF1J989UZ5omzNRUFCiwuZOnf/WyyCnTRvXZUijLw+GpohrDZ7z4ASxZuCFct5Iyyvz1zIJM+rkuw8VbaucK5vLNRT+37ktG1a9+eJhYoAadVLoizJ5IurSgvA=="}} Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: exception: Key pair 'tempest-keypair-389426627' already exists. Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-389426627', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv6fqzYAF1J989UZ5omzNRUFCiwuZOnf/WyyCnTRvXZUijLw+GpohrDZ7z4ASxZuCFct5Iyyvz1zIJM+rkuw8VbaucK5vLNRT+37ktG1a9+eJhYoAadVLoizJ5IurSgvA=='}}} Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result.read() Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f5a8d71ace8d499d821695f596be737b-tempest-keypair-389426627' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 31 14:08:40.602178 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result.read() Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 14:08:40.606835 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f5a8d71ace8d499d821695f596be737b-tempest-keypair-389426627' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 14, 8, 40, 574863), 'updated_at': None, 'name': 'tempest-keypair-389426627', 'user_id': 'f5a8d71ace8d499d821695f596be737b', 'fingerprint': '7d:22:18:0d:da:33:df:57:47:f9:49:d8:5b:ee:d4:16', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv6fqzYAF1J989UZ5omzNRUFCiwuZOnf/WyyCnTRvXZUijLw+GpohrDZ7z4ASxZuCFct5Iyyvz1zIJM+rkuw8VbaucK5vLNRT+37ktG1a9+eJhYoAadVLoizJ5IurSgvA==', 'type': 'ssh'}] Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi keypair.create() Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._create() Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-389426627' already exists. Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 31 14:08:40.618030 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-389426627' already exists. Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-389426627' already exists. Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 409 to user: Key pair 'tempest-keypair-389426627' already exists. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c436917b-ed5e-44b4-a61d-43e59bdd047f tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.108707 Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 598/1415] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:40 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:08:40.625584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e83b6c7-f2d8-4741-a835-31858e83ec54 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Calling method '.version_select at 0x7fe107626790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:40.626802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:40.626802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:40.632297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:40.640838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.641474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.643336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.645961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.646694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.647163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.657515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e83b6c7-f2d8-4741-a835-31858e83ec54 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-389426627" status: 202 len: 0 microversion: 2.1 time: 0.047624 Oct 31 14:08:40.658303 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 599/1416] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-389426627 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:40.680796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bc0f221-d950-48a7-ac76-33c502fc4c31 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe10762a4c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0HKvaJgibWgfuZhRPyBK3x7USwqIe/SZdl1+edfylixQwsO402NsTdLKL0cyLCdO7oevuG+FPDkBCciAV6of5rpgANR7Q+eTblA68KjAcQwEdfk+hHjw35FsjSwL0BHg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bc0f221-d950-48a7-ac76-33c502fc4c31 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 247 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0HKvaJgibWgfuZhRPyBK3x7USwqIe/SZdl1+edfylixQwsO402NsTdLKL0cyLCdO7oevuG+FPDkBCciAV6of5rpgANR7Q+eTblA68KjAcQwEdfk+hHjw35FsjSwL0BHg=="}} Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0HKvaJgibWgfuZhRPyBK3x7USwqIe/SZdl1+edfylixQwsO402NsTdLKL0cyLCdO7oevuG+FPDkBCciAV6of5rpgANR7Q+eTblA68KjAcQwEdfk+hHjw35FsjSwL0BHg=='}}} Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '' Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:08:40.685581 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.690883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bc0f221-d950-48a7-ac76-33c502fc4c31 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:40.692898 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7bc0f221-d950-48a7-ac76-33c502fc4c31 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.025493 Oct 31 14:08:40.693860 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 600/1417] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:08:40.710254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe1076265e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1564968162", "public_key": " "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:40.729851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:40.736458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for user f5a8d71ace8d499d821695f596be737b and project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:40.763650 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 95 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1564968162", "public_key": " "}} Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1564968162', 'public_key': ' '}}} Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.766514 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-025c65da-fb31-47a1-ad58-487785148c73 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.063552 Oct 31 14:08:40.771493 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 601/1418] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Oct 31 14:08:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:40.777314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:40.778040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:40.784638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.785344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.787199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.789054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:40.789598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:40.790108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:40.845706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lazy-loading 'services' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:08:40.982329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:40.999467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57a12361-7a88-49e0-81a6-84b71a6a8396 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1313 microversion: 2.1 time: 0.229494 Oct 31 14:08:41.004250 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 602/1419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:40 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:41.025791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b0302d0-fccb-4cbb-b1a4-b3afd5dff133 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe1076269d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvah6J4SshAwE/eYwSpuZ0FuvMk9A6RToWtDc/xfM0SlR4gPbQPVvHqruciYReVmE6lzUeVNZ/scCc2mzV9MVjrE3yqpXePSBzPRFn0q+MWUUP53zXafQB68pSFWlDdOQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b0302d0-fccb-4cbb-b1a4-b3afd5dff133 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 507 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvah6J4SshAwE/eYwSpuZ0FuvMk9A6RToWtDc/xfM0SlR4gPbQPVvHqruciYReVmE6lzUeVNZ/scCc2mzV9MVjrE3yqpXePSBzPRFn0q+MWUUP53zXafQB68pSFWlDdOQ=="}} Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvah6J4SshAwE/eYwSpuZ0FuvMk9A6RToWtDc/xfM0SlR4gPbQPVvHqruciYReVmE6lzUeVNZ/scCc2mzV9MVjrE3yqpXePSBzPRFn0q+MWUUP53zXafQB68pSFWlDdOQ=='}}} Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 31 14:08:41.031360 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.035686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b0302d0-fccb-4cbb-b1a4-b3afd5dff133 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:41.039125 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b0302d0-fccb-4cbb-b1a4-b3afd5dff133 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017180 Oct 31 14:08:41.044809 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 603/1420] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:08:41.047569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:41.048320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:41.058136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.058494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.058983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.059943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.060773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.061320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.151315 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d934172e-131b-4ee4-832a-530169a37f80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments/13f2f248-5e8c-436d-8604-63520bc8689d" status: 202 len: 0 microversion: 2.25 time: 0.552526 Oct 31 14:08:41.153315 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 818/1421] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 31 14:08:40 2022] DELETE /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments/13f2f248-5e8c-436d-8604-63520bc8689d => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:41.175509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:41.178644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:41.198450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.201908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.204996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.205851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.206807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.207327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.395628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:41.399436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:41.411278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa0cb34a-f327-466a-aff9-491237e29907 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1273 microversion: 2.1 time: 0.254729 Oct 31 14:08:41.412072 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 819/1422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:41 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:41.434429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Action: 'create', calling method: .version_select at 0x7fe107826820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1878000315", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:41.488033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:41.523209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Getting quotas for user f5a8d71ace8d499d821695f596be737b and project bf71fd29c1764edba3ff47d8bd315573. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:41.562883 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 118 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1878000315", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1878000315', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 31 14:08:41.578523 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 14:08:41.583043 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.585366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:41.585805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:41.585805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0388dfd-b15a-4888-866a-e73bb35858d4 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.166292 Oct 31 14:08:41.585805 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 820/1423] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:41.588934 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a04951a-b2fd-4b83-a220-68799070c56e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.547516 Oct 31 14:08:41.594888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:41.600549 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 604/1424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:41 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:41.602117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:41.612302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.612796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.613240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.613946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.621986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.623877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.635384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ae38197-28b4-4917-a17f-68c4a2112eb4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077c8e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:41.720551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ae38197-28b4-4917-a17f-68c4a2112eb4 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.104977 Oct 31 14:08:41.728533 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 605/1425] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:41 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:41.735651 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f47742d3-24c8-43fd-b091-41e988b2f7cf tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150832 Oct 31 14:08:41.736563 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 821/1426] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:41 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:41.741642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01a74e19-bd66-4dd7-a3df-896d3c5bf720 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Calling method '.version_select at 0x7fe1077c8280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:41.744189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:41.744809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:41.754417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.754872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.756671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.756671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:41.756908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:41.757229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:41.766684 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-01a74e19-bd66-4dd7-a3df-896d3c5bf720 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2071082318 not found for user f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01a74e19-bd66-4dd7-a3df-896d3c5bf720 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Request method failure captured: Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2071082318 HTTP/1.1 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bkCyp62zYK7Z9B6e5gOjDtnF89LdSc31QjLUyRTe6RXqtIKswvbl2P83zVX52nfY0a3WxzXojafAMARSZoUQyF9EE3jVE8u0Yle5HSaWl-rKT9pfVHEiPXjwPEInraWtyaArjdzzC2xe-VjS0UylFoXfgZl_0i7R1RVwxwae7uXLY Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf71fd29c1764edba3ff47d8bd315573", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf71fd29c1764edba3ff47d8bd315573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bf71fd29c1764edba3ff47d8bd315573 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-188164020 Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-KeyPairsNegativeTestJSON-188164020-project Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: exception: Keypair tempest-keypair-non-existent-2071082318 not found for user f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'tempest-keypair-non-existent-2071082318'} Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2071082318 not found for user f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.771502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2071082318 not found for user f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2071082318 not found for user f5a8d71ace8d499d821695f596be737b Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:41.775825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01a74e19-bd66-4dd7-a3df-896d3c5bf720 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2071082318 not found for user f5a8d71ace8d499d821695f596be737b {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:41.780727 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01a74e19-bd66-4dd7-a3df-896d3c5bf720 tempest-KeyPairsNegativeTestJSON-188164020 tempest-KeyPairsNegativeTestJSON-188164020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2071082318" status: 404 len: 145 microversion: 2.1 time: 0.051972 Oct 31 14:08:41.780727 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 606/1427] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2071082318 => generated 145 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:41.848783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:41.860729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:41.863131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:41.869866 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dee639b-8337-47e7-aa59-655c60b53880 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1488 microversion: 2.91 time: 0.132066 Oct 31 14:08:41.871285 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 822/1428] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:41 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1488 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:42.030874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:42.033090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:42.051124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:42.052362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:42.054153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:42.056894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:42.057619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:42.059223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:42.380294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:42.390192 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d4531399-6983-4437-8168-d5d52e209d56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1462 microversion: 2.1 time: 0.365957 Oct 31 14:08:42.390766 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 607/1429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:42 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1462 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:42.440424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:42.441366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:42.459753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:42.461443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:42.462336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:42.464505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:42.467682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:42.469564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:42.625911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:42.659086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02cfde29-b093-4496-9a82-acffc1327120 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1271 microversion: 2.1 time: 0.225800 Oct 31 14:08:42.663362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 608/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:42 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:42.672322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:42.673089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:42.708612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:42.709057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:42.709510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:42.710917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:42.717900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:42.719190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:42.991116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:42.996537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'deleted': False, 'project_id': '1f5f22f11cbd4e8f921339f04c1ef9ca'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:43.023871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.024368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.024808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.025742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.029938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.030811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.253790 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d94006a-afa6-49d8-b4b9-fed8f32d380e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.838134 Oct 31 14:08:43.271407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 823/1431] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:08:42 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:08:43.271407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:43.271877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:43.286723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.287356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.288138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.288852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.289308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.289733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.386294 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65a0ab13-2562-4090-846b-7530c222a130 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123159 Oct 31 14:08:43.387613 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 824/1432] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:43 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:43.401009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3949bb5d-166b-4b11-bb69-17a7e43412ea tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1076e9700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:43.471623 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3949bb5d-166b-4b11-bb69-17a7e43412ea tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1427 microversion: 2.1 time: 0.083133 Oct 31 14:08:43.478225 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 825/1433] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:43 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:43.489095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:43.489709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:43.497343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.497832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.498321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.504907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.505399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.505846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.526952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:43.538883 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ccee634-93f0-48c7-a273-2d32b76718db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.874107 Oct 31 14:08:43.542934 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 609/1434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:42 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:43.551357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:43.570407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'deleted': False} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:43.593914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.598028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.598903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.600179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.600895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.601528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.699751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:43.711735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:43.714814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:43.721310 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78323614-4403-4ef4-9fff-2fa2732b2434 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.247559 Oct 31 14:08:43.722222 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 826/1435] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:43 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:43.749904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:43.751973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:43.774446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.774941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.775371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.779845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:43.780394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:43.780832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:43.956609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:08:44.101808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:44.113185 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd655034-fc88-45fb-bc51-55d1092627ba tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1313 microversion: 2.1 time: 0.389600 Oct 31 14:08:44.114222 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 827/1436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:43 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:44.197836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:44.206967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:44.207801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:44.399922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:44.405056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:44.420673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:44.421563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:44.422526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:44.423425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:44.424038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:44.424639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:44.505979 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ee6527e-5cea-46dd-8aa7-b9fdf9df5f6b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110157 Oct 31 14:08:44.507294 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 828/1437] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:44 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:08:44.514895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-800c70c4-ab49-4e18-a031-8ef72efa13fa tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe107826e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:45.072326 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cac5e6a8-6368-4f7e-8ad1-ae4cf58d151f tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21445 microversion: 2.1 time: 1.527906 Oct 31 14:08:45.075184 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 610/1438] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Oct 31 14:08:43 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21445 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:45.083128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:45.084218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:45.090964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.091704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.092332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.093192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.093802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.094420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.328738 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-800c70c4-ab49-4e18-a031-8ef72efa13fa tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1436 microversion: 2.1 time: 0.820169 Oct 31 14:08:45.340659 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 829/1439] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:44 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1436 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:45.346145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:45.359349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:45.367415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.368187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.371798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.372559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.373035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.377731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.461335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:45.470841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:45.474636 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bbbea8c0-c7e5-492b-a641-62fff7ed0d4c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.397564 Oct 31 14:08:45.481855 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 611/1440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:45 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:45.488352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:45.498461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:45.501775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:45.504984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'deleted': False, 'project_id': '1f5f22f11cbd4e8f921339f04c1ef9ca'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:45.510348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4edf80ee-efa5-4a59-8544-da627339f76c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.168188 Oct 31 14:08:45.511459 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 830/1441] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:45 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:45.529911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:45.530811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:45.537890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.541349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.542031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.542712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.544059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.544182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.544986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.545969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.546219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.547064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:45.554232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:45.555026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:45.822721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:45.835913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d470fd2-01c8-4387-b198-e2ed0e2db96e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1334 microversion: 2.1 time: 0.312805 Oct 31 14:08:45.848703 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 831/1442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:45 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1334 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:45.955629 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bb5719c-3fdc-4c1f-9482-cfb1a80fab59 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=76489790a3e4477aba14b231646a3f98" status: 200 len: 15 microversion: 2.1 time: 0.472486 Oct 31 14:08:45.961224 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 612/1443] 10.222.0.27 () {58 vars in 1231 bytes} [Mon Oct 31 14:08:45 2022] GET /compute/v2.1/servers/detail?tenant_id=76489790a3e4477aba14b231646a3f98 => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:08:45.975153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a92a28bb-103d-4a68-8796-b1d4164328b5 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077ecca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.065110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-047a36bd-0977-41c7-b156-e28bef039c7e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe10777aaf0>, body: {"keypair": {"name": "tempest-keypair-1512760541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIijoeqrIuzWpZYvog79HeV1eq+614oQWYe1xd4E/eylIFKJbpZQ0/McITpwU3V4cUcjbESWchjHSoDaVBMYNpPPF418uJY65fbUm1LcdIt+h03GAa/mFbAcz35SEcZBwQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:46.067251 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a92a28bb-103d-4a68-8796-b1d4164328b5 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 200 len: 1436 microversion: 2.1 time: 0.101069 Oct 31 14:08:46.067880 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 613/1444] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:08:45 2022] GET /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 1436 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:46.074697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.076834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:46.095482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.096093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.096528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.097241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.097721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.098191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.115850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-047a36bd-0977-41c7-b156-e28bef039c7e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:46.124424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-047a36bd-0977-41c7-b156-e28bef039c7e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:46.136976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:46.183852 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-047a36bd-0977-41c7-b156-e28bef039c7e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.324446 Oct 31 14:08:46.191402 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 832/1445] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 342 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:08:46.229696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.242466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87cd28d1-40ee-42e9-a375-02e119221cb2 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.173266 Oct 31 14:08:46.245667 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 614/1446] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:46 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:46.263889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'tenant_id': '76489790a3e4477aba14b231646a3f98', 'deleted': False} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:46.267916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.270027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:46.287484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.288558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.289294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.291656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.292400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.294290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.300088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.300586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.301422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.302413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.302909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.303546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.390950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:08:46.629630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.630121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.630586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.640678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:46.655018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6e302d4-ea76-4df3-aab4-e6fb775d4d28 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1466 microversion: 2.1 time: 0.405867 Oct 31 14:08:46.656209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 615/1447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:46 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1466 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:46.661111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-727ed4cd-94f3-4560-b7c6-84091ea52afa tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1075d6550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.674371 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-727ed4cd-94f3-4560-b7c6-84091ea52afa tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1512760541" status: 200 len: 513 microversion: 2.2 time: 0.014007 Oct 31 14:08:46.675788 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 616/1448] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 31 14:08:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1512760541 => generated 513 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:46.702463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.705268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:46.721001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.721797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.722337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.725553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.728057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.728658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.818055 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a38daaa5-de85-497c-961c-136a6fdc1973 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76489790a3e4477aba14b231646a3f98" status: 200 len: 4823 microversion: 2.1 time: 0.625371 Oct 31 14:08:46.819516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 833/1449] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 31 14:08:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76489790a3e4477aba14b231646a3f98 => generated 4823 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:46.825078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:46.825977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:46.835521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.836430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.837996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.841524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:46.843111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:46.847716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:46.928232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:46.942368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:46.944121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:46.949865 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03c97649-24d9-41ba-9e11-a0aced7ffbe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.129027 Oct 31 14:08:46.950666 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 834/1450] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:46 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:46.972724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d725cb6-c5b2-4df0-91f7-1f20bf7126b7 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1077b8a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:47.477226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:47.495355 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-157f60f2-516a-4328-af72-03c1db976b89 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.805493 Oct 31 14:08:47.506337 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 617/1451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:46 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:47.530716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f8267cf-4726-4662-84ef-8794ba02e876 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1075d6dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:47.578965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f8267cf-4726-4662-84ef-8794ba02e876 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512760541" status: 204 len: 0 microversion: 2.2 time: 0.071221 Oct 31 14:08:47.593309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 618/1452] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 31 14:08:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512760541 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:47.598665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:47.632041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'tenant_id': '1f5f22f11cbd4e8f921339f04c1ef9ca', 'deleted': False} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:47.644143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:47.645174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:47.645809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:47.647738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:47.648512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:47.649116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:47.709782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8cc5d8c-2890-4f99-9dcd-e5979bddaec3 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1f5f22f11cbd4e8f921339f04c1ef9ca" status: 200 len: 15 microversion: 2.1 time: 0.114911 Oct 31 14:08:47.710956 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 619/1453] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 31 14:08:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1f5f22f11cbd4e8f921339f04c1ef9ca => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:08:47.723950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:47.724792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:47.742431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:47.743181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:47.744032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:47.745000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:47.748081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:47.748782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.184708 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d725cb6-c5b2-4df0-91f7-1f20bf7126b7 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "DELETE /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2" status: 204 len: 0 microversion: 2.1 time: 1.231285 Oct 31 14:08:48.186371 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 835/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:46 2022] DELETE /compute/v2.1/images/d37b8398-5c01-4fad-b94b-49da356540a2 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:48.192786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:48.202036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:48.231145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.238738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.239958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.241132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.241884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.242871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.345648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93074e58-204e-464c-a855-dcc23949ac95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.157666 Oct 31 14:08:48.350110 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 836/1455] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:48 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:48.358833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc271b0e-eac9-4163-89cd-6e1596c740d6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe1078b8700>, body: {"keypair": {"name": "tempest-keypair-1653638255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5Sc47E7oNDzun4HnoUJXxcvKsAW9A5otcXhGcFFz+LDc+cSi9OS9d2207bDpX4N/YlKlBvvgiVD6LuIj64NpLTYWBGFI37Bj7wFnPAgMC73qIPZo6j91RBsKaTFH3/yw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:48.371474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:48.385595 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b135c4cf-feda-4f83-a750-e692cf33585a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.673214 Oct 31 14:08:48.397711 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 620/1456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:47 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:48.408110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4aa32c6-88e6-4226-a0de-ed8a4f046656 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:48.424352 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4aa32c6-88e6-4226-a0de-ed8a4f046656 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023558 Oct 31 14:08:48.424938 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 621/1457] 10.222.0.27 () {58 vars in 1189 bytes} [Mon Oct 31 14:08:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:08:48.438511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:48.439572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:48.454109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-dc271b0e-eac9-4163-89cd-6e1596c740d6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:48.459946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.460687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.461904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.465432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.466120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.466772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.467377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-dc271b0e-eac9-4163-89cd-6e1596c740d6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:48.545166 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc271b0e-eac9-4163-89cd-6e1596c740d6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.190599 Oct 31 14:08:48.555497 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 837/1458] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:08:48.566579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5096adf-c29f-4694-a9a8-db533cead31e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '.version_select at 0x7fe1076e99d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:48.612543 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a5096adf-c29f-4694-a9a8-db533cead31e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] HTTP exception thrown: Image not found. Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5096adf-c29f-4694-a9a8-db533cead31e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Request method failure captured: Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 HTTP/1.1 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9aZ9H5BxmJiunt4P3zXGBZZ4_toFj7Wj0xmCM6qHrK1TSB6njHQ8Ag9JH0acYER273i7cM3kGtFdllXCvbXGNOQXloy_qDcdp2ZAu9UFC0FnHoxRe-74wZ7I4I3CpR3jxDOt5oP7LPSmTl3XyHjsmzdnsJYO9c0YVEtgHWYqevKGmk Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 35c83f504b5e41169372fb73cffd18a5 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35c83f504b5e41169372fb73cffd18a5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 35c83f504b5e41169372fb73cffd18a5 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesOneServerTestJSON-481285090-project Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: dfe88786f3e240739b5f84f1f0f43ed4 Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesOneServerTestJSON-481285090-project Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '37e07ca5-3fe3-43d1-a9e4-56ce42be0715'} Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 37e07ca5-3fe3-43d1-a9e4-56ce42be0715 to delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37e07ca5-3fe3-43d1-a9e4-56ce42be0715 could not be found. Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.619647 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5096adf-c29f-4694-a9a8-db533cead31e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:48.626044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5096adf-c29f-4694-a9a8-db533cead31e tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "DELETE /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715" status: 404 len: 62 microversion: 2.1 time: 0.064757 Oct 31 14:08:48.629370 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 838/1459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:48 2022] DELETE /compute/v2.1/images/37e07ca5-3fe3-43d1-a9e4-56ce42be0715 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:08:48.645962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:48.648225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:48.662907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:48.674340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.674850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.675285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.676334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.677881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:48.679707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:48.686364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.687099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.690794 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-600c3136-45f5-4455-897c-59894ad87b53 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.264796 Oct 31 14:08:48.694826 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 622/1460] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:48 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:48.701507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:48.708958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:48.721797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.722714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.723408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.724358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.725043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.725697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.869940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f09b6266-365e-434b-8f9f-31f5fbcf3064 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 0 microversion: 2.1 time: 0.237719 Oct 31 14:08:48.877198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 839/1461] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:48 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:48.884918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b2d2082-6073-4bb0-ae29-53d49bcae6b6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe107757700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:48.930700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b2d2082-6073-4bb0-ae29-53d49bcae6b6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653638255" status: 204 len: 0 microversion: 2.2 time: 0.052128 Oct 31 14:08:48.936262 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 840/1462] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 31 14:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653638255 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:48.944035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3194f2aa-92d4-4dfa-a329-1c13613c28f3 req-e093cf56-40e4-4691-81c6-f9ae95f2136e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "name": "network-vif-unplugged", "status": "completed", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:48.973236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3194f2aa-92d4-4dfa-a329-1c13613c28f3 req-e093cf56-40e4-4691-81c6-f9ae95f2136e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:48.973708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3194f2aa-92d4-4dfa-a329-1c13613c28f3 req-e093cf56-40e4-4691-81c6-f9ae95f2136e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:48.974426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3194f2aa-92d4-4dfa-a329-1c13613c28f3 req-e093cf56-40e4-4691-81c6-f9ae95f2136e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:48.997691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:49.000579 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3194f2aa-92d4-4dfa-a329-1c13613c28f3 req-e093cf56-40e4-4691-81c6-f9ae95f2136e service nova] Creating event network-vif-unplugged:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:08:49.009332 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df521bbb-e6ce-4bc6-b47b-3bdcc4cee04f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.313067 Oct 31 14:08:49.010920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 623/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:48 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:49.013447 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3194f2aa-92d4-4dfa-a329-1c13613c28f3 req-e093cf56-40e4-4691-81c6-f9ae95f2136e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075343 Oct 31 14:08:49.015829 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 841/1464] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:49.020393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:49.021445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:49.023228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:49.031103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.040240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:49.041071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '76489790a3e4477aba14b231646a3f98'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:49.041283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.042098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.045401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.046000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.046609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.062366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.062910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.071582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.072540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.073069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.096994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.099433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:08:49.250560 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b96069d-bf08-49d2-a8d4-98eadc11c176 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 204 len: 0 microversion: 2.1 time: 0.235384 Oct 31 14:08:49.251267 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 624/1465] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:08:49 2022] DELETE /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:49.256898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d5ff2ef-9e8e-4bfc-9edd-dd4d4de4507d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe1077c5f70>, body: {"keypair": {"name": "tempest-keypair-1338114935", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:49.290343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:49.300435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:08:49.307694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0d5ff2ef-9e8e-4bfc-9edd-dd4d4de4507d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:49.316610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0d5ff2ef-9e8e-4bfc-9edd-dd4d4de4507d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:49.361031 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d5ff2ef-9e8e-4bfc-9edd-dd4d4de4507d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.108002 Oct 31 14:08:49.362347 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 625/1466] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:49 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:08:49.367809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:49.368769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:49.376789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.377551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.378200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.379112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.379743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.380341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.435785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e64fbbc7-3ffe-4782-b9cf-d98196314fb3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.418704 Oct 31 14:08:49.444639 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 842/1467] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 31 14:08:49 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:49.457183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c98affb8-b086-40e9-961c-e195c52cf94d req-3c2cee6a-0f9e-411a-8821-a6a9f0a12db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "tag": "07d5054a-ae9a-473c-a738-7b08b8aba956"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:49.482904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c98affb8-b086-40e9-961c-e195c52cf94d req-3c2cee6a-0f9e-411a-8821-a6a9f0a12db0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.483386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c98affb8-b086-40e9-961c-e195c52cf94d req-3c2cee6a-0f9e-411a-8821-a6a9f0a12db0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.483818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c98affb8-b086-40e9-961c-e195c52cf94d req-3c2cee6a-0f9e-411a-8821-a6a9f0a12db0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.515735 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c98affb8-b086-40e9-961c-e195c52cf94d req-3c2cee6a-0f9e-411a-8821-a6a9f0a12db0 service nova] Creating event network-changed:07d5054a-ae9a-473c-a738-7b08b8aba956 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:08:49.529745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c98affb8-b086-40e9-961c-e195c52cf94d req-3c2cee6a-0f9e-411a-8821-a6a9f0a12db0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081752 Oct 31 14:08:49.531199 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 843/1468] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:49.544582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:49.551941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:49.567932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.571972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.572538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.573357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.577661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.579035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.590364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:49.672496 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03f917f3-60b2-41e0-8090-2a274b02f241 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137890 Oct 31 14:08:49.679091 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 844/1469] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:49 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:49.687583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d2155ff-c94c-476f-bf03-a17a2cdcb151 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1078b8790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:49.749610 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d2155ff-c94c-476f-bf03-a17a2cdcb151 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338114935" status: 204 len: 0 microversion: 2.2 time: 0.069238 Oct 31 14:08:49.750436 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 845/1470] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 31 14:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338114935 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:49.762666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:49.763421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:49.775785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.776290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.776754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:49.777962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:49.778484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:49.778919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.112714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:50.122159 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cd2e919-0590-48b5-a7d4-281c8ed1a251 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.370673 Oct 31 14:08:50.134843 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 846/1471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:49 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:50.147183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:50.150368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:50.160323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.161427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.162033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.162956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.163567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.164162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.293400 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c76e2e9-6b8a-4291-8c64-7c1e7b9ecee4 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 0 microversion: 2.1 time: 0.155844 Oct 31 14:08:50.299484 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 847/1472] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:50 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:50.306971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:50.310584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:50.324583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.326579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.327209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.328882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.334647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.335276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.380475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:50.398073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ee12f05-79a1-4e3c-a836-26215fd2117a tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1472 microversion: 2.1 time: 1.034439 Oct 31 14:08:50.398707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 626/1473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:49 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1472 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:50.417246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5aadf55f-8363-4264-966a-1be904375d08 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe1078214c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1729831849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEpj7ta5a9d2lO6uEE3NusZAhYvF3NTAGxfs3e9WhKp7w8nTumpAol4OyQ73MjmjZtjY4eCqb/oiFHh0uwV5mWjZrVjwAeBLG/63Qa3CoBKZ4/JDTBfC/mYFr++rsuxBw=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:50.453831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:50.467116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:50.468983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:50.472316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5aadf55f-8363-4264-966a-1be904375d08 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:50.480718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0457c9b3-4c62-464e-b8e3-47f8cbd66327 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.179734 Oct 31 14:08:50.494192 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 848/1474] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:50 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:50.496862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:50.498060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:50.508143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:50.509337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5aadf55f-8363-4264-966a-1be904375d08 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:50.515809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.518496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.518963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.519701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.522998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.524620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.568062 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5aadf55f-8363-4264-966a-1be904375d08 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.168285 Oct 31 14:08:50.568972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 627/1475] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:08:50.573676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:50.574820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:50.590199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.590707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.591146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.591868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:50.592332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:50.592747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:50.825842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:50.837654 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2782a2f5-8c88-40ff-afb9-578bb58bdde2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.355248 Oct 31 14:08:50.843884 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 849/1476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:50 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:50.859230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e04eaf0b-c0fe-4c71-9412-96aaa8bb6f3d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe1078b88b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1391690911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIQujGsCLW0ayg4ic4FleSOXsTlip/7VB6X2r/RNdWkYHAmdWpXI6SioWaDeFFoCUo9bFmMAxE0IfupDsXSa2ARfCF9VMJR04WDdv0eiYVHbpO/OVA641CtmYJ8pqaXFw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:50.903953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e04eaf0b-c0fe-4c71-9412-96aaa8bb6f3d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:50.923315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e04eaf0b-c0fe-4c71-9412-96aaa8bb6f3d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:50.992090 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46ce4230-8080-4b87-aefa-b3e563293f00 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1613 microversion: 2.1 time: 0.421876 Oct 31 14:08:50.997639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 628/1477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:50 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1613 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:51.005801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.012946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:51.039498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.041019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.041713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.043507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.044204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.045309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.047909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e04eaf0b-c0fe-4c71-9412-96aaa8bb6f3d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.201240 Oct 31 14:08:51.061925 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 850/1478] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:08:51.068004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.072387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:51.091450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.091943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.092312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.100370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.101148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.101735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.134874 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5a2a1e9-f367-428c-a9ea-b7045f22e34c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134943 Oct 31 14:08:51.139460 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 629/1479] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:50 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:51.148707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0d165f2-1a97-471f-870b-e3293c0b8fe5 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe1077c8940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-404854480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAroago48dFGk2CoVFNJEsHSJtd3g1GRJ4LUfrNiJ0Gs1gUHl0JS1WxPnhjkZ78dVsyczGiITsnwnd69X/1/E64cO5GDM22WdWSP/Z1ocmT2LPd8nUTG5DqvJsy8VcNtdg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:51.199307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-b0d165f2-1a97-471f-870b-e3293c0b8fe5 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:51.235978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-b0d165f2-1a97-471f-870b-e3293c0b8fe5 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:51.310997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0d165f2-1a97-471f-870b-e3293c0b8fe5 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.169247 Oct 31 14:08:51.311732 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 630/1480] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:08:51.320449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.345525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:51.379163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.383384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.383384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.394840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.395484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.395807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.447128 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86a04815-9b51-43e8-8e4c-9617c0aec022 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1613 microversion: 2.1 time: 0.383979 Oct 31 14:08:51.454353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 851/1481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:51 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1613 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:51.476849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c519e6e-ba89-4ef3-b152-18d5c717315d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1078f5040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.481367 n-d-863052-1 devstack@n-api.service[120640]: WARNING oslo_db.sqlalchemy.utils [None req-4c519e6e-ba89-4ef3-b152-18d5c717315d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 14:08:51.494838 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c519e6e-ba89-4ef3-b152-18d5c717315d tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.039343 Oct 31 14:08:51.501273 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 852/1482] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 31 14:08:51 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:51.513429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.514034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:51.521245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.521734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.522388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.523106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.523555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.523994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.726913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:51.758250 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1061257-8019-4611-9100-caf94a60b4af tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1472 microversion: 2.1 time: 0.249743 Oct 31 14:08:51.765237 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 853/1483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:51 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:51.779298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.798339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'host': 'n-h2-863052-1', 'deleted': False} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:51.810372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.811871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.812978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.814424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.815742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.816943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.852747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:51.867830 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e8b2a2f-d3be-4467-95be-601c655109a1 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.554423 Oct 31 14:08:51.870158 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 631/1484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:51 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:51.883644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c49af930-4128-45b7-8aa1-c4a8e95d3cdc tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1077c84c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.932580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c49af930-4128-45b7-8aa1-c4a8e95d3cdc tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-404854480" status: 204 len: 0 microversion: 2.2 time: 0.060435 Oct 31 14:08:51.935829 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 632/1485] 10.222.0.27 () {60 vars in 1318 bytes} [Mon Oct 31 14:08:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-404854480 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:51.950206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:51.954580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:51.975790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:08:51.977480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.980598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.982124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:51.983326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:51.989635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:51.990456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.105512 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9525c38d-65c3-4a7b-bab3-7f5942b41d42 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h2-863052-1&all_tenants=1" status: 200 len: 1979 microversion: 2.1 time: 0.337185 Oct 31 14:08:52.106096 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 854/1486] 10.222.0.27 () {58 vars in 1190 bytes} [Mon Oct 31 14:08:51 2022] GET /compute/v2.1/servers?host=n-h2-863052-1&all_tenants=1 => generated 1979 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:52.110805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fc58ff0a-f323-464a-9ed8-0cfee5ee73eb req-e3d2ee66-5371-4c6e-a450-e38c5620da8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "tag": "03652c30-ef7f-40a7-87c3-798fd78915e5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:52.122091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fc58ff0a-f323-464a-9ed8-0cfee5ee73eb req-e3d2ee66-5371-4c6e-a450-e38c5620da8a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.122596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fc58ff0a-f323-464a-9ed8-0cfee5ee73eb req-e3d2ee66-5371-4c6e-a450-e38c5620da8a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.123189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fc58ff0a-f323-464a-9ed8-0cfee5ee73eb req-e3d2ee66-5371-4c6e-a450-e38c5620da8a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.138282 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fc58ff0a-f323-464a-9ed8-0cfee5ee73eb req-e3d2ee66-5371-4c6e-a450-e38c5620da8a service nova] Creating event network-changed:03652c30-ef7f-40a7-87c3-798fd78915e5 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:08:52.143877 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fc58ff0a-f323-464a-9ed8-0cfee5ee73eb req-e3d2ee66-5371-4c6e-a450-e38c5620da8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035969 Oct 31 14:08:52.144310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 855/1487] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:52.150078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.150841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:52.160220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.160708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.161140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.162237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.162710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.163193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.240526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:52.250137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:52.255985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:52.267641 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c5b6dd6-bdb6-4177-84f2-3e47545e7cc4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.328724 Oct 31 14:08:52.268527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 633/1488] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:51 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:52.287871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8136d55-301e-403d-bd8f-5eb194f48a93 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1075ccc10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.341291 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8136d55-301e-403d-bd8f-5eb194f48a93 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1391690911" status: 204 len: 0 microversion: 2.2 time: 0.068607 Oct 31 14:08:52.342241 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 634/1489] 10.222.0.27 () {60 vars in 1321 bytes} [Mon Oct 31 14:08:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1391690911 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:52.349513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.373104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:08:52.386965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.388499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.391210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.392238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.394909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.395582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.470568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:52.485151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e31f489-d817-4598-8a19-eb42f0edf2da tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.339673 Oct 31 14:08:52.488515 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 856/1490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:52 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:52.499045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.505561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:52.519904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.521985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.522657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.524975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.526292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.529271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.595415 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78c9ef46-c657-49de-a45e-d90713c1458a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105451 Oct 31 14:08:52.598747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 857/1491] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:52 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:08:52.622823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4febd4c-8460-48f7-8926-6837135af6a1 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1077d6dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.632712 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df3b65fe-5266-4311-9297-fea06260bbcb tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.278525 Oct 31 14:08:52.634004 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 635/1492] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 31 14:08:52 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:08:52.652949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:52.657381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:52.673755 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4febd4c-8460-48f7-8926-6837135af6a1 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1729831849" status: 204 len: 0 microversion: 2.2 time: 0.073609 Oct 31 14:08:52.674964 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 858/1493] 10.222.0.27 () {60 vars in 1321 bytes} [Mon Oct 31 14:08:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1729831849 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:52.696135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.696705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.697538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-407a8132-402a-41e6-8364-fc60dfcfc273 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe1078268b0>, body: {"keypair": {"name": "tempest-keypair-1866590256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwPh/QMHa/JyrtPsQZFBLHm4Xmy5XxnWjC6l6tWB+NMWBCNJvBG/vvtj7v8cnk3S81IX4lWYIjlgtYUq1QBr6gGqa/WuUmZm4MQdfYfxi6OfZ09YdHjp8fXJaYBzynISg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:52.698655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.699498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.702691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.703281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.729174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-407a8132-402a-41e6-8364-fc60dfcfc273 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:52.743356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-407a8132-402a-41e6-8364-fc60dfcfc273 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:52.819627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-407a8132-402a-41e6-8364-fc60dfcfc273 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.126928 Oct 31 14:08:52.820826 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 859/1494] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 31 14:08:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 31 14:08:52.826109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.829918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:52.840742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.841240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.841668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.848937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:52.849798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:52.850264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:52.915921 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1b443eeb-ef90-4ed2-ba4a-e5e5cf780385 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 0 microversion: 2.1 time: 0.270126 Oct 31 14:08:52.920473 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 636/1495] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:52 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:52.928403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-331281db-d8e3-4f7c-a968-97ba657e687f tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe107845b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.961427 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-331281db-d8e3-4f7c-a968-97ba657e687f tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1866590256" status: 200 len: 513 microversion: 2.2 time: 0.038009 Oct 31 14:08:52.969886 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 637/1496] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 31 14:08:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1866590256 => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:52.984290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:52.984850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:53.003791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.006475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.006976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.007726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.008201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.008627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.040287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:53.241673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:53.255863 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-824536ee-0b8c-4e3a-aede-c712789e0521 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1472 microversion: 2.1 time: 0.433767 Oct 31 14:08:53.256648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 860/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:52 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:53.272199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:53.275532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:53.295279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.296590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.297607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.298975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.299736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.300657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.491525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:08:53.492340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:08:53.492492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:08:53.492799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:08:53.493210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:08:53.571157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:53.583005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.583517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.583956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.584701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.585262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.589761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.650263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45eddf52-a698-4758-814c-faad5886be56 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 1066 microversion: 2.1 time: 0.392593 Oct 31 14:08:53.652143 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 861/1498] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:53 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 1066 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 14:08:53.656901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:53.657508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:53.669418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.669418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.670295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.671090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.671614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.672171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.694358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:53.861944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:53.876561 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4da29968-895e-44e3-a4d4-b438c8a64c9f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.223584 Oct 31 14:08:53.878025 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 862/1499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:53 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:53.888351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5015439e-ec16-459d-ab6b-e88e51e0d5f6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe107915790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:53.894564 n-d-863052-1 devstack@n-api.service[120640]: WARNING oslo_db.sqlalchemy.utils [None req-5015439e-ec16-459d-ab6b-e88e51e0d5f6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 14:08:53.903700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5015439e-ec16-459d-ab6b-e88e51e0d5f6 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.022210 Oct 31 14:08:53.912569 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 863/1500] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 31 14:08:53 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:53.919113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:53.919932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:53.928787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.929430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.930297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.931096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:53.931708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:53.933592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:53.968188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:53.982657 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83de69c6-b3cf-42a9-a3db-94439e0009b6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 1.010781 Oct 31 14:08:53.986566 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 638/1501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:52 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:53.997167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:54.002290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:54.021813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.022824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.025313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.041028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.045861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.048223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.102148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:54.116047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:54.121930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:54.134604 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6074674-5c4e-4977-b052-0a867b2f89a0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.220430 Oct 31 14:08:54.146813 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 864/1502] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:53 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:54.167509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:54.170239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:54.179688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.183456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.185240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.187031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.189136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.189905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.228310 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b488791f-d84d-4681-8b17-c5f7d19d2945 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.079795 Oct 31 14:08:54.234890 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 865/1503] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:08:54 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:54.241915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:54.242557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:54.259127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.259708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.260175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.260856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.261932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.262409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.512555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:54.525085 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9755f265-6d4f-46c6-90d9-9e1541dcca43 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.293641 Oct 31 14:08:54.526374 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 866/1504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:54 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:54.541958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:54.544211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:54.552238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.552943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.553584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.554724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:54.556189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:54.556680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:54.864225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:54.895169 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ceddef8-4927-4761-93f3-9564b66a3fd8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.367225 Oct 31 14:08:54.934453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 867/1505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:54 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:54.953791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6977869-1306-4400-981a-490de4f0dfc3 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1078b10d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:54.987398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.008190 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2bd13e57-0dc8-4510-adb2-06c0ff76eb5a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 1.017574 Oct 31 14:08:55.016308 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6977869-1306-4400-981a-490de4f0dfc3 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866590256" status: 204 len: 0 microversion: 2.2 time: 0.078016 Oct 31 14:08:55.016986 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 868/1506] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 31 14:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866590256 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:55.021962 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 639/1507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:53 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:55.032144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a41ae239-b308-4bd2-a2c7-5c41e487972c req-4e1e81ed-f1c9-472f-a003-75f5104f8a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5d608-911a-4194-b3ea-5b2df9d4f6ad", "name": "network-vif-deleted", "tag": "3010e8f0-eb31-4a94-8e01-2a41fb20e295"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:55.045679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:55.046619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:55.066735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.067231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.069005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.069756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.072584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.073059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.086768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a41ae239-b308-4bd2-a2c7-5c41e487972c req-4e1e81ed-f1c9-472f-a003-75f5104f8a31 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.087278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a41ae239-b308-4bd2-a2c7-5c41e487972c req-4e1e81ed-f1c9-472f-a003-75f5104f8a31 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.090549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a41ae239-b308-4bd2-a2c7-5c41e487972c req-4e1e81ed-f1c9-472f-a003-75f5104f8a31 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.128550 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a41ae239-b308-4bd2-a2c7-5c41e487972c req-4e1e81ed-f1c9-472f-a003-75f5104f8a31 service nova] Creating event network-vif-deleted:3010e8f0-eb31-4a94-8e01-2a41fb20e295 for instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad on n-h2-863052-1 Oct 31 14:08:55.141278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a41ae239-b308-4bd2-a2c7-5c41e487972c req-4e1e81ed-f1c9-472f-a003-75f5104f8a31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120250 Oct 31 14:08:55.147390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 640/1508] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:55.156542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:55.161157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:55.180492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.181644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.184974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.186946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.188726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.189981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.205411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe88786f3e240739b5f84f1f0f43ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c83f504b5e41169372fb73cffd18a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.220099 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-faa74a36-92b3-441d-b897-631498a2aa32 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 200 len: 1302 microversion: 2.1 time: 0.197364 Oct 31 14:08:55.220925 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 869/1509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:55 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 1302 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:55.232936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:55.233833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:55.247692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.251740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.252481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.256905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.257576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.258212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.539117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.550639 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c8b2727-0558-4b42-8226-d9f0151d73e6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.325826 Oct 31 14:08:55.551959 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 870/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:55 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:55.556851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Action: 'create', calling method: .version_select at 0x7fe107911c10>, body: {"keypair": {"name": "tempest-keypair-1700277481", "type": "x509"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:55.576502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:55.582860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:55.603704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.606831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.processutils [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpu331ns6d/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpu331ns6d/temp.key -subj /CN=f7a76c099ef64b0b86a5f51cf051a0e2 -extensions v3_req_client {{(pid=120640) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 31 14:08:55.613888 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f4d4084-9dcb-46ad-a8a9-963416b168e3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.464792 Oct 31 14:08:55.614707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 641/1511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:55 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:55.630984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:55.631615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:55.638870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.639434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.640024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.640754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.641271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.641715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.726586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.735252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.739328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.755089 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f591d8d-1d23-4c23-ba8c-eb873f206118 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.131711 Oct 31 14:08:55.758330 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 642/1512] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:55 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:55.764059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:55.764691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:55.782485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.782993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.783446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.784164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:55.784628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:55.785062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:55.868176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.processutils [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpu331ns6d/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpu331ns6d/temp.key -subj /CN=f7a76c099ef64b0b86a5f51cf051a0e2 -extensions v3_req_client" returned: 0 in 0.260s {{(pid=120640) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 31 14:08:55.872145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.processutils [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpu331ns6d/temp.key -password pass: {{(pid=120640) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 31 14:08:55.915013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.processutils [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpu331ns6d/temp.key -password pass:" returned: 0 in 0.041s {{(pid=120640) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 31 14:08:55.973292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:55.985140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-602c841b-0fca-400f-b02e-9552d63a8f30 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.225626 Oct 31 14:08:55.988783 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 643/1513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:55 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:55.990120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:55.996755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Getting quotas for user f7a76c099ef64b0b86a5f51cf051a0e2 and project 178af89618d8405f8a8cedf3275dd96b. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:55.999630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-678167983"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:56.002105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:56.012405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.013322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.014213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.015105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.015735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.016163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.028908 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb4f791c-bfdf-47df-9629-0e60552f371e tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.475343 Oct 31 14:08:56.031220 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 871/1514] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Oct 31 14:08:55 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 478 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:56.047250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29c1e1c3-b903-4c6a-8342-53c5ea4bbaee tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe1079115e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.060438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29c1e1c3-b903-4c6a-8342-53c5ea4bbaee tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1700277481" status: 200 len: 1534 microversion: 2.2 time: 0.021464 Oct 31 14:08:56.062007 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 872/1515] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 31 14:08:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1700277481 => generated 1534 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:08:56.076046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.077247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:56.097815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.098385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.098841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.099628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.100092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.100522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.261317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:56.271569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-686c4475-0650-41e3-bfcc-cccc0f292e5d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.208092 Oct 31 14:08:56.287255 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18d73adb-e922-4d02-9ded-a3eef8cdba1d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.280558 Oct 31 14:08:56.287903 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 873/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:56 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:56.288014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 644/1517] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:08:55 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 14:08:56.288119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-222df905-c23b-42f8-a6c1-ce5ddda37f57 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe107915820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.288224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.288224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] [instance: f5d5d608-911a-4194-b3ea-5b2df9d4f6ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:56.288423 n-d-863052-1 devstack@n-api.service[120640]: WARNING oslo_db.sqlalchemy.utils [None req-222df905-c23b-42f8-a6c1-ce5ddda37f57 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 14:08:56.288423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:56.295263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-222df905-c23b-42f8-a6c1-ce5ddda37f57 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.021667 Oct 31 14:08:56.296124 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 874/1518] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 31 14:08:56 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:56.300316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.300823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.301274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.302239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.302579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.303075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.310305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b8b74fb-efe6-4e77-8573-68a8692e47f9 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] Calling method '.version_select at 0x7fe107757700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.330010 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] HTTP exception thrown: Instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad could not be found. Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Request method failure captured: Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad HTTP/1.1 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9aZ9H5BxmJiunt4P3zXGBZZ4_toFj7Wj0xmCM6qHrK1TSB6njHQ8Ag9JH0acYER273i7cM3kGtFdllXCvbXGNOQXloy_qDcdp2ZAu9UFC0FnHoxRe-74wZ7I4I3CpR3jxDOt5oP7LPSmTl3XyHjsmzdnsJYO9c0YVEtgHWYqevKGmk Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 35c83f504b5e41169372fb73cffd18a5 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35c83f504b5e41169372fb73cffd18a5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35c83f504b5e41169372fb73cffd18a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 35c83f504b5e41169372fb73cffd18a5 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-481285090 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesOneServerTestJSON-481285090-project Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: dfe88786f3e240739b5f84f1f0f43ed4 Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesOneServerTestJSON-481285090-project Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad could not be found. Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f5d5d608-911a-4194-b3ea-5b2df9d4f6ad'} Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad could not be found. Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad could not be found. Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:08:56.331863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad could not be found. Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] Returning 404 to user: Instance f5d5d608-911a-4194-b3ea-5b2df9d4f6ad could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-523cc340-cbd2-4770-a510-7e3ebe12a900 tempest-ImagesOneServerTestJSON-481285090 tempest-ImagesOneServerTestJSON-481285090-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad" status: 404 len: 111 microversion: 2.1 time: 0.056093 Oct 31 14:08:56.337413 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 645/1519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:56 2022] GET /compute/v2.1/servers/f5d5d608-911a-4194-b3ea-5b2df9d4f6ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:08:56.341744 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b8b74fb-efe6-4e77-8573-68a8692e47f9 tempest-KeyPairsV22TestJSON-459354919 tempest-KeyPairsV22TestJSON-459354919-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700277481" status: 204 len: 0 microversion: 2.2 time: 0.036413 Oct 31 14:08:56.342364 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 875/1520] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 31 14:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700277481 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:08:56.579026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.579856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:56.589516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.590912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.591730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.592866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.593498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.594374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.796135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:56.796135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:56.813739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.814465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.815555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.818199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:56.818199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:56.820873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:56.906472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:56.916969 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af484546-7fd3-415c-8ec9-fa005f33b219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.342751 Oct 31 14:08:56.917814 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 646/1521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:56 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:56.950678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:56.961247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:56.963015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:56.969411 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f0702a3-c356-4f70-8bbd-ad22a7ed44e9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.182465 Oct 31 14:08:56.970571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 876/1522] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:56 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:08:57.013615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:57.014622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:57.023411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.023905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.024338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.025220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.025884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.026338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.193852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cc33eed9-764c-46fd-9ca3-d43bc20048fe req-db4a1bc6-27f7-41c6-85cc-510e44284bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "tag": "6a1736e4-5e31-4672-977d-00ee187108fb"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:57.223310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cc33eed9-764c-46fd-9ca3-d43bc20048fe req-db4a1bc6-27f7-41c6-85cc-510e44284bce service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.225058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cc33eed9-764c-46fd-9ca3-d43bc20048fe req-db4a1bc6-27f7-41c6-85cc-510e44284bce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.225692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cc33eed9-764c-46fd-9ca3-d43bc20048fe req-db4a1bc6-27f7-41c6-85cc-510e44284bce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.240648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cc33eed9-764c-46fd-9ca3-d43bc20048fe req-db4a1bc6-27f7-41c6-85cc-510e44284bce service nova] Creating event network-changed:6a1736e4-5e31-4672-977d-00ee187108fb for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:08:57.253657 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cc33eed9-764c-46fd-9ca3-d43bc20048fe req-db4a1bc6-27f7-41c6-85cc-510e44284bce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059873 Oct 31 14:08:57.255270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 877/1523] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:08:57.300143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:57.302411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:57.303413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:57.309694 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b025c34-7cd4-4ba2-a130-a7a9376fdfc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.300997 Oct 31 14:08:57.311513 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 647/1524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:57 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:57.314124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.314688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.315134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.315833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.318224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.320707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.542896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:57.569066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-504abb9d-8a92-436e-be10-b74be98fa887 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.273221 Oct 31 14:08:57.569989 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 878/1525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:57 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:57.945670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:57.946829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:57.958001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.958558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.959002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.959714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:57.960169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:57.960594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:57.999271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:58.000874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:58.010963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:58.012636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:58.014147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:58.018693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:58.020801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:58.021583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:58.172470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:58.182737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:58.184776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:58.199792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6435a5fe-eab3-43ab-960a-a5da888a79d8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.205614 Oct 31 14:08:58.205094 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 879/1526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:57 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:08:58.265473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:58.278974 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb492da8-bcd1-4755-8239-7b76bdbca343 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.338989 Oct 31 14:08:58.279658 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 648/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:57 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:58.334769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:58.335383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:58.351893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:58.352381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:58.353017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:58.353915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:58.354596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:58.355183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:58.594710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:58.595433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:58.615847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:58.620894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:58.621373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:58.622127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:58.631818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:58.635215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:58.659397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:58.682367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d96e7f2-8a31-4f20-b08d-fb0152f3880e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.351503 Oct 31 14:08:58.699191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 880/1528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:58 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:59.157859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:59.173714 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a85f371-7a97-4d6b-b1cd-27db9f0bc8d9 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.582536 Oct 31 14:08:59.175845 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 649/1529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:58 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:59.239879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:59.240693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:59.255615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:59.256118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:59.256561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:59.264753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:59.274000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:59.274657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:59.449217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:59.461616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:59.463765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:59.465606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5aae6f98-3562-4a4c-ad42-e0a99527ab61 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Action: 'create', calling method: .version_select at 0x7fe107915ee0>, body: {"keypair": {"name": "tempest-keypair-757643839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH20NLtfQgPJrCwfdEWySvpGZtUZKLrKXrXVy9731f4LhL4E5n/R8inCEHYu6psKyOh6R02zg/sXJnIyYH9Ck24wsir7VofUtNM/L5h7OGEouA3Nms0XfPOj+abChbsLiw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:59.470261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86bbef57-94fe-46a9-96fb-a0c6d8fccfe9 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.235135 Oct 31 14:08:59.484457 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 650/1530] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:08:59 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:08:59.484457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:59.484457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:59.489372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5aae6f98-3562-4a4c-ad42-e0a99527ab61 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:59.505921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:59.508086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:59.508759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:59.513090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:59.513797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:59.514421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:59.529114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5aae6f98-3562-4a4c-ad42-e0a99527ab61 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for user 9513aede17374e1c9f206549224bb691 and project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:59.582840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5aae6f98-3562-4a4c-ad42-e0a99527ab61 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.667792 Oct 31 14:08:59.584442 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 881/1531] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:08:59.596042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2592867-0c2f-4a6e-8c59-5c08dd010603 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe107915790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:59.606116 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2592867-0c2f-4a6e-8c59-5c08dd010603 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-757643839" status: 200 len: 497 microversion: 2.1 time: 0.014851 Oct 31 14:08:59.607098 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 882/1532] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Oct 31 14:08:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-757643839 => generated 497 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:08:59.621439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-243e0fd7-03e8-473b-b370-b2d03ec5f0cb tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe107a01ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:59.661480 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-243e0fd7-03e8-473b-b370-b2d03ec5f0cb tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757643839" status: 202 len: 0 microversion: 2.1 time: 0.046184 Oct 31 14:08:59.663461 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 883/1533] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757643839 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:08:59.679191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd1d6745-0f63-42ce-8a4a-fcbfd1f0153e tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Action: 'create', calling method: .version_select at 0x7fe107a74ca0>, body: {"keypair": {"name": "tempest-keypair-242386808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFX513DMYqUcXZA7Kvave2p9z/t+YMgmyVZO4v9aa8YeL9DS4gcMfY6KW9mGTDwbt7VHvWCEDD3s7dIEa68bEtKDPgg+rxAedPJJERRDZwMIIlklE3jL3JqY/SCfp+YYw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:59.702089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cd1d6745-0f63-42ce-8a4a-fcbfd1f0153e tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:59.713483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cd1d6745-0f63-42ce-8a4a-fcbfd1f0153e tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for user 9513aede17374e1c9f206549224bb691 and project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:59.743793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd1d6745-0f63-42ce-8a4a-fcbfd1f0153e tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072664 Oct 31 14:08:59.751164 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 884/1534] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:59.757146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:59.757953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:08:59.766835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:59.767736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:59.768500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:59.769488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:08:59.770009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:08:59.770382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:08:59.771016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:08:59.779836 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df289588-0bc0-4199-8192-ab917c1eb219 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.303462 Oct 31 14:08:59.783240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 651/1535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:59 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:08:59.793019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c56e306c-c6e4-4d2c-b412-0f0adb09177a tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe10785a8b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:08:59.840119 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c56e306c-c6e4-4d2c-b412-0f0adb09177a tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242386808" status: 202 len: 0 microversion: 2.1 time: 0.055557 Oct 31 14:08:59.840715 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 652/1536] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242386808 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:08:59.858400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2bd3e13-7311-4f81-b9a4-19123d7d9091 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Action: 'create', calling method: .version_select at 0x7fe10783fca0>, body: {"keypair": {"name": "tempest-keypair-1797607962", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:08:59.891881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:59.909665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-a2bd3e13-7311-4f81-b9a4-19123d7d9091 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:08:59.924793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-a2bd3e13-7311-4f81-b9a4-19123d7d9091 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for user 9513aede17374e1c9f206549224bb691 and project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:08:59.981398 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2bd3e13-7311-4f81-b9a4-19123d7d9091 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.127645 Oct 31 14:08:59.982908 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 653/1537] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:08:59 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:08:59.993731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f37be751-8090-463e-897c-86d11037db7c tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe107821a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.011870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:00.023829 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f37be751-8090-463e-897c-86d11037db7c tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797607962" status: 202 len: 0 microversion: 2.1 time: 0.034531 Oct 31 14:09:00.024900 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 654/1538] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797607962 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:09:00.026759 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-366776e6-31c8-4c50-868e-c357707634c2 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.273681 Oct 31 14:09:00.027398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 885/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:08:59 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:00.037611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ff18a91-5185-4d9d-b9e3-e7f2c1dafb20 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Action: 'create', calling method: .version_select at 0x7fe1077c8ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1416746666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaf9ewr0EOO/uKVZ+RZw7kSclqAM//8Fo6PeAGiZUArAOyROBPQHGE1n0Vpb4BdPlLAkj2z/cnnOKRf9DmpJJFvO5nWC7mHncbCOCDzFtuqDB+qFufQ/6I7VuTYwnUeIQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:00.059275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-1ff18a91-5185-4d9d-b9e3-e7f2c1dafb20 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:00.066391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-1ff18a91-5185-4d9d-b9e3-e7f2c1dafb20 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for user 9513aede17374e1c9f206549224bb691 and project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:00.102303 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ff18a91-5185-4d9d-b9e3-e7f2c1dafb20 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.068628 Oct 31 14:09:00.103263 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 655/1540] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:09:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:00.116992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8118522-c4bc-4a25-8b50-748d36f0fabc tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Action: 'create', calling method: .version_select at 0x7fe107a7ca60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-277089921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSoIvfsha/+l4dpS6BhKggXT/voV4bmcl1W1tIGejlkZmnHUab5GeX2xk7yZAURawn/eIFRQY7INvsPV+4x37DVCpqeOwTe6b57tP03470q9yBWB/FaJUIstROOXCvUDA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:00.136724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e8118522-c4bc-4a25-8b50-748d36f0fabc tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:00.147252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e8118522-c4bc-4a25-8b50-748d36f0fabc tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for user 9513aede17374e1c9f206549224bb691 and project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:00.181708 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8118522-c4bc-4a25-8b50-748d36f0fabc tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.068813 Oct 31 14:09:00.182499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 886/1541] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:09:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:00.199338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.200551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:00.206262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-370ab5bd-74fd-4ec5-8aad-37bc49877ba8 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Action: 'create', calling method: .version_select at 0x7fe107939b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-805558463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrY2NkPmzpTx10tVCvykJ//GlYdk7hlQoaGe4D7dx7xScEeiIxENN0oKIJbIu3q727UpDuWfU96g/dF9y6t3FKyxv5iN5liEGJMFuxaNLO0EZuc/t3uQjb47S78s9xRZw=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:00.217477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.217995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.219193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.219930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.220400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.220929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.248597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-370ab5bd-74fd-4ec5-8aad-37bc49877ba8 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:00.258614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-370ab5bd-74fd-4ec5-8aad-37bc49877ba8 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Getting quotas for user 9513aede17374e1c9f206549224bb691 and project 6a3a717b04924e6b890cb4404cc8022e. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:00.297534 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-370ab5bd-74fd-4ec5-8aad-37bc49877ba8 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.105108 Oct 31 14:09:00.298572 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 656/1542] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:09:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:00.317328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3be403d2-57b0-424f-8b4f-2c3c6e86d9b4 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe1078a0b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.331474 n-d-863052-1 devstack@n-api.service[120641]: WARNING oslo_db.sqlalchemy.utils [None req-3be403d2-57b0-424f-8b4f-2c3c6e86d9b4 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 14:09:00.346159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3be403d2-57b0-424f-8b4f-2c3c6e86d9b4 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.040878 Oct 31 14:09:00.347518 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 657/1543] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:09:00 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:00.367604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98bfb669-2ee6-4d7a-aad7-7d951ef4b955 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe1079795e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.421381 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98bfb669-2ee6-4d7a-aad7-7d951ef4b955 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-805558463" status: 202 len: 0 microversion: 2.1 time: 0.065942 Oct 31 14:09:00.424788 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 658/1544] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-805558463 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:09:00.436951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b744641-4a0c-4569-a70f-48767e6ae54f tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe1079348b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.491781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b744641-4a0c-4569-a70f-48767e6ae54f tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-277089921" status: 202 len: 0 microversion: 2.1 time: 0.063690 Oct 31 14:09:00.495884 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 659/1545] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-277089921 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:09:00.512084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee41dbbb-b28c-45f3-ad37-4605d50d76e2 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] Calling method '.version_select at 0x7fe1075cc160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.525341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:00.545283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e7cc3d1-1d34-496a-a567-902ed88d3616 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.350060 Oct 31 14:09:00.563345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 887/1546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:00 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:00.569119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.570017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:00.580301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.581138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.581781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.582809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.584039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.584696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.592967 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ee41dbbb-b28c-45f3-ad37-4605d50d76e2 tempest-KeyPairsV2TestJSON-1799910020 tempest-KeyPairsV2TestJSON-1799910020-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1416746666" status: 202 len: 0 microversion: 2.1 time: 0.094400 Oct 31 14:09:00.600910 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 660/1547] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 31 14:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1416746666 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:09:00.669092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-284e4186-05e0-4e01-a173-61509cf6b9c0 req-9806f6c0-a887-4a2c-96f7-ca63d0c91550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-plugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:00.708212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-284e4186-05e0-4e01-a173-61509cf6b9c0 req-9806f6c0-a887-4a2c-96f7-ca63d0c91550 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.710592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-284e4186-05e0-4e01-a173-61509cf6b9c0 req-9806f6c0-a887-4a2c-96f7-ca63d0c91550 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.712904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-284e4186-05e0-4e01-a173-61509cf6b9c0 req-9806f6c0-a887-4a2c-96f7-ca63d0c91550 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.762710 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-284e4186-05e0-4e01-a173-61509cf6b9c0 req-9806f6c0-a887-4a2c-96f7-ca63d0c91550 service nova] Creating event network-vif-plugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:09:00.784043 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-284e4186-05e0-4e01-a173-61509cf6b9c0 req-9806f6c0-a887-4a2c-96f7-ca63d0c91550 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114299 Oct 31 14:09:00.788481 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 661/1548] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:09:00.804455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.813468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:00.833744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.840111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.841289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.842501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.847767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.849224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.871044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:00.886154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:00.891883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:00.897916 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e91fb0a-ce77-45e5-8cc8-f36766f81ebc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1531 microversion: 2.91 time: 0.333246 Oct 31 14:09:00.916876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 888/1549] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:00 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1531 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:00.945677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:00.953022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:00.983077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.983077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.983077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:00.983077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:00.983077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:00.983077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.262401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:01.273759 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68c5d73c-79bf-4feb-b4f9-31b7fe8b5031 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.473762 Oct 31 14:09:01.281539 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 662/1550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:00 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:01.301499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:01.307266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:01.330618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:01.331709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:01.332339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.333241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:01.333868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:01.337408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.424676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lazy-loading 'services' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:09:01.466568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-923f3dbf-6b73-4dbe-ae78-3bfcd48a61e5 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1936 microversion: 2.91 time: 0.539526 Oct 31 14:09:01.469738 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 889/1551] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:00 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1936 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:01.499024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:01.499733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:01.510126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:01.510811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:01.511259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.520825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:01.521325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:01.521782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.606258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:01.648978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lazy-loading 'flavor' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:09:01.782180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:01.796027 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68775393-1e83-4848-b1b9-6115828c3ad3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.513042 Oct 31 14:09:01.799824 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 663/1552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:01 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:01.813891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:01.828920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:01.844761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:01.856984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:01.857813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.858840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:01.863217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:01.864077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:01.888961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:02.403286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:02.407433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:02.438917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cf9b73e-cf5d-488d-bcf3-69047388f1e8 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.631456 Oct 31 14:09:02.443381 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 664/1553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:01 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:02.454542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:02.455551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:02.471663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:02.482506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:02.484168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:02.485572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:02.489103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:02.495872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:02.497834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:03.020812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:03.044758 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-114a78a3-c209-47c9-be70-40cf3ec3b18e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.598259 Oct 31 14:09:03.045543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 665/1554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:02 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:03.083343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:03.086380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:03.131518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:03.132054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:03.132501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:03.133239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:03.133692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:03.134118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:04.812035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:04.820473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df9e1edd-4ebb-43b0-bc4a-c224b8488a64 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 1.773823 Oct 31 14:09:04.828310 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 666/1555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:03 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:04.848034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-06bf44ef-8319-4f16-81c0-faffb791f267 req-11cce81d-af3a-4e5e-8bfd-325266330f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e80907a-572f-4a2a-a43e-5abbf33c2881", "name": "network-vif-unplugged", "status": "completed", "tag": "ab0bff5f-49c6-4d14-a9bc-170121dda5aa"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:04.898589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-06bf44ef-8319-4f16-81c0-faffb791f267 req-11cce81d-af3a-4e5e-8bfd-325266330f48 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:04.899053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-06bf44ef-8319-4f16-81c0-faffb791f267 req-11cce81d-af3a-4e5e-8bfd-325266330f48 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:04.899487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-06bf44ef-8319-4f16-81c0-faffb791f267 req-11cce81d-af3a-4e5e-8bfd-325266330f48 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:04.957617 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-06bf44ef-8319-4f16-81c0-faffb791f267 req-11cce81d-af3a-4e5e-8bfd-325266330f48 service nova] Creating event network-vif-unplugged:ab0bff5f-49c6-4d14-a9bc-170121dda5aa for instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 on n-h1-863052-1 Oct 31 14:09:04.981006 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-06bf44ef-8319-4f16-81c0-faffb791f267 req-11cce81d-af3a-4e5e-8bfd-325266330f48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151257 Oct 31 14:09:04.981641 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 667/1556] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:05.010795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:05.011522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:05.042906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:05.043392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:05.044229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:05.044559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:05.045022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:05.064111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:05.642222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:05.650935 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d35df89-e787-4a5b-9c0b-ff3e90885673 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.664408 Oct 31 14:09:05.674055 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 668/1557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:04 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:05.685609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:05.686548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:05.702991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:05.703798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:05.704419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:05.705713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:05.706921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:05.710157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:06.046492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:06.060833 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63842667-5ded-41ac-9d4f-83c78b5dff80 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.383142 Oct 31 14:09:06.065502 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 669/1558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:05 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:06.304738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78cb9963-5522-4809-90c6-81c0d688a548 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1714264640", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:06.308220 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-78cb9963-5522-4809-90c6-81c0d688a548 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] HTTP exception thrown: min_count must be <= max_count Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78cb9963-5522-4809-90c6-81c0d688a548 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Request method failure captured: Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 184 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9cA4YTlpEgPwfanlW4UhWf5B39s2xh_J65I2MWd2Hl9tnxoNgOq_TeKvjs4cA0OftbRPUEkapnAT4H-kAT5fgn0m_I6kGbh9qmCV3-0v4bWITJ-8UpzOm8KOVAmAFCz5u0YjOGonDn24C1Fmsi0JJpCivWPr3NNuhM0YwCyqNzbL4I Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed71bec6ff444ed98f3bbf16ec683777", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 529b848270e341b6be3d61b9d02248db Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1714264640", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: exception: min_count must be <= max_count Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1714264640', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 31 14:09:06.310254 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.322373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78cb9963-5522-4809-90c6-81c0d688a548 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Returning 400 to user: min_count must be <= max_count {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:09:06.329449 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78cb9963-5522-4809-90c6-81c0d688a548 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.260273 Oct 31 14:09:06.332158 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 670/1559] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:06 2022] POST /compute/v2.1/servers => generated 74 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:06.340505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:06.341386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:06.366148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:06.367845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:06.371220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:06.374049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:06.375228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:06.379264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:06.739291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:06.752690 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad4e184c-5193-4280-9fea-c7ab4ef3eba1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.418300 Oct 31 14:09:06.754097 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 671/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:06 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:06.766549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61513e5-e974-4248-ba74-901aa2db60f2 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1403582167", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "max_count": 0}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61513e5-e974-4248-ba74-901aa2db60f2 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Request method failure captured: Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 168 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9cA4YTlpEgPwfanlW4UhWf5B39s2xh_J65I2MWd2Hl9tnxoNgOq_TeKvjs4cA0OftbRPUEkapnAT4H-kAT5fgn0m_I6kGbh9qmCV3-0v4bWITJ-8UpzOm8KOVAmAFCz5u0YjOGonDn24C1Fmsi0JJpCivWPr3NNuhM0YwCyqNzbL4I Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed71bec6ff444ed98f3bbf16ec683777", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 529b848270e341b6be3d61b9d02248db Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1403582167", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "max_count": 0}} Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1403582167', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'max_count': 0}}} Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 0 Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:09:06.777495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61513e5-e974-4248-ba74-901aa2db60f2 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:09:06.783638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f61513e5-e974-4248-ba74-901aa2db60f2 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021154 Oct 31 14:09:06.794743 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 672/1561] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:09:06.799585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:06.808346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:06.837372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:06.838143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:06.840966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:06.841912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:06.843468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:06.844080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:07.195238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:07.212672 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e517d8bb-8b9f-4542-bd84-49dd3f0c9e8e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.416717 Oct 31 14:09:07.218037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 673/1562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:06 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:07.251713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28dd9986-d258-44b9-a8c0-ff97f7c6810f tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-856539085", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "max_count": 2.5}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28dd9986-d258-44b9-a8c0-ff97f7c6810f tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Request method failure captured: Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 169 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9cA4YTlpEgPwfanlW4UhWf5B39s2xh_J65I2MWd2Hl9tnxoNgOq_TeKvjs4cA0OftbRPUEkapnAT4H-kAT5fgn0m_I6kGbh9qmCV3-0v4bWITJ-8UpzOm8KOVAmAFCz5u0YjOGonDn24C1Fmsi0JJpCivWPr3NNuhM0YwCyqNzbL4I Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed71bec6ff444ed98f3bbf16ec683777", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 529b848270e341b6be3d61b9d02248db Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-856539085", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "max_count": 2.5}} Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-856539085', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'max_count': 2.5}}} Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 2.5 Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:09:07.268629 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28dd9986-d258-44b9-a8c0-ff97f7c6810f tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:09:07.273149 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28dd9986-d258-44b9-a8c0-ff97f7c6810f tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.049442 Oct 31 14:09:07.274927 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 674/1563] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:09:07.312057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:07.312892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:07.340316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:07.340843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:07.341391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:07.342146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:07.357615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:07.360301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:07.749716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:07.762704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dba4a3e0-d4ba-4ad0-83bf-636f2840596f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.484676 Oct 31 14:09:07.763521 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 675/1564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:07 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:07.775282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4af130ee-3907-4eb5-ad95-60f15856cb27 req-a2247044-50d6-4152-8c18-69c67c705f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e80907a-572f-4a2a-a43e-5abbf33c2881", "tag": "ab0bff5f-49c6-4d14-a9bc-170121dda5aa"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:07.802817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4af130ee-3907-4eb5-ad95-60f15856cb27 req-a2247044-50d6-4152-8c18-69c67c705f97 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:07.807258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4af130ee-3907-4eb5-ad95-60f15856cb27 req-a2247044-50d6-4152-8c18-69c67c705f97 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:07.807818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4af130ee-3907-4eb5-ad95-60f15856cb27 req-a2247044-50d6-4152-8c18-69c67c705f97 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:07.858624 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4af130ee-3907-4eb5-ad95-60f15856cb27 req-a2247044-50d6-4152-8c18-69c67c705f97 service nova] Creating event network-changed:ab0bff5f-49c6-4d14-a9bc-170121dda5aa for instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 on n-h1-863052-1 Oct 31 14:09:07.873753 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4af130ee-3907-4eb5-ad95-60f15856cb27 req-a2247044-50d6-4152-8c18-69c67c705f97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107947 Oct 31 14:09:07.876934 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 676/1565] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:07.890611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74ac382a-a622-446b-bdb1-82462eb83c55 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1968705035", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 0}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74ac382a-a622-446b-bdb1-82462eb83c55 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Request method failure captured: Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 168 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9cA4YTlpEgPwfanlW4UhWf5B39s2xh_J65I2MWd2Hl9tnxoNgOq_TeKvjs4cA0OftbRPUEkapnAT4H-kAT5fgn0m_I6kGbh9qmCV3-0v4bWITJ-8UpzOm8KOVAmAFCz5u0YjOGonDn24C1Fmsi0JJpCivWPr3NNuhM0YwCyqNzbL4I Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed71bec6ff444ed98f3bbf16ec683777", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 529b848270e341b6be3d61b9d02248db Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1968705035", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 0}} Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1968705035', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'min_count': 0}}} Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 0 Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:09:07.899289 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74ac382a-a622-446b-bdb1-82462eb83c55 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74ac382a-a622-446b-bdb1-82462eb83c55 tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024688 Oct 31 14:09:07.907139 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 677/1566] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:09:07.918442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:07.922202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:07.953312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:07.958333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:07.958859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:07.959626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:07.960106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:07.960537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:08.403024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:08.412993 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-117b7b09-f9a0-41e5-9505-2a0f7116f8a5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.507826 Oct 31 14:09:08.437008 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 678/1567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:07 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:08.437008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5af4cd2b-2aa8-4dbe-8319-ff44e1e80cfb tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-684877987", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 2.5}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5af4cd2b-2aa8-4dbe-8319-ff44e1e80cfb tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Request method failure captured: Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 169 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9cA4YTlpEgPwfanlW4UhWf5B39s2xh_J65I2MWd2Hl9tnxoNgOq_TeKvjs4cA0OftbRPUEkapnAT4H-kAT5fgn0m_I6kGbh9qmCV3-0v4bWITJ-8UpzOm8KOVAmAFCz5u0YjOGonDn24C1Fmsi0JJpCivWPr3NNuhM0YwCyqNzbL4I Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed71bec6ff444ed98f3bbf16ec683777", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed71bec6ff444ed98f3bbf16ec683777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: ed71bec6ff444ed98f3bbf16ec683777 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1407009884 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 529b848270e341b6be3d61b9d02248db Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1407009884-project Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-684877987", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 2.5}} Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-684877987', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'min_count': 2.5}}} Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 2.5 Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:09:08.442065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 14:09:08.446678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:09:08.456040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5af4cd2b-2aa8-4dbe-8319-ff44e1e80cfb tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:09:08.456939 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5af4cd2b-2aa8-4dbe-8319-ff44e1e80cfb tempest-MultipleCreateNegativeTestJSON-1407009884 tempest-MultipleCreateNegativeTestJSON-1407009884-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029374 Oct 31 14:09:08.457538 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 679/1568] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:09:08.481179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:08.481792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:08.525602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:08.534514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:08.535150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:08.535885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:08.536363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:08.549429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:08.987210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:09.000026 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-051d73a7-2275-4ffe-9551-31fd5391db65 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.533593 Oct 31 14:09:09.000619 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 680/1569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:08 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:09.014056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:09.014737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:09.029481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:09.029983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:09.030470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:09.032360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:09.032828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:09.033261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:09.431983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:09.454621 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d11cf487-7bc6-4038-b7b9-58b3e02776e7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.448555 Oct 31 14:09:09.455552 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 681/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:09 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:09.815380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae3a05e4-6a87-4616-a5de-a12f197fc9f3 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Action: 'create', calling method: .version_select at 0x7fe1075d6d30>, body: {"keypair": {"name": "tempest-keypair-846036178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjlnh5ckC2Hlo4C07Lwq2U6GlD6RCPFnSQJQmz9YQXALM00pDUuxSN2NnSIiONpqw/HAD94WSH9CrwKxoci+g/cKUen/IfTXgLCx9IxdmSilevPETcbY6y5nzJYO3zyGg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:09.851296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=35 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:09.863129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ae3a05e4-6a87-4616-a5de-a12f197fc9f3 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Getting quotas for project fe822dcacc944fe386f071c93f133c1b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:09.889816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ae3a05e4-6a87-4616-a5de-a12f197fc9f3 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Getting quotas for user 2c9a317be015453992ae7af8d8cae940 and project fe822dcacc944fe386f071c93f133c1b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:09.977343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae3a05e4-6a87-4616-a5de-a12f197fc9f3 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.518636 Oct 31 14:09:09.978746 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 682/1571] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:09:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:09.999476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:10.006456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:10.031913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.034015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.036926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:10.038517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.040270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.041009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:10.160138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=56 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:10.405286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:10.418194 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0e472dc-2b58-48ab-9314-9df4c433e27a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1470 microversion: 2.1 time: 0.434605 Oct 31 14:09:10.422353 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 683/1572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:09 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1470 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:10.433982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:10.435540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:10.452080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.452607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.453060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:10.457106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.457673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.458117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:10.695730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:10.708448 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75eedb70-afd6-4371-acd4-9c58acaeb087 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.281287 Oct 31 14:09:10.709675 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 684/1573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:10 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:10.714727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-83ec687a-d519-4799-a6a6-0afb0f1d44ee req-22921cfe-ccda-425a-bb1c-2654f77a4637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-plugged", "status": "completed", "tag": "6a1736e4-5e31-4672-977d-00ee187108fb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:10.724729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:10.731736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-83ec687a-d519-4799-a6a6-0afb0f1d44ee req-22921cfe-ccda-425a-bb1c-2654f77a4637 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.732782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-83ec687a-d519-4799-a6a6-0afb0f1d44ee req-22921cfe-ccda-425a-bb1c-2654f77a4637 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.733401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-83ec687a-d519-4799-a6a6-0afb0f1d44ee req-22921cfe-ccda-425a-bb1c-2654f77a4637 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:10.750016 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-83ec687a-d519-4799-a6a6-0afb0f1d44ee req-22921cfe-ccda-425a-bb1c-2654f77a4637 service nova] Creating event network-vif-plugged:6a1736e4-5e31-4672-977d-00ee187108fb for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:10.757854 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-83ec687a-d519-4799-a6a6-0afb0f1d44ee req-22921cfe-ccda-425a-bb1c-2654f77a4637 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045453 Oct 31 14:09:10.759576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 685/1574] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:10.766533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:10.767496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:10.776107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.777197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.777890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:10.778897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:10.779522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:10.780720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:11.101816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:11.119593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43c3b482-322d-4bd6-99d3-e58a05ce90bf tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.357100 Oct 31 14:09:11.129154 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 686/1575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:10 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:11.447398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:11.448698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:11.461955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:11.464362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:11.466621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:11.468911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:11.471665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:11.472576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:11.509538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:11.926314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:12.047713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:12.061246 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15fcc43d-54a3-432d-b338-f5e21c4e1132 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1476 microversion: 2.1 time: 0.619498 Oct 31 14:09:12.066510 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 687/1576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:11 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1476 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:12.079543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:12.081333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:12.098766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:12.099588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:12.102265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:12.103232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:12.103870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:12.106011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:12.685340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:12.703031 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca88a8b1-4ac4-4e9b-923b-e18b7ded457c tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.632455 Oct 31 14:09:12.704854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 688/1577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:12 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:12.720288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:12.721279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:12.738662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:12.740218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:12.741457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:12.743320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:12.745576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:12.747122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:12.787499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:12.981975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:12.993730 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f69504ac-ea93-457d-a33c-8445200bb961 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.287410 Oct 31 14:09:12.994870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 689/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:12 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:12.999957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-plugged", "status": "completed", "tag": "07d5054a-ae9a-473c-a738-7b08b8aba956"}, {"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-plugged", "status": "completed", "tag": "03652c30-ef7f-40a7-87c3-798fd78915e5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:13.010857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:13.011716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:13.012301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:13.027532 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] Creating event network-vif-plugged:07d5054a-ae9a-473c-a738-7b08b8aba956 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:13.028193 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] Creating event network-vif-plugged:03652c30-ef7f-40a7-87c3-798fd78915e5 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:13.035416 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2a5e2a3c-bef5-49f4-9f7a-1d4f3af3fa23 req-819eb30b-7f06-4042-8940-3eddd4f154be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038918 Oct 31 14:09:13.036567 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 690/1579] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:13.095803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:13.096617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:13.114463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:13.119498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:13.120523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:13.121443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:13.122005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:13.123431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:13.797848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:13.816407 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94a03236-6b1f-4131-84fc-548b48e74aaf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1476 microversion: 2.1 time: 0.726728 Oct 31 14:09:13.819268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 691/1580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:13 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1476 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:13.832699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:13.833462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:13.842535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:13.843153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:13.843691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:13.844526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:13.845084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:13.845614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:14.089575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:14.107253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df4b9dd9-3fb2-4152-9f06-082199f767b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.286214 Oct 31 14:09:14.108827 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 692/1581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:13 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:14.135108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:14.136918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:14.156369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:14.157283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:14.158767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:14.161454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:14.180902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:14.182889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:14.877220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:14.887262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e2a29ac-c733-4223-a40f-2784087a87d9 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1355 microversion: 2.1 time: 0.774749 Oct 31 14:09:14.887846 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 693/1582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:14 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1355 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:14.903108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-642052033", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6741c486-3b68-4005-aefa-26f7c7eda391"}], "security_groups": [{"name": "tempest-securitygroup--728666800"}], "key_name": "tempest-keypair-846036178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:15.563748 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d29ee96-fb0f-409d-b0bc-fbd5e387e292 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action" status: 202 len: 0 microversion: 2.91 time: 14.069661 Oct 31 14:09:15.571140 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 890/1583] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:09:01 2022] POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action => generated 0 bytes in 14079 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:09:15.586468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:15.592881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:15.627040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:15.636300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:15.637662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:15.640390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:15.643094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:15.645890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:16.070430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] validate_networks() for [('6741c486-3b68-4005-aefa-26f7c7eda391', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:09:16.136456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:16.150860 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95b714f4-c242-4a0a-a2a3-528579ca64cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1476 microversion: 2.1 time: 0.576441 Oct 31 14:09:16.151838 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 891/1584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:15 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1476 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:16.166771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:16.168226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:16.183490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:16.186460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:16.187150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:16.188296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:16.188766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:16.189196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:16.494976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:16.507023 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f04747c-63bc-4acd-8b02-5e6056cc57fc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.352155 Oct 31 14:09:16.523451 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 892/1585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:16 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:16.543708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:16.545074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:16.556161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:16.557499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:16.562900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:16.563964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:16.565131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:16.565749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:16.706478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:16.723541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:16.727924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:16.744761 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a454f6e4-a949-4294-a6ee-e1440355a784 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.219469 Oct 31 14:09:16.747408 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 893/1586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:16 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:16.754009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:16.758918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:16.776875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:16.784200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:16.784844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:16.785933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:16.786595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:16.787281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.117685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:17.126750 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c615c0fb-77cb-4f59-b049-df9d97d8406f tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1804 microversion: 2.1 time: 0.377980 Oct 31 14:09:17.146868 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 894/1587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:16 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1804 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:17.156382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:17.157996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:17.164419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:17.165415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:17.165945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.167069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:17.167789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:17.169757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.214397 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a97c957c-4260-4e4e-8e61-8416c8ef5c4b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa/ips" status: 200 len: 217 microversion: 2.1 time: 0.064922 Oct 31 14:09:17.215404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 895/1588] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:09:17 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa/ips => generated 217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:09:17.222036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:17.222905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:17.255880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:17.259129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:17.259129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.261237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:17.262555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:17.264109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.581468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:17.610202 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cdbcaed5-d81d-4319-9493-cc1f02abd109 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1476 microversion: 2.1 time: 0.393587 Oct 31 14:09:17.616797 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 896/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:17 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:17.639302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:17.659458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:17.711119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:17.711119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:17.711119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.711119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:17.711119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:17.711119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:17.778438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:09:18.027297 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5626addf-554a-46dc-a1ae-96345486b58b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 204 len: 0 microversion: 2.1 time: 0.407835 Oct 31 14:09:18.035082 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 897/1590] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:09:17 2022] DELETE /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:09:18.049882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:18.050976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:18.069041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.069811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.077766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.079855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.080600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.081389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.401158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:18.413800 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05bd76f4-77a3-4b9f-b9cd-7a5d6fd7e3e5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.376008 Oct 31 14:09:18.429241 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 898/1591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:18 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:18.444573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6b1b1efc-9c3e-4df8-912f-fee499fba09d req-c1e73a52-4927-4e6a-af90-41611c47ecf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63894684-26f1-4c97-99c4-7026983ea01e", "name": "network-vif-plugged", "status": "completed", "tag": "b69c64f3-b22b-46c4-8bbc-2f57a49803cf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:18.461110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6b1b1efc-9c3e-4df8-912f-fee499fba09d req-c1e73a52-4927-4e6a-af90-41611c47ecf9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.461741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6b1b1efc-9c3e-4df8-912f-fee499fba09d req-c1e73a52-4927-4e6a-af90-41611c47ecf9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.462322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6b1b1efc-9c3e-4df8-912f-fee499fba09d req-c1e73a52-4927-4e6a-af90-41611c47ecf9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.488357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6b1b1efc-9c3e-4df8-912f-fee499fba09d req-c1e73a52-4927-4e6a-af90-41611c47ecf9 service nova] Creating event network-vif-plugged:b69c64f3-b22b-46c4-8bbc-2f57a49803cf for instance 63894684-26f1-4c97-99c4-7026983ea01e on n-h2-863052-1 Oct 31 14:09:18.494761 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6b1b1efc-9c3e-4df8-912f-fee499fba09d req-c1e73a52-4927-4e6a-af90-41611c47ecf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064007 Oct 31 14:09:18.496325 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 899/1592] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:18.503692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:18.505145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:18.512095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.512727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.513394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.514237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.514882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.515315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.603555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Getting quotas for project fe822dcacc944fe386f071c93f133c1b. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:18.628993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:18.648609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:18.649866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Getting quotas for user 2c9a317be015453992ae7af8d8cae940 and project fe822dcacc944fe386f071c93f133c1b. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:18.656262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:18.671299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ff6d298-e3af-4781-85ba-8441e895806b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.171539 Oct 31 14:09:18.673821 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 900/1593] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:18 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:18.686553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:09:18.687422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:18.687940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:09:18.689139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:09:18.690127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:18.690889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:09:18.692745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:09:18.707735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.710447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.711698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.714290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.714899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.715253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.716179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.716844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.718230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.719958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.721490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.722985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.783374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Getting quotas for project fe822dcacc944fe386f071c93f133c1b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:18.803610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Getting quotas for user 2c9a317be015453992ae7af8d8cae940 and project fe822dcacc944fe386f071c93f133c1b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:18.831708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:09:18.835313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:09:18.919146 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d4ddc30-7342-48b2-b593-a9496518ba22 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.027671 Oct 31 14:09:18.920244 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 694/1594] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 4029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:09:18.930048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:18.931093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:18.940580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.941338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.942023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:18.943027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:18.943705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:18.944819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:19.093068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.101095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32300bde-9842-4dc8-8fff-f35cf5ad81be tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1810 microversion: 2.1 time: 0.425464 Oct 31 14:09:19.106577 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 901/1595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:18 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1810 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:19.115916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6c7c123-ab23-40d0-8624-f57738b3bf4f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:19.116543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6c7c123-ab23-40d0-8624-f57738b3bf4f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:19.236292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6c7c123-ab23-40d0-8624-f57738b3bf4f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.243989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6c7c123-ab23-40d0-8624-f57738b3bf4f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1276 microversion: 2.1 time: 0.136283 Oct 31 14:09:19.245566 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 902/1596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:19 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:19.442925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:19.443540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:19.474214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:19.474828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:19.482303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:19.483137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:19.483620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:19.484057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:19.579615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.592317 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0b82520-78a6-4e75-836e-215d42f6368b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1476 microversion: 2.1 time: 0.667207 Oct 31 14:09:19.593177 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 695/1597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:18 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1476 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:19.705022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:19.705646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:19.718060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:19.718723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:19.719173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:19.719607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.720124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:19.720345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:19.722374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:19.734258 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da619206-8b39-4c96-9076-46cf9f01c19a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.294066 Oct 31 14:09:19.750225 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 903/1598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:19 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:19.935243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.954664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.957723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:19.966121 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6108264c-6e66-426d-9044-903f375023f8 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.264975 Oct 31 14:09:19.968416 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 696/1599] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:19 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:09:20.127658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:20.128364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:20.155977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.158780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.159435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.161935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.163427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.166160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.269291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:20.270026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:20.295872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.296474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.297626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.304968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.305632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.306221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.582121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:20.593210 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14e84061-070f-43e7-8629-3d70bce77f58 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1810 microversion: 2.1 time: 0.469361 Oct 31 14:09:20.593872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 904/1600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:20 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1810 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:20.618553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:20.620332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:20.629286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.641651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.642328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.643663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.644499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.645735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.781009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:20.817857 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b062b814-8120-4320-9aeb-8265093c2f2b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1280 microversion: 2.1 time: 0.550164 Oct 31 14:09:20.823315 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 697/1601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:20 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1280 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:20.847135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:20.849193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:20.876166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.877899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.879167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.882111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:20.883976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:20.889405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:20.987613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:20.999771 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1eab1857-3751-46cc-8a0a-577e41c1577a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1476 microversion: 2.1 time: 0.384587 Oct 31 14:09:21.010281 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 905/1602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:20 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:21.010281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:21.010281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:21.018924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:21.020055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:21.020914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:21.022094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:21.023012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:21.024221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:21.110881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:21.122593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:21.124174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:21.134833 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32edc86e-99f9-460c-b352-f52507c3eb2e tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.132539 Oct 31 14:09:21.149091 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 906/1603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:21 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:21.518392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:21.541241 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02c12cb4-dab2-4b24-b2df-ee0b1f9a8889 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.715755 Oct 31 14:09:21.556639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 698/1604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:20 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:21.620850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:21.623019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:21.644265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:21.645725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:21.659209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:21.663728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:21.666588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:21.667051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:21.851136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:21.851746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:21.861651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:21.868113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:21.868588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:21.873847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:21.878079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:21.880943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.130049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:22.133647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:22.144838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:22.151953 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4279993e-688c-4e40-8994-7cd870b51467 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1789 microversion: 2.1 time: 0.536344 Oct 31 14:09:22.152565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 907/1605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:21 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1789 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:22.155213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-996dea10-8577-453c-8bf1-fc481f2403d1 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1336 microversion: 2.1 time: 0.308036 Oct 31 14:09:22.165247 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 699/1606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:21 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1336 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:22.165787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:22.170494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:22.184894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:22.185550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:22.200261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.201263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.203295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.209315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.213399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.214137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.216593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.221335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.225838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.229579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.232950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.235208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.613594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:22.634122 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-892bd6d3-0b70-49ee-bbc8-e32aa59ca717 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1462 microversion: 2.1 time: 0.472470 Oct 31 14:09:22.636841 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 908/1607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:22 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1462 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:22.672592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:22.673295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:22.694750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.698944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.699500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.702726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.703285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.703733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.803967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:22.822621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:22.830395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:22.850282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21680284-3a7d-4467-8350-5ff3f6a6f087 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.682451 Oct 31 14:09:22.853549 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 700/1608] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:22 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:22.880209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d885a5ac-ad00-4c90-ae68-05994c98eecf req-7f66d587-5d78-422c-b308-de9e7103cde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-deleted", "tag": "6a1736e4-5e31-4672-977d-00ee187108fb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:22.906157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d885a5ac-ad00-4c90-ae68-05994c98eecf req-7f66d587-5d78-422c-b308-de9e7103cde1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.908319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d885a5ac-ad00-4c90-ae68-05994c98eecf req-7f66d587-5d78-422c-b308-de9e7103cde1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.908769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d885a5ac-ad00-4c90-ae68-05994c98eecf req-7f66d587-5d78-422c-b308-de9e7103cde1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.927836 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d885a5ac-ad00-4c90-ae68-05994c98eecf req-7f66d587-5d78-422c-b308-de9e7103cde1 service nova] Creating event network-vif-deleted:6a1736e4-5e31-4672-977d-00ee187108fb for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:22.950577 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d885a5ac-ad00-4c90-ae68-05994c98eecf req-7f66d587-5d78-422c-b308-de9e7103cde1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095421 Oct 31 14:09:22.951244 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 701/1609] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:22.956963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:22.957703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:22.972884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.973435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.973888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:22.974649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:22.975116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:22.975865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:23.084816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:23.096933 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79313877-de25-4958-acb8-74d44e307c6f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.457957 Oct 31 14:09:23.098180 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 909/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:22 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:23.193900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:23.196162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:23.208903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:23.210885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:23.212104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:23.215146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:23.216043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:23.218538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:23.396111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:23.411891 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d6423e8-2468-4f9f-9782-75da0b473495 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1334 microversion: 2.1 time: 0.235377 Oct 31 14:09:23.412742 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 910/1611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:23 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1334 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:23.422721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:23.427957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:23.439106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:23.441825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:23.443604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:23.445541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:23.447701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:23.449418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:23.843184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:23.856752 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee670130-43d4-461b-97c6-781daaeef72a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1674 microversion: 2.1 time: 0.442435 Oct 31 14:09:23.861825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 911/1612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:23 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1674 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:23.882970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:23.883589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:23.894924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:23.895669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:23.896312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:23.897192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:23.897796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:23.898451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.116557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:24.149932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:24.153061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:24.184444 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c62e1316-b704-4175-9070-91d5fe147f6a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.305278 Oct 31 14:09:24.210445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 912/1613] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:23 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:09:24.220361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-91b6fef3-9a0d-485e-8e94-31c2987c8a48 req-891e336c-b38a-4d03-96cf-1d0491e26550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-unplugged", "status": "completed", "tag": "07d5054a-ae9a-473c-a738-7b08b8aba956"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:24.241285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-91b6fef3-9a0d-485e-8e94-31c2987c8a48 req-891e336c-b38a-4d03-96cf-1d0491e26550 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.244548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-91b6fef3-9a0d-485e-8e94-31c2987c8a48 req-891e336c-b38a-4d03-96cf-1d0491e26550 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.245300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-91b6fef3-9a0d-485e-8e94-31c2987c8a48 req-891e336c-b38a-4d03-96cf-1d0491e26550 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.279320 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-91b6fef3-9a0d-485e-8e94-31c2987c8a48 req-891e336c-b38a-4d03-96cf-1d0491e26550 service nova] Creating event network-vif-unplugged:07d5054a-ae9a-473c-a738-7b08b8aba956 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:24.292968 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-91b6fef3-9a0d-485e-8e94-31c2987c8a48 req-891e336c-b38a-4d03-96cf-1d0491e26550 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080268 Oct 31 14:09:24.294130 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 913/1614] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:24.314121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:24.315185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:24.331426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.344489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.345159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.346097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.348325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.349308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.650155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:24.663271 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55563cf3-1023-4379-b7f7-eff1c4541921 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1714 microversion: 2.1 time: 0.367759 Oct 31 14:09:24.680671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 914/1615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:24 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1714 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:24.686293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:24.690799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:24.710546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.712040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.721398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.746317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.748535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.749256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.817091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:24.825830 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-408e80fb-b59b-4fca-9fb0-8b8a25930781 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1462 microversion: 2.1 time: 1.873332 Oct 31 14:09:24.838328 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 702/1616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:22 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1462 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:24.855705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:24.891594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:24.913966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.916700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.917487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:24.918611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:24.921613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:24.923683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.132453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:09:25.132886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:09:25.133365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:09:25.133782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:09:25.149602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:09:25.353117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:25.366759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.367290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.367737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.371443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.371934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.372415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.456061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bbba0397-f1bc-4b46-aa29-938998bbabff tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 1066 microversion: 2.1 time: 0.608695 Oct 31 14:09:25.471083 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 703/1617] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:09:24 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 1066 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 14:09:25.479164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:25.480007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:25.521629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.522281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.523291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.525307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.525843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.526649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.561947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:25.575285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-821b1362-3c83-4987-a3e9-ba33c80d27f7 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.893358 Oct 31 14:09:25.591611 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 915/1618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:24 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:25.621258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:25.621258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:25.628933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.630672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.631862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.634984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.636697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.637204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.893096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:25.904289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:25.905814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:25.911706 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32abd629-3e06-4eae-b20f-ad57638c8205 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.319118 Oct 31 14:09:25.912574 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 916/1619] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:25 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:25.924677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:25.926296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:25.941617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.949606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.952549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:25.953648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:25.954735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:25.955411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:26.420769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:26.446598 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a0177e3-c61d-4397-95e5-cfaa9e303c61 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1674 microversion: 2.1 time: 0.977837 Oct 31 14:09:26.452479 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 704/1620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:25 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1674 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:26.465125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:26.468497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:26.492914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:26.493529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:26.496584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:26.500453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:26.507022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:26.507716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:26.682301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:26.732927 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10c0600a-cf92-4786-b26f-45645dbe8b9a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.817941 Oct 31 14:09:26.735079 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 917/1621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:25 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:26.764027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b86687b0-1ae6-4bf1-9b8b-c7bc9e7b0d4f req-a2f5349c-0f25-4bd0-bd38-166258bdf76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-unplugged", "status": "completed", "tag": "03652c30-ef7f-40a7-87c3-798fd78915e5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:26.793791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b86687b0-1ae6-4bf1-9b8b-c7bc9e7b0d4f req-a2f5349c-0f25-4bd0-bd38-166258bdf76f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:26.794298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b86687b0-1ae6-4bf1-9b8b-c7bc9e7b0d4f req-a2f5349c-0f25-4bd0-bd38-166258bdf76f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:26.797481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b86687b0-1ae6-4bf1-9b8b-c7bc9e7b0d4f req-a2f5349c-0f25-4bd0-bd38-166258bdf76f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:26.819471 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b86687b0-1ae6-4bf1-9b8b-c7bc9e7b0d4f req-a2f5349c-0f25-4bd0-bd38-166258bdf76f service nova] Creating event network-vif-unplugged:03652c30-ef7f-40a7-87c3-798fd78915e5 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:26.861770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b86687b0-1ae6-4bf1-9b8b-c7bc9e7b0d4f req-a2f5349c-0f25-4bd0-bd38-166258bdf76f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123136 Oct 31 14:09:26.865702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 918/1622] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:26.884648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:26.885360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:26.918616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:26.919435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:26.922144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:26.924361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:26.932558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:26.933006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:27.430651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:27.442558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5165fde8-bd72-465c-8e4c-a9114b8d702c tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.569641 Oct 31 14:09:27.445170 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 919/1623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:26 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:27.455823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:27.456455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:27.465778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:27.469133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:27.469897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:27.470960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:27.471668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:27.472357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:27.589228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:27.622318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:27.624239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:27.639930 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7963cac2-9a45-43e8-a69c-a79f9df74f98 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.191758 Oct 31 14:09:27.658270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 920/1624] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:27 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:27.658270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0bd7517d-e86d-40ae-9f23-2f0a489daf5e req-a6eae514-5f01-4781-859e-a9920c189b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-deleted", "tag": "07d5054a-ae9a-473c-a738-7b08b8aba956"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:27.676402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0bd7517d-e86d-40ae-9f23-2f0a489daf5e req-a6eae514-5f01-4781-859e-a9920c189b26 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:27.677410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0bd7517d-e86d-40ae-9f23-2f0a489daf5e req-a6eae514-5f01-4781-859e-a9920c189b26 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:27.677777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0bd7517d-e86d-40ae-9f23-2f0a489daf5e req-a6eae514-5f01-4781-859e-a9920c189b26 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:27.704369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0bd7517d-e86d-40ae-9f23-2f0a489daf5e req-a6eae514-5f01-4781-859e-a9920c189b26 service nova] Creating event network-vif-deleted:07d5054a-ae9a-473c-a738-7b08b8aba956 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:27.715395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0bd7517d-e86d-40ae-9f23-2f0a489daf5e req-a6eae514-5f01-4781-859e-a9920c189b26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065402 Oct 31 14:09:27.716593 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 921/1625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:27.859032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:27.869077 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87d826f3-8e0b-49a4-bded-58be79fc5e11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1704 microversion: 2.1 time: 1.414809 Oct 31 14:09:27.876034 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 705/1626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:26 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1704 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:27.893397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:27.894258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:27.913605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:27.914117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:27.914598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:27.916575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:27.917076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:27.917516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:27.929155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:28.071545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-db60f9ad-975c-4345-b4db-e9b6a16f42a3 req-13882ea0-5b59-4ef2-9e0d-8f0de5c1f4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dd8dd3-9df4-41a1-b505-1eaf0dde36ed", "tag": "9f816e4d-3cf6-4857-bc6e-94e6dae09c84"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:28.098305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-db60f9ad-975c-4345-b4db-e9b6a16f42a3 req-13882ea0-5b59-4ef2-9e0d-8f0de5c1f4d4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.099152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-db60f9ad-975c-4345-b4db-e9b6a16f42a3 req-13882ea0-5b59-4ef2-9e0d-8f0de5c1f4d4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.099788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-db60f9ad-975c-4345-b4db-e9b6a16f42a3 req-13882ea0-5b59-4ef2-9e0d-8f0de5c1f4d4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.133670 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-db60f9ad-975c-4345-b4db-e9b6a16f42a3 req-13882ea0-5b59-4ef2-9e0d-8f0de5c1f4d4 service nova] Creating event network-changed:9f816e4d-3cf6-4857-bc6e-94e6dae09c84 for instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed on n-h2-863052-1 Oct 31 14:09:28.146353 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-db60f9ad-975c-4345-b4db-e9b6a16f42a3 req-13882ea0-5b59-4ef2-9e0d-8f0de5c1f4d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427859 Oct 31 14:09:28.149291 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 922/1627] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:28.158310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:28.160643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:28.182269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.186926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.187677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.189291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.196726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.198103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.397852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:28.408085 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb50acbb-bef7-49f5-b4dc-5d60c0ed762c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.256285 Oct 31 14:09:28.408946 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 923/1628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:28 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:28.414293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e910455-4eed-4d06-8211-153cd4f079c5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '.version_select at 0x7fe107a7cee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:28.418790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e910455-4eed-4d06-8211-153cd4f079c5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.419519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e910455-4eed-4d06-8211-153cd4f079c5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.420175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e910455-4eed-4d06-8211-153cd4f079c5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.439868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e910455-4eed-4d06-8211-153cd4f079c5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.029627 Oct 31 14:09:28.441201 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 924/1629] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:09:28 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:28.445983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:28.446930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:28.458067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.463361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.464080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.469894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.470695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.471349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.695613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:28.717411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:28.726749 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a85fdf51-8415-486f-bff2-9c260910d71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.284001 Oct 31 14:09:28.734090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 925/1630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:28 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:28.734913 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33a06cf6-dfbf-466c-841f-4cebf734c08d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1495 microversion: 2.1 time: 0.854633 Oct 31 14:09:28.759851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 706/1631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:27 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1495 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:28.784340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:28.785398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:28.789484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:28.792403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:28.798262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:28.807275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.810185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.812840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.813831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.814883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.815639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.817552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.817767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.820099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.822598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:28.823258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:28.825880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:28.828370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=13 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:29.044430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d9ad08f-5de0-4e32-ad38-6346bd8f1a8a tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1855 microversion: 2.1 time: 0.306190 Oct 31 14:09:29.045222 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 926/1632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:28 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1855 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:29.050917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:29.052112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:29.059344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.060089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.060708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.061588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.062558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.063147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.145104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:29.152901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:29.161417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:29.163276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:29.169358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36e30974-24cf-4635-ba74-83657c4531c3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.123224 Oct 31 14:09:29.186274 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 927/1633] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:29 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:29.191660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-143663568"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:29.196155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:29.205419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.206331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.207043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.207998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.208630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.210103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.254843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:29.362394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:29.372260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d4761add-e185-473c-b4db-071fbf85c286 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.608456 Oct 31 14:09:29.373429 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 707/1634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:28 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:29.379500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-305166371", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d2840ce8-8e29-4e7a-8617-461972287234"}], "block_device_mapping_v2": [{"uuid": "23d41b99-8f81-4d8a-8e61-6774efc3a93e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:29.494267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] validate_networks() for [('d2840ce8-8e29-4e7a-8617-461972287234', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:09:29.548834 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59bb4819-c415-4c2b-82d3-3f08be134794 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.377080 Oct 31 14:09:29.549800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 928/1635] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:09:29 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 14:09:29.571119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:29.583944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:29.600700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.602963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.603719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.604806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.605667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.606700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.886923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43e6f6f7-3f9b-4d67-aed6-dfe0d480731d tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1855 microversion: 2.1 time: 0.333506 Oct 31 14:09:29.895162 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 929/1636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:29 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1855 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:29.922281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:29.922920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:29.938063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:29.940069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.940590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.941036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:29.941776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:29.942298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:29.942736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.136929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:30.147656 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f2c0818-a6c1-44b5-95ae-a75e5c5dd6e1 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.250341 Oct 31 14:09:30.149308 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 930/1637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:29 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:30.170808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:30.171575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:30.187319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.187826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.188995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.189804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.190340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.190807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.240421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.241209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.241885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.242589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lazy-loading 'fault' on Instance uuid 20d55069-5f48-4e2c-b1de-c526440f9dfa {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:09:30.303987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:30.314505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92121996-f762-4084-91ed-06ce2f6f1aa6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 200 len: 1303 microversion: 2.1 time: 0.162849 Oct 31 14:09:30.331631 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 931/1638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:30 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:30.338355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-db5e0259-1d3c-4572-81bf-1a331c59379e req-e83692a5-c1b8-4edd-96df-3a409428a928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d55069-5f48-4e2c-b1de-c526440f9dfa", "name": "network-vif-deleted", "tag": "03652c30-ef7f-40a7-87c3-798fd78915e5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:30.349341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-db5e0259-1d3c-4572-81bf-1a331c59379e req-e83692a5-c1b8-4edd-96df-3a409428a928 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.349832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-db5e0259-1d3c-4572-81bf-1a331c59379e req-e83692a5-c1b8-4edd-96df-3a409428a928 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.350298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-db5e0259-1d3c-4572-81bf-1a331c59379e req-e83692a5-c1b8-4edd-96df-3a409428a928 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.363570 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-db5e0259-1d3c-4572-81bf-1a331c59379e req-e83692a5-c1b8-4edd-96df-3a409428a928 service nova] Creating event network-vif-deleted:03652c30-ef7f-40a7-87c3-798fd78915e5 for instance 20d55069-5f48-4e2c-b1de-c526440f9dfa on n-h1-863052-1 Oct 31 14:09:30.369238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-db5e0259-1d3c-4572-81bf-1a331c59379e req-e83692a5-c1b8-4edd-96df-3a409428a928 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035678 Oct 31 14:09:30.370472 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 932/1639] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:30.376408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:30.377227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:30.384107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.385161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.385607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.386357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.386962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.387399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.515708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lazy-loading 'services' on Instance uuid 2e80907a-572f-4a2a-a43e-5abbf33c2881 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:09:30.652150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26c107da-fbe1-4a2a-a80e-27d6b466460e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments/12be9bb2-e0e0-4b82-a171-7c04fe8e399a" status: 202 len: 0 microversion: 2.1 time: 0.279991 Oct 31 14:09:30.660037 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 933/1640] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:09:30 2022] DELETE /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments/12be9bb2-e0e0-4b82-a171-7c04fe8e399a => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:09:30.678873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:30.687563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:30.729846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.730420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.733539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.737061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.740456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.741018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.842850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:30.855638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:30.857681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:30.864944 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8154c7c-9598-4202-95cb-ca5592718c54 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.206648 Oct 31 14:09:30.878194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 934/1641] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:30 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:30.885157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:30.885157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:30.899500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.901327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.902611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:30.903540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:30.904170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:30.904777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.077589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:31.087332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eae341d1-18b5-458c-8cf2-c95efaaf6238 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.210661 Oct 31 14:09:31.104370 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 935/1642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:30 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:31.111161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:31.114769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:31.122464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.123735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.124492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.125221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.125743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.128449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.169001 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdc001dd-24e7-4c39-a898-f9511c0553cc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063025 Oct 31 14:09:31.169895 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 936/1643] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:31 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:31.175538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-afc882eb-cac5-4926-8e37-c96e3ef0efc6 req-659b0e42-a1e0-4931-847b-6768f8cd0e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-unplugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:31.190397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-afc882eb-cac5-4926-8e37-c96e3ef0efc6 req-659b0e42-a1e0-4931-847b-6768f8cd0e74 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.190397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-afc882eb-cac5-4926-8e37-c96e3ef0efc6 req-659b0e42-a1e0-4931-847b-6768f8cd0e74 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.193542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-afc882eb-cac5-4926-8e37-c96e3ef0efc6 req-659b0e42-a1e0-4931-847b-6768f8cd0e74 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.229050 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-afc882eb-cac5-4926-8e37-c96e3ef0efc6 req-659b0e42-a1e0-4931-847b-6768f8cd0e74 service nova] Creating event network-vif-unplugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:09:31.242109 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-afc882eb-cac5-4926-8e37-c96e3ef0efc6 req-659b0e42-a1e0-4931-847b-6768f8cd0e74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070799 Oct 31 14:09:31.242780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 937/1644] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:31.256376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:31.257535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:31.273008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.273739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.274065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.275861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.276492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.276971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.590938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:31.626569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a1401a7-5a26-450f-8838-f10c96a6eb2b tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.382445 Oct 31 14:09:31.627965 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 938/1645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:31 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:31.635706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:31.636577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:31.646133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.646879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.647527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.648387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.649055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.649648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.678872 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] HTTP exception thrown: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Request method failure captured: Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa HTTP/1.1 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bX7Vp5IGg8xURBtnSIZcL8UU72TvEfeBTL7tCMKemzCqQdpAPgj89rWXDBBvDBJgsVRab0uz2yx2G59lmYilfclvuZdfcVaROMWlKu-IT3lwEyo-8Sgl-9MFAaHCev4gLiXXHLIhirOYSK4LqJA1Sei1q8elPxMM_4Shm7mkVw5p4 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ee6fca78314de1ae6f33dd2b433a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestMultiNic-1763388373 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 78f86aaab2684cf6b1fcdefc1d0996f6 Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '20d55069-5f48-4e2c-b1de-c526440f9dfa'} Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:09:31.682490 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:09:31.688133 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:09:31.690369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Returning 404 to user: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:09:31.691430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b44a499e-a4b3-47ea-8bfb-ee05e9c540de tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 404 len: 111 microversion: 2.1 time: 0.062294 Oct 31 14:09:31.696554 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 939/1646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:31 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:09:31.710709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:09:31.711183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:09:31.711694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:09:31.712117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:09:31.712589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:09:31.728584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.729088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.729659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.734256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.734831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.735288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.777889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:31.795442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Getting quotas for user 57251d140f49460087e4cf90f6b94a78 and project c75cb8d7db204534bc02ad16c859c108. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:31.898290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:31.898919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:31.909485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.910109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.910436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:31.915885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:09:31.918038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23d41b99-8f81-4d8a-8e61-6774efc3a93e',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:09:31.935280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:31.935808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:31.936263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:32.135521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:32.160707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:32.162710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:32.178763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7c519c2-8989-4029-863a-9d7e578cba33 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.286332 Oct 31 14:09:32.182981 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 940/1647] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:31 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:32.200353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:32.205500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:32.234346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:32.240885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:32.241482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:32.242373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:32.246103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:32.248944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:32.258455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7afd305-a382-416b-9bd5-9b8a9d4368b3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.883622 Oct 31 14:09:32.259124 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 708/1648] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2885 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:09:32.267390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:32.269679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:32.305543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:32.306088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:32.306628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:32.307356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:32.307817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:32.308256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:32.391711 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd91bdd0-9aa4-4dbd-acfe-a32f7425c501 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131118 Oct 31 14:09:32.403095 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 709/1649] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:32 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:32.408759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c2b3a56d-9950-47fb-8d2b-2f17b7c5f7ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:32.409806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c2b3a56d-9950-47fb-8d2b-2f17b7c5f7ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:32.703119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2b3a56d-9950-47fb-8d2b-2f17b7c5f7ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:32.712532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2b3a56d-9950-47fb-8d2b-2f17b7c5f7ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:32.729964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2b3a56d-9950-47fb-8d2b-2f17b7c5f7ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:32.733767 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c2b3a56d-9950-47fb-8d2b-2f17b7c5f7ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1103 microversion: 2.25 time: 0.329151 Oct 31 14:09:32.734248 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 710/1650] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:32 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1103 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:32.937073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1595162168", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:32.994371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:33.025402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:33.045811 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e4c0515-99e1-4e48-8351-e466517d38e9 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.856776 Oct 31 14:09:33.050969 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 941/1651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:32 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:33.076512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:33.078892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:33.093558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] validate_networks() for [('126b5c03-65a3-4c75-a75d-ef06aaf371a6', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:09:33.109205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.109896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.113369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.117951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.120488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.125488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.460444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:33.469625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e0eafba-b983-4a08-a633-68c2b7e36c6e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.416454 Oct 31 14:09:33.474258 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 942/1652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:33 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:33.476927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:33.477564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:33.495540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.496040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.496487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.502507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.503120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.503643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.604723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:33.615754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:33.617229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:33.629699 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cce43df4-2fbd-42a5-a019-04647c35012f tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.156431 Oct 31 14:09:33.630340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 943/1653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:33 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:33.678809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:33.681151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:33.714357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.715036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.715639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.718116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.718678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.720273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.724717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:33.868936 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4635b5df-b840-4ab1-9c30-c8fcddb8308b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210817 Oct 31 14:09:33.869546 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 944/1654] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:33 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:33.882842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:33.883517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:33.901185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.901731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.902201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:33.902962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:33.903712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:33.904244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.120668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.145773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.152030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.155393 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f6e6ad4-2f24-4b15-9458-bf375f08183a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1232 microversion: 2.25 time: 0.277080 Oct 31 14:09:34.157277 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 945/1655] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:33 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1232 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:34.163076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9e4dec15-cb89-4c01-8d21-013ea4e88bfc req-a7d4a768-d8d3-46ac-b96b-44de04f60827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dd8dd3-9df4-41a1-b505-1eaf0dde36ed", "name": "network-vif-plugged", "status": "completed", "tag": "9f816e4d-3cf6-4857-bc6e-94e6dae09c84"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:34.195436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e4dec15-cb89-4c01-8d21-013ea4e88bfc req-a7d4a768-d8d3-46ac-b96b-44de04f60827 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.196756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e4dec15-cb89-4c01-8d21-013ea4e88bfc req-a7d4a768-d8d3-46ac-b96b-44de04f60827 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.198295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e4dec15-cb89-4c01-8d21-013ea4e88bfc req-a7d4a768-d8d3-46ac-b96b-44de04f60827 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.231896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9e4dec15-cb89-4c01-8d21-013ea4e88bfc req-a7d4a768-d8d3-46ac-b96b-44de04f60827 service nova] Creating event network-vif-plugged:9f816e4d-3cf6-4857-bc6e-94e6dae09c84 for instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed on n-h2-863052-1 Oct 31 14:09:34.238859 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9e4dec15-cb89-4c01-8d21-013ea4e88bfc req-a7d4a768-d8d3-46ac-b96b-44de04f60827 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079316 Oct 31 14:09:34.240303 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 946/1656] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:34.250003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:34.251255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:34.260826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.261614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.262255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.263129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.263903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.265084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.569338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.579243 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-109b50e9-2ca0-45e5-b59d-de2d75f179a5 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.337315 Oct 31 14:09:34.579876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 947/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:34 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:34.601830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:34.602574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:34.609951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.610492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.611213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.612171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.612640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.613076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.771999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.782389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1bececfd-c074-44f7-ae3f-510b3d6076c9 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.183260 Oct 31 14:09:34.783289 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 948/1658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:34 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:34.788631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:34.789320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:34.797498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.798119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.798621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.799357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.800234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.800702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.877892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.890320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.891846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:34.897760 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb6563ac-dd71-4b9b-8094-774b64e17c88 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.113446 Oct 31 14:09:34.898603 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 949/1659] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:34 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:34.925516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:34.927465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:34.935636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.936158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.936689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.937693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:34.938415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:34.938841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:34.986994 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbbc7aa4-ff3a-466a-a72b-1f707c42f3db tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075218 Oct 31 14:09:34.992293 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 950/1660] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:34 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:35.186517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:35.187942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:35.204676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:35.205425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:35.207327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:35.208248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:35.211287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:35.211915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:35.305580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:09:35.307383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:09:35.308403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:09:35.309403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:09:35.310057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:09:35.346675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:35.357142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:35.360767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:35.361870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:35.371742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:35.372386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:35.467425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:35.490750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for user b4c57016556840538b9f426b9cd9e540 and project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:35.498266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:35.512349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:35.518785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:35.521888 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ae615eb-287b-4a07-923d-e66e3d8d7094 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1250 microversion: 2.25 time: 0.343843 Oct 31 14:09:35.542607 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 951/1661] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:35 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1250 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:09:35.555692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:09:35.561116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:09:35.604047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:35.605369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:35.616686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:35.618654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:35.620758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:35.628905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:35.630399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:35.633822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:35.689168 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5430fac6-4dbb-4542-ac45-f414d4200bb2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.945789 Oct 31 14:09:35.697880 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 711/1662] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:09:35.703523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e169fe9-b3d4-4cfe-8759-efa9723c9a4b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:35.704401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e169fe9-b3d4-4cfe-8759-efa9723c9a4b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:36.032983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e169fe9-b3d4-4cfe-8759-efa9723c9a4b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:36.064162 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e169fe9-b3d4-4cfe-8759-efa9723c9a4b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1222 microversion: 2.1 time: 0.364789 Oct 31 14:09:36.064935 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 712/1663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:35 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:36.086711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:36.093628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:36.129598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:36.135341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:36.137797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:36.139812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:36.144698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:36.146683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:36.198826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:36.234795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ff73ed6-d7ce-473e-9319-b38ed4ef2614 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 0.635175 Oct 31 14:09:36.245960 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 952/1664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:35 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:36.258215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:36.271364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:36.302691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:36.307766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:36.309292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:36.315517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:36.324116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:36.329164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:36.556646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:36.573179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:36.597174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:36.611683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fb35589-2c81-4f0c-8556-9d27f2302cb1 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.362479 Oct 31 14:09:36.621528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 953/1665] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:36 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:36.639220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:36.644371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:36.667157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:36.668600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:36.671320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:36.677440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:36.679006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:36.683874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:36.826642 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b50e749-51bf-4f3c-a824-5e009812b99f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202305 Oct 31 14:09:36.831494 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 954/1666] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:36 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:36.855056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1925475316", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:37.354665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:37.371286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26f5d4fc-50f2-4706-a178-6e51c8396fa5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 1.301166 Oct 31 14:09:37.376634 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 713/1667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:36 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:37.384740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:37.393779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:37.428117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:37.428997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:37.429703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:37.434425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:37.435166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:37.435814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:37.656647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:37.678792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:37.686505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:37.698793 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce498b22-041e-49bd-a99b-1efc3998c4b0 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1250 microversion: 2.25 time: 0.312009 Oct 31 14:09:37.702937 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 714/1668] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:37 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1250 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:37.723139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:37.731957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:37.759255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:37.761332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:37.761833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:37.764623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:37.766640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:37.767313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:38.828419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:38.837025 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2075bd9a-baf4-49e0-beb2-a3963812f0ca tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1401 microversion: 2.1 time: 1.131330 Oct 31 14:09:38.843706 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 715/1669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:37 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1401 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:38.848637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:38.849263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:38.881964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:38.882712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:38.883338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:38.887118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:38.893969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:38.894733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:39.073931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:39.094569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:39.099902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:39.135257 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b7f6c8b-2d54-4f5c-8aae-e83f23b1ec72 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.290269 Oct 31 14:09:39.136533 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 716/1670] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:38 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:39.141639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:39.152739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:39.176907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:39.177977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:39.179148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:39.182443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:39.183669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:39.187361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:39.265459 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5604a9ab-936c-4826-96ba-33e9f802a77d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127238 Oct 31 14:09:39.269321 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 717/1671] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:39 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:39.280208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:39.281220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:39.296762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:39.298861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:39.301077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:39.303928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:39.304874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:39.306721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:41.300115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:41.317173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-56a3fbf6-6ad7-4be0-a122-58816a102bb8 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 2.044453 Oct 31 14:09:41.321161 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 718/1672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:39 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:41.361175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:41.362460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:41.376809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:41.379473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:41.387703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:41.388767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:41.391993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:41.392652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:41.989063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:42.003189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:42.007944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:42.014722 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-395e3324-e8c8-453c-a301-ba6bab088520 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1292 microversion: 2.25 time: 0.688126 Oct 31 14:09:42.034237 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 719/1673] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:41 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1292 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:42.045740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ecc78552-22cc-490d-ba91-a4af359b7e86 req-4bd31448-0b38-497a-92f2-ed66910b6823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-plugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:42.068296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ecc78552-22cc-490d-ba91-a4af359b7e86 req-4bd31448-0b38-497a-92f2-ed66910b6823 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:42.069275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ecc78552-22cc-490d-ba91-a4af359b7e86 req-4bd31448-0b38-497a-92f2-ed66910b6823 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:42.073908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ecc78552-22cc-490d-ba91-a4af359b7e86 req-4bd31448-0b38-497a-92f2-ed66910b6823 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:42.098496 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ecc78552-22cc-490d-ba91-a4af359b7e86 req-4bd31448-0b38-497a-92f2-ed66910b6823 service nova] Creating event network-vif-plugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:09:42.109315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ecc78552-22cc-490d-ba91-a4af359b7e86 req-4bd31448-0b38-497a-92f2-ed66910b6823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073243 Oct 31 14:09:42.110778 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 720/1674] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:42.123575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:42.129140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:42.142907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:42.145235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:42.146873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:42.149337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:42.150090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:42.154606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:43.359537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:43.387086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b8a9c66-ad31-44f0-9483-38c2a22acacb tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1588 microversion: 2.1 time: 1.274200 Oct 31 14:09:43.390312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 721/1675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:42 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1588 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:43.413827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:43.414723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:43.427503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:43.428288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:43.429855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:43.431440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:43.432071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:43.442357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:43.797443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:43.817489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:43.824118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:43.864710 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-036dc639-25b8-40ac-a58e-18da8edd2217 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.462317 Oct 31 14:09:43.866278 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 722/1676] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:43 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:43.900443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:43.912531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:43.950313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:43.950925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:43.951381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:43.952123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:43.952579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:43.953002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:44.051016 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e747f4b-fda6-4b62-b64d-b0c6186fefba tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183261 Oct 31 14:09:44.052528 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 723/1677] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:09:43 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881/os-volume_attachments => generated 25 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:09:44.064112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:44.066952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:44.075725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:44.076754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:44.077461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:44.078451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:44.079143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:44.079825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:44.586080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:44.599150 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46162bea-128c-4b8d-a2ac-c180e175b858 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1471 microversion: 2.1 time: 0.545063 Oct 31 14:09:44.599742 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 724/1678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:44 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:44.622867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:44.623800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:44.630889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:44.631958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:44.632662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:44.633634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:44.634397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:44.635079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:45.409461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:46.047697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:46.118926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:46.146937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:46.150522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:46.152045 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f39d1a8-010f-40c1-923b-43cac2823935 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1292 microversion: 2.25 time: 1.540304 Oct 31 14:09:46.167072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 725/1679] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:44 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1292 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:46.184574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:46.188816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:46.206409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:46.207261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:46.208344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:46.209352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:46.210016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:46.210685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:46.467324 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7cdfba5a-5faf-40e7-8e1e-102e20e1f966 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.289788 Oct 31 14:09:46.469035 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 726/1680] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:09:46 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed/os-interface => generated 285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:46.474013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-707452e6-7d47-453d-a3ca-723b01e42ad7 req-f5f5bfe6-02cc-4589-be32-c2193d1e28b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a9579f-9d77-4a92-88aa-5af95afa49cd", "tag": "7c74f8b2-e9e7-4faa-9e5f-c47770131567"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:46.511497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-707452e6-7d47-453d-a3ca-723b01e42ad7 req-f5f5bfe6-02cc-4589-be32-c2193d1e28b2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:46.512008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-707452e6-7d47-453d-a3ca-723b01e42ad7 req-f5f5bfe6-02cc-4589-be32-c2193d1e28b2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:46.512526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-707452e6-7d47-453d-a3ca-723b01e42ad7 req-f5f5bfe6-02cc-4589-be32-c2193d1e28b2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:46.575261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:46.597024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-707452e6-7d47-453d-a3ca-723b01e42ad7 req-f5f5bfe6-02cc-4589-be32-c2193d1e28b2 service nova] Creating event network-changed:7c74f8b2-e9e7-4faa-9e5f-c47770131567 for instance b8a9579f-9d77-4a92-88aa-5af95afa49cd on n-h1-863052-1 Oct 31 14:09:46.609401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-707452e6-7d47-453d-a3ca-723b01e42ad7 req-f5f5bfe6-02cc-4589-be32-c2193d1e28b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138662 Oct 31 14:09:46.611215 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 727/1681] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:46.626186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:46.647225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:46.660048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:46.667343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:46.669492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:46.678217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:46.687242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:46.688543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:46.800167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=60 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:46.914074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=62 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:47.014862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:47.032180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:47.040959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:47.050290 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-689733d9-8341-4c9e-b9c1-b514e9b782aa tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1553 microversion: 2.91 time: 0.435119 Oct 31 14:09:47.058059 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 728/1682] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:46 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:47.076449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2070680258", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "107e348d-9841-42fb-9be9-5f79c32c68de"}, {"uuid": "31f6fa39-dd3a-4f48-891a-b70d149d8ba9"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:52.982257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] validate_networks() for [('126b5c03-65a3-4c75-a75d-ef06aaf371a6', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:09:53.000090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] validate_networks() for [('107e348d-9841-42fb-9be9-5f79c32c68de', None, None, None, None, None), ('31f6fa39-dd3a-4f48-891a-b70d149d8ba9', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:09:53.546902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:09:53.547520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:09:53.548174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:09:53.548967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:09:53.549562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:09:53.565746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:53.584870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:53.585552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:53.586707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:53.587359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:53.588107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:53.610105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:53.624670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for user b4c57016556840538b9f426b9cd9e540 and project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:53.647214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:09:53.650694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:09:53.729217 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b97a972-1edf-4ecd-aa9b-d21c27be2ac3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 16.896278 Oct 31 14:09:53.731138 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 955/1683] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 16899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:09:53.742385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:53.744963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:53.757882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:53.760221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:53.760689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:53.761412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:53.762608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:53.762608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:53.948422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:09:53.949669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:09:53.950852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:09:53.951837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:09:53.952488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:09:53.999354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.000199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.002364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.006911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.007402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.007838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.026714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.036947 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7c59249-61ed-4015-973b-de56c1ce4dbf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1477 microversion: 2.1 time: 0.301569 Oct 31 14:09:54.039084 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 956/1684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:53 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:54.047352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:54.048614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:54.058908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Getting quotas for project 58ee6fca78314de1ae6f33dd2b433a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:09:54.064309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.065420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.066272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.068822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.069573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Getting quotas for user 78f86aaab2684cf6b1fcdefc1d0996f6 and project 58ee6fca78314de1ae6f33dd2b433a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:09:54.070043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.071322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.087755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:09:54.095022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:09:54.198078 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99ae8877-c362-4854-ac39-3aa8d728d347 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.137068 Oct 31 14:09:54.204235 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 729/1685] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:09:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 7145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:09:54.226878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:54.227992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:54.253146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.256899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.260441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.266987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.268512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.269463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.402488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.420321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.427600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.431547 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46b8ffdb-a6e0-4942-b08a-acadbabcb7f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.388936 Oct 31 14:09:54.442331 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 957/1686] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:54 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:54.452696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:54.454514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:54.467810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.469281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.472631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.477944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.481074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.482878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.511260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.531585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.536963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:54.562422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f28e95d-3423-47b1-a431-35dc03ba9d1b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1535 microversion: 2.91 time: 0.355697 Oct 31 14:09:54.582311 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 730/1687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:54 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1535 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:54.588264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a95b4ee8-1553-46df-8305-ff839b8d20b3 req-e1b72e87-88f2-42f8-9d3e-87e3039a1067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dd8dd3-9df4-41a1-b505-1eaf0dde36ed", "tag": "9f816e4d-3cf6-4857-bc6e-94e6dae09c84"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:54.609118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a95b4ee8-1553-46df-8305-ff839b8d20b3 req-e1b72e87-88f2-42f8-9d3e-87e3039a1067 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.625222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a95b4ee8-1553-46df-8305-ff839b8d20b3 req-e1b72e87-88f2-42f8-9d3e-87e3039a1067 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.625571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a95b4ee8-1553-46df-8305-ff839b8d20b3 req-e1b72e87-88f2-42f8-9d3e-87e3039a1067 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.643909 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a95b4ee8-1553-46df-8305-ff839b8d20b3 req-e1b72e87-88f2-42f8-9d3e-87e3039a1067 service nova] Creating event network-changed:9f816e4d-3cf6-4857-bc6e-94e6dae09c84 for instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed on n-h2-863052-1 Oct 31 14:09:54.653869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a95b4ee8-1553-46df-8305-ff839b8d20b3 req-e1b72e87-88f2-42f8-9d3e-87e3039a1067 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082658 Oct 31 14:09:54.672230 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 731/1688] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:54.692367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-60e10ece-ac06-404c-8bd1-f998ea71fe90 req-20163ab2-04db-44c7-9f5d-92f1fb56de3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921b274b-f2d8-4029-9244-d900095436ad", "tag": "d554ca38-778d-43b9-ab43-915083194c4a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:54.735114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-60e10ece-ac06-404c-8bd1-f998ea71fe90 req-20163ab2-04db-44c7-9f5d-92f1fb56de3f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.741593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-60e10ece-ac06-404c-8bd1-f998ea71fe90 req-20163ab2-04db-44c7-9f5d-92f1fb56de3f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.746756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-60e10ece-ac06-404c-8bd1-f998ea71fe90 req-20163ab2-04db-44c7-9f5d-92f1fb56de3f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.779861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-60e10ece-ac06-404c-8bd1-f998ea71fe90 req-20163ab2-04db-44c7-9f5d-92f1fb56de3f service nova] Creating event network-changed:d554ca38-778d-43b9-ab43-915083194c4a for instance 921b274b-f2d8-4029-9244-d900095436ad on n-h1-863052-1 Oct 31 14:09:54.798695 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-60e10ece-ac06-404c-8bd1-f998ea71fe90 req-20163ab2-04db-44c7-9f5d-92f1fb56de3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121921 Oct 31 14:09:54.806286 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 732/1689] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:54.817556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:54.821784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:54.835796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.841024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.845448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:54.846634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:54.847572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:54.848288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.040878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:55.050204 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6c12d5c-b3e1-405e-9121-9c39ef77ca91 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1588 microversion: 2.1 time: 0.605105 Oct 31 14:09:55.056785 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 958/1690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:54 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1588 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:55.070152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16164fa5-712e-4290-bd80-d7ddeeb9deb2 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:55.071669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16164fa5-712e-4290-bd80-d7ddeeb9deb2 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:55.227528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-16164fa5-712e-4290-bd80-d7ddeeb9deb2 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:55.240672 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16164fa5-712e-4290-bd80-d7ddeeb9deb2 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1213 microversion: 2.1 time: 0.181351 Oct 31 14:09:55.256043 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 959/1691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:55 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1213 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:55.274766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:55.276318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:55.295494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.296107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.296586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.297318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.297793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.298777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.631507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:55.640209 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27c61ef7-0349-488a-8907-31e3feb79820 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1226 microversion: 2.1 time: 0.832377 Oct 31 14:09:55.644455 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 733/1692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:54 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1226 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:55.652397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d77cc100-1bfb-461b-a0c4-ff9b3957cba2 req-3141d34f-a2ec-45a8-97ae-c84f37e53f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63894684-26f1-4c97-99c4-7026983ea01e", "name": "network-vif-unplugged", "status": "completed", "tag": "b69c64f3-b22b-46c4-8bbc-2f57a49803cf"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:55.678221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d77cc100-1bfb-461b-a0c4-ff9b3957cba2 req-3141d34f-a2ec-45a8-97ae-c84f37e53f32 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.678701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d77cc100-1bfb-461b-a0c4-ff9b3957cba2 req-3141d34f-a2ec-45a8-97ae-c84f37e53f32 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.679191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d77cc100-1bfb-461b-a0c4-ff9b3957cba2 req-3141d34f-a2ec-45a8-97ae-c84f37e53f32 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.706778 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d77cc100-1bfb-461b-a0c4-ff9b3957cba2 req-3141d34f-a2ec-45a8-97ae-c84f37e53f32 service nova] Creating event network-vif-unplugged:b69c64f3-b22b-46c4-8bbc-2f57a49803cf for instance 63894684-26f1-4c97-99c4-7026983ea01e on n-h2-863052-1 Oct 31 14:09:55.726553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:55.736282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d77cc100-1bfb-461b-a0c4-ff9b3957cba2 req-3141d34f-a2ec-45a8-97ae-c84f37e53f32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090442 Oct 31 14:09:55.739043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 734/1693] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:55.747742 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-064368d9-c868-4a38-a681-7b93b1d0f8f7 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1477 microversion: 2.1 time: 0.490488 Oct 31 14:09:55.751228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 960/1694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:55 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:55.759093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:55.759912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:55.764216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:55.766113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:55.778922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.780974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.781707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.785273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.786850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.787295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.790874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.791381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.791824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:55.792528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:55.793175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:55.810674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.144053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.156320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.158702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.175700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e91d4b16-ab15-4d5e-be34-6dc8d0eaf4b3 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1535 microversion: 2.91 time: 0.422977 Oct 31 14:09:56.176631 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 961/1695] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:55 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1535 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:56.269192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:56.270203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:56.294303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:56.295394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:56.296116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.297390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:56.298099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:56.298867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.548927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.578088 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a765f82b-f1e7-45c0-9555-1b80d4dacd45 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1265 microversion: 2.1 time: 0.309606 Oct 31 14:09:56.600813 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 962/1696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:56 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:56.669269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:56.669269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:56.674962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:56.683298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:56.683970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.684736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:56.685223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:56.685658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.691948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.707820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.712692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.717517 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0df190da-abce-4adc-85a6-880f8c671931 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.973827 Oct 31 14:09:56.739009 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 735/1697] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:55 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:56.779214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:56.780119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:56.791218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:56.792748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:56.793657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.794849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:56.795813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:56.796421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:56.836801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:56.847588 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed2a36e0-8d24-4a22-96a9-44555a5c3963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1218 microversion: 2.1 time: 0.186254 Oct 31 14:09:56.849419 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 963/1698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:56 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:57.075597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:57.085243 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-079c5866-aa03-4f3e-86f2-5df8c0fcf8fa tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1477 microversion: 2.1 time: 0.313429 Oct 31 14:09:57.086145 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 736/1699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:56 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:09:57.208405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:57.209234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:57.227059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.233302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.234679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.235863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.237686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.238378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.417003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:57.457979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:57.463583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:57.477035 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24fc6616-2e6e-4837-81ce-7c0b5a1a260b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1538 microversion: 2.91 time: 0.273490 Oct 31 14:09:57.505624 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 964/1700] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:57 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1538 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:09:57.514025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:57.518324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:57.546831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.551265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.552006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.557030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.558675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.559202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.614363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:57.615298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:57.639526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.640050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.640503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.641231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.641693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.642128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.724689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-863052-1". {{(pid=120641) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 14:09:57.868903 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f43f9a6-c869-4021-9c64-569da23b8235 tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action" status: 202 len: 0 microversion: 2.91 time: 0.360445 Oct 31 14:09:57.871118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 737/1701] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:09:57 2022] POST /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:09:57.878692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:57.885519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:57.887675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:57.890120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4dcbcda-7d32-4aad-b9af-7fe0b201fce6 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1283 microversion: 2.1 time: 0.279881 Oct 31 14:09:57.902196 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 965/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:57 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1283 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:57.902196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4b832a1e-239e-4d28-b9b4-6b049327c1ce req-39b2e63a-75b3-4b56-ac70-512189e43d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921b274b-f2d8-4029-9244-d900095436ad", "name": "network-vif-plugged", "status": "completed", "tag": "d554ca38-778d-43b9-ab43-915083194c4a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:09:57.909893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4b832a1e-239e-4d28-b9b4-6b049327c1ce req-39b2e63a-75b3-4b56-ac70-512189e43d1a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.911102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4b832a1e-239e-4d28-b9b4-6b049327c1ce req-39b2e63a-75b3-4b56-ac70-512189e43d1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.911744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4b832a1e-239e-4d28-b9b4-6b049327c1ce req-39b2e63a-75b3-4b56-ac70-512189e43d1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.935832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.937480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.937941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.942130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:57.944653 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4b832a1e-239e-4d28-b9b4-6b049327c1ce req-39b2e63a-75b3-4b56-ac70-512189e43d1a service nova] Creating event network-vif-plugged:d554ca38-778d-43b9-ab43-915083194c4a for instance 921b274b-f2d8-4029-9244-d900095436ad on n-h1-863052-1 Oct 31 14:09:57.946419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:57.946887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:57.961536 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4b832a1e-239e-4d28-b9b4-6b049327c1ce req-39b2e63a-75b3-4b56-ac70-512189e43d1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068480 Oct 31 14:09:57.964241 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 966/1703] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:09:57.970116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:57.970869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:58.001471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.001987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.002472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.003178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.015590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.017081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.195351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.212503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a08496d-28ce-4d7b-a3ca-6d2fa2f36d5a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1274 microversion: 2.1 time: 0.246944 Oct 31 14:09:58.230423 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 967/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:57 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1274 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:58.237835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:58.238669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:58.255404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.257256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.259204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.261437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.264097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.268203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.269768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.270694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.272020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.273350 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5a0ac76-6684-475e-94ef-6d9d71d4872b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.401042 Oct 31 14:09:58.308945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 738/1705] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:57 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:58.313246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:58.314071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:58.321149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.321647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.322344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.323243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.323875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.324477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.404407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.413417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.417188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.428095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd0d29a3-94d9-4bb9-b0c6-74830849eacd tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1546 microversion: 2.91 time: 0.196118 Oct 31 14:09:58.428835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 968/1706] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:58 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:58.608394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:58.619987 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-afdf13fc-db1e-4340-927d-978c82ebe56c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1477 microversion: 2.1 time: 0.310164 Oct 31 14:09:58.620584 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 739/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:58 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1477 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:58.809638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:58.810281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:58.821334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.821852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.823743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.824593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.826375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.827522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.919190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:58.919877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:58.923962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:58.928407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.928908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.929605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:58.930392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:58.931010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:58.931442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.243975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.264142 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f98ed16-fc8e-4679-b386-fef97e19ff1b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.458900 Oct 31 14:09:59.266533 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 969/1708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:58 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:59.272035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:59.273129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:59.299388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.300284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.301103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.302071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.302788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.303474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.452637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.462908 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33baa522-dc62-4f03-89af-eedf7e836d4a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1280 microversion: 2.1 time: 0.194562 Oct 31 14:09:59.464033 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 970/1709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:59 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:59.471264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:59.472248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:59.481071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.481946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.482650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.483666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.484292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.484890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.487144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.510995 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b79c227f-3f05-4009-84fc-da1f5ee8a037 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1313 microversion: 2.1 time: 0.592736 Oct 31 14:09:59.511870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 740/1710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:58 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:09:59.529996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:59.530655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:59.548060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.549951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.550365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.551280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.551911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.552347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.676312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.699913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.706588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.726275 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99b4fb51-b1ea-4e14-a709-54bdb8b4bf93 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1546 microversion: 2.91 time: 0.209375 Oct 31 14:09:59.742193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 741/1711] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:59 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1546 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:59.742193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:09:59.742193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:09:59.745126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.746612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.747143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.748145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:09:59.749153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:09:59.749824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:09:59.806557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.824169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.830404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:09:59.834715 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc7e8de5-9656-4954-9235-2b429bafc1e1 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.368503 Oct 31 14:09:59.837708 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 971/1712] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:09:59 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:09:59.996347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-468adebd-70cb-42a8-991e-ac9c6d6c4f35 req-363f7fc4-7992-4ab8-9f46-75929aa5c67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63894684-26f1-4c97-99c4-7026983ea01e", "name": "network-vif-plugged", "status": "completed", "tag": "b69c64f3-b22b-46c4-8bbc-2f57a49803cf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:00.017804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:00.020925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-468adebd-70cb-42a8-991e-ac9c6d6c4f35 req-363f7fc4-7992-4ab8-9f46-75929aa5c67e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.021451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-468adebd-70cb-42a8-991e-ac9c6d6c4f35 req-363f7fc4-7992-4ab8-9f46-75929aa5c67e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.022528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-468adebd-70cb-42a8-991e-ac9c6d6c4f35 req-363f7fc4-7992-4ab8-9f46-75929aa5c67e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.027326 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f4d73a75-b523-48c6-bbc5-a1a0fb46ea3f tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1477 microversion: 2.1 time: 0.295972 Oct 31 14:10:00.027917 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 742/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:09:59 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:00.074118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-468adebd-70cb-42a8-991e-ac9c6d6c4f35 req-363f7fc4-7992-4ab8-9f46-75929aa5c67e service nova] Creating event network-vif-plugged:b69c64f3-b22b-46c4-8bbc-2f57a49803cf for instance 63894684-26f1-4c97-99c4-7026983ea01e on n-h2-863052-1 Oct 31 14:10:00.081782 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-468adebd-70cb-42a8-991e-ac9c6d6c4f35 req-363f7fc4-7992-4ab8-9f46-75929aa5c67e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092653 Oct 31 14:10:00.082414 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 972/1714] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:00.298039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:00.298694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:00.317307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.317816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.321002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.321762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.322262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.329748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.489849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:00.491454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:00.510701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.511487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.512123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.514791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.515447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.516080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.783445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:00.794236 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f233b61-67a6-4f14-a858-79ca2796cbfc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.501899 Oct 31 14:10:00.813312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 743/1715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:00 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:00.824049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:00.825264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:00.838035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.839208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.839885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.841063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.841749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.842664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.913837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:00.931920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88fff182-2e13-4799-a26f-ceac752a3121 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 0.446211 Oct 31 14:10:00.932884 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 973/1716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:00 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:00.940733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:00.946413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:00.964304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.965425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.965878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.966846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:00.967319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:00.967803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:00.999074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:01.088550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.104808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.108243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.115371 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c558e75d-fc12-4821-9142-d18546970e46 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.181215 Oct 31 14:10:01.120118 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 974/1717] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:00 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:01.125076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1115008919"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:01.127552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:01.144242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.145046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.145483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.146211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.146661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.147085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.154069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.165208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acffbe90-6095-4cbc-9148-4b04446a0f5d tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.349848 Oct 31 14:10:01.179435 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 744/1718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:00 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:01.188781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:01.189644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:01.196466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.197222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.197886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.198849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.199510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.200163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.371186 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83f74718-1a4b-42d9-aad0-7cc9a0acbc64 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.249404 Oct 31 14:10:01.372205 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 975/1719] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:01 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 14:10:01.379700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:01.380669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:01.387737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.388456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.389166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.390048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.390699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.391291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.449442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.453356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:01.460245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.463227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.464574 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d203bea8-36d0-45c3-8bd4-a30e17916918 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.283823 Oct 31 14:10:01.465620 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 745/1720] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:01 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:01.477918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:01.479088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:01.489673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.490485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.491096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.492396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.493454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.494317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.765640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.776539 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9161eaef-95db-4319-b80c-75e437ed34c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.306802 Oct 31 14:10:01.777912 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 746/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:01 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:01.823979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:01.835775 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbba8a8a-5dd5-44a9-8ba4-6a1db3205327 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1477 microversion: 2.1 time: 0.461588 Oct 31 14:10:01.852069 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 976/1722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:01 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:01.912150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-91267cf6-b1df-4e2d-beae-d8552aa214d6 req-20ed77ba-efef-45e4-b4c2-eef36704056a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a21fbf-69f8-442f-b63a-d56704726665", "tag": "355b449e-9f8e-4623-88b2-fb81ae82a649"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:01.931597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-91267cf6-b1df-4e2d-beae-d8552aa214d6 req-20ed77ba-efef-45e4-b4c2-eef36704056a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.932087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-91267cf6-b1df-4e2d-beae-d8552aa214d6 req-20ed77ba-efef-45e4-b4c2-eef36704056a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.932517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-91267cf6-b1df-4e2d-beae-d8552aa214d6 req-20ed77ba-efef-45e4-b4c2-eef36704056a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.957309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:01.957760 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-91267cf6-b1df-4e2d-beae-d8552aa214d6 req-20ed77ba-efef-45e4-b4c2-eef36704056a service nova] Creating event network-changed:355b449e-9f8e-4623-88b2-fb81ae82a649 for instance 46a21fbf-69f8-442f-b63a-d56704726665 on n-h1-863052-1 Oct 31 14:10:01.957931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:01.970289 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-91267cf6-b1df-4e2d-beae-d8552aa214d6 req-20ed77ba-efef-45e4-b4c2-eef36704056a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063778 Oct 31 14:10:01.971394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.972680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.973515 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 747/1723] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:01.989076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:01.995238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:01.995835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:01.996760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.082034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-44009d87-30c4-47cf-b90a-693ba3c8ec80 req-55f4b33c-7864-45a0-8ccd-80f53b523c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d9b505-33df-4dbd-8bd8-13c69bd80ad2", "tag": "a66f8122-b950-4e9c-a465-fd2598c6c6e6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:02.116112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-44009d87-30c4-47cf-b90a-693ba3c8ec80 req-55f4b33c-7864-45a0-8ccd-80f53b523c4c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.116663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-44009d87-30c4-47cf-b90a-693ba3c8ec80 req-55f4b33c-7864-45a0-8ccd-80f53b523c4c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.117108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-44009d87-30c4-47cf-b90a-693ba3c8ec80 req-55f4b33c-7864-45a0-8ccd-80f53b523c4c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.137080 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-44009d87-30c4-47cf-b90a-693ba3c8ec80 req-55f4b33c-7864-45a0-8ccd-80f53b523c4c service nova] Creating event network-changed:a66f8122-b950-4e9c-a465-fd2598c6c6e6 for instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 on n-h1-863052-1 Oct 31 14:10:02.146940 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-44009d87-30c4-47cf-b90a-693ba3c8ec80 req-55f4b33c-7864-45a0-8ccd-80f53b523c4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072535 Oct 31 14:10:02.149312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 748/1724] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:02.157183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:02.159755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:02.168974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.170730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.171385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.172943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.173623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.174391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.499385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:02.521319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:02.526965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:02.560201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:02.560436 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a2315a3-79a9-40bf-b5d5-b89c4c093495 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.408877 Oct 31 14:10:02.565420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 749/1725] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:02 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:02.570316 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51c6fcd0-1594-4fe1-9c02-8636f5c30d8e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 0.617335 Oct 31 14:10:02.575171 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 977/1726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:01 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:02.580865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:02.583763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:02.584541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:02.587883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:02.612095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.613356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.615828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.617440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.622342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.622934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.625584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.627393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.629786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:02.634864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:02.635374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:02.635833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:03.072832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:03.100561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:03.111819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:03.114773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88d91ecc-828d-4539-8a6e-085ad43d9b69 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.538041 Oct 31 14:10:03.117006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 978/1727] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:02 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:03.153559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:03.156200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:03.176455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:03.176945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:03.177396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:03.178129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:03.178619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:03.179051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:03.600761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:03.606740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:03.621464 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d60f61e3-b9f7-4e57-949b-ca6a87db754c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1686 microversion: 2.1 time: 0.480133 Oct 31 14:10:03.626937 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 979/1728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:03 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1686 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:03.641512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:03.642844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:03.661098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:03.661974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:03.663073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:03.664188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:03.669927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:03.670572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:03.979197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:03.992646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19125028-962d-4a03-8220-5d130e7ae99c tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 1.424671 Oct 31 14:10:03.997287 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 750/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:02 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:04.002090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:04.002759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:04.017689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.018966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.019640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.021285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.021981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.022944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.032889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.046953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:04.050114 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ca3639b-7920-422d-976b-c05278b1825c tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1462 microversion: 2.1 time: 0.421617 Oct 31 14:10:04.054929 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 980/1730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:03 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1462 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:04.063246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:04.066843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:04.081595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:04.083770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.085267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.088945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.092822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.095072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.096663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.209921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.222390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.224765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.233729 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2118f06-88fa-4944-aa65-e51fadba7076 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.177174 Oct 31 14:10:04.235102 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 981/1731] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:04 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:04.242519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-09720f7b-5693-4c24-9d75-1610ed5c6e3f req-d7ee9563-6124-45b7-a457-fec40dcb6bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-unplugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:04.253529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-09720f7b-5693-4c24-9d75-1610ed5c6e3f req-d7ee9563-6124-45b7-a457-fec40dcb6bd5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.254646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-09720f7b-5693-4c24-9d75-1610ed5c6e3f req-d7ee9563-6124-45b7-a457-fec40dcb6bd5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.255310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-09720f7b-5693-4c24-9d75-1610ed5c6e3f req-d7ee9563-6124-45b7-a457-fec40dcb6bd5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.275772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-09720f7b-5693-4c24-9d75-1610ed5c6e3f req-d7ee9563-6124-45b7-a457-fec40dcb6bd5 service nova] Creating event network-vif-unplugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:10:04.313778 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-09720f7b-5693-4c24-9d75-1610ed5c6e3f req-d7ee9563-6124-45b7-a457-fec40dcb6bd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076015 Oct 31 14:10:04.315006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 982/1732] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:04.322773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:04.327196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:04.341765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.342968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.344412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.345738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.347017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.348006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.490817 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6ea74a1-6b9f-4c04-a5c6-bbd12a8fb640 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 0 microversion: 2.1 time: 0.173675 Oct 31 14:10:04.492270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 983/1733] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:04 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:10:04.502872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:04.505897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:04.524096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.526884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.528744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.534275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.535109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.536189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.621836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.638972 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec707f7a-0998-41e8-9074-22eeb2c2434b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 0.640411 Oct 31 14:10:04.657328 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 751/1734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:03 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:04.662914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:04.676135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:04.687075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.687616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.710115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.711493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.711988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.712422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.793606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.813976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.820998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:04.824613 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88ba9158-1c4e-4c10-b2f5-c0296ad3da58 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.330543 Oct 31 14:10:04.838458 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 984/1735] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:04 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:04.845617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:04.846264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:04.851283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.852127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.852800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.853488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lazy-loading 'fault' on Instance uuid 63894684-26f1-4c97-99c4-7026983ea01e {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:04.864665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.865158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.865592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:04.866565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:04.866767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:04.867710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.144949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:05.155067 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7977f639-21e6-4bb6-ac67-01a886cc32c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1686 microversion: 2.1 time: 0.325000 Oct 31 14:10:05.166202 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 985/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:04 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1686 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:05.166202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:05.166202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:05.176904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.176904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.176904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.176904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.176904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.176904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.233139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:05.242501 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af7362fe-0eca-476e-b632-140755bcd70e tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1596 microversion: 2.1 time: 0.583564 Oct 31 14:10:05.246426 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 752/1737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:04 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1596 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:05.269614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:05.270420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:05.281920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.293553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.294496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.297877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.298687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.299410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.488149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:05.501443 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d35d1e56-415e-40a4-883a-da096dff6645 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.342783 Oct 31 14:10:05.502045 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 986/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:05 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:05.519800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:05.521135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:05.522848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:05.530797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.531655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.532107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.532827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.533284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.533977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.542928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:05.544678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:05.550939 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d52bf503-1a51-4f4f-a287-070945d2bb7a tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.285597 Oct 31 14:10:05.563090 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 753/1739] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:05 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:10:05.580611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a05a8084-5e08-4a95-af1c-a27f8ec6b2ad req-14beeb24-c485-407a-b9ef-71d2d668d7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a21fbf-69f8-442f-b63a-d56704726665", "tag": "98788494-d851-4a1b-8291-148a68676b22"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:05.593051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a05a8084-5e08-4a95-af1c-a27f8ec6b2ad req-14beeb24-c485-407a-b9ef-71d2d668d7c3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.593826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a05a8084-5e08-4a95-af1c-a27f8ec6b2ad req-14beeb24-c485-407a-b9ef-71d2d668d7c3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.594466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a05a8084-5e08-4a95-af1c-a27f8ec6b2ad req-14beeb24-c485-407a-b9ef-71d2d668d7c3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.608989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a05a8084-5e08-4a95-af1c-a27f8ec6b2ad req-14beeb24-c485-407a-b9ef-71d2d668d7c3 service nova] Creating event network-changed:98788494-d851-4a1b-8291-148a68676b22 for instance 46a21fbf-69f8-442f-b63a-d56704726665 on n-h1-863052-1 Oct 31 14:10:05.620529 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a05a8084-5e08-4a95-af1c-a27f8ec6b2ad req-14beeb24-c485-407a-b9ef-71d2d668d7c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045045 Oct 31 14:10:05.621760 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 754/1740] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:05.666055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:05.677596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:05.697202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.700264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.702457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.706734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.707452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.709060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.909225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:05.915013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1de3bb5-dfff-42e8-b19e-baeeb94d38b9 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action" status: 202 len: 0 microversion: 2.1 time: 0.411547 Oct 31 14:10:05.919705 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 987/1741] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:05 2022] POST /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:10:05.931408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:05.934112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:05.952202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.953046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.953938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:05.954953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:05.956436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:05.957450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.249210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:06.268703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:06.276104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:06.278541 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-413b253d-bf15-4aff-94b6-6f2c87c04419 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.356709 Oct 31 14:10:06.281490 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 988/1742] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:05 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:06.290647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:06.291573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:06.300596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.301421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.301915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.303564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.304138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.304697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.573837 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04d4acac-b46c-41f4-9e1c-0f1bcf06d5a7 tempest-ServersAdminTestJSON-521059805 tempest-ServersAdminTestJSON-521059805-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1613 microversion: 2.1 time: 0.289928 Oct 31 14:10:06.595083 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 989/1743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:06 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1613 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:06.601785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:06.602372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:06.609580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.610161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.610759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.611512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.612073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.612609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.796653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:06.813632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b155aae-1e38-4285-b02c-b47ebbf20a0d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 1.153483 Oct 31 14:10:06.815673 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 755/1744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:05 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:06.823354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8d611a04-864f-468c-b66a-6e43ad98c35a req-2b3757a0-186a-4982-99ef-3ed517b006b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a9579f-9d77-4a92-88aa-5af95afa49cd", "name": "network-vif-plugged", "status": "completed", "tag": "7c74f8b2-e9e7-4faa-9e5f-c47770131567"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:06.853126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8d611a04-864f-468c-b66a-6e43ad98c35a req-2b3757a0-186a-4982-99ef-3ed517b006b6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.854058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8d611a04-864f-468c-b66a-6e43ad98c35a req-2b3757a0-186a-4982-99ef-3ed517b006b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.854796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8d611a04-864f-468c-b66a-6e43ad98c35a req-2b3757a0-186a-4982-99ef-3ed517b006b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.892692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8d611a04-864f-468c-b66a-6e43ad98c35a req-2b3757a0-186a-4982-99ef-3ed517b006b6 service nova] Creating event network-vif-plugged:7c74f8b2-e9e7-4faa-9e5f-c47770131567 for instance b8a9579f-9d77-4a92-88aa-5af95afa49cd on n-h1-863052-1 Oct 31 14:10:06.898883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:06.901883 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8d611a04-864f-468c-b66a-6e43ad98c35a req-2b3757a0-186a-4982-99ef-3ed517b006b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083877 Oct 31 14:10:06.903431 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 756/1745] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:06.911964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e9d95e7-7f29-4d2e-9b2a-4cc1cd20d01f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.314491 Oct 31 14:10:06.914616 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 990/1746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:06.918621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:06.920436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:06.924586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:06.925273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:06.931585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.932421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.933242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.934350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.935031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.936167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.946248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.946682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.947142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:06.954660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:06.956882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:06.957352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.151944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.167213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.171306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.183460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:07.186017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33e166cb-a663-44dd-bfe7-0ad2c6b90591 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.266913 Oct 31 14:10:07.198326 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 991/1747] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:06 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:07.209498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:07.210118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:07.250393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.252848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.254910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.257231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.260113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.260892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.336717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:07.499601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.510870 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4bed4472-67e0-4a01-9726-c208ba8d2407 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.605821 Oct 31 14:10:07.511471 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 757/1748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:06 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:07.526133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:07.526787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:07.541701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.542762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.543215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.544238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.544704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.545225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.623635 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9f1e306-36c1-4d27-bdfd-127474fd4b81 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 204 len: 0 microversion: 2.1 time: 0.421654 Oct 31 14:10:07.626550 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 992/1749] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:07 2022] DELETE /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:07.643788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:07.645112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:07.652616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.653502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.654339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.655444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.656224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.656948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.840431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.864514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.875224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.876982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a0fb485-b4e2-4a62-8203-d10efe150462 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1280 microversion: 2.25 time: 0.364456 Oct 31 14:10:07.903737 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 758/1750] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:07 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1280 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:07.911315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:07.923612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:07.924539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a67ab8f3-1f06-4248-9859-26ba706e0848 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1468 microversion: 2.1 time: 0.291716 Oct 31 14:10:07.939512 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 993/1751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:07 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:07.939999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:07.954310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:07.955676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:07.960013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.962775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.963452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.967037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.967708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.968319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.977325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.983312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.984174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:07.986136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:07.987727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:07.990364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.231780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:08.244536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef6acd92-0cdb-4789-b35f-f341a5b73266 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 0.333427 Oct 31 14:10:08.268854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 759/1752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:07 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:08.274559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:08.275181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:08.284443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.285203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.285849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.286806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.287440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.288833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.299048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:08.310918 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fa9c89d-54da-4cbf-bfdb-c5cb382a774d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.362220 Oct 31 14:10:08.314219 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 994/1753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:07 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:08.399632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:08.410483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:08.414908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:08.425353 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f66511a8-cc9a-4ffa-9374-3b19eb512047 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.155244 Oct 31 14:10:08.426559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 760/1754] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:08 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:08.537272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:08.538510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:08.546645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.547383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.548028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.548982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.549854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.550919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.714988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:08.723128 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b52672c-be86-4e1b-b3a0-799eabe05173 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.190471 Oct 31 14:10:08.723714 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 995/1755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:08 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:08.908523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:08.909249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:08.916302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.916939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.917464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.918236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.918699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.919128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.958364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:08.959237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:08.965881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.966480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.966919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:08.967616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:08.968068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:08.968491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.084768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.095999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.097785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.099434 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b27a3d30-a72e-4cdc-a930-0af7e78af0bb tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1475 microversion: 2.25 time: 0.194944 Oct 31 14:10:09.113820 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 761/1756] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:08 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1475 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:09.113820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-plugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}, {"server_uuid": "a4d9b505-33df-4dbd-8bd8-13c69bd80ad2", "name": "network-vif-plugged", "status": "completed", "tag": "a66f8122-b950-4e9c-a465-fd2598c6c6e6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:09.134323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.134323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.134323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.152251 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] Creating event network-vif-plugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:10:09.152761 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] Creating event network-vif-plugged:a66f8122-b950-4e9c-a465-fd2598c6c6e6 for instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 on n-h1-863052-1 Oct 31 14:10:09.174976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.185106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc528d87-9a38-4d65-9f21-e97e033dd892 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1468 microversion: 2.1 time: 0.230443 Oct 31 14:10:09.186664 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 996/1757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:08 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1468 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:09.204681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fdc465a2-f677-4319-b7cb-fc13322f1680 req-041dfa75-390f-4e35-88ad-cd33bb7be87f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102936 Oct 31 14:10:09.205573 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 762/1758] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:09.276971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:09.277990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:09.290327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.291115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.291758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.292645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.293262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.293850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.443257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:09.443888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:09.454076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.455312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.455766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.459370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.460064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.460706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.532154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.544406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e345cdce-5a28-4105-94ab-abe7f2e43249 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 0.272703 Oct 31 14:10:09.545615 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 763/1759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:09 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:09.557565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:09.558198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:09.573374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.574189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.577243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.578267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.578901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.579514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.682493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid b8a9579f-9d77-4a92-88aa-5af95afa49cd {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:09.701223 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad0843e2-d4e9-44e3-b7b7-7b9a3ef91b2c tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1967 microversion: 2.25 time: 0.513185 Oct 31 14:10:09.706769 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 997/1760] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:09 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1967 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:09.713574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:09.714647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:09.733802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.734344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.734785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.735487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.743218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.745896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.776992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.786033 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3717f04-7cc6-42ec-8fb0-00248206c65c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.232717 Oct 31 14:10:09.788237 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 764/1761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:09 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:09.793771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:09.794649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:09.801183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.802105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.802749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.803695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.804321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.805490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.828729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:09.930495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.957736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.963878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:09.978157 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-834ce422-1e95-4aa2-aefa-b8511701a0cc tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.270075 Oct 31 14:10:09.979077 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 998/1762] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:09 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:09.984258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:09.984915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:09.992013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.992503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.992936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:09.993634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:09.994083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:09.994778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.161101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid b8a9579f-9d77-4a92-88aa-5af95afa49cd {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:10.196734 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-427327b9-659f-4ef4-ae98-1617f015d31a tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1967 microversion: 2.25 time: 0.406512 Oct 31 14:10:10.202710 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 765/1763] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:09 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1967 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:10.212038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:10.214987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:10.231581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.232672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.233868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.235220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.236219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.237151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.259902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:10.272295 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-240576f5-789a-4690-b28b-dfa599e490f7 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.289150 Oct 31 14:10:10.305788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 999/1764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:09 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:10.306143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:10.310529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.311027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.311732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.312797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.313260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.313686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.354684 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4618878b-2615-49ff-bdbb-57c1a7755cfd tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052141 Oct 31 14:10:10.365302 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1000/1765] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 31 14:10:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:10:10.370521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-1", "block_migration": "auto"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:10.374044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:10.388135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.389052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.390423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.391546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.395540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.396093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.450448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'flavor' on Instance uuid b8a9579f-9d77-4a92-88aa-5af95afa49cd {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:10.464812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Going to try to live migrate instance to n-h2-863052-1 {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:10:10.514479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:10.606869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:10.615661 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7d4453a-11db-4116-bb21-1aaf152d78f4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1468 microversion: 2.1 time: 0.407686 Oct 31 14:10:10.616983 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 766/1766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:10 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1468 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:10.623293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:10.624106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:10.645905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.646737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.647165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.648813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:10.649253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:10.649682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:10.973785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:10.983568 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46f653ce-7136-4233-84ee-2fe02b0c7808 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1322 microversion: 2.1 time: 0.364379 Oct 31 14:10:10.987941 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 767/1767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:10 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:10.996412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:10.997482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:11.018750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.020379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.024550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.025586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.026565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.029022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.275869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:11.322686 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f8290e9-99d4-4f89-a8ec-a475b29ccc16 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.332431 Oct 31 14:10:11.332656 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 768/1768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:10 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:11.342012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:11.342842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:11.351191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.353184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.353716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.354826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.355356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.355849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.474860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:11.489273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:11.497593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:11.512272 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7159058-f2b8-43b9-8a70-5ebc25633430 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.176093 Oct 31 14:10:11.530064 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 769/1769] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:11 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:11.537608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:11.538859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:11.548699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.549475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.550207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.552823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.553540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.554232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.857395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:11.873985 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e37058df-ac33-482d-b393-c2b84b2d2560 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.341510 Oct 31 14:10:11.886784 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 770/1770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:11 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:11.892997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:11.893941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:11.901747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.904200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.904838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:11.907540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:11.908286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:11.909536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.104729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:12.113785 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1fc3d3d9-de02-4717-a5ee-d8dba48cc0ef tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1468 microversion: 2.1 time: 0.225764 Oct 31 14:10:12.114954 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 771/1771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:11 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:12.120901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:12.121714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:12.128573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.129331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.130141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.131103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.131710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.132341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.343139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:12.352990 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-602a563f-befc-488f-9e5e-d9a89a819a54 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1516 microversion: 2.1 time: 0.236276 Oct 31 14:10:12.371776 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 772/1772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:12 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:12.379329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:12.379561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:12.387138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.387964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.388154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.388926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.389463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.389891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.603825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:12.613860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-03944231-5298-4661-a1ad-ec410e707478 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.239691 Oct 31 14:10:12.614939 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 773/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:12 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:12.650878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:12.656444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:12.663219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.664353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.664866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.665940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.666687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.667210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.708621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'flavor' on Instance uuid a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:12.811225 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8732537-2a2d-4279-a126-32f014778036 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action" status: 200 len: 32 microversion: 2.1 time: 0.181435 Oct 31 14:10:12.812419 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 774/1774] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:12 2022] POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:12.818287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:12.819184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:12.827182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.827708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.828148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.828853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.829305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.829760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.933871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:12.942281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:12.943715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:12.949490 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af5d92df-5370-4d08-a9e7-a25762474ed4 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.135724 Oct 31 14:10:12.950065 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 775/1775] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:12 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:12.975444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:12.976371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:12.982431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.983261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.983877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:12.984772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:12.985385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:12.985979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:13.222347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:13.230879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1da71d8-8ae0-417d-88a5-992c5d88ea37 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.267222 Oct 31 14:10:13.231644 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 776/1776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:12 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:13.238883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:13.239503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:13.247949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:13.248597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:13.249240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:13.252124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:13.252124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:13.252124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:13.871352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:13.880243 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71ae635a-18bf-44ce-9569-afde7bf3c9f5 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.644940 Oct 31 14:10:13.889319 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 777/1777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:13 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:13.889319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:13.889319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:13.897059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:13.897693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:13.898747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:13.899561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:13.900115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:13.900637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.049110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:14.057250 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b42e04f-1099-449e-81a6-c5433c1eabe3 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1468 microversion: 2.1 time: 0.174709 Oct 31 14:10:14.058056 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 778/1778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:13 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:14.071492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:14.072185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:14.078661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.079155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.079604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.080306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.080825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.081252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.216194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:14.218567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:14.226427 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1c25721e-814b-4aa8-9e6d-b9e26cb2653e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.159394 Oct 31 14:10:14.227009 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 779/1779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:14 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:14.231723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:14.232336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:14.239183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.239676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.240122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.240821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.241279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.241733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.307888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:14.316324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:14.317862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:14.323535 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-51376736-d894-4b1c-972d-cdd437a927c0 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.095541 Oct 31 14:10:14.324278 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 780/1780] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:14 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:14.328720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:14.329339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:14.335336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.336420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.336921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.337623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.338081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.338538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.468994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:14.476956 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4d2bf07-9645-40ac-91fd-aea86bbb402a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.151725 Oct 31 14:10:14.477536 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 781/1781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:14 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:14.905314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:14.906015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:14.916434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:14.920396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.920910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.924157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:14.924919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:14.925450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:14.925896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.232686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:15.253677 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b31f4e70-1f5d-43c0-98ee-f16060a46334 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.353422 Oct 31 14:10:15.254910 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 782/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:14 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:15.267379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:15.268003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:15.274776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.275270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.275716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.276417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.276876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.277320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.421914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:15.431640 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d7ce7c1-bb95-4d83-9bd9-e1a663aa1315 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1426 microversion: 2.1 time: 0.171121 Oct 31 14:10:15.432896 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 783/1783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:15 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1426 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:15.444558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:15.445729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:15.455942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.456933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.457610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.458589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.459253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.459903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.685704 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3427fe75-bdf4-4b49-b116-48856a149751 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd/action" status: 202 len: 0 microversion: 2.25 time: 5.319212 Oct 31 14:10:15.687321 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1001/1784] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:10:10 2022] POST /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd/action => generated 0 bytes in 5322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:15.697285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:15.698204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:15.706517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.707690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.708458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.709566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.711049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.712177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.868913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:15.893096 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fafb1dea-26b8-4518-938a-dc5a07d81c9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.458846 Oct 31 14:10:15.899824 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 784/1785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:15 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:15.923279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:15.937277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:15.940629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:15.945948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:15.949054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:15.950321 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-092604e8-27f8-4bf5-8180-36b80d6e4139 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.257656 Oct 31 14:10:15.951533 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1002/1786] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:15 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:15.956476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5df3df35-cb97-4f81-91cf-a0974d33e098 req-46f3fc7f-da8b-44e3-9f0d-9c8bcb22283e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12fede62-46c1-490c-8a44-56615f520b2a", "name": "network-vif-deleted", "tag": "7bdc8469-39d0-4334-b8f1-8d3d0f7ef18e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:15.982900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5df3df35-cb97-4f81-91cf-a0974d33e098 req-46f3fc7f-da8b-44e3-9f0d-9c8bcb22283e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:15.994882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5df3df35-cb97-4f81-91cf-a0974d33e098 req-46f3fc7f-da8b-44e3-9f0d-9c8bcb22283e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:15.995779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5df3df35-cb97-4f81-91cf-a0974d33e098 req-46f3fc7f-da8b-44e3-9f0d-9c8bcb22283e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:15.996897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.001363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.003750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.008858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.009727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.015586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.038472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5df3df35-cb97-4f81-91cf-a0974d33e098 req-46f3fc7f-da8b-44e3-9f0d-9c8bcb22283e service nova] Creating event network-vif-deleted:7bdc8469-39d0-4334-b8f1-8d3d0f7ef18e for instance 12fede62-46c1-490c-8a44-56615f520b2a on n-h2-863052-1 Oct 31 14:10:16.064609 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5df3df35-cb97-4f81-91cf-a0974d33e098 req-46f3fc7f-da8b-44e3-9f0d-9c8bcb22283e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110316 Oct 31 14:10:16.067984 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1003/1787] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:16.080614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:16.086873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:16.105714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.106851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.107470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.110207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.110982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.112768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.303361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:16.318814 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b3448a5-284d-481d-b676-acb5976a29ad tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.417422 Oct 31 14:10:16.321743 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 785/1788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:15 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:16.333641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5906982e-bab8-49ee-bca6-61d362295588 req-70c11a32-82a0-4261-8136-6dad80e44cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a21fbf-69f8-442f-b63a-d56704726665", "name": "network-vif-plugged", "status": "completed", "tag": "355b449e-9f8e-4623-88b2-fb81ae82a649"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:16.345785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5906982e-bab8-49ee-bca6-61d362295588 req-70c11a32-82a0-4261-8136-6dad80e44cd3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.346482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5906982e-bab8-49ee-bca6-61d362295588 req-70c11a32-82a0-4261-8136-6dad80e44cd3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.347569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5906982e-bab8-49ee-bca6-61d362295588 req-70c11a32-82a0-4261-8136-6dad80e44cd3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.367887 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5906982e-bab8-49ee-bca6-61d362295588 req-70c11a32-82a0-4261-8136-6dad80e44cd3 service nova] Creating event network-vif-plugged:355b449e-9f8e-4623-88b2-fb81ae82a649 for instance 46a21fbf-69f8-442f-b63a-d56704726665 on n-h1-863052-1 Oct 31 14:10:16.375061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5906982e-bab8-49ee-bca6-61d362295588 req-70c11a32-82a0-4261-8136-6dad80e44cd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051293 Oct 31 14:10:16.376509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 786/1789] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:16.383148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:16.385555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:16.397050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.398517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.399148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.400068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.400994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.402449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.539208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:16.552361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:16.557406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:16.559611 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64325087-c3fb-4cd0-a8c3-aba6b48e9a66 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.490405 Oct 31 14:10:16.561426 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1004/1790] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:16 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:16.574311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:16.578271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:16.598061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.600262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.600908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.602381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.603980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.605757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.629683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:16.642126 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf0d3e9e-0e48-4ae6-8146-8181245fb817 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.263819 Oct 31 14:10:16.659895 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 787/1791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:16 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:16.670332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.671733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.672451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.673148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lazy-loading 'fault' on Instance uuid 12fede62-46c1-490c-8a44-56615f520b2a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:16.732208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:16.740850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf198490-8058-4c64-a32b-8c313a251628 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 200 len: 1303 microversion: 2.1 time: 0.176970 Oct 31 14:10:16.741429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1005/1792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:16 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:16.925187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:16.926284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:16.938838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.941442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.942663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.944624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.950526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.951815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:16.986331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:16.987997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:16.996100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:16.996707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:16.997510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.002044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.002044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.002044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.169412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.182397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.184202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.197602 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0dad541e-257b-4276-bcfe-bbd68d746a82 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1544 microversion: 2.91 time: 0.216543 Oct 31 14:10:17.210235 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1006/1793] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:16 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:10:17.263527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.272122 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-290c5057-ce50-42df-8588-9910810fc9c2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.351009 Oct 31 14:10:17.278262 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 788/1794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:16 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:17.344289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:17.345358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:17.354439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.358831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.359284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.360008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.360466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.360890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.569233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.578831 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37447981-0087-4675-ae71-81fa9003ef21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.238210 Oct 31 14:10:17.579859 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1007/1795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:17 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:17.595666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:17.596560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:17.607472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.608295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.612115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.613090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.613557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.614184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.667364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:17.668605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:17.680046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.692495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.693233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.694179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.702063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.703779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.861125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.879263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.881660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:17.883702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87798491-4d43-47de-8e4e-6e68862899f8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.292154 Oct 31 14:10:17.884855 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 789/1796] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:17 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:17.890409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:17.891741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 12fede62-46c1-490c-8a44-56615f520b2a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:17.899301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.900088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.900826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.902521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.903323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.903966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.921195 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] HTTP exception thrown: Instance 12fede62-46c1-490c-8a44-56615f520b2a could not be found. Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Request method failure captured: Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a HTTP/1.1 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9a1jhmKw8HCIqZ8XbXnVgiqS_EW3jqSj-Pgz8iDNSRkbdGgAYDMz-9CRbeJX33YdDgxexV6654VuTMTi8DhocxtW9qJqLVgctQk_P5KqSnfFgynBgB7lkl3vleM4kT7wzWUBwvn18vOhIo3ZAFJvCno3tUhliHzU0OYWxjBEtVFQRI Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 76489790a3e4477aba14b231646a3f98 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76489790a3e4477aba14b231646a3f98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76489790a3e4477aba14b231646a3f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76489790a3e4477aba14b231646a3f98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76489790a3e4477aba14b231646a3f98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 76489790a3e4477aba14b231646a3f98 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersAdminTestJSON-1374589142-project Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 1526c17fd6164655852807d8be044072 Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersAdminTestJSON-1374589142-project Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 12fede62-46c1-490c-8a44-56615f520b2a could not be found. Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '12fede62-46c1-490c-8a44-56615f520b2a'} Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12fede62-46c1-490c-8a44-56615f520b2a could not be found. Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12fede62-46c1-490c-8a44-56615f520b2a could not be found. Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:17.923973 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12fede62-46c1-490c-8a44-56615f520b2a could not be found. Oct 31 14:10:17.931771 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:17.954598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Returning 404 to user: Instance 12fede62-46c1-490c-8a44-56615f520b2a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:17.956358 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25f9b8b5-8385-4c1b-b3a3-744a876465cf tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a" status: 404 len: 111 microversion: 2.1 time: 0.069982 Oct 31 14:10:17.959990 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 790/1797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:17 2022] GET /compute/v2.1/servers/12fede62-46c1-490c-8a44-56615f520b2a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:17.966788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:17.967292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:17.974472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.974967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.975813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:17.976747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:17.977379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:17.977976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.003501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.015869 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-404763c4-1ccf-4ef5-9031-23a302af47b3 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.353497 Oct 31 14:10:18.022709 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1008/1798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:17 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:18.031152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:18.171853 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db32fee8-e663-49da-8ef4-47e4d9c4efc0 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 204 len: 0 microversion: 2.1 time: 0.207584 Oct 31 14:10:18.173846 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 791/1799] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:17 2022] DELETE /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:18.185231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.186381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:18.194220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.196480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.197307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.198529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.199156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.199748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.233263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.236414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:18.250143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.250923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.251815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.253220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.254054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.254740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.356190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.366009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.368911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.375304 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f2c815c-f694-46f8-831b-16d5133b4143 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1531 microversion: 2.91 time: 0.147918 Oct 31 14:10:18.376361 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 792/1800] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:18 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1531 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:18.403889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.404538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:18.428504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.429836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.430286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.434351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.434831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.437850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.493368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.508775 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16b22359-e140-4676-9f1d-09b385d140d5 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1469 microversion: 2.1 time: 0.330873 Oct 31 14:10:18.510046 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1009/1801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:18 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1469 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:18.514989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.516900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:18.524306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.525119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.526320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.527389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.528211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.529045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.640934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] Lazy-loading 'services' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:18.688712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-517233bf-00f0-4a40-bebd-9aafb025f5cb tempest-UnshelveToHostMultiNodesTest-1089477857 tempest-UnshelveToHostMultiNodesTest-1089477857-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1936 microversion: 2.91 time: 0.172749 Oct 31 14:10:18.689399 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1010/1802] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:18 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1936 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:18.702964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.714222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7e177b27-48cc-40a5-9c66-c7997668a9c3 req-dbd641b2-b6c2-45a0-89bb-7548a59e1f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a21fbf-69f8-442f-b63a-d56704726665", "name": "network-vif-plugged", "status": "completed", "tag": "98788494-d851-4a1b-8291-148a68676b22"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:18.720180 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd6e41a6-d546-42ca-9269-9d84d4974f13 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.336260 Oct 31 14:10:18.722176 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 793/1803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:18 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:18.732301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.736785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e177b27-48cc-40a5-9c66-c7997668a9c3 req-dbd641b2-b6c2-45a0-89bb-7548a59e1f2e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.737263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e177b27-48cc-40a5-9c66-c7997668a9c3 req-dbd641b2-b6c2-45a0-89bb-7548a59e1f2e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.742035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:18.742035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Searching by: {'deleted': False, 'project_id': 'fe822dcacc944fe386f071c93f133c1b'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:10:18.744670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e177b27-48cc-40a5-9c66-c7997668a9c3 req-dbd641b2-b6c2-45a0-89bb-7548a59e1f2e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.756631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.757642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.758104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.758925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.759332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.759761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.767728 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7e177b27-48cc-40a5-9c66-c7997668a9c3 req-dbd641b2-b6c2-45a0-89bb-7548a59e1f2e service nova] Creating event network-vif-plugged:98788494-d851-4a1b-8291-148a68676b22 for instance 46a21fbf-69f8-442f-b63a-d56704726665 on n-h1-863052-1 Oct 31 14:10:18.772846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7e177b27-48cc-40a5-9c66-c7997668a9c3 req-dbd641b2-b6c2-45a0-89bb-7548a59e1f2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081720 Oct 31 14:10:18.774371 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1011/1804] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:18.780154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.780861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:18.788028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.788591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.789029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.789736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.794886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.796813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.810294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:10:18.866631 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7bdd13cf-e6f9-4a15-b922-8cd1237e0858 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.138016 Oct 31 14:10:18.867370 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 794/1805] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:10:18 2022] GET /compute/v2.1/servers => generated 339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:18.878527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:18.879036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:18.886983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.887628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.888071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.888777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:18.889232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:18.889654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:18.924819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:18.926964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:19.087491 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b225cba-2cce-41fe-9c79-335abe5684a2 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 204 len: 0 microversion: 2.91 time: 0.218777 Oct 31 14:10:19.089472 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 795/1806] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:18 2022] DELETE /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:10:19.099128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:19.104808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.110106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.111285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Searching by: {'deleted': False, 'project_id': 'fe822dcacc944fe386f071c93f133c1b'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:10:19.113173 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-327bdcf0-0e71-4e2c-9f4f-0a71c46a345b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.336973 Oct 31 14:10:19.113761 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1012/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:18 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:19.118690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.119879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.120896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.121779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.122425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.123155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.127004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:19.127618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:19.139477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.139961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.146215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.147164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.147645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.148114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.156924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:10:19.201022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.220711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.221197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.221632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.404245 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eef21396-4afc-4893-b2e3-2494505dd257 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.313185 Oct 31 14:10:19.405216 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 796/1808] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:10:19 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:19.433256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:19.434063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:19.447251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.449127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.450681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.452587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.454545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.454896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.562232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.574725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.576184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.586455 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a22b3a88-8d35-4af6-a680-20a7e103c388 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.462668 Oct 31 14:10:19.588286 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1013/1809] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:19 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:19.593579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:19.594902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:19.609701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.610232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.610677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.611384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:19.611834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:19.612285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:19.883932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:19.892210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8fb537bf-ba39-451f-b853-2ff265249776 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1334 microversion: 2.1 time: 0.471384 Oct 31 14:10:19.892801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 797/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:19 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1334 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:19.913145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97db2963-1862-430f-8a3a-b8f89d36a059 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:19.944384 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97db2963-1862-430f-8a3a-b8f89d36a059 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050399 Oct 31 14:10:19.965565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 798/1811] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:10:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:19.965565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:19.977113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:20.001307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.001836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.005144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.008618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.012636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.014088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.122812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:20.133107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:20.139219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:20.158662 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18b91153-dabd-4c30-9757-d3ea6bdb1099 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.568986 Oct 31 14:10:20.159845 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1014/1812] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:19 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:20.164641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:20.165467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:20.183216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.183998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.184595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.185458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.186052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.186657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.329604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:20.332421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:20.343552 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3923a12a-e165-45bf-913f-b4337b21dceb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1469 microversion: 2.1 time: 0.381608 Oct 31 14:10:20.361214 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 799/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:19 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:20.368703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:20.374566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:20.411702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.418820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.419445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.420319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.420887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.434765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.537832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:20.552691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea435e67-25a4-4293-bf42-25de5eb9fa5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.389522 Oct 31 14:10:20.553398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1015/1814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:20 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:20.566748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:20.567371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:20.600204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.601170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.603723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.606950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.607653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.609345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.681171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:20.789024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:20.858582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:20.872087 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e662b0b-0f1d-41dc-aaf8-48ffb74526ba tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.509542 Oct 31 14:10:20.890997 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 800/1815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:20 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:20.897569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:20.902557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:20.905001 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e9de991-5d9f-4e22-9194-49df1d8c7315 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 204 len: 0 microversion: 2.1 time: 0.345962 Oct 31 14:10:20.910921 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1016/1816] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:20 2022] DELETE /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:20.927629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.928577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.929338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.929756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d1b4c2aa-86cf-4454-a97f-0cbf1951f904 req-6cb0127c-06dd-4d71-a916-c5f79839e185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0631634-74b7-48fd-b6af-148d5db7360e", "name": "network-vif-deleted", "tag": "2da7be65-1a9e-457a-a807-9448f6870119"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:20.930620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:20.931318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:20.934526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:20.998371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d1b4c2aa-86cf-4454-a97f-0cbf1951f904 req-6cb0127c-06dd-4d71-a916-c5f79839e185 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.000845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d1b4c2aa-86cf-4454-a97f-0cbf1951f904 req-6cb0127c-06dd-4d71-a916-c5f79839e185 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.003658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d1b4c2aa-86cf-4454-a97f-0cbf1951f904 req-6cb0127c-06dd-4d71-a916-c5f79839e185 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.035897 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d1b4c2aa-86cf-4454-a97f-0cbf1951f904 req-6cb0127c-06dd-4d71-a916-c5f79839e185 service nova] Creating event network-vif-deleted:2da7be65-1a9e-457a-a807-9448f6870119 for instance f0631634-74b7-48fd-b6af-148d5db7360e on n-h2-863052-1 Oct 31 14:10:21.052595 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d1b4c2aa-86cf-4454-a97f-0cbf1951f904 req-6cb0127c-06dd-4d71-a916-c5f79839e185 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140267 Oct 31 14:10:21.056637 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1017/1817] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:21.077202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:21.078064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:21.102033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.102683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.103139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.104024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.104508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.104958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.187726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.199772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.201673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.203392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5aed3975-ae34-4103-bc3c-afa529a24f1c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.311078 Oct 31 14:10:21.215304 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 801/1818] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:20 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:21.234702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:21.236067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:21.245478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.246500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.247297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.248763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.249650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.250420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.587983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.604923 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ccf27ae-30b1-4be6-bc4b-1384cdf7766b tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1712 microversion: 2.1 time: 0.382282 Oct 31 14:10:21.606194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 802/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1712 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:21.611982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:21.612596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:21.620164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.620646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.621155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.622706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.623187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.624051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.645505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.676169 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-273147b8-a846-4135-b297-037d72740b96 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1669 microversion: 2.1 time: 0.617722 Oct 31 14:10:21.677303 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1018/1820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1669 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:21.693983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:21.698080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:21.720366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.722040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.723239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.724363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.725177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.727009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.769707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.809758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.829285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.856447 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21da62f2-41b8-4a60-8fe6-7138fc2fd401 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.245522 Oct 31 14:10:21.857053 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 803/1821] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:21.862096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:21.862754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:21.870018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.870587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.871327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.872062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.872522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.872929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.909278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:21.921678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c18bdc0-2d55-40ec-b964-043b1ad906d4 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1298 microversion: 2.1 time: 0.239489 Oct 31 14:10:21.929956 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1019/1822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1298 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:21.930286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:21.930708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:21.945148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.945615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.946058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.947263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:21.947263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:21.947752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:21.997240 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee08ec4a-1e23-41ed-a710-092d4547ff3b tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665/ips" status: 200 len: 179 microversion: 2.1 time: 0.072891 Oct 31 14:10:22.005621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1020/1823] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665/ips => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:22.005621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.005621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.015750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.016412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.016858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.017618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.018076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.018611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.138876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.152132 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb6b06f8-c9ea-4983-8013-a8d250d40686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.293563 Oct 31 14:10:22.153586 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 804/1824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:22.159594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.160278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.168438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.169320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.169996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.170891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.171533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.172488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.207240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:22.296825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.313447 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88d72fe4-a0c4-4d9e-8ea1-8032433c89ce tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.312910 Oct 31 14:10:22.314790 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1021/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:21 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:22.330598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.331360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.337637 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d846c0c-1fd3-4ddf-9637-341787fbc066 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 204 len: 0 microversion: 2.1 time: 0.178853 Oct 31 14:10:22.338840 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 805/1826] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:22 2022] DELETE /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:22.342244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.342749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.343199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.346819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.347390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.347868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.354065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.359614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.369385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.370145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.370778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.372583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.374063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.374699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.572494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.582550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.584014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.586364 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60d45836-49fc-46ea-b84c-c76cb7b4ea5f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.269535 Oct 31 14:10:22.598261 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1022/1827] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:22 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:22.604281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.613983 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d935cb3-de33-4cc0-bb4e-ff8f2bf6d7ad tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1675 microversion: 2.1 time: 0.265051 Oct 31 14:10:22.614795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 806/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:22 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1675 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:22.634802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.635433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.650647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.651328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.651608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.652324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.652786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.653221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.885403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.886420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.893378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.903059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.903479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.904085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:22.904249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.904672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.905097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.918006 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61fbb12a-9852-41b5-947a-ef8820256654 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1712 microversion: 2.1 time: 0.293243 Oct 31 14:10:22.919408 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1023/1829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:22 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1712 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:22.951467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:22.952238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:22.970340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.971336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.972426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:22.978809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:22.981949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:22.984477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.069727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.070258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.070928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.071660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lazy-loading 'fault' on Instance uuid f0631634-74b7-48fd-b6af-148d5db7360e {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:23.137518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.155996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.157438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.169449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.172895 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4da26a30-bb03-41f2-abef-d754c94f70d6 tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1537 microversion: 2.91 time: 0.291874 Oct 31 14:10:23.173953 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 807/1830] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:22 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:10:23.184555 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f43bfc0a-8f0f-4c44-bf80-35f447c27d4a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 200 len: 1303 microversion: 2.1 time: 0.237495 Oct 31 14:10:23.189292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:23.191629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:23.206192 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1024/1831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:22 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 1303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:23.227588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.228102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.228541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.229269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.241005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.241005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.342470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:23.343089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:23.370901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.371403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.371839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.372556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.374203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.375383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.525273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.544170 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a6bb0460-52c9-455f-84db-38040712d683 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.361480 Oct 31 14:10:23.545141 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 808/1832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:23 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:23.613410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:23.614137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:23.624584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.631565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.632103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.633194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.633842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.634784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.661260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:23.705838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.716655 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd4512be-483b-4d48-b12a-cadcbc5e0ff9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.379474 Oct 31 14:10:23.737649 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1025/1833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:23 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:23.756315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:23.760061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:23.771685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:23.779182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.781029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.781803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.783093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.783825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.790431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.917143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.927441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.930898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:23.934441 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e4891bf-5370-41b0-ba1e-613c229e0f17 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.326457 Oct 31 14:10:23.939447 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 809/1834] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:23 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:23.947085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:23.948266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:23.957322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.957841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.958395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:23.959136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:23.959657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:23.960235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.115034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:24.127965 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f3fbf08-84af-469f-aa38-c2772f66b629 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1675 microversion: 2.1 time: 0.388474 Oct 31 14:10:24.128681 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1026/1835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:23 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1675 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:24.139090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1122468108", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "da8a9929-0ff3-4206-a14a-e0d235fbfab9"}], "block_device_mapping_v2": [{"uuid": "f49a4354-21be-4ed8-bec8-312ad947d28b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:24.272242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] validate_networks() for [('da8a9929-0ff3-4206-a14a-e0d235fbfab9', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:10:24.396269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:24.410222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7df53f5f-21f1-47b8-91b2-20efcaedfa2f tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1645 microversion: 2.1 time: 0.467402 Oct 31 14:10:24.411463 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 810/1836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:23 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1645 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:24.423178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:24.424130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:24.438287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.439396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.440158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.441377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.442245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.443111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.537351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.540767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.541579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.543136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lazy-loading 'fault' on Instance uuid 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:24.676338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:24.687150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:24.688764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bffcda2a16454874b56ed8359c5e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f608aadb2fa45aa9080f7c3e325d9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:24.705244 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41a6a9b8-7d4b-4c26-92c6-8f60b8f3ee2b tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 200 len: 1542 microversion: 2.91 time: 0.291762 Oct 31 14:10:24.705244 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 811/1837] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:24 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:24.718903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:24.719781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: f0631634-74b7-48fd-b6af-148d5db7360e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:24.734922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.735802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.736602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.739210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.739210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.739210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.778871 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] HTTP exception thrown: Instance f0631634-74b7-48fd-b6af-148d5db7360e could not be found. Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Request method failure captured: Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e HTTP/1.1 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9a1jhmKw8HCIqZ8XbXnVgiqS_EW3jqSj-Pgz8iDNSRkbdGgAYDMz-9CRbeJX33YdDgxexV6654VuTMTi8DhocxtW9qJqLVgctQk_P5KqSnfFgynBgB7lkl3vleM4kT7wzWUBwvn18vOhIo3ZAFJvCno3tUhliHzU0OYWxjBEtVFQRI Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 76489790a3e4477aba14b231646a3f98 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76489790a3e4477aba14b231646a3f98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76489790a3e4477aba14b231646a3f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76489790a3e4477aba14b231646a3f98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76489790a3e4477aba14b231646a3f98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 76489790a3e4477aba14b231646a3f98 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersAdminTestJSON-1374589142-project Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 1526c17fd6164655852807d8be044072 Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersAdminTestJSON-1374589142-project Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f0631634-74b7-48fd-b6af-148d5db7360e could not be found. Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f0631634-74b7-48fd-b6af-148d5db7360e'} Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0631634-74b7-48fd-b6af-148d5db7360e could not be found. Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0631634-74b7-48fd-b6af-148d5db7360e could not be found. Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:24.780720 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0631634-74b7-48fd-b6af-148d5db7360e could not be found. Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:24.786040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Returning 404 to user: Instance f0631634-74b7-48fd-b6af-148d5db7360e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:24.789563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f8aab0d-a405-4495-bfc0-b6d8110fe48e tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e" status: 404 len: 111 microversion: 2.1 time: 0.071029 Oct 31 14:10:24.789563 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 812/1838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:24 2022] GET /compute/v2.1/servers/f0631634-74b7-48fd-b6af-148d5db7360e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:24.794322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:24.795065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:24.801406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.802036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.802611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:24.803427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:24.804052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:24.804579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.094707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:10:25.095213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:10:25.095739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:10:25.096212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:10:25.096867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:10:25.110856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.111472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.111995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.112807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.113357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.113866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.136365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:25.143165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Getting quotas for user 3589cce53cf8492a9a2e05c73f373319 and project 8597bfad0a2d4d209e6f33a02676406d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:25.212353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:25.230738 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79891ecf-1600-406d-87f0-4233a2b145e7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.435125 Oct 31 14:10:25.232124 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 813/1839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:24 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:25.248209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:25.250086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:25.263384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.265866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.266396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.274684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:10:25.275022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.275517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.276165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.280500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f49a4354-21be-4ed8-bec8-312ad947d28b',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:10:25.593865 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66901342-5cea-48d2-923b-ff8b366a672a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463996 Oct 31 14:10:25.600449 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1027/1840] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:10:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:10:25.606004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:25.612127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:25.624839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.639816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:25.642709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.643224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.643980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.650892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.651435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.669430 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3b9d3bc-ea2f-4a8c-9094-4e515e338eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.435816 Oct 31 14:10:25.670765 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 814/1841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:25 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:25.677428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:25.684962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:25.709147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.716145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.716841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.717754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:25.720153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:25.720790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:25.796102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:26.068523 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd4fea4f-33d3-40c4-be74-7b693c6ce829 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "DELETE /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 204 len: 0 microversion: 2.1 time: 0.462077 Oct 31 14:10:26.073505 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1028/1842] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:25 2022] DELETE /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:26.081989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:26.087758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:26.103892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.105107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.105776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.110136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.110873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.111495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.425119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:26.436950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:26.445521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:26.449419 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25460fe9-3f42-41dc-86fe-a10327dbebe3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.776342 Oct 31 14:10:26.455926 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 815/1843] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:25 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:26.459329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:26.472840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f85bf1a-5583-4b22-85ab-40b7b70fe743 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1654 microversion: 2.1 time: 0.397734 Oct 31 14:10:26.475090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:26.477564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:26.499172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1029/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:26 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1654 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:26.503002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.503837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.507142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.508116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.512319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0416fa44-3f31-4125-8add-6e59e8dafbc0 req-10be19a1-a2d9-441f-b797-c154bcd49a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dd8dd3-9df4-41a1-b505-1eaf0dde36ed", "name": "network-vif-deleted", "tag": "9f816e4d-3cf6-4857-bc6e-94e6dae09c84"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:26.519668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.520126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.545370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0416fa44-3f31-4125-8add-6e59e8dafbc0 req-10be19a1-a2d9-441f-b797-c154bcd49a58 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.546297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0416fa44-3f31-4125-8add-6e59e8dafbc0 req-10be19a1-a2d9-441f-b797-c154bcd49a58 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.547220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0416fa44-3f31-4125-8add-6e59e8dafbc0 req-10be19a1-a2d9-441f-b797-c154bcd49a58 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.561879 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0416fa44-3f31-4125-8add-6e59e8dafbc0 req-10be19a1-a2d9-441f-b797-c154bcd49a58 service nova] Creating event network-vif-deleted:9f816e4d-3cf6-4857-bc6e-94e6dae09c84 for instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed on n-h2-863052-1 Oct 31 14:10:26.567896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0416fa44-3f31-4125-8add-6e59e8dafbc0 req-10be19a1-a2d9-441f-b797-c154bcd49a58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067489 Oct 31 14:10:26.569051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1030/1845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:26.580539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:26.581816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:26.591663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.592851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.594782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.595899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.596589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.597193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.633794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:26.646749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.648078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.648972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.650494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lazy-loading 'fault' on Instance uuid 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:26.716520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:26.724737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06c8ff85-5039-4cce-a218-c02a4386f264 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1103 microversion: 2.1 time: 0.153806 Oct 31 14:10:26.742270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1031/1846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:26 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1103 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:26.742270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:26.742270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] [instance: 8ee370bd-68f7-4d9d-95ea-a1105a138eb8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:26.750486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.750913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.751416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.752672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.753137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.753569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.795058 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] HTTP exception thrown: Instance 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 could not be found. Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Request method failure captured: Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 HTTP/1.1 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9abgV7S3Ftub9H6ExC_CTWJWwPkBA2nJooLIavojzPnjkhoXj2l_ji5p8fnocYP2qwir4311sAtm1X3--qb68MUZAqJW6VrCGdQ_kidAb1w-Gy8_pMF_tgt9yAzK3zoRDvxpCnsn9LSlTSdCdocFqjTAjkrsdRMieY2QF9oYeqbbxQ Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.91 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 5f608aadb2fa45aa9080f7c3e325d9ca Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2126645541 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f608aadb2fa45aa9080f7c3e325d9ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f608aadb2fa45aa9080f7c3e325d9ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f608aadb2fa45aa9080f7c3e325d9ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f608aadb2fa45aa9080f7c3e325d9ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2126645541 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 5f608aadb2fa45aa9080f7c3e325d9ca Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2126645541 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-UnshelveToHostMultiNodesTest-2126645541-project Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bffcda2a16454874b56ed8359c5e4932 Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2126645541-project Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 could not be found. Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '8ee370bd-68f7-4d9d-95ea-a1105a138eb8'} Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 could not be found. Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 could not be found. Oct 31 14:10:26.796804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 could not be found. Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] Returning 404 to user: Instance 8ee370bd-68f7-4d9d-95ea-a1105a138eb8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:26.801896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70c2131c-c9a4-4b9a-b72e-5b21ea19677c tempest-UnshelveToHostMultiNodesTest-2126645541 tempest-UnshelveToHostMultiNodesTest-2126645541-project] 10.222.0.27 "GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8" status: 404 len: 111 microversion: 2.91 time: 0.065853 Oct 31 14:10:26.804504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1032/1847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:26 2022] GET /compute/v2.1/servers/8ee370bd-68f7-4d9d-95ea-a1105a138eb8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:10:26.806036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a317be015453992ae7af8d8cae940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe822dcacc944fe386f071c93f133c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:26.810748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:26.811591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:26.819061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.820295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.820925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.821178 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-54d8aaa3-cc7c-4290-9ad5-c834482ddfdc tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 200 len: 1366 microversion: 2.1 time: 0.363927 Oct 31 14:10:26.821990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.822635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.823224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.826317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 816/1848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:26 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:26.831074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:26.831688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:26.851698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.852313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.852844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:26.855659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:26.856153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:26.856699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:27.010356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:27.027178 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8caa6387-2a0e-4828-a07d-48d684d0046d tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1468 microversion: 2.1 time: 0.222884 Oct 31 14:10:27.028122 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1033/1849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:26 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:27.033956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:27.035806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:27.049023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:27.050641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:27.051147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:27.051873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:27.052357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:27.052797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:27.070160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:27.366087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:27.380600 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b2fc58c-015c-49a4-a705-7ec3c0527186 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.347659 Oct 31 14:10:27.397281 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1034/1850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:27 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:27.480589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:27.487206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:27.500677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:27.505420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:27.506160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:27.508157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:27.508831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:27.510826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:27.806863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:27.823056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:27.824605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:27.825788 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f589b9b6-cb88-49ab-9e29-2965f3a1d024 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.351428 Oct 31 14:10:27.827114 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1035/1851] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:27 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:10:27.834644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:27.839669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:27.863592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:27.864506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:27.865122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:27.866034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:27.867326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:27.867915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.131902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:28.140027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c206281-770a-4880-b004-7623e22e638a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1612 microversion: 2.1 time: 0.309104 Oct 31 14:10:28.145519 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1036/1852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:27 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1612 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:28.154960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:28.158794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:28.174673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.175291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.175976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.176948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.187940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.199030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.316629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:28.330856 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b2c9213b-5eaf-4be1-8ee9-1c1a0fb4ba0b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 1.503383 Oct 31 14:10:28.334074 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 817/1853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:26 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:28.353790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:28.356962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] [instance: 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:28.377196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.380686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.381216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.382025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.382523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.382958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.429405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] HTTP exception thrown: Instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed could not be found. Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Request method failure captured: Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed HTTP/1.1 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9cEv--ZCYDX7KxE6I1UnNMrwG3GJ7sbj-TEWSGTLj4Wn4SAdTPsPY_5o6bP1Bfj2FeD1oWxahfPZjyEn8-_cWNSpgtejfKfLqqe7jrWv0kGyGNIjcQd_Uo5QSU9G9P89MloVBGLuLIPLUQmUlNVdU9gXPw4pTR9jGIQ-X0SSZvAwm0 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fe822dcacc944fe386f071c93f133c1b Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestManualDisk-1217529519 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe822dcacc944fe386f071c93f133c1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe822dcacc944fe386f071c93f133c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe822dcacc944fe386f071c93f133c1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe822dcacc944fe386f071c93f133c1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestManualDisk-1217529519 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fe822dcacc944fe386f071c93f133c1b Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestManualDisk-1217529519 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestManualDisk-1217529519-project Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 2c9a317be015453992ae7af8d8cae940 Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestManualDisk-1217529519-project Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed could not be found. Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '92dd8dd3-9df4-41a1-b505-1eaf0dde36ed'} Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed could not be found. Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed could not be found. Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:28.436005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed could not be found. Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Returning 404 to user: Instance 92dd8dd3-9df4-41a1-b505-1eaf0dde36ed could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:28.441587 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db3217e1-5043-4219-94d3-23e22abb9bfe tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed" status: 404 len: 111 microversion: 2.1 time: 0.102182 Oct 31 14:10:28.442426 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 818/1854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:28 2022] GET /compute/v2.1/servers/92dd8dd3-9df4-41a1-b505-1eaf0dde36ed => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:28.447828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:28.448462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:28.482445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:28.488332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.488929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.489393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.490159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.490651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.491159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.501627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-440ad9f9-d88a-4e94-a8c1-ab14fe6416e7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1151 microversion: 2.1 time: 0.351030 Oct 31 14:10:28.502967 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1037/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:28 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:28.517275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:28.518945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:28.543590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.543590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.543590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.549372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.549874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.552503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.857647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:28.870048 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b7c24d9-d17d-4e1f-a285-53bd0571242a tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1468 microversion: 2.1 time: 0.424270 Oct 31 14:10:28.886203 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 819/1856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:28 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1468 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:28.886203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-522a193d-416f-44c5-b091-13d3e54a8224 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] Calling method '.version_select at 0x7fe107cc0b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:28.926142 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-522a193d-416f-44c5-b091-13d3e54a8224 tempest-ServersTestManualDisk-1217529519 tempest-ServersTestManualDisk-1217529519-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846036178" status: 202 len: 0 microversion: 2.1 time: 0.053962 Oct 31 14:10:28.930462 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 820/1857] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846036178 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:10:28.936202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a21fbf-69f8-442f-b63a-d56704726665", "name": "network-vif-deleted", "tag": "355b449e-9f8e-4623-88b2-fb81ae82a649"}, {"server_uuid": "46a21fbf-69f8-442f-b63a-d56704726665", "name": "network-vif-deleted", "tag": "98788494-d851-4a1b-8291-148a68676b22"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:28.962417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:28.962932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:28.963371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:28.990268 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] Creating event network-vif-deleted:355b449e-9f8e-4623-88b2-fb81ae82a649 for instance 46a21fbf-69f8-442f-b63a-d56704726665 on n-h1-863052-1 Oct 31 14:10:28.990797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] Creating event network-vif-deleted:98788494-d851-4a1b-8291-148a68676b22 for instance 46a21fbf-69f8-442f-b63a-d56704726665 on n-h1-863052-1 Oct 31 14:10:29.010851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3133f74b-8826-46d1-9c4d-5b07e2250c0e req-2a408901-78f7-451a-8f88-4a98be561f0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081020 Oct 31 14:10:29.016390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 821/1858] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:29.035357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:29.036077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:29.052415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.054832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.055561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.056318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.059352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.059902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.137465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:29.199123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:29.338139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:29.357676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:29.360416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:29.361923 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cebb5a89-7fe3-4c3c-a4d0-86d1860fb299 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.344003 Oct 31 14:10:29.363039 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 822/1859] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:29 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:29.368287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:29.375417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:29.416354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.418891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.423243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.424140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.424633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.425077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.479151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:29.487849 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b1cc9ec-52a8-4898-a8b5-c8acd95e6f79 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.982205 Oct 31 14:10:29.510664 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1038/1860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:28 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:29.521344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:29.527443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:29.544192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.544734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.545534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.545935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.546364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.547313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lazy-loading 'fault' on Instance uuid 46a21fbf-69f8-442f-b63a-d56704726665 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:29.547635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.548455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.552083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.552677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.733628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f86aaab2684cf6b1fcdefc1d0996f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ee6fca78314de1ae6f33dd2b433a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:29.803172 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-059185ac-65e2-4c90-a649-8764967fac48 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 200 len: 1303 microversion: 2.1 time: 0.438683 Oct 31 14:10:29.810919 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 823/1861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:29 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 1303 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:29.852074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:29.856318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:29.899145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.899986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.905389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:29.907803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:29.911137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:29.913028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:30.151638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:30.167394 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ec46b97-a44f-479d-828a-45a598354f06 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1169 microversion: 2.1 time: 0.353137 Oct 31 14:10:30.171229 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 824/1862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:29 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1169 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:30.186402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:30.187525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:30.204429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:30.207185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:30.207937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:30.208841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:30.210923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:30.212039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:30.382551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1526c17fd6164655852807d8be044072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76489790a3e4477aba14b231646a3f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:30.394724 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-afec5dd8-f54e-4ac1-a513-849f27420262 tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 200 len: 1298 microversion: 2.1 time: 0.221286 Oct 31 14:10:30.406103 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 825/1863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:30 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 1298 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:30.423143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:30.424850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:30.434848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:30.435880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:30.437067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:30.440392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:30.441260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:30.442188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:30.922055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:30.937741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:30.941907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:30.943472 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95383ff7-5f13-4992-bac8-77dfbfc935e5 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.535909 Oct 31 14:10:30.945597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 826/1864] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:30 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:30.950924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:30.952449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:30.959642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:30.960639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:30.961309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:30.962299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:30.962976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:30.963622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.440012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:31.448891 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce06d72d-93d8-451e-9cca-5f3fc24a291f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.501677 Oct 31 14:10:31.455216 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 827/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:30 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:31.460427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:31.466719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:31.477683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.481582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.482303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.483240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.483916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.484557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.490739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:31.515858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] HTTP exception thrown: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Request method failure captured: Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 HTTP/1.1 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bX7Vp5IGg8xURBtnSIZcL8UU72TvEfeBTL7tCMKemzCqQdpAPgj89rWXDBBvDBJgsVRab0uz2yx2G59lmYilfclvuZdfcVaROMWlKu-IT3lwEyo-8Sgl-9MFAaHCev4gLiXXHLIhirOYSK4LqJA1Sei1q8elPxMM_4Shm7mkVw5p4 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ee6fca78314de1ae6f33dd2b433a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 78f86aaab2684cf6b1fcdefc1d0996f6 Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '46a21fbf-69f8-442f-b63a-d56704726665'} Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:31.524537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:31.529933 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.538899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Returning 404 to user: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:31.540772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e0f6e3b-25b2-4a8a-8d64-401f1132184a tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 404 len: 111 microversion: 2.1 time: 0.084272 Oct 31 14:10:31.546107 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 828/1866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:31 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:31.551819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fd6a26bb-61be-412d-ae1d-85accfe0f939 req-5e9ebe5a-1877-471e-ace9-5c54db289444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63894684-26f1-4c97-99c4-7026983ea01e", "name": "network-vif-deleted", "tag": "b69c64f3-b22b-46c4-8bbc-2f57a49803cf"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:31.564182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fd6a26bb-61be-412d-ae1d-85accfe0f939 req-5e9ebe5a-1877-471e-ace9-5c54db289444 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.565018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fd6a26bb-61be-412d-ae1d-85accfe0f939 req-5e9ebe5a-1877-471e-ace9-5c54db289444 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.565837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fd6a26bb-61be-412d-ae1d-85accfe0f939 req-5e9ebe5a-1877-471e-ace9-5c54db289444 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.579040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fd6a26bb-61be-412d-ae1d-85accfe0f939 req-5e9ebe5a-1877-471e-ace9-5c54db289444 service nova] Creating event network-vif-deleted:b69c64f3-b22b-46c4-8bbc-2f57a49803cf for instance 63894684-26f1-4c97-99c4-7026983ea01e on n-h2-863052-1 Oct 31 14:10:31.584343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fd6a26bb-61be-412d-ae1d-85accfe0f939 req-5e9ebe5a-1877-471e-ace9-5c54db289444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036575 Oct 31 14:10:31.585598 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 829/1867] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:31.591401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:31.592465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:31.599491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.600800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.601503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.602484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.603166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.603818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.813547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:31.826396 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70095357-cc00-4df7-8144-ce9825057b12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 2.312829 Oct 31 14:10:31.829710 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1039/1868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:29 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:31.849128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:31.854435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] [instance: 63894684-26f1-4c97-99c4-7026983ea01e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:31.882288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.883086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.883608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.888489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:31.889174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:31.894213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:31.946123 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] HTTP exception thrown: Instance 63894684-26f1-4c97-99c4-7026983ea01e could not be found. Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Request method failure captured: Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e HTTP/1.1 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9a1jhmKw8HCIqZ8XbXnVgiqS_EW3jqSj-Pgz8iDNSRkbdGgAYDMz-9CRbeJX33YdDgxexV6654VuTMTi8DhocxtW9qJqLVgctQk_P5KqSnfFgynBgB7lkl3vleM4kT7wzWUBwvn18vOhIo3ZAFJvCno3tUhliHzU0OYWxjBEtVFQRI Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 76489790a3e4477aba14b231646a3f98 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76489790a3e4477aba14b231646a3f98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76489790a3e4477aba14b231646a3f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76489790a3e4477aba14b231646a3f98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76489790a3e4477aba14b231646a3f98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 76489790a3e4477aba14b231646a3f98 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminTestJSON-1374589142 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminTestJSON-1374589142-project Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1526c17fd6164655852807d8be044072 Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminTestJSON-1374589142-project Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 63894684-26f1-4c97-99c4-7026983ea01e could not be found. Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '63894684-26f1-4c97-99c4-7026983ea01e'} Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63894684-26f1-4c97-99c4-7026983ea01e could not be found. Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63894684-26f1-4c97-99c4-7026983ea01e could not be found. Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:31.948777 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63894684-26f1-4c97-99c4-7026983ea01e could not be found. Oct 31 14:10:31.953550 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:31.955903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] Returning 404 to user: Instance 63894684-26f1-4c97-99c4-7026983ea01e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:31.964603 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb31fd74-a435-49ea-9d37-89dbce0cd4eb tempest-ServersAdminTestJSON-1374589142 tempest-ServersAdminTestJSON-1374589142-project] 10.222.0.27 "GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e" status: 404 len: 111 microversion: 2.1 time: 0.133641 Oct 31 14:10:31.972429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1040/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:31 2022] GET /compute/v2.1/servers/63894684-26f1-4c97-99c4-7026983ea01e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:31.977873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:31.979495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:31.992578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:32.002937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:32.003740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:32.004700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:32.005935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:32.007436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:32.388667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:32.404780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:32.410915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:32.414548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ec1374d-640d-499f-984f-467295316db7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.440965 Oct 31 14:10:32.419079 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1041/1870] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:31 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:32.477439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:32.478121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:32.499250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:32.500126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:32.500841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:32.502862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:32.504810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:32.505456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:32.760853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:32.773984 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42c0159c-620e-4d9a-845b-cbf215054361 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1211 microversion: 2.1 time: 1.186482 Oct 31 14:10:32.774766 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 830/1871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:31 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1211 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:32.857407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:32.858280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:32.871167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:32.873471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:32.875645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:32.877772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:32.882954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:32.883721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:32.943087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:32.970093 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2159914-3674-4cb3-8d0c-eb27c46e773f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.496417 Oct 31 14:10:32.984108 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1042/1872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:32 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:33.451592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:33.452689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:33.476090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:33.477445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:33.478144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:33.479211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:33.481350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:33.484547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:33.718201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:33.726691 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c128ffa-1b6a-472a-a944-457a6b87c908 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.874831 Oct 31 14:10:33.747375 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 831/1873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:32 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:33.799091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:33.799869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:33.812327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:33.812882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:33.813458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:33.814469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:33.814797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:33.816216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:33.849082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:33.868418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:33.892712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:33.896740 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c9c8f91-becb-4a24-8fa8-ecca6eeaa878 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.449328 Oct 31 14:10:33.906260 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1043/1874] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:33 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:34.013633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:34.016900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:34.031810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:34.035380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:34.038484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:34.040376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:34.046910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:34.050242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:34.923790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:34.939962 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71d0fde4-38ce-48a4-b4d6-6bc78c40c899 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.936696 Oct 31 14:10:34.942607 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1044/1875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:34 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:34.966041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:34.970202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:34.980044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:34.981402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:34.982562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:34.983536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:34.984348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:34.985033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:35.125251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:35.158240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:35.565824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:35.579082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4e0e376-168e-478a-930b-fb7264fa8cf1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.634101 Oct 31 14:10:35.591128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1045/1876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:34 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:35.591128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5843248b-e436-4e47-99e7-3424a2ac1fe0 req-4386bd91-10b5-476f-ab77-4af5411a07d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0ca596-84a5-4c7e-9bb9-61db23198bbd", "tag": "1cd69f06-d33d-4e41-a094-e2d1440a38cd"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:35.625178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5843248b-e436-4e47-99e7-3424a2ac1fe0 req-4386bd91-10b5-476f-ab77-4af5411a07d5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:35.625671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5843248b-e436-4e47-99e7-3424a2ac1fe0 req-4386bd91-10b5-476f-ab77-4af5411a07d5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:35.626111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5843248b-e436-4e47-99e7-3424a2ac1fe0 req-4386bd91-10b5-476f-ab77-4af5411a07d5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:35.640657 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5843248b-e436-4e47-99e7-3424a2ac1fe0 req-4386bd91-10b5-476f-ab77-4af5411a07d5 service nova] Creating event network-changed:1cd69f06-d33d-4e41-a094-e2d1440a38cd for instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd on n-h2-863052-1 Oct 31 14:10:35.656416 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5843248b-e436-4e47-99e7-3424a2ac1fe0 req-4386bd91-10b5-476f-ab77-4af5411a07d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075080 Oct 31 14:10:35.657440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1046/1877] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:35.671153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:35.671871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:35.690659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:35.691195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:35.691687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:35.692435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:35.692923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:35.693353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:35.746440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:35.764710 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eeb84c3c-df1c-4212-a4c7-259e1af39714 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1211 microversion: 2.1 time: 1.971120 Oct 31 14:10:35.789837 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 832/1878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:33 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1211 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:10:35.807713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efbc364e-42eb-4f86-86d6-a45660f3cda7 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe107da20d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:35.934045 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efbc364e-42eb-4f86-86d6-a45660f3cda7 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5" status: 200 len: 637 microversion: 2.1 time: 0.142531 Oct 31 14:10:35.940857 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 833/1879] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:10:35 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5 => generated 637 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:35.957560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7f11a2d-a92e-4f18-9960-432e1484d705 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe10799db80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:36.080720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d7f11a2d-a92e-4f18-9960-432e1484d705 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:36.105163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d7f11a2d-a92e-4f18-9960-432e1484d705 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:36.613908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:36.624709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:36.625583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:36.643170 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18d3d67c-6e31-4f89-9a67-ecdfaf807f3f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.984481 Oct 31 14:10:36.643835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1047/1880] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:35 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:36.648626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:36.658482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:36.672554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:36.679709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:36.680927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:36.685913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:36.686738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:36.689048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:36.698846 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7f11a2d-a92e-4f18-9960-432e1484d705 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.746449 Oct 31 14:10:36.703765 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 834/1881] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:35 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:36.712499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:36.713152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:36.735846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:36.738073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:36.739938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:36.742387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:36.744565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:36.746654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:37.754724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:37.768502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-addfaafd-f1d6-4b6b-bfdf-3ef3adcd7089 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 1.121392 Oct 31 14:10:37.770460 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1048/1882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:36 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:37.787360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49ef67a5-07fd-45aa-bde4-57269972ba82 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe107410820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:38.258315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:38.308889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d18b2ae9-be3f-4997-9016-2ee5827ac034 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 1.603074 Oct 31 14:10:38.315307 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 835/1883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:36 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:38.328545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:38.334646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:38.351139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:38.352259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:38.353310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:38.354927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:38.356207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:38.357890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:38.493364 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49ef67a5-07fd-45aa-bde4-57269972ba82 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "DELETE /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.718428 Oct 31 14:10:38.494360 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1049/1884] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 31 14:10:37 2022] DELETE /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata/os_version => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:10:38.499296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ff503f4a-3484-4eea-8c52-faf6647e2d07 req-c80fa29d-c9ae-4811-b789-e56b61034f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a9579f-9d77-4a92-88aa-5af95afa49cd", "name": "network-vif-unplugged", "status": "completed", "tag": "7c74f8b2-e9e7-4faa-9e5f-c47770131567"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:38.542551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ff503f4a-3484-4eea-8c52-faf6647e2d07 req-c80fa29d-c9ae-4811-b789-e56b61034f48 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:38.548476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ff503f4a-3484-4eea-8c52-faf6647e2d07 req-c80fa29d-c9ae-4811-b789-e56b61034f48 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:38.552401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ff503f4a-3484-4eea-8c52-faf6647e2d07 req-c80fa29d-c9ae-4811-b789-e56b61034f48 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:38.590772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ff503f4a-3484-4eea-8c52-faf6647e2d07 req-c80fa29d-c9ae-4811-b789-e56b61034f48 service nova] Creating event network-vif-unplugged:7c74f8b2-e9e7-4faa-9e5f-c47770131567 for instance b8a9579f-9d77-4a92-88aa-5af95afa49cd on n-h1-863052-1 Oct 31 14:10:38.612041 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ff503f4a-3484-4eea-8c52-faf6647e2d07 req-c80fa29d-c9ae-4811-b789-e56b61034f48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116326 Oct 31 14:10:38.612658 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1050/1885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:38.617782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:38.627446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:38.646361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:38.655154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:38.658015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:38.658980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:38.661263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:38.661885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:39.269975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:39.305979 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67bae223-6702-4321-8c4d-66afb2189d47 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1211 microversion: 2.1 time: 0.987967 Oct 31 14:10:39.307284 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 836/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:38 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1211 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:39.347007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-348772f7-4f65-444f-b8ef-ea305bca096f tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe107e94940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:39.522494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:39.550423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:39.556508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:39.558967 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c732360d-1a59-40cd-94f7-e03359675268 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.945197 Oct 31 14:10:39.560819 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1051/1887] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:38 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:39.572438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:39.573273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:39.586715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-348772f7-4f65-444f-b8ef-ea305bca096f tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 37 microversion: 2.1 time: 0.249470 Oct 31 14:10:39.592676 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 837/1888] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:10:39 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 37 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:39.592906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:39.593334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:39.594868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:39.596144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:39.599842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:39.600926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:39.604288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:39.605049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:39.618038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:39.619069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:39.619640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:39.620475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:39.621038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:39.621734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:40.312941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:40.329646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a232d0ac-251d-46ce-8775-b924690f0fb5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.737850 Oct 31 14:10:40.330911 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 838/1889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:39 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:40.341970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-edb5b6c2-be75-4761-b4fc-031f75e65554 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe1079e7160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:40.444746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-edb5b6c2-be75-4761-b4fc-031f75e65554 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:40.472958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-edb5b6c2-be75-4761-b4fc-031f75e65554 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:40.671513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:40.697656 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d654f235-c749-4a4e-81bb-f53857f04c00 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 1.122654 Oct 31 14:10:40.698956 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1052/1890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:39 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:40.703898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:40.710545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:40.750294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:40.750798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:40.751236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:40.751945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:40.752399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:40.752812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.029857 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-edb5b6c2-be75-4761-b4fc-031f75e65554 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.696777 Oct 31 14:10:41.035643 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 839/1891] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:40 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:41.044086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:41.045806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:41.066067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.067058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.071713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.072757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.076154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.077760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.114016 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] HTTP exception thrown: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Request method failure captured: Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 HTTP/1.1 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9bX7Vp5IGg8xURBtnSIZcL8UU72TvEfeBTL7tCMKemzCqQdpAPgj89rWXDBBvDBJgsVRab0uz2yx2G59lmYilfclvuZdfcVaROMWlKu-IT3lwEyo-8Sgl-9MFAaHCev4gLiXXHLIhirOYSK4LqJA1Sei1q8elPxMM_4Shm7mkVw5p4 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ee6fca78314de1ae6f33dd2b433a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 78f86aaab2684cf6b1fcdefc1d0996f6 Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '46a21fbf-69f8-442f-b63a-d56704726665'} Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:41.116646 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.122151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Returning 404 to user: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:41.127118 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-62fe191f-b1f7-4ca4-896f-df29bb3383ac tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 404 len: 111 microversion: 2.1 time: 0.086703 Oct 31 14:10:41.127118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 840/1892] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:41 2022] DELETE /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:41.132409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:41.133121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:41.140195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.141411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.141930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.142896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.143829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.144467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.470514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:41.475012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:41.500449 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eec73e22-47aa-4e8d-b635-b62105f46f11 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.800173 Oct 31 14:10:41.504589 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1053/1893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:40 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:41.512783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d875df65-a456-40f0-b1e3-f77a3d8f38c4 req-01ddd51c-1236-4adb-8317-e75b9c619d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a9579f-9d77-4a92-88aa-5af95afa49cd", "tag": "7c74f8b2-e9e7-4faa-9e5f-c47770131567"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:41.528303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d875df65-a456-40f0-b1e3-f77a3d8f38c4 req-01ddd51c-1236-4adb-8317-e75b9c619d51 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.529938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d875df65-a456-40f0-b1e3-f77a3d8f38c4 req-01ddd51c-1236-4adb-8317-e75b9c619d51 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.530596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d875df65-a456-40f0-b1e3-f77a3d8f38c4 req-01ddd51c-1236-4adb-8317-e75b9c619d51 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.545267 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d875df65-a456-40f0-b1e3-f77a3d8f38c4 req-01ddd51c-1236-4adb-8317-e75b9c619d51 service nova] Creating event network-changed:7c74f8b2-e9e7-4faa-9e5f-c47770131567 for instance b8a9579f-9d77-4a92-88aa-5af95afa49cd on n-h1-863052-1 Oct 31 14:10:41.551282 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d875df65-a456-40f0-b1e3-f77a3d8f38c4 req-01ddd51c-1236-4adb-8317-e75b9c619d51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044415 Oct 31 14:10:41.552457 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1054/1894] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:41.560528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0ce2d15-287d-4cdd-9b6d-477096b8172b tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe107465c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:41.591516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:41.613506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:41.616102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:41.616594 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0ce2d15-287d-4cdd-9b6d-477096b8172b tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.061177 Oct 31 14:10:41.617395 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-54940ce4-1704-4d40-8c29-ebe3e6256faa tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.491081 Oct 31 14:10:41.632311 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1055/1895] 10.222.0.27 () {58 vars in 1290 bytes} [Mon Oct 31 14:10:41 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata/os_distro => generated 33 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:41.633559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 841/1896] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:41 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:41.646657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:41.648562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 46a21fbf-69f8-442f-b63a-d56704726665] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:41.654940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:41.655836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:41.656571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.657300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.657965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.658934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.659622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.660292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.674141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.677344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.677807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.681208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:41.681690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:41.682128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:41.686286 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] HTTP exception thrown: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Request method failure captured: Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 HTTP/1.1 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bX7Vp5IGg8xURBtnSIZcL8UU72TvEfeBTL7tCMKemzCqQdpAPgj89rWXDBBvDBJgsVRab0uz2yx2G59lmYilfclvuZdfcVaROMWlKu-IT3lwEyo-8Sgl-9MFAaHCev4gLiXXHLIhirOYSK4LqJA1Sei1q8elPxMM_4Shm7mkVw5p4 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ee6fca78314de1ae6f33dd2b433a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 78f86aaab2684cf6b1fcdefc1d0996f6 Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '46a21fbf-69f8-442f-b63a-d56704726665'} Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:41.690009 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. Oct 31 14:10:41.698326 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:41.701757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Returning 404 to user: Instance 46a21fbf-69f8-442f-b63a-d56704726665 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:41.703182 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1245e768-90ad-467a-a6d8-a75576f37ce4 tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665" status: 404 len: 111 microversion: 2.1 time: 0.068913 Oct 31 14:10:41.707680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1056/1897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:41 2022] GET /compute/v2.1/servers/46a21fbf-69f8-442f-b63a-d56704726665 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:41.716619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f232ddd-34e1-4a58-b178-81525aa5f8ac tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe107465940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:41.808318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8f232ddd-34e1-4a58-b178-81525aa5f8ac tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:41.814803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8f232ddd-34e1-4a58-b178-81525aa5f8ac tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:42.056349 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f232ddd-34e1-4a58-b178-81525aa5f8ac tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.347222 Oct 31 14:10:42.063470 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1057/1898] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:41 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:42.094680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:42.095856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:42.104989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.106531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.107399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.110542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.122293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.123584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.159539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] HTTP exception thrown: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Request method failure captured: Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa HTTP/1.1 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bX7Vp5IGg8xURBtnSIZcL8UU72TvEfeBTL7tCMKemzCqQdpAPgj89rWXDBBvDBJgsVRab0uz2yx2G59lmYilfclvuZdfcVaROMWlKu-IT3lwEyo-8Sgl-9MFAaHCev4gLiXXHLIhirOYSK4LqJA1Sei1q8elPxMM_4Shm7mkVw5p4 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ee6fca78314de1ae6f33dd2b433a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 78f86aaab2684cf6b1fcdefc1d0996f6 Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '20d55069-5f48-4e2c-b1de-c526440f9dfa'} Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:42.161890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.168134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Returning 404 to user: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:42.170571 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcb0cd75-8f0e-43fc-8471-0a2203c968aa tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 404 len: 111 microversion: 2.1 time: 0.104324 Oct 31 14:10:42.173989 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1058/1899] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:10:42 2022] DELETE /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:42.176871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:42.177803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:42.202419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.203998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.204720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.205760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.206479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.207113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.376213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:42.384696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbec8128-2ad5-4939-88ef-6e9d7fec656f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.212935 Oct 31 14:10:42.390848 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1059/1900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:42 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:42.397028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4568982a-e26f-4e36-97ed-29c381774eed tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe107406f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:42.438460 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4568982a-e26f-4e36-97ed-29c381774eed tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.045890 Oct 31 14:10:42.440349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1060/1901] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:10:42 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:42.454276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:42.455157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] [instance: 20d55069-5f48-4e2c-b1de-c526440f9dfa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:42.463586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.464088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.464602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.465314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.466475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.466936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.487122 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] HTTP exception thrown: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Request method failure captured: Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa HTTP/1.1 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9bX7Vp5IGg8xURBtnSIZcL8UU72TvEfeBTL7tCMKemzCqQdpAPgj89rWXDBBvDBJgsVRab0uz2yx2G59lmYilfclvuZdfcVaROMWlKu-IT3lwEyo-8Sgl-9MFAaHCev4gLiXXHLIhirOYSK4LqJA1Sei1q8elPxMM_4Shm7mkVw5p4 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ee6fca78314de1ae6f33dd2b433a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ee6fca78314de1ae6f33dd2b433a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58ee6fca78314de1ae6f33dd2b433a5e Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestMultiNic-1763388373 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 78f86aaab2684cf6b1fcdefc1d0996f6 Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestMultiNic-1763388373-project Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '20d55069-5f48-4e2c-b1de-c526440f9dfa'} Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:42.489711 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. Oct 31 14:10:42.496204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:42.499459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] Returning 404 to user: Instance 20d55069-5f48-4e2c-b1de-c526440f9dfa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:42.500503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f991ff20-c666-4629-a8eb-7f3fd49d741e tempest-ServersTestMultiNic-1763388373 tempest-ServersTestMultiNic-1763388373-project] 10.222.0.27 "GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa" status: 404 len: 111 microversion: 2.1 time: 0.059010 Oct 31 14:10:42.503749 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1061/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:42 2022] GET /compute/v2.1/servers/20d55069-5f48-4e2c-b1de-c526440f9dfa => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:42.511992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e6a8135-1eaf-4937-95d8-cad553017065 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe107406940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:42.543619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:42.559600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4fadae3-5141-45f8-abb1-b6db838d0f1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1681 microversion: 2.1 time: 0.916694 Oct 31 14:10:42.559600 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 842/1903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:41 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1681 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:42.563970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:42.564578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:42.576060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-6e6a8135-1eaf-4937-95d8-cad553017065 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:42.582872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.583373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.583658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-6e6a8135-1eaf-4937-95d8-cad553017065 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:42.583804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.584548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.585004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.585427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.815259 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e6a8135-1eaf-4937-95d8-cad553017065 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.310059 Oct 31 14:10:42.816106 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1062/1904] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:42 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:42.822716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:42.823604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:42.829879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:42.832589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.833536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.834530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.835303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:42.835939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:42.836411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:42.922341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:42.936517 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c491515a-9863-4e11-a213-f9ba85e01373 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.376452 Oct 31 14:10:42.937597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 843/1905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:42 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:43.118086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:43.120031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:43.124931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.125636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.127204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.128228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.128901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.129553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.131107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:43.132882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:43.135443 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f24b1d9-9d95-43c9-a439-04c28cf8e965 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.318214 Oct 31 14:10:43.136008 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1063/1906] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:42 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:43.141873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5859624e-0c37-4caf-ba4f-cd0c0725a4e0 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe107465790>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:43.159373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06146ab4-b9a9-4ded-a294-500ed2e11f7b tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.220412 Oct 31 14:10:43.160157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 844/1907] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:10:42 2022] GET /compute/v2.1/os-services => generated 944 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:43.174856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:43.181049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.182511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.183260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.184209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.185465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.186076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.223507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c03e9aa-d815-4ede-a410-8dd732b07d46 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-863052-1" status: 200 len: 578 microversion: 2.1 time: 0.052667 Oct 31 14:10:43.226128 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 845/1908] 10.222.0.27 () {58 vars in 1172 bytes} [Mon Oct 31 14:10:43 2022] GET /compute/v2.1/os-services?host=n-d-863052-1 => generated 578 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:10:43.258708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:43.265802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5859624e-0c37-4caf-ba4f-cd0c0725a4e0 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:43.278526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5859624e-0c37-4caf-ba4f-cd0c0725a4e0 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:43.294070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.294717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.296106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.297002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.297428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.297828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.397608 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2753bb9b-399d-4adc-8e99-4e4c414b6c86 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.160077 Oct 31 14:10:43.398294 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 846/1909] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:10:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:10:43.420549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:43.424921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:43.436605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.437065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.437504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.439766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.440234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.440670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.827577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5859624e-0c37-4caf-ba4f-cd0c0725a4e0 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 64 microversion: 2.1 time: 0.689331 Oct 31 14:10:43.828973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1064/1910] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:43 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 64 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:43.837599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:43.845812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.852683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.854243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.855623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.856321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.856983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.862943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:43.874908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a9ef4a88-51e0-4316-b799-8769100e7c28 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.467411 Oct 31 14:10:43.875503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 847/1911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:43 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:43.903460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:43.904402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:43.918546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.921033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.921657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.923303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:43.925162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3710aac8-1d4c-406a-842e-c17d5fd83094 tempest-ServicesAdminTestJSON-2036565653 tempest-ServicesAdminTestJSON-2036565653-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.094300 Oct 31 14:10:43.925909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:43.926756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:43.927808 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1065/1912] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:10:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:43.933253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de5c66bd-3821-48f4-bc12-f615149d2919 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe1074069d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:44.032106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de5c66bd-3821-48f4-bc12-f615149d2919 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 64 microversion: 2.1 time: 0.102543 Oct 31 14:10:44.032909 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1066/1913] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:10:43 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 64 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:44.043401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:44.044407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:44.062056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:44.063157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:44.063841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:44.064871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:44.065560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:44.066316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:44.382282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:44.394101 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-549223b6-2806-46f1-b904-58751a28d342 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.501156 Oct 31 14:10:44.407529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 848/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:43 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:44.431130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4eed9a25-c061-4b23-b5e7-a70fc1d6b5ab tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe10c480280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:44.485482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:44.518946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fa06c06-580c-443a-b60e-b4fe5c9a52ed tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.484276 Oct 31 14:10:44.520027 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1067/1915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:44 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:44.526665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:44.528374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:44.535705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:44.536464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:44.537061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:44.539243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:44.540186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:44.540945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:44.541753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4eed9a25-c061-4b23-b5e7-a70fc1d6b5ab tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:44.557213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4eed9a25-c061-4b23-b5e7-a70fc1d6b5ab tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:45.041133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:45.051371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:45.054331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:45.055854 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdbdba0a-44be-4d1f-a703-b8abde92439e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.534034 Oct 31 14:10:45.057115 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1068/1916] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:44 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:45.061861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:45.062776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:45.070322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:45.071486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:45.072155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:45.073100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:45.074040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:45.074707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:45.159457 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4eed9a25-c061-4b23-b5e7-a70fc1d6b5ab tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.750599 Oct 31 14:10:45.160156 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 849/1917] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:44 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:45.165508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:45.166193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:45.173399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:45.173868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:45.174452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:45.175198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:45.175667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:45.176094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:45.426623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:45.449770 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7fb0f25-e722-46ed-a119-232827b4a35a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1522 microversion: 2.1 time: 0.287986 Oct 31 14:10:45.450847 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 850/1918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:45 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:45.459820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7733cbd-94a6-4611-a102-762cf354e2e4 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update', calling method: .version_select at 0x7fe10c480940>, body: {"meta": {"os_version": "alt"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:45.520367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c7733cbd-94a6-4611-a102-762cf354e2e4 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:45.526760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c7733cbd-94a6-4611-a102-762cf354e2e4 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:45.540010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:45.609836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:45.636792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2cff44d-e3b1-44ff-8c56-1ac80047d6eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.578190 Oct 31 14:10:45.639063 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1069/1919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:45 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:45.649752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:45.655494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:45.672767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:45.673628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:45.674386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:45.676093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:45.677164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:45.677918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:45.953489 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7733cbd-94a6-4611-a102-762cf354e2e4 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.501105 Oct 31 14:10:45.954434 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 851/1920] 10.222.0.27 () {60 vars in 1313 bytes} [Mon Oct 31 14:10:45 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata/os_version => generated 31 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:45.965336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1bafe586-c1cb-476a-8ad0-f2bf98b86099 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe10c0d7c10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:46.057241 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1bafe586-c1cb-476a-8ad0-f2bf98b86099 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 58 microversion: 2.1 time: 0.095773 Oct 31 14:10:46.063672 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 852/1921] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:10:45 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 58 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:46.097046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15d7bb30-217e-4b9f-8d8e-e32acc2e75f9 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'update_all', calling method: .version_select at 0x7fe107da2af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:46.186387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-15d7bb30-217e-4b9f-8d8e-e32acc2e75f9 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:46.193583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-15d7bb30-217e-4b9f-8d8e-e32acc2e75f9 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:46.453203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:46.465031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1ada410-ad20-40ea-8b7d-a5dd2e899470 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.823751 Oct 31 14:10:46.469175 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1070/1922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:45 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:46.478681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:46.481443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:46.500838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:46.501735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:46.502145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:46.502934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:46.503408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:46.503867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:46.783846 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15d7bb30-217e-4b9f-8d8e-e32acc2e75f9 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.715656 Oct 31 14:10:46.785129 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 853/1923] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:46 2022] PUT /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 61 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:46.800448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:46.801928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:46.822545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:46.823397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:46.824274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:46.826636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:46.828669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:46.829380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:46.867113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:46.890875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:46.893794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:46.901976 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf2e406e-8818-4210-aa9e-5e943fbadf38 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.431180 Oct 31 14:10:46.902635 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1071/1924] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:46 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:46.907278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-341849b0-296a-4b7c-810f-4651ac2b9486 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Action: 'create', calling method: .version_select at 0x7fe1074e2790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:47.008473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-341849b0-296a-4b7c-810f-4651ac2b9486 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:10:47.015930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-341849b0-296a-4b7c-810f-4651ac2b9486 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Getting quotas for user c5fb638cc2464266ad7114cb60a388e9 and project 320a29881be54b1d80be7a1e8096e089. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:10:47.602845 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-341849b0-296a-4b7c-810f-4651ac2b9486 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "POST /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 85 microversion: 2.1 time: 0.698467 Oct 31 14:10:47.608244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:47.608871 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1072/1925] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 31 14:10:46 2022] POST /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 85 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:47.615090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cfbe7035-6468-4374-999e-d08dc4517e92 req-43e88322-301f-44e2-b0d9-77139158e273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-unplugged", "status": "completed", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:47.627977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cfbe7035-6468-4374-999e-d08dc4517e92 req-43e88322-301f-44e2-b0d9-77139158e273 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:47.628946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cfbe7035-6468-4374-999e-d08dc4517e92 req-43e88322-301f-44e2-b0d9-77139158e273 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:47.629708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cfbe7035-6468-4374-999e-d08dc4517e92 req-43e88322-301f-44e2-b0d9-77139158e273 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:47.632240 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bed87ec-0059-4759-aedd-9fb82ae8dd66 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1502 microversion: 2.1 time: 0.844277 Oct 31 14:10:47.634886 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 854/1926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:46 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1502 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:47.644747 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cfbe7035-6468-4374-999e-d08dc4517e92 req-43e88322-301f-44e2-b0d9-77139158e273 service nova] Creating event network-vif-unplugged:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:10:47.648800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:47.649668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:47.654759 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cfbe7035-6468-4374-999e-d08dc4517e92 req-43e88322-301f-44e2-b0d9-77139158e273 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043323 Oct 31 14:10:47.657548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1073/1927] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:47.671681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fd7120c-aa6e-4ae2-81b4-939c33e92df7 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] Calling method '.version_select at 0x7fe107c85160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:47.695014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:47.697059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:47.697517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:47.704881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:47.707396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:47.707864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:47.735504 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fd7120c-aa6e-4ae2-81b4-939c33e92df7 tempest-ImagesMetadataTestJSON-809322212 tempest-ImagesMetadataTestJSON-809322212-project] 10.222.0.27 "GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata" status: 200 len: 85 microversion: 2.1 time: 0.074875 Oct 31 14:10:47.738247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1074/1928] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:10:47 2022] GET /compute/v2.1/images/c7fa5bed-1692-4fd4-a42a-70d9cc73dbb5/metadata => generated 85 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:47.749295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:47.750923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:47.768617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:47.769228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:47.769794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:47.771865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:47.772359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:47.772799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:48.087588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:48.100570 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2cdfb47-4134-49c0-abb1-47cb86d7fa60 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1517 microversion: 2.1 time: 0.360180 Oct 31 14:10:48.104639 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1075/1929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:47 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:48.117702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:48.121745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:48.163108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:48.167002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:48.167724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:48.171410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:48.172911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:48.174675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:48.324563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:48.350360 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5fb65337-162a-4fbf-a3d9-098948aa7c39 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.711208 Oct 31 14:10:48.356730 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 855/1930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:47 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:48.369972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40d47b30-835e-4db6-90f0-8de4d8a9012d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:48.379781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40d47b30-835e-4db6-90f0-8de4d8a9012d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: bd4aac24-2d4a-474f-9168-24904e73d991] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:48.394753 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-40d47b30-835e-4db6-90f0-8de4d8a9012d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Instance bd4aac24-2d4a-474f-9168-24904e73d991 could not be found. Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40d47b30-835e-4db6-90f0-8de4d8a9012d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/bd4aac24-2d4a-474f-9168-24904e73d991/action HTTP/1.1 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 14 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: {"rescue": {}} Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance bd4aac24-2d4a-474f-9168-24904e73d991 could not be found. Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'bd4aac24-2d4a-474f-9168-24904e73d991', 'body': {'rescue': {}}} Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4aac24-2d4a-474f-9168-24904e73d991 could not be found. Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4aac24-2d4a-474f-9168-24904e73d991 could not be found. Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:48.402847 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:48.407810 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:48.407810 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:48.407810 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:48.407810 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:48.407810 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4aac24-2d4a-474f-9168-24904e73d991 could not be found. Oct 31 14:10:48.407810 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:48.413470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40d47b30-835e-4db6-90f0-8de4d8a9012d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 404 to user: Instance bd4aac24-2d4a-474f-9168-24904e73d991 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:48.414638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40d47b30-835e-4db6-90f0-8de4d8a9012d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/bd4aac24-2d4a-474f-9168-24904e73d991/action" status: 404 len: 111 microversion: 2.1 time: 0.056616 Oct 31 14:10:48.415928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 856/1931] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:48 2022] POST /compute/v2.1/servers/bd4aac24-2d4a-474f-9168-24904e73d991/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:10:48.427027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:48.428468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:48.439575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:48.440317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:48.440800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:48.441637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:48.443868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:48.444586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:48.517516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:48.564821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4faa1df6-b5d8-4c49-9917-89d6ae632bec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action" status: 202 len: 0 microversion: 2.1 time: 0.141021 Oct 31 14:10:48.567553 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 857/1932] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:48 2022] POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:10:48.589146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:48.590468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:48.625029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:48.625705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:48.634012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:48.635024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:48.635292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:48.635751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.040563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:49.054781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63b5365c-4d4a-4159-b76e-36e963732a31 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.484871 Oct 31 14:10:49.055375 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 858/1933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:48 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:49.061149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:49.061770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:49.072000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.072854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.073355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.074392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.074853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.075286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.309884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:49.323723 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd0fe76e-2955-4a09-9d5e-357931c1315c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1502 microversion: 2.1 time: 0.267162 Oct 31 14:10:49.324690 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 859/1934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:49 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:49.334914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:49.335930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:49.344812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.345343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.345747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.347097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.348577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.351216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.548123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:49.578148 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-954fe3ef-f33c-44c0-8029-7a9e02b90b56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.251227 Oct 31 14:10:49.603668 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 860/1935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:49 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:49.622061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:49.628053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:49.636596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.637296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.644726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.645694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.646475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.647222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.724409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'flavor' on Instance uuid 921b274b-f2d8-4029-9244-d900095436ad {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:49.743007 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Cannot 'rescue' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state paused Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action HTTP/1.1 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 14 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: {"rescue": {}} Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'rescue' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state paused Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '921b274b-f2d8-4029-9244-d900095436ad', 'body': {'rescue': {}}} Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 921b274b-f2d8-4029-9244-d900095436ad in vm_state paused. Cannot rescue while the instance is in this state. Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state paused Oct 31 14:10:49.744955 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state paused Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:49.749559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 409 to user: Cannot 'rescue' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state paused {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:49.753222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06afb44e-e6ca-4c92-8528-e823506f536c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action" status: 409 len: 144 microversion: 2.1 time: 0.141258 Oct 31 14:10:49.753222 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 861/1936] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:49 2022] POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action => generated 144 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:10:49.767172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:49.768791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:49.769827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:49.779334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.779918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.780437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.781173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:49.781329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.781844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.782457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.784904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:49.792352 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fcb59fa-154a-4a75-bfb3-4939ac81c23f tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 1.679951 Oct 31 14:10:49.810690 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1076/1937] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:48 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:49.810690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:49.810690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:49.821626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.822124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.822585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:49.823288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:49.823745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:49.824229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.056745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:50.067808 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ad11420-e8de-47fc-b54f-50c8b77967c2 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.308688 Oct 31 14:10:50.082285 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 862/1938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:49 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:50.092716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:50.095720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:50.112091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.112594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.117048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.117936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.118454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.119158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.195208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:50.205044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d65f0677-ac7a-4203-acf5-8853f2393cac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.409691 Oct 31 14:10:50.209212 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1077/1939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:49 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:50.232309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:50.235813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:50.261236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.262063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.262770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.263745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.266032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.267538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.287571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-763fd3bd-7956-4504-a1c0-8c97d86e7786 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action" status: 202 len: 0 microversion: 2.1 time: 0.204981 Oct 31 14:10:50.289040 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 863/1940] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:50 2022] POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:10:50.300025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:50.301280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:50.310893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.311901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.312740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.316268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.317024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.319732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.461168 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-586bc369-dd4f-4e43-a551-689a52afa39a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.231084 Oct 31 14:10:50.461467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1078/1941] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:50 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:10:50.484399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:50.485137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:50.511599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.528458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.528913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.529663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.530123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.530574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.760754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:50.774085 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb1cbd8a-d57c-4498-a4f0-060c206744f0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1509 microversion: 2.1 time: 0.475488 Oct 31 14:10:50.774864 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 864/1942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:50 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1509 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:50.824137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:50.824764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:50.833452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.834558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.835008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:50.835728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:50.836191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:50.836617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.052218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:51.067894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:51.069956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:51.075681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6521e3a-a98a-474b-bd6b-6229cf2a27ad tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1485 microversion: 2.25 time: 0.254454 Oct 31 14:10:51.081282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 865/1943] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:50 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1485 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:10:51.087471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9caf6aa3-7625-4be4-b2e7-5addaf9b7141 req-355d3179-b02a-4b84-bc14-f015152ce5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0ca596-84a5-4c7e-9bb9-61db23198bbd", "name": "network-vif-plugged", "status": "completed", "tag": "1cd69f06-d33d-4e41-a094-e2d1440a38cd"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:51.102572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9caf6aa3-7625-4be4-b2e7-5addaf9b7141 req-355d3179-b02a-4b84-bc14-f015152ce5b6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.111332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9caf6aa3-7625-4be4-b2e7-5addaf9b7141 req-355d3179-b02a-4b84-bc14-f015152ce5b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.111332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9caf6aa3-7625-4be4-b2e7-5addaf9b7141 req-355d3179-b02a-4b84-bc14-f015152ce5b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.124196 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9caf6aa3-7625-4be4-b2e7-5addaf9b7141 req-355d3179-b02a-4b84-bc14-f015152ce5b6 service nova] Creating event network-vif-plugged:1cd69f06-d33d-4e41-a094-e2d1440a38cd for instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd on n-h2-863052-1 Oct 31 14:10:51.132065 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9caf6aa3-7625-4be4-b2e7-5addaf9b7141 req-355d3179-b02a-4b84-bc14-f015152ce5b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048334 Oct 31 14:10:51.133028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 866/1944] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:51.152496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.153138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:51.154928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:51.162490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.163584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.164028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.164979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.165714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.166374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.173780 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a4f48e3-f92e-4b8f-9681-464a457e97bd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1670 microversion: 2.1 time: 0.707613 Oct 31 14:10:51.174964 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1079/1945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:50 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1670 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:51.442231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:51.451003 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2b87309-5c5d-441e-b4c8-8b812b9c7060 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.316531 Oct 31 14:10:51.462229 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 867/1946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:51.473310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Action: 'update', calling method: .version_select at 0x7fe1074e2a60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:51.478500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.479156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.479899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.489062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.489672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.490251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.499203 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] HTTP exception thrown: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Request method failure captured: Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585 HTTP/1.1 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 56 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9drgFnt6ni3H5--V7oIq0FI_UTG5SNpRwq9NMIptZaz60SuVolYpr6j95AL8WgAO5f8DNPqSqAvfpIAMREO_LU7g4MudRMT0K0WOVB1ItilYZuOzpiZsPRgwI_4qTDilZ-sLan4mxaI9eDK-KGY1R1u_96Mm81fusIQFQRZL5nUuTg Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: dcabcafa308f403eab0a37c74f0687f3 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dcabcafa308f403eab0a37c74f0687f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: dcabcafa308f403eab0a37c74f0687f3 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b6a8cd55f7e54294a1f0d7f69abf05c3 Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: exception: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'bffb218b-d219-437d-8948-ba741fc7e585', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:51.501728 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Returning 404 to user: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:51.507815 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5140e690-c2e3-4e7c-a988-6a8a7c231b7e tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585" status: 404 len: 110 microversion: 2.53 time: 0.251133 Oct 31 14:10:51.509293 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1080/1947] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 31 14:10:51 2022] PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585 => generated 110 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:10:51.514334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Action: 'update', calling method: .version_select at 0x7fe10c0c6f70>, body: {"status": "disabled"} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:51.519003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.519592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.520075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.529731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.530787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.531236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.541855 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] HTTP exception thrown: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Request method failure captured: Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: request: PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585 HTTP/1.1 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 22 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9drgFnt6ni3H5--V7oIq0FI_UTG5SNpRwq9NMIptZaz60SuVolYpr6j95AL8WgAO5f8DNPqSqAvfpIAMREO_LU7g4MudRMT0K0WOVB1ItilYZuOzpiZsPRgwI_4qTDilZ-sLan4mxaI9eDK-KGY1R1u_96Mm81fusIQFQRZL5nUuTg Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: dcabcafa308f403eab0a37c74f0687f3 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dcabcafa308f403eab0a37c74f0687f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: dcabcafa308f403eab0a37c74f0687f3 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b6a8cd55f7e54294a1f0d7f69abf05c3 Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: {"status": "disabled"} Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: exception: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'bffb218b-d219-437d-8948-ba741fc7e585', 'body': {'status': 'disabled'}} Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:51.543943 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Returning 404 to user: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-537844f3-f01d-4702-a1f1-3f4d799e1977 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585" status: 404 len: 110 microversion: 2.53 time: 0.035107 Oct 31 14:10:51.549152 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 868/1948] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 31 14:10:51 2022] PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585 => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:10:51.556731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Action: 'update', calling method: .version_select at 0x7fe107989ee0>, body: {"status": "enabled"} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:51.560382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.560994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.561501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.567658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.568731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.569233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.579662 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] HTTP exception thrown: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Request method failure captured: Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585 HTTP/1.1 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 21 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9drgFnt6ni3H5--V7oIq0FI_UTG5SNpRwq9NMIptZaz60SuVolYpr6j95AL8WgAO5f8DNPqSqAvfpIAMREO_LU7g4MudRMT0K0WOVB1ItilYZuOzpiZsPRgwI_4qTDilZ-sLan4mxaI9eDK-KGY1R1u_96Mm81fusIQFQRZL5nUuTg Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: dcabcafa308f403eab0a37c74f0687f3 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dcabcafa308f403eab0a37c74f0687f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcabcafa308f403eab0a37c74f0687f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: dcabcafa308f403eab0a37c74f0687f3 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b6a8cd55f7e54294a1f0d7f69abf05c3 Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: {"status": "enabled"} Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: exception: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'bffb218b-d219-437d-8948-ba741fc7e585', 'body': {'status': 'enabled'}} Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:51.582086 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Returning 404 to user: Service bffb218b-d219-437d-8948-ba741fc7e585 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebcf8aba-b001-4168-b389-307896cdddae tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585" status: 404 len: 110 microversion: 2.53 time: 0.030919 Oct 31 14:10:51.588437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1081/1949] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 31 14:10:51 2022] PUT /compute/v2.1/os-services/bffb218b-d219-437d-8948-ba741fc7e585 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:10:51.596186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.601044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.601814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.601985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.602763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.603702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.604169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.632692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b2f6aae-a99d-4adb-8f26-ec0022803715 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040655 Oct 31 14:10:51.638240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 869/1950] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:51.648176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.653340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.653834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.654376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.655122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.655581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.656010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.692691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad065495-b32d-49f5-b145-2127ee48476f tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048784 Oct 31 14:10:51.693993 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1082/1951] 10.222.0.27 () {60 vars in 1211 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:51.708328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.712730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.713218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.713651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.716941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.717365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.717801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.770933 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01d3be8a-208e-48ee-b3f4-0de8a03bd6db tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.066973 Oct 31 14:10:51.772186 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 870/1952] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:51.792917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.801053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.803759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:51.806765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.807286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.809117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.809745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.814263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.814769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.820232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.820755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.825133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.825957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.828492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.828941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.897971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94474b2a-c671-4717-a462-b93de9f33854 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-863052-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.115515 Oct 31 14:10:51.905988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1083/1953] 10.222.0.27 () {60 vars in 1235 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/os-services?host=n-d-863052-1&binary=xxx => generated 16 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:51.910953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.919189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.919772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.921338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.922079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.923720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.924150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.937110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:51.968617 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df0a57d1-37e2-4d4e-a711-6363cc47a9c7 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.061315 Oct 31 14:10:51.969747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1084/1954] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:10:51.984282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:51.997306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.997811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.998291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:51.999005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:51.999471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:51.999863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.076271 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b9382d4-7804-4252-ae57-12c1189ebef4 tempest-ServicesAdminNegativeV253TestJSON-1452271202 tempest-ServicesAdminNegativeV253TestJSON-1452271202-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.094043 Oct 31 14:10:52.077267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1085/1955] 10.222.0.27 () {60 vars in 1239 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:52.108163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:52.124757 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb5f391e-954a-4030-996e-f6e01884ab82 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1517 microversion: 2.1 time: 0.328645 Oct 31 14:10:52.130493 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 871/1956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:51 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1517 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:52.136836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:52.138417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:52.178280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.178774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.180483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.181968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.182652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.183092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.436532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22bc2817-ed8b-455c-8e18-d4e767e9189d tempest-ServicesAdminNegativeV253TestJSON-732032359 tempest-ServicesAdminNegativeV253TestJSON-732032359-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:52.439693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-22bc2817-ed8b-455c-8e18-d4e767e9189d tempest-ServicesAdminNegativeV253TestJSON-732032359 tempest-ServicesAdminNegativeV253TestJSON-732032359-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '45b864de7ee44d32a95f203f849f2978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab79cf5a5d544648871a806083ec1593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22bc2817-ed8b-455c-8e18-d4e767e9189d tempest-ServicesAdminNegativeV253TestJSON-732032359 tempest-ServicesAdminNegativeV253TestJSON-732032359-project] Request method failure captured: Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9dpNVo5Ey19cPLePkv-zCIZ5bUHkh7gfsE71f7wEeL8VcpfXEhM3-d8-GvW7F-mao9BhaHGp40YiNNjgzkDoWnUYspaAWrKtQsUG30PeXcq-arJjll-fbvz_kcat4soWFQaKoksI5yQzcKZJSeC6e-TroscRZdz47f6mkojSXnXM4Q Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: ab79cf5a5d544648871a806083ec1593 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-732032359 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ab79cf5a5d544648871a806083ec1593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab79cf5a5d544648871a806083ec1593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ab79cf5a5d544648871a806083ec1593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab79cf5a5d544648871a806083ec1593"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-732032359 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: ab79cf5a5d544648871a806083ec1593 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-732032359 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServicesAdminNegativeV253TestJSON-732032359-project Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 45b864de7ee44d32a95f203f849f2978 Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-732032359-project Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:10:52.443319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:52.448778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22bc2817-ed8b-455c-8e18-d4e767e9189d tempest-ServicesAdminNegativeV253TestJSON-732032359 tempest-ServicesAdminNegativeV253TestJSON-732032359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:52.454456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:52.454586 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22bc2817-ed8b-455c-8e18-d4e767e9189d tempest-ServicesAdminNegativeV253TestJSON-732032359 tempest-ServicesAdminNegativeV253TestJSON-732032359-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.363363 Oct 31 14:10:52.455656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1086/1957] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 31 14:10:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 370 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:10:52.463773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:52.464400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:52.465001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:52.474128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:52.479040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e96d26af-8a32-4aac-81fe-35965fbd6621 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1475 microversion: 2.25 time: 0.348433 Oct 31 14:10:52.479259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.479381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.479810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.480517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.480970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.483648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.486319 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 872/1958] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:52 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:52.500985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:52.508711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:52.532706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.534330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.536508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.538760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.540669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.541734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.856303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:52.868117 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab8f42da-a139-4b00-8bf8-42dbd62020d7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1199 microversion: 2.1 time: 0.379964 Oct 31 14:10:52.869395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 873/1959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:52 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1199 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:52.889962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e1ca2414-2515-4981-9d1b-6eb8315ed2d8 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '.version_select at 0x7fe10757a310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:52.907587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1ca2414-2515-4981-9d1b-6eb8315ed2d8 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.908323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1ca2414-2515-4981-9d1b-6eb8315ed2d8 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.909198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1ca2414-2515-4981-9d1b-6eb8315ed2d8 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.945965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e1ca2414-2515-4981-9d1b-6eb8315ed2d8 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.074640 Oct 31 14:10:52.948357 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 874/1960] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 31 14:10:52 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:52.965558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:52.966204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:52.985062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.985566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.986010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:52.986753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:52.987211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:52.987639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:53.038493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:53.054692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-feef487c-efa8-490d-950c-88ca52608107 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1670 microversion: 2.1 time: 0.589671 Oct 31 14:10:53.055938 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1087/1961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:52 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1670 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:53.654702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:53.661677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] Lazy-loading 'services' on Instance uuid b8a9579f-9d77-4a92-88aa-5af95afa49cd {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:53.701632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7080d1fc-d576-43b4-a03a-a14bd010b310 tempest-LiveAutoBlockMigrationV225Test-890658248 tempest-LiveAutoBlockMigrationV225Test-890658248-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1967 microversion: 2.25 time: 0.738461 Oct 31 14:10:53.703732 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 875/1962] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:52 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1967 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:53.752745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:53.753914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:53.760926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:53.761804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:53.762503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:53.763388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:53.764100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:53.764703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:53.845275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:10:53.894974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:53.896899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:53.924366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:53.924900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:53.931923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:53.932722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:53.940132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:53.941144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:54.209125 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b5c6c5e-58b8-4414-ac2a-2bd4a9c3f17c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 204 len: 0 microversion: 2.25 time: 0.459908 Oct 31 14:10:54.213767 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1088/1963] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:10:53 2022] DELETE /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:10:54.226455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:54.229341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:54.244669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:54.246392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:54.247564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:54.248533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:54.249221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:54.249900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:54.333118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:54.351885 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b6cc9b9-0a35-498a-b5ca-e3e855d83224 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1381 microversion: 2.1 time: 0.459683 Oct 31 14:10:54.354753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 876/1964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:53 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1381 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:54.382015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:54.382964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:54.393212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:54.394078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:54.396453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:54.397733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:54.398785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:54.402516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:54.776886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:54.794119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:54.795810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:54.797321 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06786d79-0393-46e6-acc5-6dbbf2def1ef tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1481 microversion: 2.25 time: 0.439222 Oct 31 14:10:54.797950 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 877/1965] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:54 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1481 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:55.139952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:55.151266 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fbf3a87-1726-41cc-96d9-8cb82d96e51f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.935830 Oct 31 14:10:55.154244 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1089/1966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:54 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:55.182793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:55.186553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:55.196866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.197383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.197826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.198739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.199247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.199867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.262608 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71893726-2ad1-4b73-96e7-4b201abd2d8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 200 len: 322 microversion: 2.1 time: 0.084532 Oct 31 14:10:55.263978 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1090/1967] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:55 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:10:55.280790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:55.281303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:55.320679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.321270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.323334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.327338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.328082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.328881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.403062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:55.403559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:55.414157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.414691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.415129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.415975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.417118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.417616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.663860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1125b44b-df8d-4bc2-8f61-8558ac101883 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1532 microversion: 2.1 time: 0.863831 Oct 31 14:10:55.664471 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 878/1968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:54 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1532 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:55.694671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:55.698305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:55.710354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.712336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.715163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.716554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.718316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.718861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.809191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:55.821064 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2094845-e51d-4b03-a5bf-daacc7d73d1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.550759 Oct 31 14:10:55.839763 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1091/1969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:55 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:55.852038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:55.853387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:55.866606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.867169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.867616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:55.868358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:55.869118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:55.869550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.203623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=20 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:56.229021 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45ffe0a5-5367-4059-b505-a14f1200ae8f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1532 microversion: 2.1 time: 0.543391 Oct 31 14:10:56.243522 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 879/1970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:55 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1532 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:56.246461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:56.248755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:56.266786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.269590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.270629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.273335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.274874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.276734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.549208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:56.562271 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-13265e1e-4763-4203-b990-b8c8075e703b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.325916 Oct 31 14:10:56.565803 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 880/1971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:56 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:56.578338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:56.586695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:56.598105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.602801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.603922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.605402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.606101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.606821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.653108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'flavor' on Instance uuid 921b274b-f2d8-4029-9244-d900095436ad {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:56.816652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-60a9a9fe-9f66-4433-9d26-803a1d492843 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action" status: 200 len: 32 microversion: 2.1 time: 0.248070 Oct 31 14:10:56.817644 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 881/1972] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:56 2022] POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:10:56.841493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:56.847814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.848697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.849541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.850643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.851285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.851884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.888076 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ba05f34-22bc-4b1e-8c32-271d8a424757 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057481 Oct 31 14:10:56.891312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 882/1973] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:10:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:56.897332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae4d1b35-6558-428c-a6d1-ba7f6e5775aa tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107492940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:56.944214 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae4d1b35-6558-428c-a6d1-ba7f6e5775aa tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/7afea0bc-5c04-4874-abab-6b63d04d10b8" status: 200 len: 661 microversion: 2.1 time: 0.051407 Oct 31 14:10:56.945086 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 883/1974] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:10:56 2022] GET /compute/v2.1/images/7afea0bc-5c04-4874-abab-6b63d04d10b8 => generated 661 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:56.950787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:56.951722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:56.959844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.960332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.960960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:56.961662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:56.962113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:56.962559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:57.019563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:57.028040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:10:57.032683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:57.034230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:57.035431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b75337f-4f9d-4a4d-88c0-c26c8b754a80 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1481 microversion: 2.25 time: 1.194302 Oct 31 14:10:57.035988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1092/1975] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:55 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1481 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:57.201603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bf4353e-f793-4203-970b-f61e487b2292 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:57.225611 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bf4353e-f793-4203-970b-f61e487b2292 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.175262 Oct 31 14:10:57.226899 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1093/1976] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:10:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:57.244095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:57.244853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:57.262972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:57.264449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:57.264986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:57.267348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:57.269003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:57.270422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:57.503512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:57.517437 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a44604b-35a8-4ae5-a574-b8a5f55e2918 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.570112 Oct 31 14:10:57.524124 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 884/1977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:56 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:57.536465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:57.542637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:57.558409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:57.561669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:57.562391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:57.563358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:57.565321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:57.566096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:57.635917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lazy-loading 'flavor' on Instance uuid cd0ca596-84a5-4c7e-9bb9-61db23198bbd {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:10:57.696098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Going to try to live migrate instance to n-h1-863052-1 {{(pid=120641) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:10:57.908958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:57.939502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-563a5b4a-5bb2-4726-9734-9cdf89427e01 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.710908 Oct 31 14:10:57.940109 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1094/1978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:57 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:57.970447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eeb83dd6-3a41-44c2-8b1c-fb4a2271bd30 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1074178b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:58.032018 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eeb83dd6-3a41-44c2-8b1c-fb4a2271bd30 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/7afea0bc-5c04-4874-abab-6b63d04d10b8" status: 200 len: 661 microversion: 2.1 time: 0.075506 Oct 31 14:10:58.036188 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1095/1979] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:10:57 2022] GET /compute/v2.1/images/7afea0bc-5c04-4874-abab-6b63d04d10b8 => generated 661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:58.060228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-53af66c3-4db8-4549-9bdd-9c8bcaae8ec2 req-1e6b233b-6719-4317-87df-325d9474d3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a9579f-9d77-4a92-88aa-5af95afa49cd", "name": "network-vif-deleted", "tag": "7c74f8b2-e9e7-4faa-9e5f-c47770131567"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:58.094652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-53af66c3-4db8-4549-9bdd-9c8bcaae8ec2 req-1e6b233b-6719-4317-87df-325d9474d3ea service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:58.099857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-53af66c3-4db8-4549-9bdd-9c8bcaae8ec2 req-1e6b233b-6719-4317-87df-325d9474d3ea service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:58.102153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-53af66c3-4db8-4549-9bdd-9c8bcaae8ec2 req-1e6b233b-6719-4317-87df-325d9474d3ea service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:58.137121 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-53af66c3-4db8-4549-9bdd-9c8bcaae8ec2 req-1e6b233b-6719-4317-87df-325d9474d3ea service nova] Creating event network-vif-deleted:7c74f8b2-e9e7-4faa-9e5f-c47770131567 for instance b8a9579f-9d77-4a92-88aa-5af95afa49cd on n-h2-863052-1 Oct 31 14:10:58.152135 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-53af66c3-4db8-4549-9bdd-9c8bcaae8ec2 req-1e6b233b-6719-4317-87df-325d9474d3ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114407 Oct 31 14:10:58.153726 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1096/1980] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:10:58.158958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:58.165756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:58.200677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:58.201172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:58.201613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:58.202345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:58.210927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:58.211411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:58.606757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:58.624259 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65ac7024-7634-4900-8dd7-e4d202869f4e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.468433 Oct 31 14:10:58.649634 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1097/1981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:10:58 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:10:58.660792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:10:58.663637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:10:58.671786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:58.672542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:58.673206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:58.674449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:10:58.675101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:10:58.676472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:10:59.075104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:59.088684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:59.095274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:10:59.098714 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cbfef19d-9765-42eb-b491-cacbd64641d8 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1265 microversion: 2.25 time: 0.446269 Oct 31 14:10:59.119160 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1098/1982] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:10:58 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1265 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:10:59.126114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-959f260f-1fe0-468e-abf6-e73e9d4e8933 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-74581046", "imageRef": "5be7c6cf-6a45-425a-b74e-a9ae1d167a8c", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:10:59.187864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-959f260f-1fe0-468e-abf6-e73e9d4e8933 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:10:59.858844 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-959f260f-1fe0-468e-abf6-e73e9d4e8933 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-959f260f-1fe0-468e-abf6-e73e9d4e8933 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] Request method failure captured: Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 141 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9dwMamsQnEV-dvGg94_qJs0JDuGDBhhIdcHnq-nNXP3Ahd31ESqDGlQtJ7TYUph7NZk6BYuBzmTNn52lcth8946LTx2Fio9VDU9aR-WX8i-2LWRnvngp6LkEADZkN8jCmG-XwHEBbjcNUJDSwW53VobRB-AJKPnOAPQ6FiGf8tK6EA Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d24920d3709f4148b693202ad4389104 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FlavorsV2NegativeTest-1517156240 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d24920d3709f4148b693202ad4389104", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d24920d3709f4148b693202ad4389104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d24920d3709f4148b693202ad4389104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d24920d3709f4148b693202ad4389104"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FlavorsV2NegativeTest-1517156240 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d24920d3709f4148b693202ad4389104 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1517156240 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FlavorsV2NegativeTest-1517156240-project Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 6796d26568f14572b62c385352e2a990 Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FlavorsV2NegativeTest-1517156240-project Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-74581046", "imageRef": "5be7c6cf-6a45-425a-b74e-a9ae1d167a8c", "flavorRef": "452"}} Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor's memory is too small for requested image. Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-74581046', 'imageRef': '5be7c6cf-6a45-425a-b74e-a9ae1d167a8c', 'flavorRef': '452'}}} Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:59.860746 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-959f260f-1fe0-468e-abf6-e73e9d4e8933 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-959f260f-1fe0-468e-abf6-e73e9d4e8933 tempest-FlavorsV2NegativeTest-1517156240 tempest-FlavorsV2NegativeTest-1517156240-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.741676 Oct 31 14:10:59.867078 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1099/1983] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:10:59 2022] POST /compute/v2.1/servers => generated 93 bytes in 743 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:10:59.872680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-695944385", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "726ec790-fa70-4df0-af4a-a3e3b994a919"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:00.001915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] validate_networks() for [('726ec790-fa70-4df0-af4a-a3e3b994a919', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:00.919684 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df6375d1-dfeb-439d-8396-49970fcbd7db tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd/action" status: 202 len: 0 microversion: 2.1 time: 3.393638 Oct 31 14:11:00.920298 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 885/1984] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:10:57 2022] POST /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd/action => generated 0 bytes in 3395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:11:00.926640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:00.928961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:00.977269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:00.978070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:00.978727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:00.980386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:00.983486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:00.984524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.589501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:01.598564 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f92a4662-2e6a-4623-8dcf-be401e07166e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.676847 Oct 31 14:11:01.617069 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 886/1985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:00 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:01.628753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57380713-bec3-4471-9178-0d59f498e03a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1074b0e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:01.655351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:01.656843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:01.657431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:01.658304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:01.659658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:01.685029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:01.689557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:01.690469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.694932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:01.695456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:01.699023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.702308 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57380713-bec3-4471-9178-0d59f498e03a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/07943914-46ae-49f0-9f46-9b0387c2eb67" status: 200 len: 661 microversion: 2.1 time: 0.083810 Oct 31 14:11:01.703110 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 887/1986] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:01 2022] GET /compute/v2.1/images/07943914-46ae-49f0-9f46-9b0387c2eb67 => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:01.720511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:01.726605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:01.743402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:01.744507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:01.746483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.747407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:01.749822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:01.750504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.758649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:01.775216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for user f6d0e8b2b04b47e69d87f436eb387941 and project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:01.801087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:01.810779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:01.819850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:01.916129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb96dcd0-7486-46d5-81d6-aca06cfdbfc7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050742 Oct 31 14:11:01.918689 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1100/1987] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:01.946457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:01.948505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:01.966719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:01.967220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:01.967664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.971853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:01.972354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:01.975306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:01.976069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:01.991517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:02.000537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:02.006654 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74806d82-64d5-4193-ad71-5056a3381c45 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1265 microversion: 2.25 time: 0.297907 Oct 31 14:11:02.032580 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 888/1988] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:01 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:02.046907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd981832-37d1-407c-9b00-c8c51ea092c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107492f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:02.141908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd981832-37d1-407c-9b00-c8c51ea092c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/07943914-46ae-49f0-9f46-9b0387c2eb67" status: 200 len: 661 microversion: 2.1 time: 0.108109 Oct 31 14:11:02.143118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 889/1989] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:02 2022] GET /compute/v2.1/images/07943914-46ae-49f0-9f46-9b0387c2eb67 => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:02.165475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dca50a85-4e37-4032-b4d2-2837df1d87cd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:02.166737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dca50a85-4e37-4032-b4d2-2837df1d87cd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:02.393179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dca50a85-4e37-4032-b4d2-2837df1d87cd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:02.412687 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dca50a85-4e37-4032-b4d2-2837df1d87cd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1214 microversion: 2.1 time: 0.268184 Oct 31 14:11:02.422752 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 890/1990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:02 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:02.633766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:02.634825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:02.659028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:02.660610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:02.661073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:02.665812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:02.666354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:02.668954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:02.706876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:02.720567 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c93fd8d-38a5-4269-b6f8-df08dae30284 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.799822 Oct 31 14:11:02.723516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1101/1991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:01 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:03.034063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:03.034985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:03.045808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:03.049881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:03.050446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:03.051233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:03.053750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:03.055300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:03.341385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:03.366807 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5659e53-c364-423f-a4e6-5de32dd78606 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.738500 Oct 31 14:11:03.369563 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 891/1992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:02 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:03.447625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:03.448337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:03.482426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:03.483892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:03.486824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:03.491730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:03.492756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:03.495020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:03.746509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:03.761540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:03.775952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:03.777171 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90ae109f-c34d-4a00-95d7-7f16871e5394 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1265 microversion: 2.25 time: 0.747550 Oct 31 14:11:03.784960 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1102/1993] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:03 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1265 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:03.801815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:03.811344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:03.827370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:03.827905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:03.836534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:03.837684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:03.837684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:03.838125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:03.843738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:03.852854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:03.864317 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac9724ac-5172-4325-ac04-23c4d3333541 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1266 microversion: 2.1 time: 0.420836 Oct 31 14:11:03.871707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 892/1994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:03 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:04.279320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51381801-64fe-4d44-ab38-cd437c512f18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10c480940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:04.356516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-51381801-64fe-4d44-ab38-cd437c512f18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/f109a740-fac7-487c-af12-b27f04b50101" status: 200 len: 661 microversion: 2.1 time: 0.081574 Oct 31 14:11:04.361144 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 893/1995] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:04 2022] GET /compute/v2.1/images/f109a740-fac7-487c-af12-b27f04b50101 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:11:04.375983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f40ac65f-c246-4574-b364-b6418cc265ae tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1074838b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:04.378112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:04.391989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-179af88d-b396-4b8c-ae44-3194020bf36b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.605374 Oct 31 14:11:04.409547 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1103/1996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:03 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:04.424421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:04.432160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:04.452580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f40ac65f-c246-4574-b364-b6418cc265ae tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/f109a740-fac7-487c-af12-b27f04b50101" status: 200 len: 661 microversion: 2.1 time: 0.082275 Oct 31 14:11:04.456809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:04.460703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:04.461368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:04.461952 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 894/1997] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:04 2022] GET /compute/v2.1/images/f109a740-fac7-487c-af12-b27f04b50101 => generated 661 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:04.464000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:04.464657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:04.466722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:04.809605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:04.810646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:04.830150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:04.831975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:04.834371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:04.836717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:04.838767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:04.843276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:04.868166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:04.897017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6902f623-fbad-4fb6-8e1e-20b14410904e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.484441 Oct 31 14:11:04.897982 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1104/1998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:04 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:04.902925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-110521952", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:05.018441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:05.344928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:05.360187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:05.363714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:05.367243 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e1335e9d-8df3-422f-8503-affa6a369bcd tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 200 len: 1265 microversion: 2.25 time: 0.561157 Oct 31 14:11:05.367844 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 895/1999] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:04 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 1265 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:11:05.502008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:05.502859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:05.503778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:05.504435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:05.505634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:05.531596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:05.532395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:05.533012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:05.533921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:05.534595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:05.535831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:05.558846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=17 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:05.590446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Getting quotas for project c84be206a0324a14bf3c77ec4e50f940. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:05.596940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Getting quotas for user c81d9c4b657d43bfb9d3d88c171a54ea and project c84be206a0324a14bf3c77ec4e50f940. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:05.630538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:05.633337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:05.712593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-459702923", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7791d1cc-91a3-4ccc-9a62-bb64b1bcdeec"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:05.740207 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9a8bb63-e0f0-41d1-b608-9c61d3ff01fd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840962 Oct 31 14:11:05.741585 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1105/2000] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:05.771137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:05.774609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:05.809931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] validate_networks() for [('7791d1cc-91a3-4ccc-9a62-bb64b1bcdeec', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:05.815974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:05.818353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:05.820633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:05.824596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:05.825271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:05.826015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:06.062022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:06.066683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:06.076546 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5424f5db-dcac-43f4-8c34-a42b096cabe5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1272 microversion: 2.1 time: 0.333876 Oct 31 14:11:06.087197 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1106/2001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:05 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:06.097663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:06.108420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:06.131702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:06.135497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:06.136939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:06.138593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:06.140768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:06.143194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:06.846898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:06.855674 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f97966db-a996-48eb-8dfe-7507850111d3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.764322 Oct 31 14:11:06.858896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:06.861922 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1107/2002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:06 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:06.890472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:06.892865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:06.906304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:06.907149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:06.908028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:06.910230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:06.910974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:06.915880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:07.491974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:07.510040 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9fe04f64-8516-435a-948a-69ea842891a9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.646610 Oct 31 14:11:07.513339 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1108/2003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:06 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:07.523908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1102127155", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:07.635270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:08.088827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:08.089777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:08.090256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:08.090671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:08.091133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:08.124406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:08.124917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:08.125336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:08.125756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:08.126200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:08.133884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.135527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.137994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.138893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.145164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.146192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.165641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.166268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.166657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.167439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.167907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.168339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.206954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Getting quotas for project c84be206a0324a14bf3c77ec4e50f940. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:08.215167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Getting quotas for user c81d9c4b657d43bfb9d3d88c171a54ea and project c84be206a0324a14bf3c77ec4e50f940. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:08.233800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:08.237328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:08.274204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Getting quotas for project bd0bd0633fab41348c29a69aebb7b069. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:08.292071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Getting quotas for user 79995efa070844cf94985c291b8388b7 and project bd0bd0633fab41348c29a69aebb7b069. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:08.325257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:08.357947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:08.363079 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa5ec4af-9198-44ef-b377-3d328b70dd47 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848230 Oct 31 14:11:08.364843 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1109/2004] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:11:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:08.371156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:08.372376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: b8a9579f-9d77-4a92-88aa-5af95afa49cd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:08.373333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:08.382703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.383520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.384228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.385236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.385975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.386660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.406974 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] HTTP exception thrown: Instance b8a9579f-9d77-4a92-88aa-5af95afa49cd could not be found. Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Request method failure captured: Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd HTTP/1.1 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XHpTTdheSm88LK25aNFR3GFmsoZGCVbmlawotOndhw2SCLBuA2tRM1IKSie6ra5R2-nB1TJWt0C9vQJ6KzaE71p2bA-megy5UHNImRE8RyoEJQTqTmTUYlgeMFIeaBiU0pVvtagsqh-Ustq9Tpf0bumiLRnrGDpDnYVMFW1p4saZc Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c75cb8d7db204534bc02ad16c859c108", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 57251d140f49460087e4cf90f6b94a78 Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b8a9579f-9d77-4a92-88aa-5af95afa49cd could not be found. Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b8a9579f-9d77-4a92-88aa-5af95afa49cd'} Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a9579f-9d77-4a92-88aa-5af95afa49cd could not be found. Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a9579f-9d77-4a92-88aa-5af95afa49cd could not be found. Oct 31 14:11:08.408856 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a9579f-9d77-4a92-88aa-5af95afa49cd could not be found. Oct 31 14:11:08.413604 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:08.418912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Returning 404 to user: Instance b8a9579f-9d77-4a92-88aa-5af95afa49cd could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:08.420491 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d9cb5c5-ebb7-4c12-8ed9-fe8851e555d9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd" status: 404 len: 111 microversion: 2.25 time: 0.053850 Oct 31 14:11:08.424678 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1110/2005] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:08 2022] GET /compute/v2.1/servers/b8a9579f-9d77-4a92-88aa-5af95afa49cd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:11:08.446108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:08.451426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:08.467792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.471333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.472100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.473161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.473934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.476073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.566858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd5e304a-5e55-487f-b6fc-6529aa5d043a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.195781 Oct 31 14:11:08.574514 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 896/2006] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:08.591021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:08.600088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:08.622368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.622890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.623325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:08.624053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:08.624560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:08.637417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:09.236059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:09.247124 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d4e35be-9ba6-4c85-8c0e-9d232c5851f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1272 microversion: 2.1 time: 0.824742 Oct 31 14:11:09.250445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1111/2007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:08 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1272 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:09.263099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32372826-5801-4697-99f5-ee602af74aa8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:09.264095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32372826-5801-4697-99f5-ee602af74aa8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:09.626880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32372826-5801-4697-99f5-ee602af74aa8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:09.647885 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32372826-5801-4697-99f5-ee602af74aa8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1218 microversion: 2.1 time: 0.392703 Oct 31 14:11:09.663580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1112/2008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:09 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1218 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:09.672894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:09.674138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:09.684234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:09.685334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:09.685949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:09.687113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:09.687748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:09.688691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:09.839035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:09.855725 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57145ad5-7f98-40cf-a12a-83bc7a81b9d6 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 1.277204 Oct 31 14:11:09.857283 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 897/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:08 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:09.873082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86000318-0f0f-4887-a1ed-c5fce6297f3b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:09.874160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86000318-0f0f-4887-a1ed-c5fce6297f3b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:10.045312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86000318-0f0f-4887-a1ed-c5fce6297f3b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:10.055166 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86000318-0f0f-4887-a1ed-c5fce6297f3b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1217 microversion: 2.1 time: 0.196209 Oct 31 14:11:10.066046 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 898/2010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:09 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:10.274351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:10.275218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:10.292186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:10.292976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:10.293453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:10.294240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:10.294741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:10.295175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:10.730876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:10.744560 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30745a95-5397-4ba6-b5b3-7cc1f6be8e1e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 1.079689 Oct 31 14:11:10.747840 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1113/2011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:09 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:10.763405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:10.764369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:10.777562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:10.778057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:10.783662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:10.784439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:10.784915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:10.785349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:11.022289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:11.032587 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35d81699-285a-4fa0-a2d2-6117f1ba7996 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.763219 Oct 31 14:11:11.041751 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 899/2012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:10 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:11.061974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:11.063242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:11.073302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:11.074081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:11.076631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:11.077701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:11.079584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:11.080295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:11.325039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:11.335674 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-976df6af-8ed1-4faf-9bda-1abfce18974a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1270 microversion: 2.1 time: 0.585561 Oct 31 14:11:11.343281 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1114/2013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:10 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1270 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:11.352936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:11.355933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:11.368988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:11.369754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:11.371141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:11.372006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:11.372619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:11.373232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:11.661276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:11.674774 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad9b8072-b64d-4c1b-8e2d-a2a49c17034e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1269 microversion: 2.1 time: 0.328317 Oct 31 14:11:11.675722 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1115/2014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:11 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1269 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:11.789730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:11.795039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:11.820287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:11.821347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:11.823859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:11.827707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:11.828404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:11.830689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:12.375368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:12.385441 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15a03e41-f491-40c4-a6ed-05431bc3c60d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.613927 Oct 31 14:11:12.391638 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1116/2015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:11 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:12.561258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1358755153", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d84ec31c-f9aa-4ab0-b7aa-1fb2d71e82ce"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:12.664650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] validate_networks() for [('d84ec31c-f9aa-4ab0-b7aa-1fb2d71e82ce', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:12.720427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:12.737816 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10130c30-3a87-4409-9594-4606a961c80e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 1.692319 Oct 31 14:11:12.757839 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 900/2016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:11 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:12.767055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:12.767981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:12.776871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:12.782098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:12.784312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:12.785300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:12.786537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:12.787112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:13.344520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:13.353403 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e25cd04a-b068-4f59-b459-8f6ddc20e3a4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.593117 Oct 31 14:11:13.362842 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 901/2017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:12 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:13.380966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:13.384186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:13.416827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:13.417588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:13.418188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:13.419062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:13.421990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:13.422622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:13.563877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:13.579046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a7bbd17-ec86-437f-b762-9169bddb34ec tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1276 microversion: 2.1 time: 0.214931 Oct 31 14:11:13.581343 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 902/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:13 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:13.599694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:13.600641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:13.622040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:13.622566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:13.624842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:13.625591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:13.626057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:13.626519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:13.791332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:13.801345 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c57c6c50-0af1-4574-b951-e9849e8fd459 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1275 microversion: 2.1 time: 0.218076 Oct 31 14:11:13.808497 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 903/2019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:13 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:13.819514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:13.820439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:13.843514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:13.844076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:13.844534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:13.847611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:13.848162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:13.848689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:14.198873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:14.213801 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aed4f09f-e5aa-4efa-885e-a2c50e87d5d1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.403846 Oct 31 14:11:14.218078 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 904/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:13 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:14.226453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:14.230952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:14.249412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:14.250824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:14.263210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:14.266592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:14.269159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:14.269804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.018720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:15.019222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:15.019612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:15.020025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:15.020729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:15.038426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.041329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.041943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.042880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.043850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.044393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.101122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Getting quotas for project a101ed7968244a4ba358acae20744009. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:15.113785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Getting quotas for user 0fa812d31aed420397d85abe62b91827 and project a101ed7968244a4ba358acae20744009. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:15.135212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:15.137496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:15.211150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83247909-1245-41c7-8c2f-17c560a0aedc tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818057 Oct 31 14:11:15.212210 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1117/2021] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:15.217590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:15.218388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:15.226907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.228230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.228819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.229726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.230426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.231297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.623523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:15.641489 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57e415e0-a87a-4743-9cc1-1e37e46e8a09 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 1.421955 Oct 31 14:11:15.661858 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 905/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:14 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:15.674074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-936d0d40-405e-48c1-9e5d-a4862915692f req-7b3aa13a-101b-46cc-82ef-dd1ba2cd95b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5", "tag": "4763e0ff-5484-4925-9f3c-283cc524703d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:15.730579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-936d0d40-405e-48c1-9e5d-a4862915692f req-7b3aa13a-101b-46cc-82ef-dd1ba2cd95b1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.731584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-936d0d40-405e-48c1-9e5d-a4862915692f req-7b3aa13a-101b-46cc-82ef-dd1ba2cd95b1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.732311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-936d0d40-405e-48c1-9e5d-a4862915692f req-7b3aa13a-101b-46cc-82ef-dd1ba2cd95b1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.775319 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-936d0d40-405e-48c1-9e5d-a4862915692f req-7b3aa13a-101b-46cc-82ef-dd1ba2cd95b1 service nova] Creating event network-changed:4763e0ff-5484-4925-9f3c-283cc524703d for instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 on n-h1-863052-1 Oct 31 14:11:15.794071 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-936d0d40-405e-48c1-9e5d-a4862915692f req-7b3aa13a-101b-46cc-82ef-dd1ba2cd95b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128309 Oct 31 14:11:15.797037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 906/2023] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:15.835401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:15.838365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:15.858704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.861558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.864601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:15.867114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:15.868790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:15.869543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.087180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:16.103220 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5245379a-3b1c-4161-bd5c-b0b94c528587 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.888213 Oct 31 14:11:16.106837 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1118/2024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:15 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:16.129205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:16.129931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:16.160198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:16.165804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:16.168278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.169261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:16.172447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:16.174394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.472579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:16.487066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6518b6ca-78b3-4add-b30c-071fd3882de1 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1275 microversion: 2.1 time: 0.375057 Oct 31 14:11:16.492366 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1119/2025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:16 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1275 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:16.508094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:16.516441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:16.548726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:16.553203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:16.557252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.558359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:16.560394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:16.561852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.600200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:16.626913 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45fcb186-bc36-4597-861a-9f1c320d80c2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.811630 Oct 31 14:11:16.634594 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 907/2026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:15 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:16.651978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:16.654863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:16.703064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:16.705029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:16.712091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.713792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:16.714317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:16.714770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:16.997035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:17.008098 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cc65520-d52d-4a2d-9df7-3f25cbe8810b tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1269 microversion: 2.1 time: 0.512717 Oct 31 14:11:17.018310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1120/2027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:16 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1269 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:17.036651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:17.038607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:17.096625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:17.097888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:17.099580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:17.101747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:17.103995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:17.104588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:17.547966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:17.563742 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e55e9f6a-f592-4d5e-83c0-0d650c5fad57 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.923233 Oct 31 14:11:17.565674 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 908/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:16 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:17.583030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:17.584104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:17.597204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:17.598353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:17.600630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:17.612126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:17.612970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:17.613657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:18.222421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:18.320381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:18.332405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6de43920-3247-4939-a07a-6a20fd44b847 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.765323 Oct 31 14:11:18.351528 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 909/2029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:17 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:18.363029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:18.363659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:18.389485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:18.390015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:18.390491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:18.391222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:18.391688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:18.392117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:18.505392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:18.518607 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a917591c-dbbf-4eda-8358-331f7891097f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 1.498667 Oct 31 14:11:18.520836 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1121/2030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:17 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:18.531890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:18.559886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:18.582464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:18.587052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:18.587966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:18.588998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:18.589686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:18.590362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:20.038533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:20.052580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-604cff0e-4c17-4e58-a106-d21ea3bc6e2d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 1.699749 Oct 31 14:11:20.069403 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 910/2031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:18 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:20.085268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:20.089511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:20.105613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:20.124387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:20.124912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:20.127801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:20.128681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:20.129182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:20.130351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:20.409390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:20.436994 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7474f984-be7b-429c-a559-bcf44a144d06 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 1.914102 Oct 31 14:11:20.440642 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1122/2032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:18 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:20.449182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:20.452570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:20.499702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:20.505171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:20.507969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:20.513728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:20.515364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:20.517367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:21.379481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:21.390989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ecc166d-0478-469f-a9b8-e843584e69f9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1503 microversion: 2.1 time: 0.948645 Oct 31 14:11:21.397606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1123/2033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:20 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1503 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:21.423920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:21.425275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:21.440562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:21.441302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:21.444244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:21.445220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:21.454268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:21.454923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.012045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:22.028446 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d390c79-00d8-4581-a8cf-25513709ae56 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.623391 Oct 31 14:11:22.029521 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1124/2034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:21 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:22.034974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:22.035841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:22.043555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.045495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.046110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.047171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.047784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.048384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.058626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:22.072030 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b3c49c1-e9cd-4494-8911-a3a5d0412d1d tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 1.999653 Oct 31 14:11:22.073710 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 911/2035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:20 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:22.083221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2035da74-2cf8-406a-a64d-eff9b68db16b req-6f4c33ad-c8af-40f5-8f5d-4797d69bda72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:22.111881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2035da74-2cf8-406a-a64d-eff9b68db16b req-6f4c33ad-c8af-40f5-8f5d-4797d69bda72 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.112556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2035da74-2cf8-406a-a64d-eff9b68db16b req-6f4c33ad-c8af-40f5-8f5d-4797d69bda72 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.113137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2035da74-2cf8-406a-a64d-eff9b68db16b req-6f4c33ad-c8af-40f5-8f5d-4797d69bda72 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.134063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2035da74-2cf8-406a-a64d-eff9b68db16b req-6f4c33ad-c8af-40f5-8f5d-4797d69bda72 service nova] Creating event network-changed:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:11:22.142318 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2035da74-2cf8-406a-a64d-eff9b68db16b req-6f4c33ad-c8af-40f5-8f5d-4797d69bda72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065941 Oct 31 14:11:22.144051 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 912/2036] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:22.151951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:22.153066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:22.181312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.182094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.182771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.185052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.185720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.187290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.506266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:22.555909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d20d139a-3660-47a1-8484-34f11971125d tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.525041 Oct 31 14:11:22.561178 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1125/2037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:22 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:22.589759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:22.591402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:22.604362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:22.617286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:22.617910 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb3a7baf-0717-436b-aae0-6f66fbe9e5b5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.472440 Oct 31 14:11:22.621643 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 913/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:22 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:22.625294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.626736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.627724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.629313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.631375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cebf7101-b39a-48c3-ad40-d8b7b5fc2f95"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:22.632281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.633395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.639012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:22.651710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.652534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.653247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.655486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.656762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.658102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.693128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:22.736134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:22.751306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Cannot 'attach_volume' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state rescued Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/os-volume_attachments HTTP/1.1 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 74 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: {"volumeAttachment": {"volumeId": "cebf7101-b39a-48c3-ad40-d8b7b5fc2f95"}} Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'attach_volume' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state rescued Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '921b274b-f2d8-4029-9244-d900095436ad', 'body': {'volumeAttachment': {'volumeId': 'cebf7101-b39a-48c3-ad40-d8b7b5fc2f95'}}} Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 921b274b-f2d8-4029-9244-d900095436ad in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 31 14:11:22.754736 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state rescued Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state rescued Oct 31 14:11:22.758495 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:22.762060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:11:22.764998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 409 to user: Cannot 'attach_volume' instance 921b274b-f2d8-4029-9244-d900095436ad while it is in vm_state rescued {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:22.766097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd3866dc-a50a-4d96-972a-f5f66e9ab81d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.143301 Oct 31 14:11:22.774767 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 914/2039] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:11:22 2022] POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/os-volume_attachments => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:11:22.781178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:22.782062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:22.789707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.790559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.791170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.792217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:22.792976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:22.793648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:22.974772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b56809f6-d947-4429-8e36-bbbffa267d4b tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 204 len: 0 microversion: 2.25 time: 0.410107 Oct 31 14:11:22.976336 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1126/2040] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:11:22 2022] DELETE /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:11:22.985658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1a76200f-3e09-4124-878f-f5a7fb07711f req-2fa7b8bc-ce68-47a2-9242-a6bb63dd8c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f9e762-ff51-4111-946e-50eaa69df94b", "tag": "98a382a7-f2e3-4e9d-bd8c-950abec1c5f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:23.003930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a76200f-3e09-4124-878f-f5a7fb07711f req-2fa7b8bc-ce68-47a2-9242-a6bb63dd8c71 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.005296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a76200f-3e09-4124-878f-f5a7fb07711f req-2fa7b8bc-ce68-47a2-9242-a6bb63dd8c71 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.006538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a76200f-3e09-4124-878f-f5a7fb07711f req-2fa7b8bc-ce68-47a2-9242-a6bb63dd8c71 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.040671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1a76200f-3e09-4124-878f-f5a7fb07711f req-2fa7b8bc-ce68-47a2-9242-a6bb63dd8c71 service nova] Creating event network-changed:98a382a7-f2e3-4e9d-bd8c-950abec1c5f8 for instance c4f9e762-ff51-4111-946e-50eaa69df94b on n-h1-863052-1 Oct 31 14:11:23.047818 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1a76200f-3e09-4124-878f-f5a7fb07711f req-2fa7b8bc-ce68-47a2-9242-a6bb63dd8c71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069820 Oct 31 14:11:23.049931 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1127/2041] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:23.062631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:23.063306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:23.083820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.085177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.086080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.088380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.088973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.091345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.227614 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aaf689f7-b62a-46c5-8f75-46cccd2b4869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action" status: 202 len: 0 microversion: 2.1 time: 0.175045 Oct 31 14:11:23.228916 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1128/2042] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:11:23 2022] POST /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:11:23.235041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:23.236238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:23.244055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.244827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.245550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.246726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.247456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.248116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.422999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:23.433967 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-082f66a5-3a60-4e1e-a264-83170535ac7d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.657861 Oct 31 14:11:23.435482 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 915/2043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:22 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:23.442339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:23.443368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:23.451779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.452454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.453063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.453959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.454588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.455298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.630729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:23.641377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:23.644218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:23.645972 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f08b2ae8-4908-4eeb-acb3-880821d07940 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1729 microversion: 2.25 time: 0.415524 Oct 31 14:11:23.646751 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1129/2044] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:23 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1729 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:23.652186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:23.653395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:23.661934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.662654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.663413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.664288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.664884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.665592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.899195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:23.913253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86878c4b-84d0-4e5b-ba14-c29c5d9cab90 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.476457 Oct 31 14:11:23.915890 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 916/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:23 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:23.925036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:23.925976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:23.934284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.934981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.935511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:23.936781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:23.937452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:23.938026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.157547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:24.168816 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-348222a5-7409-451e-ad25-0da4267840e7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1511 microversion: 2.1 time: 0.250907 Oct 31 14:11:24.169790 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 917/2046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:23 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:24.180533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d12548a0-78f0-45ac-9b63-bb08d8f74ef4 req-ced7eec0-285d-49e6-bbda-127c22314d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5", "name": "network-vif-plugged", "status": "completed", "tag": "4763e0ff-5484-4925-9f3c-283cc524703d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:24.194207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d12548a0-78f0-45ac-9b63-bb08d8f74ef4 req-ced7eec0-285d-49e6-bbda-127c22314d07 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.194796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d12548a0-78f0-45ac-9b63-bb08d8f74ef4 req-ced7eec0-285d-49e6-bbda-127c22314d07 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.195232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d12548a0-78f0-45ac-9b63-bb08d8f74ef4 req-ced7eec0-285d-49e6-bbda-127c22314d07 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.209623 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d12548a0-78f0-45ac-9b63-bb08d8f74ef4 req-ced7eec0-285d-49e6-bbda-127c22314d07 service nova] Creating event network-vif-plugged:4763e0ff-5484-4925-9f3c-283cc524703d for instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 on n-h1-863052-1 Oct 31 14:11:24.215842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d12548a0-78f0-45ac-9b63-bb08d8f74ef4 req-ced7eec0-285d-49e6-bbda-127c22314d07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044649 Oct 31 14:11:24.216698 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 918/2047] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:24.221889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:24.222793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:24.232568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:24.237062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.240206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.241836 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c95460de-5e18-4c49-882a-e8a78a0fa849 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 0.593855 Oct 31 14:11:24.242445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1130/2048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:23 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:24.244637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.245779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.246546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.247151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.247342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:24.247946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:24.255016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.255558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.255990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.256754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.257197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.257617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.496779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:24.506219 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6497c0d8-9d61-4e5d-bbda-f29527ae8503 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.288357 Oct 31 14:11:24.514584 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 919/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:24 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:24.514584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d8bb3481-bb57-4e7e-a08c-8637ab97dc6e req-5c3f4dd8-0d2e-4429-9c01-9c0f73b1ab54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51a9543-d5a1-47c3-913e-c5453fc4a538", "tag": "98abb853-920f-4edd-82ef-b19d0a5a0a60"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:24.522005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d8bb3481-bb57-4e7e-a08c-8637ab97dc6e req-5c3f4dd8-0d2e-4429-9c01-9c0f73b1ab54 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.522527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d8bb3481-bb57-4e7e-a08c-8637ab97dc6e req-5c3f4dd8-0d2e-4429-9c01-9c0f73b1ab54 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.523062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d8bb3481-bb57-4e7e-a08c-8637ab97dc6e req-5c3f4dd8-0d2e-4429-9c01-9c0f73b1ab54 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.538661 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d8bb3481-bb57-4e7e-a08c-8637ab97dc6e req-5c3f4dd8-0d2e-4429-9c01-9c0f73b1ab54 service nova] Creating event network-changed:98abb853-920f-4edd-82ef-b19d0a5a0a60 for instance e51a9543-d5a1-47c3-913e-c5453fc4a538 on n-h1-863052-1 Oct 31 14:11:24.544745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d8bb3481-bb57-4e7e-a08c-8637ab97dc6e req-5c3f4dd8-0d2e-4429-9c01-9c0f73b1ab54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036580 Oct 31 14:11:24.545467 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 920/2050] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:24.551748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:24.552473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:24.560359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.560868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.561321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.562221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.562769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.563324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.830119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:24.851697 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba3b49e8-074b-44df-b06e-049f0dc58a4d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.304805 Oct 31 14:11:24.888100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 921/2051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:24 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:24.897524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:24.898147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:24.905484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.905976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.906590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:24.907423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:24.908162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:24.908691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.007337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.021770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5e72f62-b0dc-4632-970c-9603302df2eb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.774695 Oct 31 14:11:25.024345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1131/2052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:24 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:25.034130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:25.035087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:25.043772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.044560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.045130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.045977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.046598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.047157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.072740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:25.115073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.125411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.127115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.128341 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b195574c-7e2e-45f2-9e69-2321bc190c6e tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1729 microversion: 2.25 time: 0.235683 Oct 31 14:11:25.129212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=26 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:25.129416 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 922/2053] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:24 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:25.133804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-756c3e7d-3911-4c4d-8347-4698c822dc6f req-2ed4741d-da3d-4140-ba11-8cdcd4e7f3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1095a41a-149d-4705-bec8-b03e23850a02", "tag": "5c82f5fc-d3f2-40b6-8df8-4b205e62b0a3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:25.143823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-756c3e7d-3911-4c4d-8347-4698c822dc6f req-2ed4741d-da3d-4140-ba11-8cdcd4e7f3b6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.144501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-756c3e7d-3911-4c4d-8347-4698c822dc6f req-2ed4741d-da3d-4140-ba11-8cdcd4e7f3b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.145673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-756c3e7d-3911-4c4d-8347-4698c822dc6f req-2ed4741d-da3d-4140-ba11-8cdcd4e7f3b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.158857 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-756c3e7d-3911-4c4d-8347-4698c822dc6f req-2ed4741d-da3d-4140-ba11-8cdcd4e7f3b6 service nova] Creating event network-changed:5c82f5fc-d3f2-40b6-8df8-4b205e62b0a3 for instance 1095a41a-149d-4705-bec8-b03e23850a02 on n-h2-863052-1 Oct 31 14:11:25.165795 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-756c3e7d-3911-4c4d-8347-4698c822dc6f req-2ed4741d-da3d-4140-ba11-8cdcd4e7f3b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035175 Oct 31 14:11:25.166869 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 923/2054] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:25.196009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:25.197006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:25.203209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.203785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.204285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.205078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.205599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.206188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.348615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.356666 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a9938b4-cf9c-49ca-bdab-aa51fc194f86 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1511 microversion: 2.1 time: 0.165488 Oct 31 14:11:25.357239 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 924/2055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:25 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:25.362201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:25.362887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:25.368957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.369492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.369926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.370645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.371092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.371512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.383111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.391375 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c359f514-fda6-4ae0-8666-13669db60d60 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.365416 Oct 31 14:11:25.391976 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1132/2056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:25 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:25.530846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:25.531471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:25.537117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.545138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.545664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.547347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.548092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.548561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.548996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.553065 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-03b26fdd-766f-4cd7-a873-ea83c94635b2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 0.193764 Oct 31 14:11:25.569835 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 925/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:25 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:25.724883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31ded04a-0c3e-4917-afb0-3cd3d1cc5574 tempest-FloatingIPDetailsNegativeTestJSON-850341778 tempest-FloatingIPDetailsNegativeTestJSON-850341778-project] Calling method '.version_select at 0x7fe10757af70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:25.779371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:25.784443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-31ded04a-0c3e-4917-afb0-3cd3d1cc5574 tempest-FloatingIPDetailsNegativeTestJSON-850341778 tempest-FloatingIPDetailsNegativeTestJSON-850341778-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 30fb603d-58d9-468b-9a7c-9faffe57460e could not be found", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:11:25.785516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-31ded04a-0c3e-4917-afb0-3cd3d1cc5574 tempest-FloatingIPDetailsNegativeTestJSON-850341778 tempest-FloatingIPDetailsNegativeTestJSON-850341778-project] HTTP exception thrown: Floating IP not found for ID 30fb603d-58d9-468b-9a7c-9faffe57460e Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31ded04a-0c3e-4917-afb0-3cd3d1cc5574 tempest-FloatingIPDetailsNegativeTestJSON-850341778 tempest-FloatingIPDetailsNegativeTestJSON-850341778-project] Request method failure captured: Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-floating-ips/30fb603d-58d9-468b-9a7c-9faffe57460e HTTP/1.1 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eNKEHbjFB6TP9sX8A24AoWIvmbgXoMHwHCvsBFR_d2C8tFbRSJ9YE2VeguPsRgAP_qhzc7HIuGon57IwyE6f_KGKADcpMsAecRCUXtkVbsJLsdX5sh4FSx2LQS-Vf6M63WPYDY-6IctxuvN8JWCj8R7hA8rFvfXEYMNFAa_-9Ya9k Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 9acb08eb2e30490089925ccd6b248e15 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-850341778 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9acb08eb2e30490089925ccd6b248e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9acb08eb2e30490089925ccd6b248e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9acb08eb2e30490089925ccd6b248e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9acb08eb2e30490089925ccd6b248e15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-850341778 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 9acb08eb2e30490089925ccd6b248e15 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-850341778 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-850341778-project Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 976dadeecee6436b954668ce72eb055d Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-850341778-project Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: exception: Floating IP not found for ID 30fb603d-58d9-468b-9a7c-9faffe57460e Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '30fb603d-58d9-468b-9a7c-9faffe57460e'} Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 30fb603d-58d9-468b-9a7c-9faffe57460e could not be found Oct 31 14:11:25.788232 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66f5092d-2074-48d0-905e-609c69ed1751'] Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 30fb603d-58d9-468b-9a7c-9faffe57460e. Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 30fb603d-58d9-468b-9a7c-9faffe57460e Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 30fb603d-58d9-468b-9a7c-9faffe57460e Oct 31 14:11:25.791744 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:25.794621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31ded04a-0c3e-4917-afb0-3cd3d1cc5574 tempest-FloatingIPDetailsNegativeTestJSON-850341778 tempest-FloatingIPDetailsNegativeTestJSON-850341778-project] Returning 404 to user: Floating IP not found for ID 30fb603d-58d9-468b-9a7c-9faffe57460e {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:25.795710 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31ded04a-0c3e-4917-afb0-3cd3d1cc5574 tempest-FloatingIPDetailsNegativeTestJSON-850341778 tempest-FloatingIPDetailsNegativeTestJSON-850341778-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/30fb603d-58d9-468b-9a7c-9faffe57460e" status: 404 len: 111 microversion: 2.1 time: 0.138331 Oct 31 14:11:25.802739 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 926/2058] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:11:25 2022] GET /compute/v2.1/os-floating-ips/30fb603d-58d9-468b-9a7c-9faffe57460e => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:11:25.807619 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8b55987-5be5-46ed-b8ef-f970bb6c3d2f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.280373 Oct 31 14:11:25.828414 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1133/2059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:25 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:25.883036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:25.886150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:25.899488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.901012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.901851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:25.903318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:25.906396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:25.907229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.061873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:26.065825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:26.085833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.092219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.093606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.094614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.095912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.096656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.637872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:26.659707 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7160634-9772-47aa-b306-529f86961ad5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.612780 Oct 31 14:11:26.671253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1134/2060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:26 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:26.703870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:26.708845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:26.740127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.740650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.746726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.749532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.752092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.752558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.843986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:26.859183 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0dacb2e3-7d98-40ae-8812-cc39228cbf2f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.983998 Oct 31 14:11:26.859781 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 927/2061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:25 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:26.867219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:26.868972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:26.886144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.886666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.889056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.889996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.890670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.895435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.941234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:26.942381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:26.942775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:26.948295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lazy-loading 'fault' on Instance uuid 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:11:27.061847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:27.078433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:27.085136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:27.087384 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d13143ef-2314-4a0b-a044-7d1231fe1538 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 200 len: 1374 microversion: 2.25 time: 0.412977 Oct 31 14:11:27.090858 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1135/2062] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:26 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 1374 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:27.124525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:27.126760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:27.163166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.163657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.164461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:27.164798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.165239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.165659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:27.473257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:27.490547 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70410625-35b9-4cff-af24-97a6c3aef906 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1511 microversion: 2.1 time: 0.627095 Oct 31 14:11:27.491218 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 928/2063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:26 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1511 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:27.508523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:27.510361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:27.528604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.529653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.532128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:27.533077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.537600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.538360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:27.637175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:27.647344 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c8583b5-f33b-4dd0-9991-712d0bf8fe91 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.538257 Oct 31 14:11:27.654320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1136/2064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:27 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:27.661735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1fecba46-04dd-4135-9150-b83b9412727a req-c43599d5-947a-4a6e-9b11-621e782d49bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6c9d2-b928-495e-a5cf-188bd6f5c7c8", "name": "network-vif-deleted", "tag": "3c9ce681-9ef5-4ef2-865a-938931cd612a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:27.686186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1fecba46-04dd-4135-9150-b83b9412727a req-c43599d5-947a-4a6e-9b11-621e782d49bc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.687197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1fecba46-04dd-4135-9150-b83b9412727a req-c43599d5-947a-4a6e-9b11-621e782d49bc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.688009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1fecba46-04dd-4135-9150-b83b9412727a req-c43599d5-947a-4a6e-9b11-621e782d49bc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:27.712984 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1fecba46-04dd-4135-9150-b83b9412727a req-c43599d5-947a-4a6e-9b11-621e782d49bc service nova] Creating event network-vif-deleted:3c9ce681-9ef5-4ef2-865a-938931cd612a for instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 on n-h2-863052-1 Oct 31 14:11:27.726130 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1fecba46-04dd-4135-9150-b83b9412727a req-c43599d5-947a-4a6e-9b11-621e782d49bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069048 Oct 31 14:11:27.729066 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1137/2065] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:27.742708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:27.744270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:27.752610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.753396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.753815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:27.754795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:27.755478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:27.755849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.114208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:28.124195 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30765176-cfe8-4143-9bbc-688f0dc3780b tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.393650 Oct 31 14:11:28.130290 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1138/2066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:27 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:28.142901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:28.146296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:28.152949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.156076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.156721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.157609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.158235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.158799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.320529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:28.332600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58919305-d543-408f-a7c1-1761807a6607 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 0.837341 Oct 31 14:11:28.343783 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 929/2067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:27 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:28.349368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:28.358585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:28.374862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.383030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.384460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.385386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.386033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.386663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.465567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:28.476721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eadb5b84-4521-4bbd-af06-f091b0a5a857 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.344930 Oct 31 14:11:28.478909 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1139/2068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:28 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:28.484537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:28.485852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:28.500488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.501406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.502148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.503065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.503705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.504364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.528992 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] HTTP exception thrown: Instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 could not be found. Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Request method failure captured: Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 HTTP/1.1 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XHpTTdheSm88LK25aNFR3GFmsoZGCVbmlawotOndhw2SCLBuA2tRM1IKSie6ra5R2-nB1TJWt0C9vQJ6KzaE71p2bA-megy5UHNImRE8RyoEJQTqTmTUYlgeMFIeaBiU0pVvtagsqh-Ustq9Tpf0bumiLRnrGDpDnYVMFW1p4saZc Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c75cb8d7db204534bc02ad16c859c108", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 57251d140f49460087e4cf90f6b94a78 Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 could not be found. Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '60d6c9d2-b928-495e-a5cf-188bd6f5c7c8'} Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 could not be found. Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 could not be found. Oct 31 14:11:28.531319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 could not be found. Oct 31 14:11:28.534468 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:28.537077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Returning 404 to user: Instance 60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:28.538353 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75b47c8d-dd4c-43b4-90aa-8177b991137a tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8" status: 404 len: 111 microversion: 2.25 time: 0.057534 Oct 31 14:11:28.539801 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1140/2069] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:28 2022] GET /compute/v2.1/servers/60d6c9d2-b928-495e-a5cf-188bd6f5c7c8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:11:28.549415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:28.550510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:28.562780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.563646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.564305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.565264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.565928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.566963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.718984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:28.727756 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b96b3ae-1890-4bdc-9053-c8a4cfdc6db4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1511 microversion: 2.1 time: 0.186598 Oct 31 14:11:28.742679 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1141/2070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:28 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:28.750792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18377f65-198e-4b64-8c57-0759e0248a95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '.version_select at 0x7fe107440c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:28.777263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18377f65-198e-4b64-8c57-0759e0248a95 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84781145" status: 204 len: 0 microversion: 2.25 time: 0.032809 Oct 31 14:11:28.778538 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1142/2071] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:11:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84781145 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:11:28.795548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:28.801040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:28.811854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.815999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.816755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.817721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:28.821234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:28.821901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:28.831566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:29.159105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:29.167781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:29.170701 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5473e674-0c98-42c9-8f62-ed4c3b66f9dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1314 microversion: 2.1 time: 0.389819 Oct 31 14:11:29.174616 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1143/2072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:28 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:29.186021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:29.187107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:29.189779 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-39f3a930-48e9-4988-ad73-e1acccfef32e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.844705 Oct 31 14:11:29.191941 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 930/2073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:28 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:29.209231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:29.210373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:29.211115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:29.212079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:29.213188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:29.213840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:29.366557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:29.369718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:29.380842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:29.381645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:29.382576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:29.383699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:29.384354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:29.384919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:29.472789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:29.481940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78c0ec91-4b82-4e26-8127-fb1f94131758 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.305895 Oct 31 14:11:29.489025 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1144/2074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:29 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:29.502638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:29.503508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:29.512273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:29.513395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:29.514055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:29.515035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:29.515684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:29.516300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.031078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:30.039413 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d32b74d3-c40c-4a4f-81dd-7b23459a7ba2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.541335 Oct 31 14:11:30.039994 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1145/2075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:29 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:30.048899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5fdde6eb-f99e-4397-8a89-3407e8066a15 req-5991e445-abd8-4d25-b01a-a71aa10d98c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "name": "network-vif-plugged", "status": "completed", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:30.073220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5fdde6eb-f99e-4397-8a89-3407e8066a15 req-5991e445-abd8-4d25-b01a-a71aa10d98c4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.073930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5fdde6eb-f99e-4397-8a89-3407e8066a15 req-5991e445-abd8-4d25-b01a-a71aa10d98c4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.075698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5fdde6eb-f99e-4397-8a89-3407e8066a15 req-5991e445-abd8-4d25-b01a-a71aa10d98c4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.101252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5fdde6eb-f99e-4397-8a89-3407e8066a15 req-5991e445-abd8-4d25-b01a-a71aa10d98c4 service nova] Creating event network-vif-plugged:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:11:30.109613 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5fdde6eb-f99e-4397-8a89-3407e8066a15 req-5991e445-abd8-4d25-b01a-a71aa10d98c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064693 Oct 31 14:11:30.116881 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1146/2076] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:30.127150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:30.129638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:30.145129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.145860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.146490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.147380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.153367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.158880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.403863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:30.432897 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc54a277-2bab-47b3-9bd2-a163a2c4bcf2 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 1.078052 Oct 31 14:11:30.440181 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 931/2077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:29 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:30.445403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-86061565-dd13-473a-9757-8a589aa07003 req-2f05bd81-b29b-4394-a2af-f0153f6e6a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0ca596-84a5-4c7e-9bb9-61db23198bbd", "name": "network-vif-unplugged", "status": "completed", "tag": "1cd69f06-d33d-4e41-a094-e2d1440a38cd"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:30.487670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-86061565-dd13-473a-9757-8a589aa07003 req-2f05bd81-b29b-4394-a2af-f0153f6e6a5c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.488665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-86061565-dd13-473a-9757-8a589aa07003 req-2f05bd81-b29b-4394-a2af-f0153f6e6a5c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.491640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-86061565-dd13-473a-9757-8a589aa07003 req-2f05bd81-b29b-4394-a2af-f0153f6e6a5c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.509916 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-86061565-dd13-473a-9757-8a589aa07003 req-2f05bd81-b29b-4394-a2af-f0153f6e6a5c service nova] Creating event network-vif-unplugged:1cd69f06-d33d-4e41-a094-e2d1440a38cd for instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd on n-h2-863052-1 Oct 31 14:11:30.516452 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-86061565-dd13-473a-9757-8a589aa07003 req-2f05bd81-b29b-4394-a2af-f0153f6e6a5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074679 Oct 31 14:11:30.518037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 932/2078] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:30.525197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:30.526338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:30.534865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.536225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.536866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.537968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.538709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.539366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.917678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:30.933768 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97fb4477-1ab7-4990-9009-73ff788726d9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1511 microversion: 2.1 time: 0.815189 Oct 31 14:11:30.936568 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1147/2079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:30 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1511 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:30.947090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:30.948060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:30.960027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.964836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.965571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:30.966553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:30.969484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:30.971337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.079356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:31.093167 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0016446a-0051-40a0-8099-57ea8e3b573b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1501 microversion: 2.1 time: 0.571449 Oct 31 14:11:31.093755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 933/2080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:30 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1501 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:31.107807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.108433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.122837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.125174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.125903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.128963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.130934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.131505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.187339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:31.197130 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a62f77aa-acc1-4314-891c-a96c15d1e580 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.259226 Oct 31 14:11:31.198482 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1148/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:30 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:31.203292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.204251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.211325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.212016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.212595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.213458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.214235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.214800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.425963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:31.436338 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1f6bcd7-2a0b-455e-8990-0dca8fee99e8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.236272 Oct 31 14:11:31.437500 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1149/2082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:31 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:31.443212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00ee99a7-5d41-47d2-9aeb-db2ad1acc848 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:31.449496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ee99a7-5d41-47d2-9aeb-db2ad1acc848 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.452007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ee99a7-5d41-47d2-9aeb-db2ad1acc848 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.452690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ee99a7-5d41-47d2-9aeb-db2ad1acc848 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.522215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00ee99a7-5d41-47d2-9aeb-db2ad1acc848 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Going to try to stop instance {{(pid=120640) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:11:31.577795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00ee99a7-5d41-47d2-9aeb-db2ad1acc848 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5/action" status: 202 len: 0 microversion: 2.1 time: 0.138707 Oct 31 14:11:31.579418 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1150/2083] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:11:31 2022] POST /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:11:31.603312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.604319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.618875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.619903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.620471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.621005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.621559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.623075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.632378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:31.642626 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc8f643e-bc5d-4e7d-a148-e6ccc7c520ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.546057 Oct 31 14:11:31.644172 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 934/2084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:31 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:31.657557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.658257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.668115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:11:31.675362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.676518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.676966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.677674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.678136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.678587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.694035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:31.771590 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80aa59ef-2246-4723-ae98-b6f911abaaa3 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 204 len: 0 microversion: 2.25 time: 0.189657 Oct 31 14:11:31.772165 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1151/2085] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:11:31 2022] DELETE /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:11:31.777782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.779099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.788215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.788714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.789150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.790238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.790422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.790830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.947788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:31.959485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:31.963559 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aecd2b35-42c0-4e89-8f32-f310f8bf12d0 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 0.318019 Oct 31 14:11:31.965072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 935/2086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:31 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:31.969419 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21edb0ac-2868-4db3-a51d-c3af87d13d97 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.195970 Oct 31 14:11:31.970287 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1152/2087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:31 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:31.975916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.976700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.982674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:31.983332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.983983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.984562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.985400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.985580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:31.986156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.987788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.995454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.996156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.997074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:31.998069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:31.998931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:31.999584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.138211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:32.151429 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45fd5c66-70a0-471b-a489-871f3288e52c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1517 microversion: 2.1 time: 0.179890 Oct 31 14:11:32.152009 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1153/2088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:31 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:32.214183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51a9543-d5a1-47c3-913e-c5453fc4a538", "name": "network-vif-plugged", "status": "completed", "tag": "98abb853-920f-4edd-82ef-b19d0a5a0a60"}, {"server_uuid": "1095a41a-149d-4705-bec8-b03e23850a02", "name": "network-vif-plugged", "status": "completed", "tag": "5c82f5fc-d3f2-40b6-8df8-4b205e62b0a3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:32.234228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.236549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.237532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.318924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] Creating event network-vif-plugged:98abb853-920f-4edd-82ef-b19d0a5a0a60 for instance e51a9543-d5a1-47c3-913e-c5453fc4a538 on n-h1-863052-1 Oct 31 14:11:32.319875 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] Creating event network-vif-plugged:5c82f5fc-d3f2-40b6-8df8-4b205e62b0a3 for instance 1095a41a-149d-4705-bec8-b03e23850a02 on n-h2-863052-1 Oct 31 14:11:32.345185 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-191923b3-7bba-4203-a39a-f0b14f88b932 req-cc7f33ba-1fca-476d-9656-ae99d5b34798 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134552 Oct 31 14:11:32.348460 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1154/2089] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:32.362497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:32.363274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:32.373005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.373547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.374354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.375094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.375519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.376090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.556008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:32.566233 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5cb3dec5-b861-4c91-a73a-570cdb8a46a8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.216416 Oct 31 14:11:32.582549 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1155/2090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:32 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:32.582549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:32.582549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:32.591978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.592477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.592926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.594267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.594749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.595244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.784339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:32.794357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02a71248-ed73-4cdc-9968-b4d069f36be4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.223977 Oct 31 14:11:32.795358 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1156/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:32 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:32.801273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:32.802197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:32.808810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.809533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.810933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.811189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:32.811735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:32.812253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:32.998776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.014700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.017767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.023337 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bf0e4ccb-99ab-4999-b48c-93a7a9d4d31c tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1548 microversion: 2.25 time: 1.057036 Oct 31 14:11:33.027376 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 936/2092] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:31 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1548 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:33.029097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.041968 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b1e26c1-4c37-4047-82d3-abb17beb1b5e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.245322 Oct 31 14:11:33.043056 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1157/2093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:32 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:33.044405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7aef7af3-89de-4125-afda-8789290412dc req-2dfa64ff-2c90-45c8-a8db-7f32d634a13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0ca596-84a5-4c7e-9bb9-61db23198bbd", "tag": "1cd69f06-d33d-4e41-a094-e2d1440a38cd"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:33.048330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:33.049365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:33.056954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.057642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.058254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.059095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.059763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.060331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.065450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7aef7af3-89de-4125-afda-8789290412dc req-2dfa64ff-2c90-45c8-a8db-7f32d634a13c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.070200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7aef7af3-89de-4125-afda-8789290412dc req-2dfa64ff-2c90-45c8-a8db-7f32d634a13c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.071332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7aef7af3-89de-4125-afda-8789290412dc req-2dfa64ff-2c90-45c8-a8db-7f32d634a13c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.092169 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7aef7af3-89de-4125-afda-8789290412dc req-2dfa64ff-2c90-45c8-a8db-7f32d634a13c service nova] Creating event network-changed:1cd69f06-d33d-4e41-a094-e2d1440a38cd for instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd on n-h2-863052-1 Oct 31 14:11:33.105480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:33.107776 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7aef7af3-89de-4125-afda-8789290412dc req-2dfa64ff-2c90-45c8-a8db-7f32d634a13c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076813 Oct 31 14:11:33.111670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 937/2094] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:33.121172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:33.122842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:33.131826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.132458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.133004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.134443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.135126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.135659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.315084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.330917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdaca56c-6654-449e-8477-a93c9b4447f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.286533 Oct 31 14:11:33.331426 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1158/2095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:33 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:33.591021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:33.591574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:33.604338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.604829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.609429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.614340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.614897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.615347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.683906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.694994 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf9884c3-953d-4f07-9e4b-be133e384ac8 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1317 microversion: 2.1 time: 0.581882 Oct 31 14:11:33.698556 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 938/2096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:33 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:33.838657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:33.839283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:33.849464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.850757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.851296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.852252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:33.853034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:33.854418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:33.905900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:33.917628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c2d8662-ead6-4ec1-bfa8-b230283459ac tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.332377 Oct 31 14:11:33.918861 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1159/2097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:33 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:34.072743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:34.074289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:34.080707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.081202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.081641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.083237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.083864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.084297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.127630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.128781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.129228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.129685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lazy-loading 'fault' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:11:34.177281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:34.186961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:34.188618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:34.189383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:34.190749 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d6184d8-8b40-46cb-9897-faa3e6b08411 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1352 microversion: 2.25 time: 0.122096 Oct 31 14:11:34.191353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1160/2098] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:34 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:11:34.196128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:34.196742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:34.202873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.203706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.204378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.205087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.205548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.205978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.214300 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e8becc2f-d62a-4a61-98e5-9e72fc0cec43 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1317 microversion: 2.1 time: 0.395900 Oct 31 14:11:34.215426 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 939/2099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:33 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:34.357460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:34.358023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:34.367946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.369259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.369847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.370791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.371810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.372422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.376604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:34.385927 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e1e310c-d50f-42fe-889f-f51dff22e8b3 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.193360 Oct 31 14:11:34.386973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1161/2100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:34 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:34.719032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:34.719672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:34.726495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.726984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.727470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.728173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.728624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.729226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.891985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:34.905206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e54d5490-22ab-454e-83de-c889c66ddb3a tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1507 microversion: 2.1 time: 0.189659 Oct 31 14:11:34.921582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1162/2101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:34 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:34.928837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5dd9a447-b055-49ec-abf9-fa6dbacaf4fb tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'create', calling method: .version_select at 0x7fe10745ef70>, body: {"keypair": {"name": "tempest-keypair-982463534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhHP7nwTaNrSaB6sRz7vzTECnlN9gRhWsWKkbjMKwLMb+T2CkurnlkAKf1SZF+JZx3daAVRSfnB96M2JcTqn6ZDrp9HQogKXAi6OmbZDGKaGp0T1tTkLkV8Vz4wPSjf0w=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:34.947316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5dd9a447-b055-49ec-abf9-fa6dbacaf4fb tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:34.953731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5dd9a447-b055-49ec-abf9-fa6dbacaf4fb tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for user b4c57016556840538b9f426b9cd9e540 and project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:34.966074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:34.981476 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5dd9a447-b055-49ec-abf9-fa6dbacaf4fb tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058590 Oct 31 14:11:34.982410 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1163/2102] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:11:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:34.987115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:34.987825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:34.995762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.996414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.996999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:34.997860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:34.998508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:34.999406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.072240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:35.082505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:35.084854 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a80b12d-140c-403a-894f-960981869abb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.733071 Oct 31 14:11:35.087009 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce6cb933-a4a9-458a-92f6-4401beecde10 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02/os-instance-actions/req-83247909-1245-41c7-8c2f-17c560a0aedc" status: 200 len: 313 microversion: 2.1 time: 0.102711 Oct 31 14:11:35.088433 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 940/2103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:34 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:35.089459 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1164/2104] 10.222.0.27 () {58 vars in 1419 bytes} [Mon Oct 31 14:11:34 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02/os-instance-actions/req-83247909-1245-41c7-8c2f-17c560a0aedc => generated 313 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:35.098638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:35.099277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:35.107830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:35.110192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:35.118792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.119374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.121355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.123743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.125967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.126450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.131320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.131826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.133558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.137779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.138304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.142280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.325324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2f6fb19-d68d-43f1-95db-a45e55c39a47 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "POST /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02/action" status: 202 len: 0 microversion: 2.1 time: 0.223716 Oct 31 14:11:35.326579 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1165/2105] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:11:35 2022] POST /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:11:35.338961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:35.344723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:35.356458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.356943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.357378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.358079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.358555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.358978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.450939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.451386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.451828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.452472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lazy-loading 'fault' on Instance uuid 51b9c3a6-7448-4c96-af32-93c724e53d67 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:11:35.596516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:35.614445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:35.615833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:35.617051 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e606947a-2373-499b-a91c-de881ba0f6cc tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 200 len: 1352 microversion: 2.25 time: 0.289000 Oct 31 14:11:35.617588 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1166/2106] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:35 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 1352 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:35.631211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7b547865-49af-4e77-a8a6-63aed184739d req-d70f32aa-b6fb-49b5-8a2e-67100b6dc680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f9e762-ff51-4111-946e-50eaa69df94b", "name": "network-vif-plugged", "status": "completed", "tag": "98a382a7-f2e3-4e9d-bd8c-950abec1c5f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:35.654679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7b547865-49af-4e77-a8a6-63aed184739d req-d70f32aa-b6fb-49b5-8a2e-67100b6dc680 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.655322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7b547865-49af-4e77-a8a6-63aed184739d req-d70f32aa-b6fb-49b5-8a2e-67100b6dc680 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.655895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7b547865-49af-4e77-a8a6-63aed184739d req-d70f32aa-b6fb-49b5-8a2e-67100b6dc680 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.676840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7b547865-49af-4e77-a8a6-63aed184739d req-d70f32aa-b6fb-49b5-8a2e-67100b6dc680 service nova] Creating event network-vif-plugged:98a382a7-f2e3-4e9d-bd8c-950abec1c5f8 for instance c4f9e762-ff51-4111-946e-50eaa69df94b on n-h1-863052-1 Oct 31 14:11:35.682832 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7b547865-49af-4e77-a8a6-63aed184739d req-d70f32aa-b6fb-49b5-8a2e-67100b6dc680 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059419 Oct 31 14:11:35.684325 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1167/2107] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:35.684731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:35.690260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:35.691350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:35.694590 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7f0b8e52-1dfe-4c6c-9f84-0dc637d6b599 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.604969 Oct 31 14:11:35.695180 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 941/2108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:35 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:35.699406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.699993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.700528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.701413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.702241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.702741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.704860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-419b2c1f-1ced-4ee9-9ead-5e0cb01418ad req-e043f9b2-9dc5-49e9-90c3-92257339c35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b9c3a6-7448-4c96-af32-93c724e53d67", "name": "network-vif-deleted", "tag": "c312fc2c-6a72-4889-aa42-da10a17782ca"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:35.719650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-419b2c1f-1ced-4ee9-9ead-5e0cb01418ad req-e043f9b2-9dc5-49e9-90c3-92257339c35d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.720498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-419b2c1f-1ced-4ee9-9ead-5e0cb01418ad req-e043f9b2-9dc5-49e9-90c3-92257339c35d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.721080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-419b2c1f-1ced-4ee9-9ead-5e0cb01418ad req-e043f9b2-9dc5-49e9-90c3-92257339c35d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.734593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-419b2c1f-1ced-4ee9-9ead-5e0cb01418ad req-e043f9b2-9dc5-49e9-90c3-92257339c35d service nova] Creating event network-vif-deleted:c312fc2c-6a72-4889-aa42-da10a17782ca for instance 51b9c3a6-7448-4c96-af32-93c724e53d67 on n-h1-863052-1 Oct 31 14:11:35.742777 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-419b2c1f-1ced-4ee9-9ead-5e0cb01418ad req-e043f9b2-9dc5-49e9-90c3-92257339c35d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046228 Oct 31 14:11:35.743936 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 942/2109] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:35.755426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:35.756262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:35.767847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.798799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.799374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:35.806872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:35.807593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:35.808192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.136666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:36.147743 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa94200e-348f-4802-99b5-22b8960eaee3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1506 microversion: 2.1 time: 0.461781 Oct 31 14:11:36.166621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1168/2110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:35 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:36.172000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:36.172827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:36.180544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.181361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.182553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.183460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.184081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.184661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.224583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:36.244316 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-836faf2e-269b-4e57-9b51-f2cce9376da9 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1509 microversion: 2.1 time: 0.498669 Oct 31 14:11:36.257303 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 943/2111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:35 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:36.266703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:36.267339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:36.270522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:36.282648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.283158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.283590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.286482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.288194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.288780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.606726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:36.619558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-919282ee-4b26-47ee-8fe2-4f76a8ae5e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.451570 Oct 31 14:11:36.622623 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1169/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:36 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:36.632452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:36.636278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:36.644499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:36.648345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.651979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.652806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.653729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.656999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.657647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.663090 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40b07b04-a784-443d-bc9f-6a847657390f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.408482 Oct 31 14:11:36.665477 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 944/2113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:36 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:36.683492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:36.684141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 51b9c3a6-7448-4c96-af32-93c724e53d67] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:36.703798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.704355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.705028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.708153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.708622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.710129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.730469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] HTTP exception thrown: Instance 51b9c3a6-7448-4c96-af32-93c724e53d67 could not be found. Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Request method failure captured: Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 HTTP/1.1 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9XHpTTdheSm88LK25aNFR3GFmsoZGCVbmlawotOndhw2SCLBuA2tRM1IKSie6ra5R2-nB1TJWt0C9vQJ6KzaE71p2bA-megy5UHNImRE8RyoEJQTqTmTUYlgeMFIeaBiU0pVvtagsqh-Ustq9Tpf0bumiLRnrGDpDnYVMFW1p4saZc Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c75cb8d7db204534bc02ad16c859c108", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 57251d140f49460087e4cf90f6b94a78 Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 51b9c3a6-7448-4c96-af32-93c724e53d67 could not be found. Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '51b9c3a6-7448-4c96-af32-93c724e53d67'} Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b9c3a6-7448-4c96-af32-93c724e53d67 could not be found. Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b9c3a6-7448-4c96-af32-93c724e53d67 could not be found. Oct 31 14:11:36.732979 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b9c3a6-7448-4c96-af32-93c724e53d67 could not be found. Oct 31 14:11:36.736167 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:36.738971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Returning 404 to user: Instance 51b9c3a6-7448-4c96-af32-93c724e53d67 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:36.740530 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a83c735-ae19-422b-b4ef-96aac93e6e36 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67" status: 404 len: 111 microversion: 2.25 time: 0.069951 Oct 31 14:11:36.741810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 945/2114] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:36 2022] GET /compute/v2.1/servers/51b9c3a6-7448-4c96-af32-93c724e53d67 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:11:36.748221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:36.749245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:36.756022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.756828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.757478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:36.758863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:36.759600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:36.760258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.000049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:37.001657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:37.014063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1001b005-471e-46a9-a150-ab868b94df09 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1318 microversion: 2.1 time: 0.270912 Oct 31 14:11:37.014710 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9dc751e4-84c6-410f-83a6-05a55a04fbd3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1506 microversion: 2.1 time: 0.390779 Oct 31 14:11:37.015050 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 946/2115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:36 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:37.015295 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1170/2116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:36 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:37.025771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:37.034316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.041561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:37.043950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.044938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.047643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.048285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.052553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.053388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.053988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.063072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.063624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.064139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.065791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.066850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.067297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.146851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:11:37.170839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:37.171647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:37.172274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:37.172865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:37.173430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:37.257251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.265109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.265865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.266513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.267775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.268438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.269620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.313478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f27f9e2-f21d-4a6c-a892-50fe9909c2c4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "POST /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538/action" status: 202 len: 1108 microversion: 2.1 time: 0.275998 Oct 31 14:11:37.315113 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 947/2117] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:11:37 2022] POST /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538/action => generated 1108 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 14:11:37.321369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:37.322475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.330538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.331507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.332332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.334228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.334953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.335784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.476248 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85414124-14d0-41e1-8e61-1c8833d3a749 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 204 len: 0 microversion: 2.25 time: 0.459479 Oct 31 14:11:37.479291 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1171/2118] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:11:37 2022] DELETE /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:11:37.506558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:37.509429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.523848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.524443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.525397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.526391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.528557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.534589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.735626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:37.761864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bec3f4ab-1b76-4beb-87af-6d68dc03d338 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1509 microversion: 2.1 time: 0.442437 Oct 31 14:11:37.762775 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 948/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:37 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:37.787052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:37.788859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.805753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.811191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.811873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.827842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.828707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.829476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.857983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:37.871546 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e48147e-5ffd-4f79-aaab-1713ae62f053 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.390674 Oct 31 14:11:37.872153 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1172/2120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:37 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:37.893586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:37.894230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:37.916406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.917123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.917712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.919958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:37.920450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:37.920888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:37.967665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:38.141709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:38.159678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:38.163296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:38.167097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e793cc3b-c9e2-487b-8dfd-8beeecd5c190 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1563 microversion: 2.25 time: 0.399592 Oct 31 14:11:38.168125 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 949/2121] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:37 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1563 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:38.180132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:38.181065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:38.219297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:38.219848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:38.220408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:38.222417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:38.222887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:38.223501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:38.227472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:38.239110 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-926278d1-5b99-493d-bb20-3d696a84f167 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.365908 Oct 31 14:11:38.265012 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1173/2122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:37 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:38.281411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:38.282300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:38.309945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:38.311278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:38.311880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:38.313018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:38.313611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:38.314192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:38.651817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:38.664374 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-875b2b37-f486-4770-9113-9a164595675f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.493686 Oct 31 14:11:38.665592 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 950/2123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:38 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:38.798736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:38.800463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:38.815259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:38.817838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:38.818575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:38.822046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:38.825043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:38.825992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:38.954014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:38.965324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0342bec1-c837-4f99-9bef-b0e131f2c03c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1468 microversion: 2.1 time: 0.697263 Oct 31 14:11:38.967308 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1174/2124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:38 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1468 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:38.986535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:38.987398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:38.998697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.011196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.014405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.015651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.016398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.017255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.143377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:39.148659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:39.163755 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6cd544e2-88cd-4d56-b806-074ab0f1f904 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1507 microversion: 2.1 time: 0.368739 Oct 31 14:11:39.165064 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 951/2125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:38 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:39.171160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:39.172100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:39.181095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.182102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.182810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.183771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.184592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.185237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.302912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:39.317648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dfddea2b-c1a7-4868-a336-016b42d9ab9f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.348835 Oct 31 14:11:39.334259 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1175/2126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:38 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:39.339704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '.version_select at 0x7fe107443d30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:39.340276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:39.351387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.351886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.352328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.353039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.355796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.360656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.472835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbbe4d9d-a5cc-45b2-b046-cf0897970b66 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.137293 Oct 31 14:11:39.478158 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1176/2127] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 31 14:11:39 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02/os-instance-actions => generated 611 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:39.483590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:39.484430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:39.492084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.492651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.493450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.494394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.494996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.495565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.546511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:39.556914 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-55461c06-7836-4b58-9d67-7816285d7e40 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1466 microversion: 2.1 time: 0.390213 Oct 31 14:11:39.557501 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 952/2128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:39 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:39.580219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:39.581067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:39.587718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.588554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.589182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.590071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.590750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.592123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.605396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:39.619329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:39.622766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57251d140f49460087e4cf90f6b94a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75cb8d7db204534bc02ad16c859c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:39.624229 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75f171a2-90ba-4fcd-8042-7b542303f6b7 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 200 len: 1521 microversion: 2.25 time: 0.144546 Oct 31 14:11:39.645598 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1177/2129] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:39 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:11:39.652273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:39.652785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:39.659207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.660358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.661417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.662225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.662687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.663109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.702236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:11:39.905839 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17272050-4af6-418a-afc7-ae03c91134f5 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 204 len: 0 microversion: 2.1 time: 0.258121 Oct 31 14:11:39.910680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1178/2130] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:11:39 2022] DELETE /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:11:39.916732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1496941037"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:39.919919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:39.931061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.931622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.932065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:39.932779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:39.933232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:39.933716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.127386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:40.135565 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b004af1-8cb3-41e8-9617-80388fff72a7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.564396 Oct 31 14:11:40.136139 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 953/2131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:39 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:40.145509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:40.147396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:40.154902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.155607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.156420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.157328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.157955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.158607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.208398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f760a5bc-b67a-4a22-a67b-e747d2950710 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "POST /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88/action" status: 202 len: 0 microversion: 2.1 time: 0.298888 Oct 31 14:11:40.208655 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1179/2132] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:11:39 2022] POST /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:11:40.218584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e96de2bb-9ec1-4f14-b45c-a44ed72b1799 req-8ddad946-fbdc-4192-bd6a-4293d6856150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e2d575-4378-4af3-a7df-7cd877f77090", "name": "network-vif-deleted", "tag": "304c534a-f4f7-4fee-a9f0-589142a7085e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:40.230666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e96de2bb-9ec1-4f14-b45c-a44ed72b1799 req-8ddad946-fbdc-4192-bd6a-4293d6856150 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.231148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e96de2bb-9ec1-4f14-b45c-a44ed72b1799 req-8ddad946-fbdc-4192-bd6a-4293d6856150 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.232179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e96de2bb-9ec1-4f14-b45c-a44ed72b1799 req-8ddad946-fbdc-4192-bd6a-4293d6856150 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.245589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e96de2bb-9ec1-4f14-b45c-a44ed72b1799 req-8ddad946-fbdc-4192-bd6a-4293d6856150 service nova] Creating event network-vif-deleted:304c534a-f4f7-4fee-a9f0-589142a7085e for instance 14e2d575-4378-4af3-a7df-7cd877f77090 on n-h1-863052-1 Oct 31 14:11:40.250842 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e96de2bb-9ec1-4f14-b45c-a44ed72b1799 req-8ddad946-fbdc-4192-bd6a-4293d6856150 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040632 Oct 31 14:11:40.251876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1180/2133] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:40.257324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:40.257846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:40.264398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.264890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.265323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.266220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.266668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.267415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.390670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:40.398461 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98609430-0dd5-4590-b53f-b6ee7b222bfd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.257099 Oct 31 14:11:40.399040 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 954/2134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:40 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:40.404348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1965303396", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "126b5c03-65a3-4c75-a75d-ef06aaf371a6"}], "security_groups": [{"name": "tempest-securitygroup--1043817892"}], "key_name": "tempest-keypair-982463534", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:40.499847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:40.508627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9ed9bc4-a72c-4957-8b9b-0979c0bf5815 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1513 microversion: 2.1 time: 0.255816 Oct 31 14:11:40.509521 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1181/2135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:40 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:40.514303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6eb06182-35ca-4b11-8f69-b2dec837be1a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc8d9d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:40.547798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] validate_networks() for [('126b5c03-65a3-4c75-a75d-ef06aaf371a6', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:40.566718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6eb06182-35ca-4b11-8f69-b2dec837be1a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.055974 Oct 31 14:11:40.575334 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1182/2136] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:40 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:40.580168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:40.580904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:40.587485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.588111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.588658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.589587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.590484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.591137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.752370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:40.761096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46a85893-3f11-4e6b-8bc3-665e4baf6200 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.184432 Oct 31 14:11:40.761492 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1183/2137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:40 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:40.766371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:40.767130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] [instance: 14e2d575-4378-4af3-a7df-7cd877f77090] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:40.773875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.774561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.776153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.777019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:40.777468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:40.777892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:40.791613 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] HTTP exception thrown: Instance 14e2d575-4378-4af3-a7df-7cd877f77090 could not be found. Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Request method failure captured: Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 HTTP/1.1 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9XHpTTdheSm88LK25aNFR3GFmsoZGCVbmlawotOndhw2SCLBuA2tRM1IKSie6ra5R2-nB1TJWt0C9vQJ6KzaE71p2bA-megy5UHNImRE8RyoEJQTqTmTUYlgeMFIeaBiU0pVvtagsqh-Ustq9Tpf0bumiLRnrGDpDnYVMFW1p4saZc Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c75cb8d7db204534bc02ad16c859c108", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c75cb8d7db204534bc02ad16c859c108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c75cb8d7db204534bc02ad16c859c108 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 57251d140f49460087e4cf90f6b94a78 Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1897116362-project Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 14e2d575-4378-4af3-a7df-7cd877f77090 could not be found. Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '14e2d575-4378-4af3-a7df-7cd877f77090'} Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e2d575-4378-4af3-a7df-7cd877f77090 could not be found. Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e2d575-4378-4af3-a7df-7cd877f77090 could not be found. Oct 31 14:11:40.793430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e2d575-4378-4af3-a7df-7cd877f77090 could not be found. Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] Returning 404 to user: Instance 14e2d575-4378-4af3-a7df-7cd877f77090 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd745f7d-8c61-4431-8ff5-99c68afa7ee9 tempest-LiveAutoBlockMigrationV225Test-1897116362 tempest-LiveAutoBlockMigrationV225Test-1897116362-project] 10.222.0.27 "GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090" status: 404 len: 111 microversion: 2.25 time: 0.033613 Oct 31 14:11:40.797327 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1184/2138] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:11:40 2022] GET /compute/v2.1/servers/14e2d575-4378-4af3-a7df-7cd877f77090 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:11:41.163284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:41.164029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:41.173009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:41.173759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:41.174220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:41.174942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:41.175400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:41.176457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:41.583958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:41.593971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22798f8e-d194-4a7a-9db4-0706176d0c2e tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1391 microversion: 2.1 time: 0.435917 Oct 31 14:11:41.606962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1185/2139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:41 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:41.617100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:41.617908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:41.624445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:41.625182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:41.625881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:41.626984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:41.627519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:41.628149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:41.757095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:41.757557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:41.757958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:41.759292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:41.760077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:41.781084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:41.782499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:41.785699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:41.788965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:41.790663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:41.791322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:41.826294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:41.834351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Getting quotas for user b4c57016556840538b9f426b9cd9e540 and project fa005082e4ff47b2a2dca2e27b6e0403. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:41.871133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:41.874061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:41.956258 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42e2cdd1-f878-4fa3-aa2d-777a8d2a38e6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.556136 Oct 31 14:11:41.957974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 955/2140] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:11:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:41.974075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:41.974944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:42.026929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.027445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.027895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.028628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.029083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.029569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.080579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:42.095546 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b04a632-810f-483c-b201-a71dec0b8073 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.485570 Oct 31 14:11:42.100298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1186/2141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:41 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:42.119325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e7d9c94-81fa-4af9-be2e-4e9416dde74c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1077954c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:42.186196 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e7d9c94-81fa-4af9-be2e-4e9416dde74c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.083664 Oct 31 14:11:42.195788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1187/2142] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:42 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:42.201725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:42.202610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:42.220012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.220711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.221144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.225065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.225491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.229404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.484041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:42.493562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a683820c-1686-4dbe-a20c-eac14ceb1e3d tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.296154 Oct 31 14:11:42.494201 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1188/2143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:42 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:42.512809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:42.513875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:42.531439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.532227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.532839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.533787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.534424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.535570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.672823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:42.677942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:42.686645 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b110aea-e5e2-4d58-9904-376620eee88e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1249 microversion: 2.1 time: 0.189866 Oct 31 14:11:42.689046 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1189/2144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:42 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1249 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:42.695661 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7569685b-842d-4ec4-bcf8-cc4a52f78c48 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1513 microversion: 2.1 time: 0.736252 Oct 31 14:11:42.696831 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 956/2145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:41 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1513 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:42.711931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:42.714872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:42.721909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.722515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.722945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.723858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:42.724906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:42.725529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:42.755913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:43.051794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-47886b1c-0ef9-46b1-ada3-c13a1f2049cd req-7055585c-f210-4bec-b6ac-b885c22e1ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1095a41a-149d-4705-bec8-b03e23850a02", "name": "network-vif-deleted", "tag": "5c82f5fc-d3f2-40b6-8df8-4b205e62b0a3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:43.087062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-47886b1c-0ef9-46b1-ada3-c13a1f2049cd req-7055585c-f210-4bec-b6ac-b885c22e1ef5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.087548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-47886b1c-0ef9-46b1-ada3-c13a1f2049cd req-7055585c-f210-4bec-b6ac-b885c22e1ef5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.093970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-47886b1c-0ef9-46b1-ada3-c13a1f2049cd req-7055585c-f210-4bec-b6ac-b885c22e1ef5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.110729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:43.119379 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-476307fd-0b70-4364-9cfa-19e5278b041a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1381 microversion: 2.1 time: 0.429130 Oct 31 14:11:43.121685 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-47886b1c-0ef9-46b1-ada3-c13a1f2049cd req-7055585c-f210-4bec-b6ac-b885c22e1ef5 service nova] Creating event network-vif-deleted:5c82f5fc-d3f2-40b6-8df8-4b205e62b0a3 for instance 1095a41a-149d-4705-bec8-b03e23850a02 on n-h2-863052-1 Oct 31 14:11:43.137306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-47886b1c-0ef9-46b1-ada3-c13a1f2049cd req-7055585c-f210-4bec-b6ac-b885c22e1ef5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095159 Oct 31 14:11:43.139930 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 957/2146] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:11:43.141422 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1190/2147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:42 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1381 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.149864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab4cdf53-e306-412d-8c46-1199b2ecc39f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '.version_select at 0x7fe107c7d670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.155429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.156425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.160737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4cdf53-e306-412d-8c46-1199b2ecc39f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.169324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.170440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.171292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4cdf53-e306-412d-8c46-1199b2ecc39f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.171571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.171699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4cdf53-e306-412d-8c46-1199b2ecc39f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.172629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.173188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.173817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.199610 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab4cdf53-e306-412d-8c46-1199b2ecc39f tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.053156 Oct 31 14:11:43.212559 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1191/2148] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.217624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e04b4d15-de7e-4b46-ab28-b933b4b53dd6 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107418280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.285639 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e04b4d15-de7e-4b46-ab28-b933b4b53dd6 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.071094 Oct 31 14:11:43.298671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1192/2149] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.303813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.307447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.324099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.324598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.325034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.325812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.326215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.326703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.509152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:43.517785 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbfd381b-5286-4568-9da0-fec46739f1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.376135 Oct 31 14:11:43.545091 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49a726f9-a754-4c6e-b435-bed019e892a5 tempest-LiveMigrationTest-503554893 tempest-LiveMigrationTest-503554893-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1532 microversion: 2.1 time: 0.244550 Oct 31 14:11:43.553801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 958/2150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.565882 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1193/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1532 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.568754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.570526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.586864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.587892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.589019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.595727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.596144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.596589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.612184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.612700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.624849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.625545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.626399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.627437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.628040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.630595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.688357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:11:43.819813 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e1096fa-76c1-4923-a71d-b54797bb9e25 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 204 len: 0 microversion: 2.1 time: 0.243322 Oct 31 14:11:43.820900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1194/2152] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:11:43 2022] DELETE /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:11:43.829289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.830435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.838120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.838653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.839145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.839858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.840308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.840730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.936539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:43.952812 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f668a06c-7a52-4b02-9acd-36f4cef8e08f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1305 microversion: 2.1 time: 0.129439 Oct 31 14:11:43.959103 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1195/2153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.960226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:43.966862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.968258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.977765 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32f9e8c8-41c0-4809-911a-404a7dab9968 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.422296 Oct 31 14:11:43.979092 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 959/2154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:43.981146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.981884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.982542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.983469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.984125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.984735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:43.985904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:43.986785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:43.995756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:43.996608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:43.997291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:44.010611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:44.012690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:44.014696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:44.058237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:44.058929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:44.059383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:44.059849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lazy-loading 'fault' on Instance uuid 1095a41a-149d-4705-bec8-b03e23850a02 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:11:44.198261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa812d31aed420397d85abe62b91827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a101ed7968244a4ba358acae20744009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:44.206855 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb038009-cbdc-46a7-8637-5d42e3509946 tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 200 len: 1307 microversion: 2.1 time: 0.246446 Oct 31 14:11:44.207760 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1196/2155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:44.310359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bff52a6e-2eca-4785-ba92-55598963bdf6 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107443790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:44.374676 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bff52a6e-2eca-4785-ba92-55598963bdf6 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.077587 Oct 31 14:11:44.375441 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1197/2156] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:44 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:44.428767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:44.438945 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-033061b2-261d-49b3-8d74-f54dfef53bfc tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1387 microversion: 2.1 time: 0.458027 Oct 31 14:11:44.442568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 960/2157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:43 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1387 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:44.542646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:44.543731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:44.553103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:44.554337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:44.554948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:44.555832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:44.557706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:44.558391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:44.961274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:44.979842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:44.980641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:44.997534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:44.999548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.000523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.002779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.004943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.007137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.155836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:45.176905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aea9d6cd-e807-426d-865a-3803b8422e8d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1303 microversion: 2.1 time: 0.201278 Oct 31 14:11:45.178856 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 961/2158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:44 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1303 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:45.183935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:45.184547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:45.217241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.220602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.221209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.231464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.236973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.240999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.344612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:45.358073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23219d43-6177-4d57-b961-9089e4465f30 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.819733 Oct 31 14:11:45.362770 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1198/2159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:44 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:45.378441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:45.379201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] [instance: 1095a41a-149d-4705-bec8-b03e23850a02] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:45.398864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.402195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.402856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.403694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.406693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.407297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.435908 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] HTTP exception thrown: Instance 1095a41a-149d-4705-bec8-b03e23850a02 could not be found. Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Request method failure captured: Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 HTTP/1.1 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9d_9cSaHZgRsVy1Bx5agCpX0zo3Dm7pcXFc-gOtaUSmqJSrGsPlD9DBO-X5Vq3BBBC869EqOH1N1Xyv8iJ-iV8up16-ns-oACJqJrkIer7N5EZP0ZZSer0xTc7z-9zVQxlboPrI6GFk4DL_HiVYjhVaTHHwdC2DVPA-L_6EMB3rT3w Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a101ed7968244a4ba358acae20744009 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-InstanceActionsTestJSON-1876725499 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a101ed7968244a4ba358acae20744009", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a101ed7968244a4ba358acae20744009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a101ed7968244a4ba358acae20744009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a101ed7968244a4ba358acae20744009"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-InstanceActionsTestJSON-1876725499 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a101ed7968244a4ba358acae20744009 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1876725499 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-InstanceActionsTestJSON-1876725499-project Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 0fa812d31aed420397d85abe62b91827 Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-InstanceActionsTestJSON-1876725499-project Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 1095a41a-149d-4705-bec8-b03e23850a02 could not be found. Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '1095a41a-149d-4705-bec8-b03e23850a02'} Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1095a41a-149d-4705-bec8-b03e23850a02 could not be found. Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1095a41a-149d-4705-bec8-b03e23850a02 could not be found. Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:45.437758 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1095a41a-149d-4705-bec8-b03e23850a02 could not be found. Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] Returning 404 to user: Instance 1095a41a-149d-4705-bec8-b03e23850a02 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:45.444376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2eb8b221-8e04-48a1-87fc-c5c1ca35e32c tempest-InstanceActionsTestJSON-1876725499 tempest-InstanceActionsTestJSON-1876725499-project] 10.222.0.27 "GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02" status: 404 len: 111 microversion: 2.1 time: 0.075338 Oct 31 14:11:45.446706 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1199/2160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:45 2022] GET /compute/v2.1/servers/1095a41a-149d-4705-bec8-b03e23850a02 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:11:45.452261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d23a160f-e65b-4f1a-abd6-88aaf3346c30 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a68dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:45.509288 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d23a160f-e65b-4f1a-abd6-88aaf3346c30 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.061386 Oct 31 14:11:45.518891 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1200/2161] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:45 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:45.526110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:45.527027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:45.536047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.536901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.537541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.538617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.540018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.540668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.647203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:45.661244 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8ee7718-c4fb-408c-8eb9-39725d071c34 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1345 microversion: 2.1 time: 0.137741 Oct 31 14:11:45.666488 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1201/2162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:45 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:45.865147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-bd5f05b9-06c0-46d1-886f-7fa95aa20d28 req-377189fb-23a6-41e3-8b0b-bc19d1481551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0ca596-84a5-4c7e-9bb9-61db23198bbd", "name": "network-vif-deleted", "tag": "1cd69f06-d33d-4e41-a094-e2d1440a38cd"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:45.893459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bd5f05b9-06c0-46d1-886f-7fa95aa20d28 req-377189fb-23a6-41e3-8b0b-bc19d1481551 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:45.893947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bd5f05b9-06c0-46d1-886f-7fa95aa20d28 req-377189fb-23a6-41e3-8b0b-bc19d1481551 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:45.902727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bd5f05b9-06c0-46d1-886f-7fa95aa20d28 req-377189fb-23a6-41e3-8b0b-bc19d1481551 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:45.938524 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-bd5f05b9-06c0-46d1-886f-7fa95aa20d28 req-377189fb-23a6-41e3-8b0b-bc19d1481551 service nova] Creating event network-vif-deleted:1cd69f06-d33d-4e41-a094-e2d1440a38cd for instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd on n-h1-863052-1 Oct 31 14:11:45.956281 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-bd5f05b9-06c0-46d1-886f-7fa95aa20d28 req-377189fb-23a6-41e3-8b0b-bc19d1481551 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094768 Oct 31 14:11:45.967444 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1202/2163] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:46.149509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:46.166344 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a273c3c9-71a5-4e30-b3cc-e953f1044d53 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.985944 Oct 31 14:11:46.182193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 962/2164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:45 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:46.202676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:46.203521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:46.220375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:46.231074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:46.231549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:46.232316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:46.232791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:46.233219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:46.385517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:46.386137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:46.398210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:46.401120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:46.401742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:46.402658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:46.405369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:46.405985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:46.697446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:46.713032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7d14116-3829-4f97-9dc2-a58bb8aa9c43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1303 microversion: 2.1 time: 0.514602 Oct 31 14:11:46.726594 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1203/2165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:46 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1303 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:46.735295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a22631c-f8bc-4f42-a1f5-9363b3653cf2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107abf280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:46.817164 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a22631c-f8bc-4f42-a1f5-9363b3653cf2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.089034 Oct 31 14:11:46.817637 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1204/2166] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:46 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:46.825920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:46.833017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:46.858802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:46.859302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:46.859936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:46.860808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:46.861419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:46.861997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:47.170484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:47.180791 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ecfe6efa-0c9a-496b-9fb5-9f0c53e2b6c4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.799778 Oct 31 14:11:47.181383 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 963/2167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:46 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:47.227741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:47.233853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:47.252808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:47.254243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:47.254891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:47.255757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:47.256380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:47.257165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:47.576677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:47.586059 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-800af49d-5742-4c3a-b25f-5bb509030dfb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1184 microversion: 2.1 time: 0.767165 Oct 31 14:11:47.594634 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1205/2168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:46 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1184 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:47.613301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:47.634716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef8dae01-3b45-48e6-9c5f-86d22475b6c5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.427951 Oct 31 14:11:47.637653 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 964/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:47 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:47.740206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:47.742097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:47.760416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:47.763940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:47.769454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:47.771320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:47.774394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:47.775467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:47.834104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e1678bc4-91fe-482c-87fd-d46716ff663e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc99ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:47.963113 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e1678bc4-91fe-482c-87fd-d46716ff663e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.133017 Oct 31 14:11:47.964348 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 965/2170] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:47 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:48.208851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:48.210241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:48.235343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:48.236967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:48.238394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:48.240927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:48.243818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:48.244435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:48.523153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:48.535895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e33cc764-3d56-4fb0-bdc2-42ef3201da43 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1303 microversion: 2.1 time: 0.801795 Oct 31 14:11:48.558049 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1206/2171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:47 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1303 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:48.619633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:48.621146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:48.634534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:48.635311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:48.635907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:48.637351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:48.638118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:48.638750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:48.872145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:48.881101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dec6d986-01c4-4db8-8bd0-b08a88c908d0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1184 microversion: 2.1 time: 0.265534 Oct 31 14:11:48.885069 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1207/2172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:48 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1184 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:48.891353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:48.895368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:48.907720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:48.917179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:48.918381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:48.919717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:48.920695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:48.921166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:48.921603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:49.265410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:49.273971 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d19d9bd-6c74-4724-9986-f518b6927ded tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 1.069951 Oct 31 14:11:49.274615 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 966/2173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:48 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:49.310009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-752804eb-e004-421b-8509-cdb48b878f4c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10746f0d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:49.384052 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-752804eb-e004-421b-8509-cdb48b878f4c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.108358 Oct 31 14:11:49.392013 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 967/2174] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:49 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:49.563669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:49.564744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:49.577495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:49.587109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:49.590606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:49.595193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:49.606952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:49.613226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:49.795346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:49.808334 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-59802469-db8e-421d-aaf1-59f78883e8c3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1303 microversion: 2.1 time: 0.250598 Oct 31 14:11:49.820611 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 968/2175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:49 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:49.908726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:49.914264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:49.915292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:49.920103 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d93802b-577a-4bd6-b821-2d64a48bc238 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 1.033714 Oct 31 14:11:49.926424 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1208/2176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:48 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:49.947030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:49.947925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:49.967575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:49.968717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:49.969852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:49.970762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:50.015047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-520a7450-4105-48c5-be9b-3d330b4ca712 req-e9f3e6d1-6963-452c-b564-f5e7e29fc9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "name": "network-vif-plugged", "status": "completed", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:50.040686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-520a7450-4105-48c5-be9b-3d330b4ca712 req-e9f3e6d1-6963-452c-b564-f5e7e29fc9ce service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:50.041062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-520a7450-4105-48c5-be9b-3d330b4ca712 req-e9f3e6d1-6963-452c-b564-f5e7e29fc9ce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:50.041492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-520a7450-4105-48c5-be9b-3d330b4ca712 req-e9f3e6d1-6963-452c-b564-f5e7e29fc9ce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:50.078409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-520a7450-4105-48c5-be9b-3d330b4ca712 req-e9f3e6d1-6963-452c-b564-f5e7e29fc9ce service nova] Creating event network-vif-plugged:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:11:50.098632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-520a7450-4105-48c5-be9b-3d330b4ca712 req-e9f3e6d1-6963-452c-b564-f5e7e29fc9ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087271 Oct 31 14:11:50.107830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1209/2177] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:50.282948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:50.301799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:50.302903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:50.316284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-993fa254-ed77-448c-b413-7c8fd480e9c5 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1184 microversion: 2.1 time: 0.405849 Oct 31 14:11:50.328655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:50.330128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:50.335751 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 969/2178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:49 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1184 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:50.338748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:50.354706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:50.355386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:50.356083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:50.399708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87b8d396-a457-4dfe-b461-48899783bd60 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1074b2d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:50.503331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87b8d396-a457-4dfe-b461-48899783bd60 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.107641 Oct 31 14:11:50.504603 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 970/2179] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:50 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:50.852319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:50.853304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:50.879583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:50.888898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:50.889709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:50.891538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:50.894119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:50.896622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:51.276443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:51.291090 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54b4fdf5-c8e5-42a2-b7d9-ebd8eb2d1972 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.994121 Oct 31 14:11:51.291673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1210/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:50 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:51.310429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:51.311436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:51.327102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:51.327856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:51.328450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:51.329428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:51.330027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:51.334196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:51.686601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:51.706300 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c80496d9-bd83-4820-b05e-782839960f3c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 0.859140 Oct 31 14:11:51.711139 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 971/2181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:50 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:51.726140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:51.726957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:51.740069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:51.743891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:51.744918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:51.749516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:51.750028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:51.750505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:51.807924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:51.844404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:51.858246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:51.862105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:51.871194 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8efa6064-6b1a-4feb-85c9-71afb0066e15 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.575771 Oct 31 14:11:51.873759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1211/2182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:51 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:51.879177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13ec348f-16ad-4fa4-abfc-3ba215e371be tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a6d550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:51.973669 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13ec348f-16ad-4fa4-abfc-3ba215e371be tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.098538 Oct 31 14:11:51.981594 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1212/2183] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:51 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:52.030870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:52.032118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:52.045473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0db1c68-2865-40d0-b491-d5cec99e074f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1184 microversion: 2.1 time: 0.330230 Oct 31 14:11:52.049249 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 972/2184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:51 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1184 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:52.316211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:52.316822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:52.335939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:52.342897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:52.343407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:52.344086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:52.344545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:52.344972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:52.737854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:52.738995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:52.752115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:52.752620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:52.760491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:52.761417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:52.764060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:52.766677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:53.132757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:53.142757 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc9b77be-53fa-4cdc-b617-c2449270fca6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 0.408623 Oct 31 14:11:53.143349 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 973/2185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:52 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:53.167802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:53.174343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:53.193770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:53.194495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:53.195091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:53.195951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:53.207042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:53.207748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:53.446716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:53.459816 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-126a1fba-c460-4508-a995-81f2dc1c876f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.296152 Oct 31 14:11:53.460405 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 974/2186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:53 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:53.483033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d79b32a-8e8f-4ccd-b704-3236718d6895 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10c0aa1f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:53.542852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d79b32a-8e8f-4ccd-b704-3236718d6895 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.063460 Oct 31 14:11:53.545137 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 975/2187] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:53 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:53.551152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:53.552094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:53.558495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:53.559254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:53.559875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:53.560763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:53.561402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:53.561998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:53.653261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:53.663057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4af6b31f-d4e7-428f-b10f-a2c4a7731aa7 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 200 len: 1184 microversion: 2.1 time: 0.116627 Oct 31 14:11:53.663655 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 976/2188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:53 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 1184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:53.742988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:53.754022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80bac9c5-0ceb-42f2-ad76-80e03ce9f0c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 1.442194 Oct 31 14:11:53.760694 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1213/2189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:52 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:53.981222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-64798643", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:54.063981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] validate_networks() for [('d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:11:54.170049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:54.171134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:54.197441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:54.199729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:54.201701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:54.205363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:54.208807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:54.209526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.147417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:11:55.148201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:11:55.148941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:11:55.149835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:11:55.150758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:11:55.167257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:55.177528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.178478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.178847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb7314e4-ea55-44f1-bb01-2ddc6779f201 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 1.012438 Oct 31 14:11:55.179813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.181154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.181869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.196527 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1214/2190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:54 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:55.196822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.201878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:55.202802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:55.215143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.215920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.216531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.217428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.218046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.218653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.284007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:11:55.294123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for user ec707d34966e44aa93900eebc62a6a93 and project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:11:55.316642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:11:55.323203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:11:55.414811 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-66bf18df-7a0c-4656-870b-84cd03cb3fc3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705483 Oct 31 14:11:55.415308 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 977/2191] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:11:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:11:55.420618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-eb5499fc-937f-4f48-bdb3-99e231a9b129 req-b041aff3-00a1-42cc-beb7-4dc007c9abf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692cbab4-8865-401a-8f21-4d26f7607f58", "tag": "0296bd5e-8bc5-4e14-bf85-884f06420d0e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:11:55.447751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-eb5499fc-937f-4f48-bdb3-99e231a9b129 req-b041aff3-00a1-42cc-beb7-4dc007c9abf4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.448452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-eb5499fc-937f-4f48-bdb3-99e231a9b129 req-b041aff3-00a1-42cc-beb7-4dc007c9abf4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.449039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-eb5499fc-937f-4f48-bdb3-99e231a9b129 req-b041aff3-00a1-42cc-beb7-4dc007c9abf4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.475454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-eb5499fc-937f-4f48-bdb3-99e231a9b129 req-b041aff3-00a1-42cc-beb7-4dc007c9abf4 service nova] Creating event network-changed:0296bd5e-8bc5-4e14-bf85-884f06420d0e for instance 692cbab4-8865-401a-8f21-4d26f7607f58 on n-h2-863052-1 Oct 31 14:11:55.526690 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-eb5499fc-937f-4f48-bdb3-99e231a9b129 req-b041aff3-00a1-42cc-beb7-4dc007c9abf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110012 Oct 31 14:11:55.535359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 978/2192] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:11:55.555162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb79fe57-852f-451c-9a3d-33900794bb10 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc89a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:55.621024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb79fe57-852f-451c-9a3d-33900794bb10 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.083493 Oct 31 14:11:55.622330 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 979/2193] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:55 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:55.628767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:55.629731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: cd0ca596-84a5-4c7e-9bb9-61db23198bbd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:55.637270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.638111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.638769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.639684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.640335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.640967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.662908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] HTTP exception thrown: Instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd could not be found. Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Request method failure captured: Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd HTTP/1.1 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9YOEU1iOF-sr1sV1yEjXMEUeYRljjEat7GTm08yg7MmcPcYHuqhOFek7RUYSNLR4kKhumScJKFWOVWN9_CSqYgbBiOcKySzhrEej6KVbS_-qHBB4v25POteD4wVPKUidsJHXpCZ11GdTlD6z45oRBjd2IQlcDMQTl6HXeaWpPujNCU Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8597bfad0a2d4d209e6f33a02676406d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-LiveMigrationTest-191451690 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-LiveMigrationTest-191451690-project Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3589cce53cf8492a9a2e05c73f373319 Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-LiveMigrationTest-191451690-project Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd could not be found. Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'cd0ca596-84a5-4c7e-9bb9-61db23198bbd'} Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd could not be found. Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd could not be found. Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:11:55.666574 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd could not be found. Oct 31 14:11:55.669957 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:11:55.675085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Returning 404 to user: Instance cd0ca596-84a5-4c7e-9bb9-61db23198bbd could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:11:55.676790 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9fac6cb7-0d97-4a86-a335-2cfd531452f0 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd" status: 404 len: 111 microversion: 2.1 time: 0.053189 Oct 31 14:11:55.678023 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 980/2194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:55 2022] GET /compute/v2.1/servers/cd0ca596-84a5-4c7e-9bb9-61db23198bbd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:11:55.690100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:55.692122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:55.704494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.706457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.708822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:55.709920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:55.712543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:55.713569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:56.177327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:56.190569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f2e7382-11f9-4e59-989b-e6e0acc42176 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.992393 Oct 31 14:11:56.210659 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1215/2195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:55 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:56.232674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e2debbc-4a25-47fe-9e9a-45ca06249c33 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:56.241464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e2debbc-4a25-47fe-9e9a-45ca06249c33 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:56.388108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:56.411774 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22ff4ded-5afc-491b-b32c-e9d888971804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.728274 Oct 31 14:11:56.416174 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 981/2196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:55 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:56.440371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:56.446434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:56.463750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:56.494725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:56.495605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:56.498549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:56.499567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:56.500612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:56.502105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:56.786539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e2debbc-4a25-47fe-9e9a-45ca06249c33 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:56.795101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e2debbc-4a25-47fe-9e9a-45ca06249c33 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1206 microversion: 2.1 time: 0.585319 Oct 31 14:11:56.803087 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1216/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:56 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1206 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:56.821704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a551eed-ad15-4fd9-a24d-d1c65a53f603 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a680d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:56.935890 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a551eed-ad15-4fd9-a24d-d1c65a53f603 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.130964 Oct 31 14:11:56.944822 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1217/2198] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:56 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:57.199069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:57.218279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:57.219560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:57.225480 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a280fb6c-784d-4403-ad74-6189ac4f53bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 0.803779 Oct 31 14:11:57.228746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:57.234191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:57.235023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:57.236092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:57.236737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:57.237366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:57.243635 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 982/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:56 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:57.449552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:57.451371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:57.478920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:57.485932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:57.486981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:57.491354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:57.492985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:57.500352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:57.966410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:57.992643 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3455ba02-ddf1-48ee-8a55-996fb791820b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.552812 Oct 31 14:11:57.997618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 983/2200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:57 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:58.013743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:58.016697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:58.043059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:58.045456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:58.047116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:58.048053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:58.052947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:58.054435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:58.408471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:58.426494 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d2f4ddc-0fe8-4276-a062-09b2aa25d13f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1258 microversion: 2.1 time: 0.422841 Oct 31 14:11:58.430283 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 984/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:57 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1258 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:58.437996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:58.455291 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08fa8cde-d5bf-4f4b-9511-66370bbe2311 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 1.240830 Oct 31 14:11:58.462129 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1218/2202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:57 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:58.466596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd7256b2-cad0-4208-8580-6efd445374bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc878b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:58.477661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:58.479908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:58.496072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:58.496753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:58.498713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:58.499601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:58.502114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:58.502833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:58.596731 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd7256b2-cad0-4208-8580-6efd445374bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.160903 Oct 31 14:11:58.605299 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 985/2203] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:58 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:11:59.024065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:59.028372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:59.050327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:59.054238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:59.054964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:59.055923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:59.064008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:59.064798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:59.881687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:11:59.895804 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d18ce2e4-e230-4c6f-bd3f-6d5bbc157538 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 0.877305 Oct 31 14:11:59.918734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 986/2204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:59 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:11:59.939373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:11:59.940012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:11:59.951100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:59.951465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:59.966912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:11:59.967989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:11:59.968644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:11:59.969416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:00.136755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:00.158691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91252534-9dd4-4a61-b752-6acbdd3050dc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 1.683585 Oct 31 14:12:00.177154 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1219/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:58 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:00.182274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:00.187349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:00.201954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:00.208172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:00.208783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:00.209689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:00.210387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:00.210970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:00.272865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:00.281887 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d5267099-e531-4df4-b0f2-745e311bd42f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1264 microversion: 2.1 time: 0.361940 Oct 31 14:12:00.283140 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 987/2206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:11:59 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1264 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:00.301479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41d70275-6816-4a63-a16a-275126672ab1 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc6d3a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:00.414781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41d70275-6816-4a63-a16a-275126672ab1 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.130287 Oct 31 14:12:00.417555 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 988/2207] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:00 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:00.652466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:00.661591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3dde557-b6c1-474d-b383-d757edd69d33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.483041 Oct 31 14:12:00.671764 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1220/2208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:00 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:00.930670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:00.931473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:00.940056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:00.949222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:00.955294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:00.956432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:00.957019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:00.957721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:01.183007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:01.183622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:01.207424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:01.207943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:01.208771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:01.209727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:01.210390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:01.210975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:01.924595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:01.938461 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d692a977-b699-4d39-99da-b6d06ca013c7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 0.758616 Oct 31 14:12:01.959907 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1221/2209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:01 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:01.966414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:01.967220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:01.980523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:01.981430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:01.982113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:01.983145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:01.983745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:01.984996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:02.021457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:02.048693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-510ab26e-7926-45cd-b005-c37e83e3c73c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1511 microversion: 2.1 time: 1.119463 Oct 31 14:12:02.052905 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 989/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:00 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1511 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:02.075017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-829f2203-3a09-4d42-bb0e-8561ec8dc75a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc2a310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:02.191304 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-829f2203-3a09-4d42-bb0e-8561ec8dc75a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.135188 Oct 31 14:12:02.191890 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 990/2211] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:02 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:02.213433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:02.214074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:02.251086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:02.258761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:02.259370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:02.260235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:02.270788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:02.271388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:02.720766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:02.732982 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5719db6b-d89e-4a74-a388-5d174a754a7d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.771377 Oct 31 14:12:02.745167 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1222/2212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:01 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:02.967365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:02.967911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:02.976740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:02.977490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:02.978878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:02.982810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:02.985266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:02.986829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:03.376754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:03.385513 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bef9c65f-459c-4fd9-80de-fbe1ae06c925 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 1.179232 Oct 31 14:12:03.389218 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 991/2213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:02 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:03.403808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:03.404623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:03.418498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:03.420718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:03.423899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:03.425142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:03.427564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:03.428201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:03.832737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:03.845986 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5ada9a5-b576-4c55-813a-da22abae2ffa tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1488 microversion: 2.1 time: 0.452501 Oct 31 14:12:03.866380 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 992/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:03 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1488 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:03.880174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d8f6a2e-edec-4252-9be1-087e2d11eec7 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc2f550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:03.963226 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d8f6a2e-edec-4252-9be1-087e2d11eec7 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.095629 Oct 31 14:12:03.973018 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 993/2215] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:03 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:03.993672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:03.995304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:04.010211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.011026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.011668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.013314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.015579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.016221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.264568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:04.270714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:04.282843 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24fcc203-97d3-4811-9473-ab842638f922 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.308325 Oct 31 14:12:04.286552 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42e3b876-33f9-4f50-aaba-14b125c8f7ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 1.323110 Oct 31 14:12:04.287682 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 994/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:03 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:04.289166 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1223/2217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:02 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:04.293051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:04.295515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:04.302828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.303570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.304160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.305504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.305974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.306591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.414074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:04.415709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:04.420781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa082e20-bcd7-4d57-9049-7c97e9de0b57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 200 len: 156 microversion: 2.1 time: 0.129272 Oct 31 14:12:04.429317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 995/2218] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:04 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 156 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:04.437055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.441648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:04.442516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.443380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.444363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.445273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:04.445891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.446528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.461242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.466822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.467458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.468407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.469047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.469748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.757641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:04.768596 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d8e42b4-8851-4a05-b18d-67dfc3338311 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.334500 Oct 31 14:12:04.773821 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 996/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:04 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:04.802206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:04.804028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:04.811770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.812472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.813976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:04.815052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:04.815819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:04.816659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.181833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:05.184929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:05.198721 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f37c6c8f-aa8d-4d99-a653-3a60ca0d4aef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.400051 Oct 31 14:12:05.201804 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 997/2220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:04 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:05.209863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-234e8ada-d2f9-4d76-8295-9bca70a6de19 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10749e820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:05.234767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:05.252529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:05.261438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1259d0d-f1df-47da-ad3b-6a982b73578b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.852407 Oct 31 14:12:05.266446 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1224/2221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:04 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:05.273908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:05.279327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:05.292098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.294029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.295561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.296722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.298731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.299547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.307321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:05.371884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:12:05.393813 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-234e8ada-d2f9-4d76-8295-9bca70a6de19 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.190516 Oct 31 14:12:05.406259 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 998/2222] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:05 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:05.411321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:05.411945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:05.426571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.427214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.427489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.428200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.428657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.429074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.610673 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85844457-9655-449e-94d7-df33949e044f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 204 len: 0 microversion: 2.1 time: 0.341000 Oct 31 14:12:05.611750 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1225/2223] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:12:05 2022] DELETE /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:12:05.619712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:05.620797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:05.637411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.641606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.642642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.644754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.646781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.647724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.907246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:05.942994 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-973c9531-68e6-4469-b9f9-761d8e6e1c05 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.535369 Oct 31 14:12:05.943595 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 999/2224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:05 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:05.978734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:05.980647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:05.990119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.991175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.992371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:05.993286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:05.994246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:05.994883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:06.258351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:06.279206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-759f82a0-6b6a-42cc-99a6-d065bd528d36 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.663960 Oct 31 14:12:06.280486 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1226/2225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:05 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:06.314346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:06.315259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:06.342529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:06.343277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:06.343865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:06.344732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:06.345332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:06.345898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:06.779822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:06.788464 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d11e7347-6d29-4be7-9e6b-eff969fd3b4a tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1664 microversion: 2.1 time: 0.504958 Oct 31 14:12:06.793223 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1227/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:06 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1664 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:06.820363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:06.822667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:06.830541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:06.851993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:06.852486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:06.852921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:06.853623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:06.854073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:06.867625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:06.953583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:06.966688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ee0bf180-aeda-405b-91b3-894307dac141 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 1.019301 Oct 31 14:12:06.967498 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1000/2227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:05 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:06.977436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:06.978434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:06.992990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:06.994068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:06.994861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:06.996312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:06.997964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:06.998667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:07.573272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:07.584391 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dec7d542-864b-4d92-9a6e-eb03fc873acc tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 0.615535 Oct 31 14:12:07.585628 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1001/2228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:06 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:07.591628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74051a51-e6d9-4e4b-9013-399090437a57 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107ce3700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:07.636960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:07.656163 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e516d7ce-dc95-4ff3-ade2-af7f7f418e9a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.859271 Oct 31 14:12:07.657287 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1228/2229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:07.664369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a63584e9-799f-4bb9-b4ec-9f81f11163c8 req-d1f220a5-30ff-422d-bb81-51e490db8ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692cbab4-8865-401a-8f21-4d26f7607f58", "name": "network-vif-plugged", "status": "completed", "tag": "0296bd5e-8bc5-4e14-bf85-884f06420d0e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:07.672189 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74051a51-e6d9-4e4b-9013-399090437a57 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.085279 Oct 31 14:12:07.683412 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1002/2230] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:07 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:07.692982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a63584e9-799f-4bb9-b4ec-9f81f11163c8 req-d1f220a5-30ff-422d-bb81-51e490db8ddb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:07.693489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a63584e9-799f-4bb9-b4ec-9f81f11163c8 req-d1f220a5-30ff-422d-bb81-51e490db8ddb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:07.694235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a63584e9-799f-4bb9-b4ec-9f81f11163c8 req-d1f220a5-30ff-422d-bb81-51e490db8ddb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:07.697478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7995133c-3fe4-415d-9e38-80bed4321850 req-e24fd20d-09d9-4551-b4c6-5444cf66cf4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c250ffcc-8637-425b-a0c3-7906f0afff8e", "tag": "3cc4b314-66c6-43b8-99da-42a221b6880f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:07.709879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7995133c-3fe4-415d-9e38-80bed4321850 req-e24fd20d-09d9-4551-b4c6-5444cf66cf4f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:07.710644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7995133c-3fe4-415d-9e38-80bed4321850 req-e24fd20d-09d9-4551-b4c6-5444cf66cf4f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:07.711300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7995133c-3fe4-415d-9e38-80bed4321850 req-e24fd20d-09d9-4551-b4c6-5444cf66cf4f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:07.715243 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a63584e9-799f-4bb9-b4ec-9f81f11163c8 req-d1f220a5-30ff-422d-bb81-51e490db8ddb service nova] Creating event network-vif-plugged:0296bd5e-8bc5-4e14-bf85-884f06420d0e for instance 692cbab4-8865-401a-8f21-4d26f7607f58 on n-h2-863052-1 Oct 31 14:12:07.721019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a63584e9-799f-4bb9-b4ec-9f81f11163c8 req-d1f220a5-30ff-422d-bb81-51e490db8ddb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062337 Oct 31 14:12:07.723432 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1229/2231] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:07.725151 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7995133c-3fe4-415d-9e38-80bed4321850 req-e24fd20d-09d9-4551-b4c6-5444cf66cf4f service nova] Creating event network-changed:3cc4b314-66c6-43b8-99da-42a221b6880f for instance c250ffcc-8637-425b-a0c3-7906f0afff8e on n-h2-863052-1 Oct 31 14:12:07.729258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:07.732890 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7995133c-3fe4-415d-9e38-80bed4321850 req-e24fd20d-09d9-4551-b4c6-5444cf66cf4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047848 Oct 31 14:12:07.734027 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1003/2232] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:07.742117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:07.751402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:07.752251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:07.752901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:07.753908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:07.754606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:07.755471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:07.798506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:07.817016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:07.818714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:07.830837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:07.832929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:07.833631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:07.836418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:07.837136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:07.838058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:08.047887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:08.062268 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca9ef2a0-c319-4452-ae3e-d461c7c1fa95 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.337292 Oct 31 14:12:08.063066 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1230/2233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:07 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:08.068257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-250777186", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "726ec790-fa70-4df0-af4a-a3e3b994a919"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:08.157783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] validate_networks() for [('726ec790-fa70-4df0-af4a-a3e3b994a919', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:08.443808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:08.458292 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-968243b0-dc47-4f1d-8a16-e28df846f495 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1664 microversion: 2.1 time: 0.640171 Oct 31 14:12:08.477598 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1004/2234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:07 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1664 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:08.491704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:08.492792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:08.506670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:08.507330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:08.508506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:08.509513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:08.510253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:08.510862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:08.935606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:08.936785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:08.937961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:08.938769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:08.939682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:08.957274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:08.988712 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f459de2e-797e-4316-9b7e-4f539d6786b8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1371 microversion: 2.1 time: 0.509780 Oct 31 14:12:08.997490 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1005/2235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:08 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1371 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:09.007369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:09.010738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:09.012889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:09.015310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:09.016490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:09.018369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:09.019419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:09.021265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:09.056743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:09.062116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:09.064135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:09.066645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:09.072480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:09.078530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:09.126985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:09.145356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for user f6d0e8b2b04b47e69d87f436eb387941 and project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:09.183545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:12:09.185968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:12:09.266736 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e8d3bd5-b271-4a40-87ae-9a5059d6c0b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201487 Oct 31 14:12:09.274132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1231/2236] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:12:09.275724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2e8db84-3d67-44fc-bc7e-cb3d15f2fd2b tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a6d310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:09.383697 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2e8db84-3d67-44fc-bc7e-cb3d15f2fd2b tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.112547 Oct 31 14:12:09.385368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1232/2237] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:09 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:09.391634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:09.392487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:09.402453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:09.403161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:09.403802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:09.404760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:09.411510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:09.412357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.137778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:10.146375 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d789833a-e825-4fc9-bf4c-64f83c3e7b26 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.759675 Oct 31 14:12:10.150370 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1233/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:09 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:10.167646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a870a7f9-6c47-46d4-8b2c-9fc8102fc244 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:10.170536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a870a7f9-6c47-46d4-8b2c-9fc8102fc244 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:10.202988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:10.216188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72a10faa-c8bf-48ea-a05a-ade386b6ddb0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1513 microversion: 2.1 time: 1.212118 Oct 31 14:12:10.217393 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1006/2239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:09 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1513 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:10.227231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:10.230396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:10.270850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.271648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.273847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.276468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.277766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.279917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.442546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a870a7f9-6c47-46d4-8b2c-9fc8102fc244 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:10.450053 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a870a7f9-6c47-46d4-8b2c-9fc8102fc244 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1214 microversion: 2.1 time: 0.298442 Oct 31 14:12:10.470949 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1234/2240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:10 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:10.473273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:10.487029 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e832e536-ba63-4510-9db7-1b4409230810 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 200 len: 1318 microversion: 2.1 time: 0.268167 Oct 31 14:12:10.490792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-60601698-5ef9-4fbc-91dd-0a6409de4705 req-08dfc76d-7927-4df8-b0cc-8902a76334ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e80907a-572f-4a2a-a43e-5abbf33c2881", "name": "network-vif-deleted", "tag": "ab0bff5f-49c6-4d14-a9bc-170121dda5aa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:10.501860 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1007/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:10 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:10.518926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:10.520040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:10.527256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-60601698-5ef9-4fbc-91dd-0a6409de4705 req-08dfc76d-7927-4df8-b0cc-8902a76334ef service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.527742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-60601698-5ef9-4fbc-91dd-0a6409de4705 req-08dfc76d-7927-4df8-b0cc-8902a76334ef service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.528181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-60601698-5ef9-4fbc-91dd-0a6409de4705 req-08dfc76d-7927-4df8-b0cc-8902a76334ef service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.530419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.531378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.532352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.533384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.534698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.536319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.579678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-60601698-5ef9-4fbc-91dd-0a6409de4705 req-08dfc76d-7927-4df8-b0cc-8902a76334ef service nova] Creating event network-vif-deleted:ab0bff5f-49c6-4d14-a9bc-170121dda5aa for instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 on n-h2-863052-1 Oct 31 14:12:10.601361 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-60601698-5ef9-4fbc-91dd-0a6409de4705 req-08dfc76d-7927-4df8-b0cc-8902a76334ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122813 Oct 31 14:12:10.603537 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1235/2242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:10.614522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7f6ac44-f646-4411-aad7-d59aa18fea92 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc8db80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:10.703669 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7f6ac44-f646-4411-aad7-d59aa18fea92 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.098753 Oct 31 14:12:10.706920 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1236/2243] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:10 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:10.905086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:10.921866 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ece438e3-0286-4197-b26b-9201bda1494e tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1566 microversion: 2.1 time: 0.417156 Oct 31 14:12:10.934206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1008/2244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:10 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1566 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:10.954795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:10.955405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:10.967994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.973477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.973974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:10.974853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:10.975336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:10.975770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:11.171479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:11.172097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:11.185143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:11.191625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:11.192156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:11.192914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:11.204985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:11.205620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:11.309935 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e22984cb-2926-4b65-9d5f-3d373b02d0e3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.364697 Oct 31 14:12:11.320082 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1237/2245] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:12:10 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-interface => generated 285 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:11.325551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:11.327591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:11.342844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:11.343613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:11.344210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:11.345281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:11.345915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:11.346608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:11.929685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:11.940309 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a9f8957-9649-44bc-a779-4be0cccfc559 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.618996 Oct 31 14:12:11.945379 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1238/2246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:11 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:11.963513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:11.964032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:11.980523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:11.981053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:11.981496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:11.982247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:11.982707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:11.983133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:12.080919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:12.096404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f1c3dce-9622-497f-bb02-c4335bdfd555 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.928616 Oct 31 14:12:12.109110 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1009/2247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:11 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:12.131169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:12.131807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 2e80907a-572f-4a2a-a43e-5abbf33c2881] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:12.152637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:12.165460 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee18e07d-76f0-4b0a-ae21-d7a7d2790219 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1266 microversion: 2.1 time: 0.209763 Oct 31 14:12:12.169461 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1239/2248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:11 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:12.171095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:12.171615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:12.172067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:12.172795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:12.173254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:12.176300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e2e945c-02bb-4c82-8dfc-a3f492977033 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a114c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:12.188325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:12.240388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] HTTP exception thrown: Instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 could not be found. Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Request method failure captured: Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 HTTP/1.1 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9YOEU1iOF-sr1sV1yEjXMEUeYRljjEat7GTm08yg7MmcPcYHuqhOFek7RUYSNLR4kKhumScJKFWOVWN9_CSqYgbBiOcKySzhrEej6KVbS_-qHBB4v25POteD4wVPKUidsJHXpCZ11GdTlD6z45oRBjd2IQlcDMQTl6HXeaWpPujNCU Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8597bfad0a2d4d209e6f33a02676406d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-LiveMigrationTest-191451690 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-LiveMigrationTest-191451690-project Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3589cce53cf8492a9a2e05c73f373319 Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-LiveMigrationTest-191451690-project Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 could not be found. Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '2e80907a-572f-4a2a-a43e-5abbf33c2881'} Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 could not be found. Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 could not be found. Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:12.246652 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 could not be found. Oct 31 14:12:12.251096 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:12.255218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Returning 404 to user: Instance 2e80907a-572f-4a2a-a43e-5abbf33c2881 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:12.256337 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e55aec3a-d2bd-4eb5-b645-472be0f38308 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881" status: 404 len: 111 microversion: 2.1 time: 0.146189 Oct 31 14:12:12.257439 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1010/2249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:12 2022] GET /compute/v2.1/servers/2e80907a-572f-4a2a-a43e-5abbf33c2881 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:12.294389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-531d1a42-c9fb-4302-aeef-5e9a473ffb59 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '.version_select at 0x7fe10749e790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:12.309599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e2e945c-02bb-4c82-8dfc-a3f492977033 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.138741 Oct 31 14:12:12.311483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1240/2250] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:12 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:12.348369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-531d1a42-c9fb-4302-aeef-5e9a473ffb59 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955721238" status: 202 len: 0 microversion: 2.1 time: 0.076924 Oct 31 14:12:12.350109 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1011/2251] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955721238 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:12:12.980011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:12.980898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:13.002052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:13.003681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:13.004242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:13.005322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:13.005930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:13.009433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:13.130190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:13.131070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:13.154480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:13.155358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:13.155992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:13.159843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:13.160551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:13.167572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:13.632277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:13.636583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:13.642507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0859819d-b6ee-4f36-8775-46cd196a3100 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.517172 Oct 31 14:12:13.645819 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1012/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:13 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:13.663300 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e013cdeb-717f-4ef2-a636-5dbec87c2cb7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.690985 Oct 31 14:12:13.665230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:13.666024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:13.668606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1241/2253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:12 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:13.684149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6037cfff-4f76-4afa-a23b-f38e2683f64f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a11c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:13.687909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:13.688506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:13.689020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:13.689752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:13.690242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:13.692059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:13.803569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6037cfff-4f76-4afa-a23b-f38e2683f64f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1455 microversion: 2.1 time: 0.132278 Oct 31 14:12:13.805156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1242/2254] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:13 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:14.012151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:14.023933 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b74dcd4d-92ae-4b3d-b762-ccb85dac14ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1272 microversion: 2.1 time: 0.369193 Oct 31 14:12:14.025963 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1013/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:13 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:14.122291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a3a10acb-9174-4efc-99e9-179086474ab9 req-540234b0-d24e-497e-893c-13dae52aa7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51a9543-d5a1-47c3-913e-c5453fc4a538", "name": "network-vif-unplugged", "status": "completed", "tag": "98abb853-920f-4edd-82ef-b19d0a5a0a60"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:14.140559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a3a10acb-9174-4efc-99e9-179086474ab9 req-540234b0-d24e-497e-893c-13dae52aa7ee service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:14.140954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a3a10acb-9174-4efc-99e9-179086474ab9 req-540234b0-d24e-497e-893c-13dae52aa7ee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:14.141385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a3a10acb-9174-4efc-99e9-179086474ab9 req-540234b0-d24e-497e-893c-13dae52aa7ee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:14.171170 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a3a10acb-9174-4efc-99e9-179086474ab9 req-540234b0-d24e-497e-893c-13dae52aa7ee service nova] Creating event network-vif-unplugged:98abb853-920f-4edd-82ef-b19d0a5a0a60 for instance e51a9543-d5a1-47c3-913e-c5453fc4a538 on n-h1-863052-1 Oct 31 14:12:14.181400 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a3a10acb-9174-4efc-99e9-179086474ab9 req-540234b0-d24e-497e-893c-13dae52aa7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064585 Oct 31 14:12:14.189263 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1243/2256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:14.669123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:14.670587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:14.681880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:14.684296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:14.684986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:14.687135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:14.696644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:14.698269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:14.706651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:14.709287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:14.731031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:14.731979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:14.731979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:14.741058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:14.742291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:14.743030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.134449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:15.145718 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a287c58-8ad9-41da-9e42-b923a8689ea8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.481752 Oct 31 14:12:15.161952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:15.162752 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1014/2257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:14 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:15.169165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e634df4c-891c-44ed-a110-a15aa6b511cd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1074793a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:15.171913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04cb272a-ef1a-49e5-9d81-3e8ccc45f3d8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.480055 Oct 31 14:12:15.175405 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1244/2258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:14 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:15.190547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-bf2154a4-dce1-451a-ba9b-3571340dc2b3 req-d8afbe96-1f8d-4fb7-9380-69ec646baca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692cbab4-8865-401a-8f21-4d26f7607f58", "tag": "0296bd5e-8bc5-4e14-bf85-884f06420d0e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:15.229625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bf2154a4-dce1-451a-ba9b-3571340dc2b3 req-d8afbe96-1f8d-4fb7-9380-69ec646baca8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.232229 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e634df4c-891c-44ed-a110-a15aa6b511cd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1464 microversion: 2.1 time: 0.067589 Oct 31 14:12:15.232783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bf2154a4-dce1-451a-ba9b-3571340dc2b3 req-d8afbe96-1f8d-4fb7-9380-69ec646baca8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.235633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bf2154a4-dce1-451a-ba9b-3571340dc2b3 req-d8afbe96-1f8d-4fb7-9380-69ec646baca8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.235819 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1015/2259] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:15 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1464 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:15.246374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:15.251376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:15.256296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-bf2154a4-dce1-451a-ba9b-3571340dc2b3 req-d8afbe96-1f8d-4fb7-9380-69ec646baca8 service nova] Creating event network-changed:0296bd5e-8bc5-4e14-bf85-884f06420d0e for instance 692cbab4-8865-401a-8f21-4d26f7607f58 on n-h2-863052-1 Oct 31 14:12:15.263054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.263563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.265112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.270129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.271793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-bf2154a4-dce1-451a-ba9b-3571340dc2b3 req-d8afbe96-1f8d-4fb7-9380-69ec646baca8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094336 Oct 31 14:12:15.272052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.272646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.273801 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1245/2260] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:15.291645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:15.295432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:15.311399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.313137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.314363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.315692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.318075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.318735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.377628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:12:15.489135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:15.507583 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b972674-4421-490f-9301-171757935e26 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1272 microversion: 2.1 time: 0.269144 Oct 31 14:12:15.518160 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1016/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:15 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:15.538726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-781fd11a-6464-4cf2-917f-4605268f81dd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc42280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:15.597973 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-877632f1-4bd1-41a8-a0f2-f69c765b30ea tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 204 len: 0 microversion: 2.1 time: 0.316224 Oct 31 14:12:15.599323 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1246/2262] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:12:15 2022] DELETE /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:12:15.616842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:15.619325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:15.634854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.635846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.636294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.638152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:15.638675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:15.639108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:15.651467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-781fd11a-6464-4cf2-917f-4605268f81dd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 200 len: 1464 microversion: 2.1 time: 0.127101 Oct 31 14:12:15.652062 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1017/2263] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:15 2022] GET /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 1464 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:15.929530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5b6f433-ff23-46c5-89c1-c28d20a3cc40 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Calling method '.version_select at 0x7fe10fc40f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:16.026945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:16.040581 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05447fb4-1eb8-48b4-a52f-4d36b8c88623 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1484 microversion: 2.1 time: 0.436192 Oct 31 14:12:16.043679 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1247/2264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:15 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1484 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:16.058743 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5b6f433-ff23-46c5-89c1-c28d20a3cc40 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 371 microversion: 2.1 time: 0.405546 Oct 31 14:12:16.059632 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1018/2265] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:12:15 2022] GET /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:16.063970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:16.067642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:16.073819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Action: 'update', calling method: .version_select at 0x7fe10fc875e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:16.079408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.080484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.083413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.084422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.086363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.087022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.186903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.187418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.187930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.188672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.190076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.191240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.263026 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd5b9029-f37d-4b66-87d4-1185dd05ec28 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 328 microversion: 2.1 time: 0.194525 Oct 31 14:12:16.266548 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1019/2266] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:16 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:16.275519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:16.292805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:16.310047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.310628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.311077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.314006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.314554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.314995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.471473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:16.480137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1083e4e4-cec9-48d9-881c-e6c3ee0f01c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1466 microversion: 2.1 time: 0.435110 Oct 31 14:12:16.481592 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1248/2267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:16 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1466 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:16.486473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:16.488116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:16.491378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:16.506148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.506994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.507437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.508365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:16.510105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:16.510745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:16.738778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:16.747421 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a156db7-ba72-476b-a30c-3cb748d102e9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.264226 Oct 31 14:12:16.765499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1249/2268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:16 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:16.887860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1748304593", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:16.985747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:17.022665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:17.036652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-159867da-0a8a-4683-8683-49446b4eb404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.768616 Oct 31 14:12:17.037386 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1020/2269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:16 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:17.043834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-902452312"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:17.046482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:17.058983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.059779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.064419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.065510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.066268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.066920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.306000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:17.323992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:17.324576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:17.325295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:17.325576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:17.325905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:17.337016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.338023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.338808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.339915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.340605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.341631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.367446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Getting quotas for project 41100e2f2db542fe9d4d08c13af026bb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:17.374641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Getting quotas for user bff5dce1e5f74f4c856daeb2a89a0dc3 and project 41100e2f2db542fe9d4d08c13af026bb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:17.383446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8990582c-1909-4c4c-a44c-c6852e7742df tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "POST /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b/action" status: 202 len: 0 microversion: 2.1 time: 0.344485 Oct 31 14:12:17.394591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.utils [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] cores quota exceeded for 41100e2f2db542fe9d4d08c13af026bb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120640) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 14:12:17.394962 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1021/2270] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:17 2022] POST /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:12:17.396231 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 14:12:17.407957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:17.410142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:17.417984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.418843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.419486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.420729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.421391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.422007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Request method failure captured: Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 145 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9e-NfNjvUydrgUwzu2dR6cxLY8EsM_Ybt9vn9AElXBIEdVl3A8Ks5EmwGsjhn_HDSwYgvQegRVjRwYF0Kvt8EebT3WMg1BlAwn-kbkSPwUJ82FbUorUHQKIMwntqqp7zY6H2Rws-SrgVUZQq0DTw1Cj6DNL-D5vKH3IjCTMF1mRQ18 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41100e2f2db542fe9d4d08c13af026bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bff5dce1e5f74f4c856daeb2a89a0dc3 Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1748304593", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1748304593', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452'}}} Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:12:17.422941 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:17.427297 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1e807a5-1a47-4c7b-be13-8707222f2854 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.657701 Oct 31 14:12:17.432269 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1250/2271] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 665 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:17.442574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-615ef89c-701f-49ce-962c-6912582bd737 req-42493504-6291-4368-8273-fc343d7297c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c250ffcc-8637-425b-a0c3-7906f0afff8e", "name": "network-vif-plugged", "status": "completed", "tag": "3cc4b314-66c6-43b8-99da-42a221b6880f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:17.461939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-615ef89c-701f-49ce-962c-6912582bd737 req-42493504-6291-4368-8273-fc343d7297c8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.462446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-615ef89c-701f-49ce-962c-6912582bd737 req-42493504-6291-4368-8273-fc343d7297c8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.465633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-615ef89c-701f-49ce-962c-6912582bd737 req-42493504-6291-4368-8273-fc343d7297c8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.483533 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-615ef89c-701f-49ce-962c-6912582bd737 req-42493504-6291-4368-8273-fc343d7297c8 service nova] Creating event network-vif-plugged:3cc4b314-66c6-43b8-99da-42a221b6880f for instance c250ffcc-8637-425b-a0c3-7906f0afff8e on n-h2-863052-1 Oct 31 14:12:17.490104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-615ef89c-701f-49ce-962c-6912582bd737 req-42493504-6291-4368-8273-fc343d7297c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057918 Oct 31 14:12:17.491522 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1251/2272] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:17.503466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:17.504665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:17.517017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.517815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.518992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.520222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:17.521043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:17.521800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:17.899768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:17.910606 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c65e7a1-2508-4402-ae3b-6deebc40a922 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1484 microversion: 2.1 time: 0.417729 Oct 31 14:12:17.911338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1252/2273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:17 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1484 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:17.930906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e60884f-3ba0-43b2-81ab-b35f8523e444 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a7c550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:17.991839 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e60884f-3ba0-43b2-81ab-b35f8523e444 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.064287 Oct 31 14:12:17.992574 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1253/2274] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:17 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:17.993835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:18.001422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Action: 'update', calling method: .version_select at 0x7fe107af5550>, body: {"quota_set": {"cores": 20}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:18.001731 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b98a0b4d-1b57-43f8-b9ea-70b914db298e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.604127 Oct 31 14:12:18.002385 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1022/2275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:17 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:18.007366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-da55da7d-45ab-43ae-8e57-b496950e432f req-3bd6cb9f-b6fc-4599-a475-e4119c73d6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7288e187-fb7b-4904-95fe-e91ba8aea039", "tag": "32357038-e558-426c-96f8-b6edda5f50c4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:18.026079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da55da7d-45ab-43ae-8e57-b496950e432f req-3bd6cb9f-b6fc-4599-a475-e4119c73d6cb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.027280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da55da7d-45ab-43ae-8e57-b496950e432f req-3bd6cb9f-b6fc-4599-a475-e4119c73d6cb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.027900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da55da7d-45ab-43ae-8e57-b496950e432f req-3bd6cb9f-b6fc-4599-a475-e4119c73d6cb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.039558 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-da55da7d-45ab-43ae-8e57-b496950e432f req-3bd6cb9f-b6fc-4599-a475-e4119c73d6cb service nova] Creating event network-changed:32357038-e558-426c-96f8-b6edda5f50c4 for instance 7288e187-fb7b-4904-95fe-e91ba8aea039 on n-h2-863052-1 Oct 31 14:12:18.044533 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-da55da7d-45ab-43ae-8e57-b496950e432f req-3bd6cb9f-b6fc-4599-a475-e4119c73d6cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040429 Oct 31 14:12:18.045438 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1023/2276] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:18.051513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:18.052383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:18.080722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.082216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.082992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.083874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.084488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.085093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.123867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.124357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.124799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.125535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.125982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.126438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.227597 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-278cc33b-44ee-4f27-9dbb-96f682a726a3 tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 329 microversion: 2.1 time: 0.232160 Oct 31 14:12:18.228344 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1254/2277] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:17 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:18.242792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:18.243991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:18.258614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.259105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.259537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.266361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.267265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.268107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.482393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:18.485436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:18.491179 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0b3c919-ae0d-4785-85a9-810437c02429 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1306 microversion: 2.1 time: 0.253909 Oct 31 14:12:18.493775 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1255/2278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:18 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1306 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:18.496182 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40b20a94-7c10-4b4a-8558-07efe86871ee tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.449271 Oct 31 14:12:18.496909 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1024/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:18 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:18.501915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2388a610-b562-423e-9f44-7f807521aef2 req-bca98468-711a-479e-964d-46cad4a71962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe82d2-dea9-4ed6-92b6-05bff851e8dc", "name": "network-vif-deleted", "tag": "ee385a28-bfce-436b-97c5-f6a8b1851e5d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:18.514870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2388a610-b562-423e-9f44-7f807521aef2 req-bca98468-711a-479e-964d-46cad4a71962 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.515611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2388a610-b562-423e-9f44-7f807521aef2 req-bca98468-711a-479e-964d-46cad4a71962 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.516269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2388a610-b562-423e-9f44-7f807521aef2 req-bca98468-711a-479e-964d-46cad4a71962 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.527719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07c547c6-e3b7-4c22-bd97-f1ed1f13c69c tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Calling method '.version_select at 0x7fe107a724c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:18.529872 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2388a610-b562-423e-9f44-7f807521aef2 req-bca98468-711a-479e-964d-46cad4a71962 service nova] Creating event network-vif-deleted:ee385a28-bfce-436b-97c5-f6a8b1851e5d for instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc on n-h1-863052-1 Oct 31 14:12:18.545464 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2388a610-b562-423e-9f44-7f807521aef2 req-bca98468-711a-479e-964d-46cad4a71962 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Oct 31 14:12:18.546956 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1025/2280] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:18.658406 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07c547c6-e3b7-4c22-bd97-f1ed1f13c69c tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 371 microversion: 2.1 time: 0.163173 Oct 31 14:12:18.665948 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1256/2281] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:12:18 2022] GET /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:18.671956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Action: 'update', calling method: .version_select at 0x7fe10fc2f8b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:18.812394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.813036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.813539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.814853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.815451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.815947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.935612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:18.939045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:18.939812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:18.949632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-530035c6-6bda-46b1-9f31-7e56f3cda7cc tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 328 microversion: 2.1 time: 0.274181 Oct 31 14:12:18.950953 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1026/2282] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:18 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:18.951777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.953752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.954371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.955472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:18.956569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:18.958070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:18.997889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:19.007423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80bd9929-9d5f-45b6-a748-47c2cf1ba2ca tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc2a0d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:19.026829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.027768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.028709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.029447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lazy-loading 'fault' on Instance uuid 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:12:19.091322 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80bd9929-9d5f-45b6-a748-47c2cf1ba2ca tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.087729 Oct 31 14:12:19.092805 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1027/2283] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:19 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:19.100635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:19.102147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:19.110568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.111386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.112083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.113127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.113815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.114352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.135140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:19.144252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76ffeed3-6928-4024-8e63-b550c8cf3bd4 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 200 len: 1301 microversion: 2.1 time: 0.214710 Oct 31 14:12:19.145208 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1257/2284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:18 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 1301 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:19.150395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1237049933", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:19.215939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:19.320236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:19.330146 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43438c62-8879-4962-b579-eff00ee202e1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.236002 Oct 31 14:12:19.334694 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1028/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:19 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:19.482584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:19.483710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:19.484437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:19.485067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:19.486127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:19.507783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.508518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.509272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.510373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.511497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.512298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.520457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:19.521098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:19.538897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.540511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.542521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.543427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.544546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.546615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.624603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Getting quotas for project 41100e2f2db542fe9d4d08c13af026bb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:19.635947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Getting quotas for user bff5dce1e5f74f4c856daeb2a89a0dc3 and project 41100e2f2db542fe9d4d08c13af026bb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:19.665195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.utils [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] instances quota exceeded for 41100e2f2db542fe9d4d08c13af026bb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120640) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 14:12:19.665761 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Request method failure captured: Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 145 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9e-NfNjvUydrgUwzu2dR6cxLY8EsM_Ybt9vn9AElXBIEdVl3A8Ks5EmwGsjhn_HDSwYgvQegRVjRwYF0Kvt8EebT3WMg1BlAwn-kbkSPwUJ82FbUorUHQKIMwntqqp7zY6H2Rws-SrgVUZQq0DTw1Cj6DNL-D5vKH3IjCTMF1mRQ18 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41100e2f2db542fe9d4d08c13af026bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bff5dce1e5f74f4c856daeb2a89a0dc3 Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1237049933", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1237049933', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452'}}} Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:12:19.669029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d7695d3-86ec-4426-b19c-4e514de67dcc tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.524126 Oct 31 14:12:19.673214 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1258/2286] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:19 2022] POST /compute/v2.1/servers => generated 119 bytes in 525 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:19.684905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:19.685841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:19.697490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.698000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.698473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.699190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.699650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.700081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.875126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:19.884455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18df4e8b-153c-4c17-808e-3f1a4e69cc13 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1486 microversion: 2.1 time: 0.371214 Oct 31 14:12:19.885047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1029/2287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:19 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1486 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:19.898738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8b074a73-23a4-454c-9657-5c18cb6eac1b req-93c16167-df49-4f4c-b4b2-77f3db4ea810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51a9543-d5a1-47c3-913e-c5453fc4a538", "name": "network-vif-plugged", "status": "completed", "tag": "98abb853-920f-4edd-82ef-b19d0a5a0a60"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:19.911797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8b074a73-23a4-454c-9657-5c18cb6eac1b req-93c16167-df49-4f4c-b4b2-77f3db4ea810 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.913653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8b074a73-23a4-454c-9657-5c18cb6eac1b req-93c16167-df49-4f4c-b4b2-77f3db4ea810 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.914515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8b074a73-23a4-454c-9657-5c18cb6eac1b req-93c16167-df49-4f4c-b4b2-77f3db4ea810 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.926850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:19.939978 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbcc40b4-f980-4ad1-b530-0033d6b07a5f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.267789 Oct 31 14:12:19.941834 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1259/2288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:19 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:19.945990 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8b074a73-23a4-454c-9657-5c18cb6eac1b req-93c16167-df49-4f4c-b4b2-77f3db4ea810 service nova] Creating event network-vif-plugged:98abb853-920f-4edd-82ef-b19d0a5a0a60 for instance e51a9543-d5a1-47c3-913e-c5453fc4a538 on n-h1-863052-1 Oct 31 14:12:19.950324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Action: 'update', calling method: .version_select at 0x7fe107a72b80>, body: {"quota_set": {"instances": 10}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:19.960595 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8b074a73-23a4-454c-9657-5c18cb6eac1b req-93c16167-df49-4f4c-b4b2-77f3db4ea810 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074115 Oct 31 14:12:19.961852 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1030/2289] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:19.972378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:19.974910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:19.989962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.990800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.991600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:19.992534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:19.993234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:19.994158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.102720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.104318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.104954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.105987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.106863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.107515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.111637 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d457cae1-47a4-4bb5-a8be-006ac84c699b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e/action" status: 202 len: 0 microversion: 2.1 time: 0.144634 Oct 31 14:12:20.114519 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1031/2290] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:19 2022] POST /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:12:20.120173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72bd90c3-d881-47f0-ad88-29cd2f08932b tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc2a9d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.201530 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72bd90c3-d881-47f0-ad88-29cd2f08932b tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.085588 Oct 31 14:12:20.210550 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1032/2291] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:20 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:20.217373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.223710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:20.242858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.243348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d952b6d-eca6-42df-8472-c47a8c0b40ea tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 329 microversion: 2.1 time: 0.299536 Oct 31 14:12:20.244558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.244977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.245088 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1260/2292] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:19 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 329 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:20.245762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.246245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.247462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.253335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.254220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:20.261668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.262852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.263474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.264343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.264947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.265644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.311008 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] HTTP exception thrown: Instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc could not be found. Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Request method failure captured: Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc HTTP/1.1 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9YOEU1iOF-sr1sV1yEjXMEUeYRljjEat7GTm08yg7MmcPcYHuqhOFek7RUYSNLR4kKhumScJKFWOVWN9_CSqYgbBiOcKySzhrEej6KVbS_-qHBB4v25POteD4wVPKUidsJHXpCZ11GdTlD6z45oRBjd2IQlcDMQTl6HXeaWpPujNCU Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8597bfad0a2d4d209e6f33a02676406d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-LiveMigrationTest-191451690 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-LiveMigrationTest-191451690-project Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3589cce53cf8492a9a2e05c73f373319 Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-LiveMigrationTest-191451690-project Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc could not be found. Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '0ffe82d2-dea9-4ed6-92b6-05bff851e8dc'} Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc could not be found. Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc could not be found. Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:20.313359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc could not be found. Oct 31 14:12:20.316901 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:20.321825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Returning 404 to user: Instance 0ffe82d2-dea9-4ed6-92b6-05bff851e8dc could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:20.323669 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93e60293-5466-446f-bed2-48b1c0e76b62 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc" status: 404 len: 111 microversion: 2.1 time: 0.077503 Oct 31 14:12:20.330301 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1261/2293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:20 2022] GET /compute/v2.1/servers/0ffe82d2-dea9-4ed6-92b6-05bff851e8dc => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:20.347829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd2a3f04-06c0-4682-b1f8-e71e25c46b1a tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Calling method '.version_select at 0x7fe107a680d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.473683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd2a3f04-06c0-4682-b1f8-e71e25c46b1a tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 371 microversion: 2.1 time: 0.140734 Oct 31 14:12:20.474934 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1262/2294] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:12:20 2022] GET /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:20.479878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.480586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:20.487832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.488918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.489565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.490294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.490734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.491151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.524426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:12:20.528442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:20.538126 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6bb45af3-cc1d-4115-8dfc-cd8eeb6fe893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1491 microversion: 2.1 time: 0.326246 Oct 31 14:12:20.539358 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1033/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:20 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1491 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:20.548399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.549452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:20.558048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.558830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.559659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.560544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.561170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.561916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.629176 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b284a7a-d7a8-4e84-be5b-ecbf8ddcc760 tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 204 len: 0 microversion: 2.1 time: 0.152690 Oct 31 14:12:20.630119 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1263/2296] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:12:20 2022] DELETE /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:12:20.701180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-10173471", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "4ac518b0-7781-4e63-8730-f0506dff823e"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:20.724190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:20.734109 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efcf06b0-7b88-4209-988e-283d4edd1177 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.193284 Oct 31 14:12:20.734738 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1034/2297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:20 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:20.739397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Action: 'update', calling method: .version_select at 0x7fe10fc3ec10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:20.761908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] validate_networks() for [('4ac518b0-7781-4e63-8730-f0506dff823e', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:20.806951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.807525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.808033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.808771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.809224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.809647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.869515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce3033b8-2fee-4f2a-b4be-5171f3eae69f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 325 microversion: 2.1 time: 0.133366 Oct 31 14:12:20.870501 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1035/2298] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:20 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:20.875507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:20.876146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:20.884776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.885258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.885696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:20.886422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:20.886873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:20.887292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.046285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:21.054374 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47af9baf-74bf-45ce-a28f-7919c95fdbcf tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1499 microversion: 2.1 time: 0.182921 Oct 31 14:12:21.054941 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1036/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:20 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1499 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:21.059673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1581334617", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:21.121132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:21.199466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:21.199886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:21.200357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:21.200756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:21.201165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:21.210184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.212115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.212555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.213281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.214420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.214420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.234334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Getting quotas for project 3a5a8b6ce1d84d1e98c65deb63b4b0c8. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:21.243362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Getting quotas for user 5f7ab2d13ffd499fbb37e04fdcdcee92 and project 3a5a8b6ce1d84d1e98c65deb63b4b0c8. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:21.256644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:12:21.259354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:12:21.273090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:21.333726 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4084611b-92c5-45ee-b552-e3c84fc84e36 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 0.701717 Oct 31 14:12:21.341685 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1264/2300] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:12:21.346906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:21.347786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:21.353598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:21.354301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:21.354934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:21.355536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:21.356999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:21.371272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.371788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.372203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.372902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.373258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.373607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.374055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.374606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.382340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.385537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.386327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.386984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.436287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Getting quotas for project 41100e2f2db542fe9d4d08c13af026bb. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:21.444301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Getting quotas for user bff5dce1e5f74f4c856daeb2a89a0dc3 and project 41100e2f2db542fe9d4d08c13af026bb. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:21.497308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.utils [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] ram quota exceeded for 41100e2f2db542fe9d4d08c13af026bb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120641) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 14:12:21.500093 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Request method failure captured: Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 145 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9e-NfNjvUydrgUwzu2dR6cxLY8EsM_Ybt9vn9AElXBIEdVl3A8Ks5EmwGsjhn_HDSwYgvQegRVjRwYF0Kvt8EebT3WMg1BlAwn-kbkSPwUJ82FbUorUHQKIMwntqqp7zY6H2Rws-SrgVUZQq0DTw1Cj6DNL-D5vKH3IjCTMF1mRQ18 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41100e2f2db542fe9d4d08c13af026bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bff5dce1e5f74f4c856daeb2a89a0dc3 Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1581334617", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1581334617', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452'}}} Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:12:21.512029 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 14:12:21.516150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:21.523237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:21.524246 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-23ae351f-d398-4deb-8c1d-e52b305d0720 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.468202 Oct 31 14:12:21.525183 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1037/2301] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:21 2022] POST /compute/v2.1/servers => generated 110 bytes in 469 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:21.536798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73b75016-ea72-4668-a544-27ad8505cecc tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc893a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:21.645968 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73b75016-ea72-4668-a544-27ad8505cecc tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.119612 Oct 31 14:12:21.646825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1038/2302] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:21 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:21.660423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cae90fa-d63f-4b82-9318-9c94e3f9d2f1 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:21.661055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3cae90fa-d63f-4b82-9318-9c94e3f9d2f1 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:21.667948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:21.681756 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4eed198-e99c-4319-bbaa-3e3803c4cde5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1519 microversion: 2.1 time: 0.337027 Oct 31 14:12:21.682542 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1265/2303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:21 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1519 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:21.689852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Action: 'update', calling method: .version_select at 0x7fe107cb8c10>, body: {"quota_set": {"ram": 51200}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:21.818408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cae90fa-d63f-4b82-9318-9c94e3f9d2f1 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:21.826722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cae90fa-d63f-4b82-9318-9c94e3f9d2f1 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:21.833023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cae90fa-d63f-4b82-9318-9c94e3f9d2f1 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:21.834910 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cae90fa-d63f-4b82-9318-9c94e3f9d2f1 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1257 microversion: 2.21 time: 0.186994 Oct 31 14:12:21.859027 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1039/2304] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:21 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1257 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:21.865937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:21.866370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:21.873776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.875054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.875745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.877162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.878101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.878770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.883192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.891127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.891641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.892909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.893431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.893869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.979825 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0e59395-7d72-45db-a7b3-f5f7bb669f4f tempest-QuotasAdminNegativeTest-1700310580 tempest-QuotasAdminNegativeTest-1700310580-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 200 len: 329 microversion: 2.1 time: 0.295269 Oct 31 14:12:21.980424 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1266/2305] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:21 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 329 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:21.986194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:21.989623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:21.997642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:21.998295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:21.998798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:21.999728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.000254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.000745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.202057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:22.213646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53023b09-fc11-4f2b-a6cd-6be9778c836d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.231940 Oct 31 14:12:22.214695 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1267/2306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:21 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:22.222805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-887cf907-e4de-41aa-a7cd-bfd0b691f662 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Action: 'update', calling method: .version_select at 0x7fe107418700>, body: {"quota_set": {"ram": 0}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:22.229023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-887cf907-e4de-41aa-a7cd-bfd0b691f662 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'bff5dce1e5f74f4c856daeb2a89a0dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41100e2f2db542fe9d4d08c13af026bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-887cf907-e4de-41aa-a7cd-bfd0b691f662 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Request method failure captured: Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb HTTP/1.1 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 25 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9e-NfNjvUydrgUwzu2dR6cxLY8EsM_Ybt9vn9AElXBIEdVl3A8Ks5EmwGsjhn_HDSwYgvQegRVjRwYF0Kvt8EebT3WMg1BlAwn-kbkSPwUJ82FbUorUHQKIMwntqqp7zY6H2Rws-SrgVUZQq0DTw1Cj6DNL-D5vKH3IjCTMF1mRQ18 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41100e2f2db542fe9d4d08c13af026bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41100e2f2db542fe9d4d08c13af026bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 41100e2f2db542fe9d4d08c13af026bb Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1055888955 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bff5dce1e5f74f4c856daeb2a89a0dc3 Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-QuotasAdminNegativeTest-1055888955-project Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: {"quota_set": {"ram": 0}} Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '41100e2f2db542fe9d4d08c13af026bb', 'body': {'quota_set': {'ram': 0}}} Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:12:22.236197 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-887cf907-e4de-41aa-a7cd-bfd0b691f662 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:22.239769 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-887cf907-e4de-41aa-a7cd-bfd0b691f662 tempest-QuotasAdminNegativeTest-1055888955 tempest-QuotasAdminNegativeTest-1055888955-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb" status: 403 len: 116 microversion: 2.1 time: 0.022100 Oct 31 14:12:22.241345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1268/2307] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:12:22 2022] PUT /compute/v2.1/os-quota-sets/41100e2f2db542fe9d4d08c13af026bb => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:22.248531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-76eff1c9-44ab-4631-9064-cb994b0e70ab req-0f157b26-764c-429f-88e2-fb2d317bb95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "name": "network-vif-unplugged", "status": "completed", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:22.267440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-76eff1c9-44ab-4631-9064-cb994b0e70ab req-0f157b26-764c-429f-88e2-fb2d317bb95f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.267992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-76eff1c9-44ab-4631-9064-cb994b0e70ab req-0f157b26-764c-429f-88e2-fb2d317bb95f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.269166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-76eff1c9-44ab-4631-9064-cb994b0e70ab req-0f157b26-764c-429f-88e2-fb2d317bb95f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.282868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-76eff1c9-44ab-4631-9064-cb994b0e70ab req-0f157b26-764c-429f-88e2-fb2d317bb95f service nova] Creating event network-vif-unplugged:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:12:22.309343 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-76eff1c9-44ab-4631-9064-cb994b0e70ab req-0f157b26-764c-429f-88e2-fb2d317bb95f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057188 Oct 31 14:12:22.310369 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1269/2308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:22.323549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:22.329225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:22.340311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.340821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.341337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.343576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.344432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.344945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.382339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:22.398002 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9beb81d-f8ed-482d-9bcc-ca4d3aca7e9b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 200 len: 1471 microversion: 2.1 time: 0.537248 Oct 31 14:12:22.400307 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1040/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:21 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:22.424031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1851902987"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:22.428401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:22.434821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.435890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.436948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.438375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.439138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.439731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.761514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:22.788353 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-282b643a-be24-485c-a199-34445fa7c8bb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1499 microversion: 2.1 time: 0.476583 Oct 31 14:12:22.795962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1270/2310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:22 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1499 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:22.821754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6b910a6-de91-40ee-a7fc-3d3a2779eea1 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107979a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:22.885731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6b910a6-de91-40ee-a7fc-3d3a2779eea1 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.078352 Oct 31 14:12:22.887164 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1271/2311] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:22 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:22.892020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:22.895733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:22.913752 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-128c69ab-baca-4e67-95c1-c8063ef4d031 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e/action" status: 202 len: 0 microversion: 2.1 time: 0.492965 Oct 31 14:12:22.922655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.923607 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1041/2312] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:22 2022] POST /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 31 14:12:22.923799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.924259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.931017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.931682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.932330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:22.950261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0f642d8b-ef45-4e63-ba53-e04baa9551f8 req-ce431f50-e5e5-4a6c-b568-d8960c2cd81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3", "name": "network-vif-deleted", "tag": "c778a55d-5f99-4c18-922a-7bde2ec40796"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:22.970512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0f642d8b-ef45-4e63-ba53-e04baa9551f8 req-ce431f50-e5e5-4a6c-b568-d8960c2cd81e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:22.974850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0f642d8b-ef45-4e63-ba53-e04baa9551f8 req-ce431f50-e5e5-4a6c-b568-d8960c2cd81e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:22.975439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0f642d8b-ef45-4e63-ba53-e04baa9551f8 req-ce431f50-e5e5-4a6c-b568-d8960c2cd81e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.010618 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0f642d8b-ef45-4e63-ba53-e04baa9551f8 req-ce431f50-e5e5-4a6c-b568-d8960c2cd81e service nova] Creating event network-vif-deleted:c778a55d-5f99-4c18-922a-7bde2ec40796 for instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 on n-h1-863052-1 Oct 31 14:12:23.031604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0f642d8b-ef45-4e63-ba53-e04baa9551f8 req-ce431f50-e5e5-4a6c-b568-d8960c2cd81e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096949 Oct 31 14:12:23.038025 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1042/2313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:23.066873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:23.068843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:23.078135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.078738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.079257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.081478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.082225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.082629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.236560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:23.252561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:23.256828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:23.258802 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26835700-0f0e-44e3-96ec-efed5339eb1a tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1309 microversion: 2.21 time: 0.218004 Oct 31 14:12:23.275556 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1043/2314] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:23 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:23.287325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71a121fb-174c-4bf3-96de-914921e3f21a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fc89ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:23.324216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:23.375677 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52556d1f-014c-438b-abe6-8e86196b48b3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1504 microversion: 2.1 time: 0.487196 Oct 31 14:12:23.376213 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1272/2315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:22 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:23.382667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:23.391631 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71a121fb-174c-4bf3-96de-914921e3f21a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1412 microversion: 2.1 time: 0.114770 Oct 31 14:12:23.397603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:23.399228 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1044/2316] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:23 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:23.405038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:23.406026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:23.410675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.411398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.411996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.412852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.414372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.419358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.419533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.421302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.421806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.422623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.423248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.423830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.428353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:23.724079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:23.734718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83865a2c-a4a5-4e13-a402-4dabc6ab47f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.355493 Oct 31 14:12:23.756805 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1273/2317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:23 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:23.820124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:23.820899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:23.828690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.838882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.840401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.846124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:23.849648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:23.850923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:23.993984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:24.007945 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0fe0936-aa22-4707-825b-bf63163745a0 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 200 len: 1504 microversion: 2.1 time: 0.607385 Oct 31 14:12:24.019144 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1045/2318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:23 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:24.019144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d652bd6-a417-458d-b87a-0e671096ce52 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fbbb550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:24.020700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.026274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.027097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:24.027573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lazy-loading 'fault' on Instance uuid e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:12:24.102213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d652bd6-a417-458d-b87a-0e671096ce52 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.092208 Oct 31 14:12:24.103179 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1046/2319] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:24 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:24.124821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:24.125437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:24.126544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3589cce53cf8492a9a2e05c73f373319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8597bfad0a2d4d209e6f33a02676406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:24.132887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.134209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.135356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:24.136298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.136435 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c86ec92d-da6d-4009-81df-5c92516a0bbb tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 200 len: 1300 microversion: 2.1 time: 0.320962 Oct 31 14:12:24.136946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.138057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:24.141573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1274/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:23 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 1300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:24.176539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:12:24.290921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:24.291961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:24.301416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.305285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.309458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:24.320472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.323957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.324648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:24.412352 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e03b9620-814d-49a4-8c6c-6fedf4a031ae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 204 len: 0 microversion: 2.1 time: 0.296086 Oct 31 14:12:24.413934 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1047/2321] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:12:24 2022] DELETE /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:12:24.432000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42476fa6-9706-48ee-b109-e222dc57967c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fbd0d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:24.486673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:24.505653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:24.508492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:24.510778 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa507da1-9a88-4c07-b85b-bb93951493d9 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1315 microversion: 2.21 time: 0.224702 Oct 31 14:12:24.526212 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1275/2322] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:24 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:24.531042 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42476fa6-9706-48ee-b109-e222dc57967c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1412 microversion: 2.1 time: 0.114867 Oct 31 14:12:24.532100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1048/2323] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:24 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:24.665083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1934809443", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7791d1cc-91a3-4ccc-9a62-bb64b1bcdeec"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:24.767558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:24.769494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:24.771315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] validate_networks() for [('7791d1cc-91a3-4ccc-9a62-bb64b1bcdeec', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:24.805264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.805765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.806258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:24.808197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:24.808665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:24.809102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.158923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:25.173938 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6405558c-0ef0-41b2-997b-bed0ae0bd645 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.413781 Oct 31 14:12:25.186269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1049/2324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:24 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:25.186269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dc13ebcb-76b4-45d4-90f1-55e2ccd04b05 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10c0d7e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:25.257809 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dc13ebcb-76b4-45d4-90f1-55e2ccd04b05 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1454 microversion: 2.1 time: 0.081780 Oct 31 14:12:25.261126 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1050/2325] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:25 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:25.276612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:25.277232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] [instance: e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:25.295441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:25.298117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:25.298629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.299384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:25.302056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:25.302581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.335119 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] HTTP exception thrown: Instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 could not be found. Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Request method failure captured: Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 HTTP/1.1 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9YOEU1iOF-sr1sV1yEjXMEUeYRljjEat7GTm08yg7MmcPcYHuqhOFek7RUYSNLR4kKhumScJKFWOVWN9_CSqYgbBiOcKySzhrEej6KVbS_-qHBB4v25POteD4wVPKUidsJHXpCZ11GdTlD6z45oRBjd2IQlcDMQTl6HXeaWpPujNCU Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8597bfad0a2d4d209e6f33a02676406d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8597bfad0a2d4d209e6f33a02676406d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-LiveMigrationTest-191451690 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8597bfad0a2d4d209e6f33a02676406d Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-LiveMigrationTest-191451690 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-LiveMigrationTest-191451690-project Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3589cce53cf8492a9a2e05c73f373319 Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-LiveMigrationTest-191451690-project Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 could not be found. Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3'} Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 could not be found. Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 could not be found. Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:25.339274 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 could not be found. Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] Returning 404 to user: Instance e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:25.344056 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99c305c3-4e88-439d-ab6b-ba45ed91c89f tempest-LiveMigrationTest-191451690 tempest-LiveMigrationTest-191451690-project] 10.222.0.27 "GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3" status: 404 len: 111 microversion: 2.1 time: 0.078448 Oct 31 14:12:25.344991 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1051/2326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:25 2022] GET /compute/v2.1/servers/e0dd6bd4-fe89-4e8c-9f65-f09f494cc8a3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:12:25.550330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:25.555698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:25.583101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:25.584272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:25.584938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:25.586334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:25.586933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:25.587441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:25.590924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:25.592302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.597135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:25.598203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:25.602518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.621315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:25.622644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:25.623264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.624266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:25.624902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:25.627449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:25.706898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Getting quotas for project bd0bd0633fab41348c29a69aebb7b069. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:25.740540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Getting quotas for user 79995efa070844cf94985c291b8388b7 and project bd0bd0633fab41348c29a69aebb7b069. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:25.809871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:12:25.822079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:12:25.931122 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00d62ec2-0538-4f16-a1ea-126ee110f8cd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269985 Oct 31 14:12:25.932312 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1276/2327] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:12:25.956098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c4f98c1-b14c-4db1-a745-dcb9c411acb1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078da160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:26.209880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:26.232159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:26.233787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:26.235121 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d27521ef-9ab4-4b85-b6b2-06e5fe4d7054 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1357 microversion: 2.21 time: 0.699425 Oct 31 14:12:26.237896 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1052/2328] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:25 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1357 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:26.246747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19e0a85f-1ac0-4d6e-a3cc-cc392f518cf8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:26.247728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19e0a85f-1ac0-4d6e-a3cc-cc392f518cf8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:26.291587 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c4f98c1-b14c-4db1-a745-dcb9c411acb1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1412 microversion: 2.1 time: 0.351300 Oct 31 14:12:26.304199 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1277/2329] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:25 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1412 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:26.322974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:26.324687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:26.345058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:26.347674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:26.348967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:26.354090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:26.355544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:26.357368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:26.530220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19e0a85f-1ac0-4d6e-a3cc-cc392f518cf8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:26.538777 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19e0a85f-1ac0-4d6e-a3cc-cc392f518cf8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1218 microversion: 2.1 time: 0.298900 Oct 31 14:12:26.545122 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1053/2330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:26 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:26.550849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-680cef81-2526-4c69-b47d-973da23df9a4 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fbbb700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:27.850102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:27.866552 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-106f9512-6ead-42cc-9271-19e246257ee6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 1.558882 Oct 31 14:12:27.867373 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1278/2331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:26 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:27.914346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ea317af3-3e4b-4ba0-8e90-a743a8c3b6ae req-c59db52c-926a-42f5-9b83-b8987f9a0838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f9e762-ff51-4111-946e-50eaa69df94b", "name": "network-vif-plugged", "status": "completed", "tag": "98a382a7-f2e3-4e9d-bd8c-950abec1c5f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:27.944282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ea317af3-3e4b-4ba0-8e90-a743a8c3b6ae req-c59db52c-926a-42f5-9b83-b8987f9a0838 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:27.953507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ea317af3-3e4b-4ba0-8e90-a743a8c3b6ae req-c59db52c-926a-42f5-9b83-b8987f9a0838 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:27.961811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ea317af3-3e4b-4ba0-8e90-a743a8c3b6ae req-c59db52c-926a-42f5-9b83-b8987f9a0838 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:28.005107 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ea317af3-3e4b-4ba0-8e90-a743a8c3b6ae req-c59db52c-926a-42f5-9b83-b8987f9a0838 service nova] Creating event network-vif-plugged:98a382a7-f2e3-4e9d-bd8c-950abec1c5f8 for instance c4f9e762-ff51-4111-946e-50eaa69df94b on n-h1-863052-1 Oct 31 14:12:28.017241 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ea317af3-3e4b-4ba0-8e90-a743a8c3b6ae req-c59db52c-926a-42f5-9b83-b8987f9a0838 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126381 Oct 31 14:12:28.026887 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1279/2332] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:28.046451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:28.047569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:28.071737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:28.074497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:28.078210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:28.082364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:28.082972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:28.094894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:29.012370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:29.027606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:29.031292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:29.032469 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d2e9b60-68ec-431f-a745-85eccd00da1d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1357 microversion: 2.21 time: 1.004048 Oct 31 14:12:29.053770 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1280/2333] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:28 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1357 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:29.067580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b847746e-36bc-47f8-9a45-7bf4a24a26ec tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107443e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:31.412174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:35.653311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:35.772603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=60 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:36.214459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:36.264716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:36.534697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=36 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:38.069927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:39.017467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:41.781246 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-680cef81-2526-4c69-b47d-973da23df9a4 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1463 microversion: 2.1 time: 15.232876 Oct 31 14:12:41.797785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b847746e-36bc-47f8-9a45-7bf4a24a26ec tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1412 microversion: 2.1 time: 12.742590 Oct 31 14:12:41.798506 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1281/2334] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:29 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1412 bytes in 12744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:41.803240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1054/2335] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:26 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1463 bytes in 15257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:41.811424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:41.812307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:41.819192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-618d92d2-88f1-416d-a23e-5ee99b6a0c7f req-3fba93c4-5b2a-4c45-842d-28625c1a874e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51a9543-d5a1-47c3-913e-c5453fc4a538", "name": "network-vif-deleted", "tag": "98abb853-920f-4edd-82ef-b19d0a5a0a60"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:41.821108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:41.823841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:41.824528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:41.828658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:41.829327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:41.829916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:41.850022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-618d92d2-88f1-416d-a23e-5ee99b6a0c7f req-3fba93c4-5b2a-4c45-842d-28625c1a874e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:41.850870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-618d92d2-88f1-416d-a23e-5ee99b6a0c7f req-3fba93c4-5b2a-4c45-842d-28625c1a874e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:41.851481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-618d92d2-88f1-416d-a23e-5ee99b6a0c7f req-3fba93c4-5b2a-4c45-842d-28625c1a874e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:41.873874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-618d92d2-88f1-416d-a23e-5ee99b6a0c7f req-3fba93c4-5b2a-4c45-842d-28625c1a874e service nova] Creating event network-vif-deleted:98abb853-920f-4edd-82ef-b19d0a5a0a60 for instance e51a9543-d5a1-47c3-913e-c5453fc4a538 on n-h1-863052-1 Oct 31 14:12:41.893541 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-618d92d2-88f1-416d-a23e-5ee99b6a0c7f req-3fba93c4-5b2a-4c45-842d-28625c1a874e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093876 Oct 31 14:12:41.894730 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1282/2336] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:41.912022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:41.913057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:41.920003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:41.920721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:41.921373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:41.922260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:41.922861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:41.923457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:42.128353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:42.141158 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ed66736-836a-44d8-b8c8-af686249824b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1318 microversion: 2.1 time: 0.336746 Oct 31 14:12:42.154568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1055/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:41 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:42.166823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7ad166e2-c6f0-4b42-870e-cf3b8198d4cf req-8003366b-0639-484d-b8b8-47bbaeb04519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7288e187-fb7b-4904-95fe-e91ba8aea039", "name": "network-vif-plugged", "status": "completed", "tag": "32357038-e558-426c-96f8-b6edda5f50c4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:42.187456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7ad166e2-c6f0-4b42-870e-cf3b8198d4cf req-8003366b-0639-484d-b8b8-47bbaeb04519 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:42.187938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7ad166e2-c6f0-4b42-870e-cf3b8198d4cf req-8003366b-0639-484d-b8b8-47bbaeb04519 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:42.188365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7ad166e2-c6f0-4b42-870e-cf3b8198d4cf req-8003366b-0639-484d-b8b8-47bbaeb04519 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:42.203352 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7ad166e2-c6f0-4b42-870e-cf3b8198d4cf req-8003366b-0639-484d-b8b8-47bbaeb04519 service nova] Creating event network-vif-plugged:32357038-e558-426c-96f8-b6edda5f50c4 for instance 7288e187-fb7b-4904-95fe-e91ba8aea039 on n-h2-863052-1 Oct 31 14:12:42.210495 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7ad166e2-c6f0-4b42-870e-cf3b8198d4cf req-8003366b-0639-484d-b8b8-47bbaeb04519 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054209 Oct 31 14:12:42.212529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1056/2338] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:42.220017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:42.221075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:42.229697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:42.231032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:42.231727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:42.233826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:42.235642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:42.237989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:42.491570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:42.505790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:42.507610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:42.512160 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84195da2-c292-4ada-8ece-d14ddb09c14c tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1357 microversion: 2.21 time: 0.298263 Oct 31 14:12:42.512894 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1057/2339] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:42 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:42.673248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:42.688988 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d02a6c25-2892-4d7b-b3cf-d2de4a27ae59 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1314 microversion: 2.1 time: 0.792125 Oct 31 14:12:42.694233 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1283/2340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:41 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:42.701836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a3da2800-c2e9-44ce-9b3f-b394ababc615 req-99c74ab7-b531-42ca-b47f-fe61f0586703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d8072b-22d5-4efb-a8f0-cbc64db7474b", "tag": "aad909a1-be8f-4014-b4ee-a410a747fb4c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:42.729299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a3da2800-c2e9-44ce-9b3f-b394ababc615 req-99c74ab7-b531-42ca-b47f-fe61f0586703 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:42.742358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a3da2800-c2e9-44ce-9b3f-b394ababc615 req-99c74ab7-b531-42ca-b47f-fe61f0586703 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:42.744195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a3da2800-c2e9-44ce-9b3f-b394ababc615 req-99c74ab7-b531-42ca-b47f-fe61f0586703 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:42.763179 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a3da2800-c2e9-44ce-9b3f-b394ababc615 req-99c74ab7-b531-42ca-b47f-fe61f0586703 service nova] Creating event network-changed:aad909a1-be8f-4014-b4ee-a410a747fb4c for instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b on n-h2-863052-1 Oct 31 14:12:42.769793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a3da2800-c2e9-44ce-9b3f-b394ababc615 req-99c74ab7-b531-42ca-b47f-fe61f0586703 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074047 Oct 31 14:12:42.770960 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1284/2341] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:42.779681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc13baa3-aca9-48fd-b824-2a657dae9d69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1077d6ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:42.818280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2133968307", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:42.841977 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc13baa3-aca9-48fd-b824-2a657dae9d69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 200 len: 1463 microversion: 2.1 time: 0.067499 Oct 31 14:12:42.848812 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1285/2342] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:42 2022] GET /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:42.861656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfa38111-dff2-4644-8fc8-2702ba13dd8f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078ae5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:42.919673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:42.930558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfa38111-dff2-4644-8fc8-2702ba13dd8f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1412 microversion: 2.1 time: 0.079616 Oct 31 14:12:42.930991 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1286/2343] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:42 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:42.940394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:42.941137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:42.947931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:42.948626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:42.949242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:42.950103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:42.950737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:42.951321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.326449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:43.337442 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-258b55b2-f1f7-4f82-bb53-e6f4fd467b3a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1468 microversion: 2.1 time: 0.398734 Oct 31 14:12:43.351682 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1287/2344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:42 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1468 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:43.393142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:43.394045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:43.420585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.421412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.421992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.423306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.425442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.426031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.614525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:43.614960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:43.615453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:43.615915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:43.616277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:43.656438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.656931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.657375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.658115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.670473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.670834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.694408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:43.700333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:43.718545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:12:43.721810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:12:43.773817 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb875c99-a9e5-4483-837b-6e81b5707436 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258473 Oct 31 14:12:43.775361 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1058/2345] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:12:43.781007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1873088907"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:43.784816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:43.793246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.793955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.794793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.795681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.796443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.797026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.858029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:43.871356 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70206c20-77f7-4d8e-8239-53fb3214aa2b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1318 microversion: 2.1 time: 0.518184 Oct 31 14:12:43.872733 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1288/2346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:43 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:43.878012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:43.878789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:43.885349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.886442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.887085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:43.888283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:43.888940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:43.889570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.256189 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-288b9043-4373-44f5-8175-b9174767e294 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "POST /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88/action" status: 202 len: 0 microversion: 2.1 time: 0.479328 Oct 31 14:12:44.260885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1059/2347] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:43 2022] POST /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:12:44.272099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.278320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:44.291118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.291968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.297301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.298363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.299036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.299157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:44.299814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.312430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:44.317129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:44.321360 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a16e9bb1-b00a-4575-ac7a-867ed83174c5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1357 microversion: 2.21 time: 0.447263 Oct 31 14:12:44.323186 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1289/2348] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:43 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1357 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:44.332603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26cb1714-ddd2-4ec8-a708-0d12b43708fa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.336445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26cb1714-ddd2-4ec8-a708-0d12b43708fa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:44.460328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-26cb1714-ddd2-4ec8-a708-0d12b43708fa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:44.468271 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26cb1714-ddd2-4ec8-a708-0d12b43708fa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1217 microversion: 2.1 time: 0.143597 Oct 31 14:12:44.487748 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1290/2349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:44 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:44.497690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d4c8311a-8d45-4614-85dd-d8b0d46ea32c req-84914140-194f-4155-8818-e41a039ade92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d8854f-fe06-4f83-8ae3-fdb277efd0df", "tag": "3c4e16a8-b692-4aca-93de-b68fd9520020"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:44.525601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d4c8311a-8d45-4614-85dd-d8b0d46ea32c req-84914140-194f-4155-8818-e41a039ade92 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.525966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d4c8311a-8d45-4614-85dd-d8b0d46ea32c req-84914140-194f-4155-8818-e41a039ade92 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.526432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d4c8311a-8d45-4614-85dd-d8b0d46ea32c req-84914140-194f-4155-8818-e41a039ade92 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.552532 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d4c8311a-8d45-4614-85dd-d8b0d46ea32c req-84914140-194f-4155-8818-e41a039ade92 service nova] Creating event network-changed:3c4e16a8-b692-4aca-93de-b68fd9520020 for instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df on n-h1-863052-1 Oct 31 14:12:44.559920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d4c8311a-8d45-4614-85dd-d8b0d46ea32c req-84914140-194f-4155-8818-e41a039ade92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070507 Oct 31 14:12:44.564276 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1291/2350] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:44.578803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1218d9e2-a180-469b-8209-e67dcc197f72 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078ae820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.657262 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1218d9e2-a180-469b-8209-e67dcc197f72 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1421 microversion: 2.1 time: 0.090877 Oct 31 14:12:44.668396 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1292/2351] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:44 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:44.675431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c250ffcc-8637-425b-a0c3-7906f0afff8e", "name": "network-vif-plugged", "status": "completed", "tag": "3cc4b314-66c6-43b8-99da-42a221b6880f"}, {"server_uuid": "c1d8854f-fe06-4f83-8ae3-fdb277efd0df", "name": "network-vif-plugged", "status": "completed", "tag": "3c4e16a8-b692-4aca-93de-b68fd9520020"}, {"server_uuid": "f5d8072b-22d5-4efb-a8f0-cbc64db7474b", "name": "network-vif-plugged", "status": "completed", "tag": "aad909a1-be8f-4014-b4ee-a410a747fb4c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:44.693622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.694312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.695383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.714044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Creating event network-vif-plugged:3cc4b314-66c6-43b8-99da-42a221b6880f for instance c250ffcc-8637-425b-a0c3-7906f0afff8e on n-h2-863052-1 Oct 31 14:12:44.714495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:44.714663 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Creating event network-vif-plugged:3c4e16a8-b692-4aca-93de-b68fd9520020 for instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df on n-h1-863052-1 Oct 31 14:12:44.715576 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] Creating event network-vif-plugged:aad909a1-be8f-4014-b4ee-a410a747fb4c for instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b on n-h2-863052-1 Oct 31 14:12:44.726816 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2f52fae8-2d12-44e6-bccd-5cae66b959d7 req-e78a99dc-2eda-4dfd-99be-6f16795c1e36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056917 Oct 31 14:12:44.727717 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1293/2352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:44.728210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-90b9e899-9e7d-4873-ade8-9ece88c0a0c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1500 microversion: 2.1 time: 0.464012 Oct 31 14:12:44.729810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1060/2353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:44 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:44.735504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47709c16-4df5-425d-9d92-9af08eb1c36d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107479940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.742370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-889f751a-6ecc-41a0-b523-4ad479969241 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107871310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.810798 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47709c16-4df5-425d-9d92-9af08eb1c36d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 200 len: 1421 microversion: 2.1 time: 0.079572 Oct 31 14:12:44.811480 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1061/2354] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:44 2022] GET /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:44.825872 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-889f751a-6ecc-41a0-b523-4ad479969241 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.097183 Oct 31 14:12:44.834126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:44.834424 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1294/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:44 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:44.834523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:44.834603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e55401bb-c341-48bb-b49d-4ec61e0d3a4e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1077d60d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.849388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.850094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.850963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.851709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.852343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.855592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.949827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fed3041-1cc4-459d-af17-a055c3058e96 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.126373 Oct 31 14:12:44.957820 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1062/2356] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:44 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:44.963280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:44.964544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:44.973206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.974065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.974859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:44.975730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:44.976341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:44.976925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.507241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:45.516811 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea7c308c-85dd-4eb8-ab2a-f583804db94e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1318 microversion: 2.1 time: 0.557612 Oct 31 14:12:45.517379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1063/2357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:44 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:45.530768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:45.535027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:45.542450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.543059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.543819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.544992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.545431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.545896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.754635 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e55401bb-c341-48bb-b49d-4ec61e0d3a4e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 204 len: 0 microversion: 2.1 time: 0.924439 Oct 31 14:12:45.755541 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1295/2358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:44 2022] DELETE /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:12:45.760469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:45.761765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:45.769607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.770497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.771136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.772062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.772713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.773357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.783194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:45.794120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:45.795649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:45.796800 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b5d75f6-0c24-4300-81cb-46d7d7a1afb7 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1357 microversion: 2.21 time: 0.277790 Oct 31 14:12:45.799443 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1064/2359] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:45 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:45.813955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:45.814481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:45.823155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.823858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.824446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.825300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.825904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.826504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.858859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:12:45.861682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:45.871103 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3ef71a7-a4c5-4a32-ad4a-0c1790a86df8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1269 microversion: 2.1 time: 0.114197 Oct 31 14:12:45.872346 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1296/2360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:45 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1269 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:45.879639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1780afb-e85b-46f6-97f6-c26ae969f123 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107c3a670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:45.939454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1780afb-e85b-46f6-97f6-c26ae969f123 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.065864 Oct 31 14:12:45.940600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1297/2361] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:45 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:45.955444 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63a2a54c-0ec5-4156-9262-80845363fc79 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 204 len: 0 microversion: 2.1 time: 0.153034 Oct 31 14:12:45.956317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1065/2362] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:12:45 2022] DELETE /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:12:45.961072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:45.963571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:45.971040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.971674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.972275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:45.973300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:45.973938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:45.974665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.084915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-491566122", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:46.101500 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c212f6e8-3aeb-496f-bb00-6589f3e8d53a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.143759 Oct 31 14:12:46.102382 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1298/2363] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:45 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:46.160702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] validate_networks() for [('d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:46.543143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:46.544196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:46.552716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.553430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.553968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.554922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.555865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.556372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.701457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:46.711058 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d514799f-0ac5-4d60-9be9-1f37fbc245da tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1318 microversion: 2.1 time: 0.174106 Oct 31 14:12:46.711666 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1299/2364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:46 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:46.745946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-90208f9c-b59e-4bd9-b76f-8b1389195ccc req-19ee1800-602b-46d0-94e2-778cf3a8a701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f9e762-ff51-4111-946e-50eaa69df94b", "name": "network-vif-unplugged", "status": "completed", "tag": "98a382a7-f2e3-4e9d-bd8c-950abec1c5f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:46.749685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:46.750861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:46.751558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:46.752985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:46.753657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:46.756502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90208f9c-b59e-4bd9-b76f-8b1389195ccc req-19ee1800-602b-46d0-94e2-778cf3a8a701 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.757050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90208f9c-b59e-4bd9-b76f-8b1389195ccc req-19ee1800-602b-46d0-94e2-778cf3a8a701 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.757416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90208f9c-b59e-4bd9-b76f-8b1389195ccc req-19ee1800-602b-46d0-94e2-778cf3a8a701 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.768811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.769859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.770588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.771618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.772325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.773002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.773422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-90208f9c-b59e-4bd9-b76f-8b1389195ccc req-19ee1800-602b-46d0-94e2-778cf3a8a701 service nova] Creating event network-vif-unplugged:98a382a7-f2e3-4e9d-bd8c-950abec1c5f8 for instance c4f9e762-ff51-4111-946e-50eaa69df94b on n-h1-863052-1 Oct 31 14:12:46.779493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-90208f9c-b59e-4bd9-b76f-8b1389195ccc req-19ee1800-602b-46d0-94e2-778cf3a8a701 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038029 Oct 31 14:12:46.785272 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1300/2365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:12:46.799927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:46.809004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for user ec707d34966e44aa93900eebc62a6a93 and project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:46.822685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:12:46.825129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:12:46.827534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:46.828367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:46.836535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.837029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.837473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.838388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:46.839025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:46.839639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:46.878469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e4cf8b5d-e5c0-4752-adf6-86531f7e234c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798112 Oct 31 14:12:46.879796 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1066/2366] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:12:46.892021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68c28474-5492-40cb-84a3-83eb852b18c7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:46.894393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68c28474-5492-40cb-84a3-83eb852b18c7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:46.997122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68c28474-5492-40cb-84a3-83eb852b18c7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.006210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68c28474-5492-40cb-84a3-83eb852b18c7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1207 microversion: 2.1 time: 0.118984 Oct 31 14:12:47.006789 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1067/2367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:46 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1207 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:47.028315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:47.028947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:47.036478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.036997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.040206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.042527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.044151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.044847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.045574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.049350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.053968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.059302 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e268d5e-122c-47ca-b5df-7da5d18e2908 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1549 microversion: 2.21 time: 0.237114 Oct 31 14:12:47.068887 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1301/2368] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:46 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:12:47.075012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a31c7509-66d9-4d07-98f9-3ed064a1be7a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078ee790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:47.146440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.168479 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36954919-5129-4c9b-899d-cbefe112ddc9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1275 microversion: 2.1 time: 0.143874 Oct 31 14:12:47.170075 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1068/2369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:47 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:47.177078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:47.178553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:47.187382 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a31c7509-66d9-4d07-98f9-3ed064a1be7a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.119842 Oct 31 14:12:47.188190 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1302/2370] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:47 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:47.193717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:47.196594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:47.199389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.200974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.201603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.202544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.203163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.203752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.204625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.206048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.206757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.207660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.208266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.208953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.239582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:12:47.343992 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5230674-8882-4a4e-9546-6fd76acabd4e tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 204 len: 0 microversion: 2.21 time: 0.172234 Oct 31 14:12:47.345008 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1069/2371] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:12:47 2022] DELETE /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:12:47.354663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:47.355359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:47.361632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.362822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.363280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.364254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.364441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.364872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.568190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.577593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.579311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.580592 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86a8a411-ca61-4026-8dfd-f684955ac4be tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1555 microversion: 2.21 time: 0.230637 Oct 31 14:12:47.581193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1070/2372] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:47 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:12:47.681919 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b986393-92bf-4113-9482-501385a46dc2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.492313 Oct 31 14:12:47.685687 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1303/2373] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:47 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:47.738496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:47.739625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:47.749968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-499605996", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:47.760973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.761547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.761883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.762610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.763062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.763483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.826679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:12:47.932344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:47.940238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbd3addc-4e6f-4d2b-9c10-d6fc7336b9a6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1508 microversion: 2.1 time: 0.208984 Oct 31 14:12:47.940800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1304/2374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:47 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:47.963512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:47.964349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:47.970636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.972045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.972486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:47.973185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:47.973634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:47.974234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.053028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:48.053450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:48.053926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:48.054952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:48.055371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:48.064604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.065137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.065579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.066451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.066912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.067343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.074390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:48.087745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:12:48.093605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for user 4d15f804765e48e3a279a902cde38dec and project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:12:48.112849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:12:48.115222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:12:48.163436 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f9a1c5e1-87da-43a4-8cd0-b78b9e1f93f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580895 Oct 31 14:12:48.171044 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1071/2375] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:12:48.177963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:48.178670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:48.189157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.189657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.190094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.190950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.191423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.192240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.254875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:48.267356 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f67a330e-74bc-469b-b8cc-11c74e0d0e26 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1508 microversion: 2.1 time: 0.305671 Oct 31 14:12:48.269969 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1305/2376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:47 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:48.275340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ead1f50-4b7b-4644-991f-7dd93b1d58f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:48.276306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ead1f50-4b7b-4644-991f-7dd93b1d58f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:48.285078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:48.299099 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c636f3e5-d62c-4ebc-9c30-7ee53d39b5b0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1211 microversion: 2.1 time: 0.126581 Oct 31 14:12:48.300076 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1072/2377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:48 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:48.324380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:48.325013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:48.344115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.349204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.349934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.350469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.351003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.351555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.424785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ead1f50-4b7b-4644-991f-7dd93b1d58f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:48.440369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ead1f50-4b7b-4644-991f-7dd93b1d58f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1212 microversion: 2.1 time: 0.168616 Oct 31 14:12:48.441312 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1306/2378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:48 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1212 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:48.476569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a932e66-8fdd-47e3-a76c-45452f35defd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078b1160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:48.543246 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a932e66-8fdd-47e3-a76c-45452f35defd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.081395 Oct 31 14:12:48.543843 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1307/2379] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:48 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:48.552771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:48.555310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:48.562986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.563490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.563932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.565194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.565987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.566106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.659587 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69e42d09-4435-4d10-98d6-a2e8b621e6ec tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "PUT /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1080 microversion: 2.1 time: 0.114652 Oct 31 14:12:48.668958 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1308/2380] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:12:48 2022] PUT /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1080 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:48.681963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:48.685454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:48.697572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.699861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.702396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.708241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.712967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.714403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.930936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:48.942998 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a92be167-6624-4ff9-af1d-2a49e263392a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.641476 Oct 31 14:12:48.944133 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1073/2381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:48 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:48.952114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:48.953323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:48.966107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.966869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.967558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:48.968735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:48.969435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:48.970009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.041180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:49.053308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:49.054959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:49.056128 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d5ddc3f-5641-41c3-8d9c-b3a7d77dfe4d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1555 microversion: 2.21 time: 0.385035 Oct 31 14:12:49.070194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1309/2382] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:48 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1555 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:49.070194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:49.070194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:49.073908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.074612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.075991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.077064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.077679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.078862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.150692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dfad562c-2618-4fb0-9739-34d5f676a118 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.092510 Oct 31 14:12:49.156257 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1310/2383] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:49 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:49.164135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "601ea56b-505c-412e-9248-017047aaf8dc"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:49.167817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:49.179824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.181533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.181989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.182752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.183215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.183645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.319208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:49.329574 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bdcce277-96f2-485e-aec0-5f0a6171aa50 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1506 microversion: 2.1 time: 0.384175 Oct 31 14:12:49.330452 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1074/2384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:48 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:49.335747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6da81cd6-9dbb-4728-a891-bc4811b7be31 req-3e3c2a48-3cfe-40d8-b589-3d4beb41be3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c250ffcc-8637-425b-a0c3-7906f0afff8e", "name": "network-vif-deleted", "tag": "3cc4b314-66c6-43b8-99da-42a221b6880f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:49.355960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6da81cd6-9dbb-4728-a891-bc4811b7be31 req-3e3c2a48-3cfe-40d8-b589-3d4beb41be3e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.356439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6da81cd6-9dbb-4728-a891-bc4811b7be31 req-3e3c2a48-3cfe-40d8-b589-3d4beb41be3e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.356868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6da81cd6-9dbb-4728-a891-bc4811b7be31 req-3e3c2a48-3cfe-40d8-b589-3d4beb41be3e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.376446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6da81cd6-9dbb-4728-a891-bc4811b7be31 req-3e3c2a48-3cfe-40d8-b589-3d4beb41be3e service nova] Creating event network-vif-deleted:3cc4b314-66c6-43b8-99da-42a221b6880f for instance c250ffcc-8637-425b-a0c3-7906f0afff8e on n-h2-863052-1 Oct 31 14:12:49.385599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6da81cd6-9dbb-4728-a891-bc4811b7be31 req-3e3c2a48-3cfe-40d8-b589-3d4beb41be3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054039 Oct 31 14:12:49.392450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1075/2385] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:49.403464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:49.404398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:49.415475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.416404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.416641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.417477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.417998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.418519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.614563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:49.786772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36883ad0-4463-47ca-86b4-8ab3e32e428b tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628638 Oct 31 14:12:49.787380 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1311/2386] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:12:49 2022] POST /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:49.793190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:49.793902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:49.802846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.803341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.803779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.804463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.805066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.805621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.954513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:49.960531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:49.963801 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36236405-5991-44f4-b776-3a57bff97cab tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1506 microversion: 2.1 time: 0.175015 Oct 31 14:12:49.964620 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1312/2387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:49 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:49.969442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:49.970121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:49.976843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.977444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.977972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.978793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:49.979359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:49.979951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:49.980551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a7fffeb-7d8d-41dd-bc6b-bbcd68cd0025 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1259 microversion: 2.1 time: 0.585926 Oct 31 14:12:49.981663 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1076/2388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:49 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1259 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:49.987515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf5d26c5-2d8b-45a0-90f5-56be53f75939 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc40280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:50.048008 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf5d26c5-2d8b-45a0-90f5-56be53f75939 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.065016 Oct 31 14:12:50.049152 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1077/2389] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:49 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:50.054203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:50.054810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:50.058621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:50.059648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:50.063850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.064339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.065689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.066579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.067160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.067592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.070200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14a4beaf-963c-46a4-9313-898168746482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1264 microversion: 2.1 time: 0.104348 Oct 31 14:12:50.071071 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1313/2390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:49 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1264 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:50.079306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:50.083474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:50.101812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.103952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.122600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.124116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.125259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.125941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.313809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:12:50.317517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:12:50.318062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:12:50.318683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:12:50.319137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:12:50.437004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:50.452197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.452750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.455390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.456268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.458291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.458810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.532549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-866d78ec-90f3-43ed-adf7-23339b6e6ca4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "POST /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b/action" status: 202 len: 1112 microversion: 2.1 time: 0.459188 Oct 31 14:12:50.532757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1314/2391] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:50 2022] POST /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b/action => generated 1112 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 14:12:50.543754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:50.544424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:50.567495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.568142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.569966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.570986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.571236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.572807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.712385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:50.724086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bcadb41f-fb1b-47fd-ac32-673be751f9dd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.673778 Oct 31 14:12:50.725028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1078/2392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:50 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:50.749883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:50.760599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:50.772659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.774781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.775446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.787594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.788315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.788987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.867069 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18c643e1-94ad-419f-b688-e5cdcb6b12c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.125993 Oct 31 14:12:50.867797 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1079/2393] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:50 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:50.874966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:50.875959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:50.892417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.897440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.898431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:50.905548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:50.906243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:50.906765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.026421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:51.044425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:51.047874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:51.053535 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea23a831-d44a-42ec-9e25-4f709673891d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1555 microversion: 2.21 time: 0.519721 Oct 31 14:12:51.056328 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1315/2394] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:50 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1555 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:12:51.067529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1f26204a-1711-4e3d-ac52-d10713c81038 req-d95d25a1-7e16-41f1-857f-a0a591ef1ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "name": "network-vif-plugged", "status": "completed", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:51.095496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1f26204a-1711-4e3d-ac52-d10713c81038 req-d95d25a1-7e16-41f1-857f-a0a591ef1ce5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.099930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1f26204a-1711-4e3d-ac52-d10713c81038 req-d95d25a1-7e16-41f1-857f-a0a591ef1ce5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.101426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1f26204a-1711-4e3d-ac52-d10713c81038 req-d95d25a1-7e16-41f1-857f-a0a591ef1ce5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.136731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1f26204a-1711-4e3d-ac52-d10713c81038 req-d95d25a1-7e16-41f1-857f-a0a591ef1ce5 service nova] Creating event network-vif-plugged:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:12:51.173299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1f26204a-1711-4e3d-ac52-d10713c81038 req-d95d25a1-7e16-41f1-857f-a0a591ef1ce5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109993 Oct 31 14:12:51.191172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1316/2395] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:51.220621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:51.223118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:51.232706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.233620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.234394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.235392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.236058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.236863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.367841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:51.391795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62011e23-8755-4e87-bf80-dbc0d2de9f08 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1265 microversion: 2.1 time: 0.193759 Oct 31 14:12:51.398319 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1317/2396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:51 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:51.419468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3543aaf-2dff-4311-aa1d-fd5f053b4ae8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc8daf0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:51.470340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:51.483032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb43a718-1fd9-4f1f-9277-c70a8624c08b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.613220 Oct 31 14:12:51.488434 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3543aaf-2dff-4311-aa1d-fd5f053b4ae8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.088930 Oct 31 14:12:51.498334 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1318/2397] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:51 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:51.498334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:51.499389 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1080/2398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:50 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:51.512589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-cd6623dd-b683-4345-aea9-c63bfee4ff80 req-d314d65b-f81c-4456-a8f3-61d2a2c3f93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d8854f-fe06-4f83-8ae3-fdb277efd0df", "name": "network-vif-deleted", "tag": "3c4e16a8-b692-4aca-93de-b68fd9520020"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:51.515058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:51.532818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.537401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.538182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.538990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.539473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.539909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.562982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cd6623dd-b683-4345-aea9-c63bfee4ff80 req-d314d65b-f81c-4456-a8f3-61d2a2c3f93b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.563422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cd6623dd-b683-4345-aea9-c63bfee4ff80 req-d314d65b-f81c-4456-a8f3-61d2a2c3f93b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.563869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cd6623dd-b683-4345-aea9-c63bfee4ff80 req-d314d65b-f81c-4456-a8f3-61d2a2c3f93b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.598305 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-cd6623dd-b683-4345-aea9-c63bfee4ff80 req-d314d65b-f81c-4456-a8f3-61d2a2c3f93b service nova] Creating event network-vif-deleted:3c4e16a8-b692-4aca-93de-b68fd9520020 for instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df on n-h1-863052-1 Oct 31 14:12:51.607997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-cd6623dd-b683-4345-aea9-c63bfee4ff80 req-d314d65b-f81c-4456-a8f3-61d2a2c3f93b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110909 Oct 31 14:12:51.608922 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1081/2399] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:51.729054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:51.741990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99d65ce0-5a12-4c33-aab2-85f745a47ce1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1270 microversion: 2.1 time: 0.251913 Oct 31 14:12:51.744123 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1319/2400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:51 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:51.765381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:51.766085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:51.793405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.794037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.796175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.796979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.797453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.797883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.879473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:51.881938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:51.900501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.901189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.902022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.902810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:51.903274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:51.904094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:51.979002 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27e2235e-7af4-44ab-b0a4-94f20cd1fcb7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.103218 Oct 31 14:12:51.980136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1320/2401] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:51 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:52.086583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:52.088219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:52.106689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.107429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.108174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.109046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.113320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.113956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.190880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:52.196334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.197151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.197767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.198465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lazy-loading 'fault' on Instance uuid c1d8854f-fe06-4f83-8ae3-fdb277efd0df {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:12:52.202676 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-88b8b68d-4df0-4027-9d2b-62466ebba0b6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.441995 Oct 31 14:12:52.208418 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1082/2402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:51 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:52.335965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:52.351451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:52.353150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f7ab2d13ffd499fbb37e04fdcdcee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5a8b6ce1d84d1e98c65deb63b4b0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:52.354547 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c509404-35ce-45a3-bd93-6c0c13469af0 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 200 len: 1347 microversion: 2.21 time: 0.274500 Oct 31 14:12:52.355627 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1321/2403] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:52 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 1347 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:12:52.428816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:52.429439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:52.457358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.457857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.458327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.459050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.459500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.474537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.509455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e18a79f5-37a9-4360-87ce-4eab3500c0b2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1077d6550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:52.588060 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e18a79f5-37a9-4360-87ce-4eab3500c0b2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.082330 Oct 31 14:12:52.589117 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1322/2404] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:52 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:52.605018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:52.606045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:52.619704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.627009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.627766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.628743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.629402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.633480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.652477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:52.668023 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a7eb895-ce08-426a-8114-79d629d54977 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1265 microversion: 2.1 time: 0.250455 Oct 31 14:12:52.686889 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1083/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:52 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:52.772636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:52.777165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:52.795720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.796502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.797169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:52.798148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:52.799811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:52.800767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.006854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:53.016661 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42f8234a-c6d1-48e1-a0dd-946afc35fa25 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.425427 Oct 31 14:12:53.022866 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1323/2406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:52 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:53.043361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:53.050308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:53.071849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.072569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.073663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.074576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.075201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.075773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.159418 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-530c76fa-29a0-474f-999c-3acd10c8813a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.129517 Oct 31 14:12:53.163879 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1324/2407] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:53 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:53.245225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:53.246118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:53.257737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.266666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.268046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.269018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.269721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.270431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.478109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:53.489661 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c73e7752-a31b-4fa2-87dc-8bd309cf99a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 0.726583 Oct 31 14:12:53.496609 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1084/2408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:52 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:53.510485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:53.513704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:53.532468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.533349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.534007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.534989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.535742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.536358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.559505 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] HTTP exception thrown: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Request method failure captured: Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df HTTP/1.1 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fEfZSCOBqFu5D6EB4ouNedUGXByAVpW9oCmm1eUe4P3WRqfCy06Kqe-yDKklLUPqeBQqkGAPRmlFZGc7YWIrsy_-NDI11-D3fCrNPr9fuqxwwTtM4E7hAWy2WEiOC1uZGiafmHh4UBYL_XeR3SmzRytkYeOhg-pPPA_BpiB2cR84k Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 3a5a8b6ce1d84d1e98c65deb63b4b0c8 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a5a8b6ce1d84d1e98c65deb63b4b0c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 3a5a8b6ce1d84d1e98c65deb63b4b0c8 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-InstanceActionsV221TestJSON-1182700994-project Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 5f7ab2d13ffd499fbb37e04fdcdcee92 Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-InstanceActionsV221TestJSON-1182700994-project Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c1d8854f-fe06-4f83-8ae3-fdb277efd0df'} Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:53.561678 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:53.568622 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:53.570284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Returning 404 to user: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:53.570639 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bdc673b8-0749-4641-983f-2f911ec30fe5 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 404 len: 111 microversion: 2.21 time: 0.072753 Oct 31 14:12:53.574713 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1085/2409] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:53 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:12:53.584277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '.version_select at 0x7fe107457a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:53.586133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:53.599425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.600311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.601279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.602333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.602986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.603635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.684773 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-070b00f8-3ce0-4742-8a77-62a0915852b6 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.109129 Oct 31 14:12:53.685973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1086/2410] 10.222.0.27 () {60 vars in 1337 bytes} [Mon Oct 31 14:12:53 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:12:53.691715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02fa5941-9d38-4e14-bbfc-fe8164b64a71 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107476310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:53.749037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02fa5941-9d38-4e14-bbfc-fe8164b64a71 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.061758 Oct 31 14:12:53.749886 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1087/2411] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:53 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:53.755597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:53.756706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:53.763169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.763897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.764559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.765461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.766108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.767030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.940175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:53.951746 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef7695bf-35bf-4199-880f-887b8a9cece0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.723426 Oct 31 14:12:53.957367 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1325/2412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:53 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:53.969651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:53.970496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:53.989649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.991271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.991962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:53.992922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:53.993616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:53.996508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.031289 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] HTTP exception thrown: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Request method failure captured: Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df HTTP/1.1 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fEfZSCOBqFu5D6EB4ouNedUGXByAVpW9oCmm1eUe4P3WRqfCy06Kqe-yDKklLUPqeBQqkGAPRmlFZGc7YWIrsy_-NDI11-D3fCrNPr9fuqxwwTtM4E7hAWy2WEiOC1uZGiafmHh4UBYL_XeR3SmzRytkYeOhg-pPPA_BpiB2cR84k Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 3a5a8b6ce1d84d1e98c65deb63b4b0c8 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a5a8b6ce1d84d1e98c65deb63b4b0c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 3a5a8b6ce1d84d1e98c65deb63b4b0c8 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-InstanceActionsV221TestJSON-1182700994-project Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 5f7ab2d13ffd499fbb37e04fdcdcee92 Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-InstanceActionsV221TestJSON-1182700994-project Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c1d8854f-fe06-4f83-8ae3-fdb277efd0df'} Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:12:54.038040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.041649 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.044475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Returning 404 to user: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:54.048135 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c1e8f3f-b468-4762-b597-ef46009b5c8d tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 404 len: 111 microversion: 2.21 time: 0.089538 Oct 31 14:12:54.049017 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1326/2413] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:12:53 2022] DELETE /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:12:54.060841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ddbe901e-96d4-47b0-a753-c8d9cb550c10 req-b598fa75-3449-490f-838d-f1957d13450f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5f08e7-abcf-4dac-baf3-4b84313cf486", "tag": "afc66d42-1974-454e-b7b9-5c54e80ec047"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:54.096604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ddbe901e-96d4-47b0-a753-c8d9cb550c10 req-b598fa75-3449-490f-838d-f1957d13450f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.097705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ddbe901e-96d4-47b0-a753-c8d9cb550c10 req-b598fa75-3449-490f-838d-f1957d13450f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.099919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ddbe901e-96d4-47b0-a753-c8d9cb550c10 req-b598fa75-3449-490f-838d-f1957d13450f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.124178 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ddbe901e-96d4-47b0-a753-c8d9cb550c10 req-b598fa75-3449-490f-838d-f1957d13450f service nova] Creating event network-changed:afc66d42-1974-454e-b7b9-5c54e80ec047 for instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 on n-h1-863052-1 Oct 31 14:12:54.128034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:54.130773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ddbe901e-96d4-47b0-a753-c8d9cb550c10 req-b598fa75-3449-490f-838d-f1957d13450f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078109 Oct 31 14:12:54.132835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1327/2414] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:54.138457 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a687b1a-1402-4b4a-ad7e-b661dcdf6d18 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.387192 Oct 31 14:12:54.139042 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1088/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:53 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:54.139763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:54.142529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:54.148380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:54.152760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.153867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.154812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.155037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] [instance: c1d8854f-fe06-4f83-8ae3-fdb277efd0df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:54.156137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.157452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.158651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.176411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.176926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.177468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.178425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.179048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.179627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.211954 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] HTTP exception thrown: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Request method failure captured: Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df HTTP/1.1 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fEfZSCOBqFu5D6EB4ouNedUGXByAVpW9oCmm1eUe4P3WRqfCy06Kqe-yDKklLUPqeBQqkGAPRmlFZGc7YWIrsy_-NDI11-D3fCrNPr9fuqxwwTtM4E7hAWy2WEiOC1uZGiafmHh4UBYL_XeR3SmzRytkYeOhg-pPPA_BpiB2cR84k Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 3a5a8b6ce1d84d1e98c65deb63b4b0c8 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a5a8b6ce1d84d1e98c65deb63b4b0c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a5a8b6ce1d84d1e98c65deb63b4b0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 3a5a8b6ce1d84d1e98c65deb63b4b0c8 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1182700994 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-InstanceActionsV221TestJSON-1182700994-project Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 5f7ab2d13ffd499fbb37e04fdcdcee92 Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-InstanceActionsV221TestJSON-1182700994-project Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c1d8854f-fe06-4f83-8ae3-fdb277efd0df'} Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.213761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. Oct 31 14:12:54.219124 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:12:54.220423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] Returning 404 to user: Instance c1d8854f-fe06-4f83-8ae3-fdb277efd0df could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:12:54.221483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7e88f66-9bbc-452c-ba5b-695e0be45947 tempest-InstanceActionsV221TestJSON-1182700994 tempest-InstanceActionsV221TestJSON-1182700994-project] 10.222.0.27 "GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df" status: 404 len: 111 microversion: 2.21 time: 0.076910 Oct 31 14:12:54.222234 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1089/2416] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:12:54 2022] GET /compute/v2.1/servers/c1d8854f-fe06-4f83-8ae3-fdb277efd0df => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:12:54.230711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:54.233360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:54.240302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.241031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.241613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.242499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.243262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.244106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.320814 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0325414c-9aa5-409f-ba64-fbdb033459d3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.093446 Oct 31 14:12:54.324461 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1090/2417] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:54 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:54.376461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0daf2fd6-4d47-4f88-9370-8e5a52a31fcc req-65298ffe-0721-4ae8-924a-0c211344492f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac09d929-a71d-4ae1-8395-99a281a5b3a7", "tag": "934b105d-4ebe-4255-b58c-a813f5992a2a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:54.404944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0daf2fd6-4d47-4f88-9370-8e5a52a31fcc req-65298ffe-0721-4ae8-924a-0c211344492f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.406262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0daf2fd6-4d47-4f88-9370-8e5a52a31fcc req-65298ffe-0721-4ae8-924a-0c211344492f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.406408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0daf2fd6-4d47-4f88-9370-8e5a52a31fcc req-65298ffe-0721-4ae8-924a-0c211344492f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.643434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:54.661233 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54f08d83-17af-491b-978c-c26a74d413c6 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.526856 Oct 31 14:12:54.663214 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1328/2418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:54 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:54.668914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:54.676074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:54.691531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.692146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.692588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.693303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:54.693756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:54.694202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:54.717093 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0daf2fd6-4d47-4f88-9370-8e5a52a31fcc req-65298ffe-0721-4ae8-924a-0c211344492f service nova] Creating event network-changed:934b105d-4ebe-4255-b58c-a813f5992a2a for instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 on n-h1-863052-1 Oct 31 14:12:54.724529 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0daf2fd6-4d47-4f88-9370-8e5a52a31fcc req-65298ffe-0721-4ae8-924a-0c211344492f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351889 Oct 31 14:12:54.727171 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1091/2419] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:54.769080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-930f1515-8ab6-41c2-93b2-16723b63bca5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fb7a4c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:54.830909 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-930f1515-8ab6-41c2-93b2-16723b63bca5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.068592 Oct 31 14:12:54.832029 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1092/2420] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:54 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:54.985203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:54.987170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:55.007890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.010447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.010935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.013625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.015205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.017541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.276525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:55.280732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:55.312209 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2690504c-7ce0-42e0-b1a5-5ccadc087d96 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 0.646968 Oct 31 14:12:55.313512 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1329/2421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:54 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:55.325236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:55.325869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:55.341468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.346117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.348493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.350530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.351010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.356676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.366855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:55.380908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d4a2fa3-5093-4fcf-9989-05e556585a8c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.401930 Oct 31 14:12:55.387448 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1093/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:54 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:55.395932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:55.411957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:55.440955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.443388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.444088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.447074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.447857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.452582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.517522 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9e57e39-6991-4f4d-9c5f-a5e47678feee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.128565 Oct 31 14:12:55.523739 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1094/2423] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:55 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:55.692317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:55.694298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:55.711059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.711777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.712446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.713602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:55.714261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:55.718994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:55.861981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:55.870246 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bae70cc4-ab17-46c9-bc5c-b92d8ab5a0ed tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.555579 Oct 31 14:12:55.882916 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1330/2424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:55 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:55.902027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eff3f9a3-02c3-413e-b2c6-9571d5c1e5f8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107838700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:55.991347 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eff3f9a3-02c3-413e-b2c6-9571d5c1e5f8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.106885 Oct 31 14:12:56.002510 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1331/2425] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:55 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:56.022116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:56.025951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:56.038870 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16269e88-f705-44c4-88af-9eff1b8e72de tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.353425 Oct 31 14:12:56.054734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1095/2426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:55 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:56.170844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f2ab9fb9-961a-4c98-9684-3b67b24e0d97 req-c9f77144-6708-4372-8382-382cbb35f7cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cd0646-c655-4849-88ee-7314178eebc3", "tag": "8dee12a1-38ae-4b8a-b790-6c8e7d2d073f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:56.193187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f2ab9fb9-961a-4c98-9684-3b67b24e0d97 req-c9f77144-6708-4372-8382-382cbb35f7cc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.193671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f2ab9fb9-961a-4c98-9684-3b67b24e0d97 req-c9f77144-6708-4372-8382-382cbb35f7cc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.194096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f2ab9fb9-961a-4c98-9684-3b67b24e0d97 req-c9f77144-6708-4372-8382-382cbb35f7cc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.226226 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f2ab9fb9-961a-4c98-9684-3b67b24e0d97 req-c9f77144-6708-4372-8382-382cbb35f7cc service nova] Creating event network-changed:8dee12a1-38ae-4b8a-b790-6c8e7d2d073f for instance e8cd0646-c655-4849-88ee-7314178eebc3 on n-h1-863052-1 Oct 31 14:12:56.231309 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f2ab9fb9-961a-4c98-9684-3b67b24e0d97 req-c9f77144-6708-4372-8382-382cbb35f7cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070998 Oct 31 14:12:56.232224 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1332/2427] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:56.336935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:56.337556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:56.355376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.356163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.357241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.358360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.362053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.363019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.403662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:56.404453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:56.422606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.423292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.424435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.425278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.425873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.426470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.558184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:56.570106 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-140fd491-7a4e-4dff-8782-5f3b2bf647aa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 0.237761 Oct 31 14:12:56.571503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1096/2428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:56 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:56.611730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:56.617680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:56.643745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.646034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.647186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.649593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.651476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.652665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.773401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7f5da428-4497-46ca-88cb-7ffd7c280b2f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 14 microversion: 2.1 time: 0.200241 Oct 31 14:12:56.776008 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1097/2429] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:56 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:12:56.844242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:56.863625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91a098d3-a97f-4e6f-8a55-d3d1d6b6f1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.463912 Oct 31 14:12:56.882945 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1333/2430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:56 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:56.905764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:56.906904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:56.937563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.938311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.938864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:56.940135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:56.940824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:56.941384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.008623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86c86d25-a7bc-4a9d-8856-82a4875b734a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10777ad30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:57.146360 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86c86d25-a7bc-4a9d-8856-82a4875b734a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.142631 Oct 31 14:12:57.148867 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1334/2431] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:57 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:12:57.161603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:57.163744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:57.184484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.186335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.190814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.192041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.192742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.193788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.213220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:57.235673 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1ed7489-efe6-4230-aec3-dc58dedb433a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.334403 Oct 31 14:12:57.256824 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1098/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:56 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:57.594218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:57.594921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:57.602031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:57.613225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.614741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.615275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.616186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.616722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.617339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.618596 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93d652f4-49df-43a7-8e6d-a9cacdf895b2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.466686 Oct 31 14:12:57.622075 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1335/2433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:57 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:57.791642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:57.794793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:57.816422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.817324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.817982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.819317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.821839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.822554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.915194 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b129202-755b-4d1e-b5c6-e973caf20913 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action" status: 200 len: 8208 microversion: 2.1 time: 0.132637 Oct 31 14:12:57.916790 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1336/2434] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:12:57 2022] POST /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039/action => generated 8208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:57.923338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:57.944645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:57.982700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.983574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:57.985021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:57.992651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:57.993672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:58.005816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:58.074958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:58.104257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=20 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:58.431538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:58.587473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:58.600967 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a251c7db-a5d1-45bc-a2b6-65a9cfe5f7d2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 1.011610 Oct 31 14:12:58.601832 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1099/2435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:57 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:58.614556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:58.628667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:58.652086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:58.654837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:58.659106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:58.662279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:58.666875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:58.668535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:58.812931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:58.840380 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd0cdfeb-97e0-40be-9844-815181687c8e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.919031 Oct 31 14:12:58.841715 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1337/2436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:57 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:58.864434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6ee539e1-afe1-48e2-a81d-7c2a4eb7f523 req-91c074ba-6463-43cf-a72c-31dd0e32ac74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5f08e7-abcf-4dac-baf3-4b84313cf486", "name": "network-vif-plugged", "status": "completed", "tag": "afc66d42-1974-454e-b7b9-5c54e80ec047"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:12:58.928595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:12:58.932397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6ee539e1-afe1-48e2-a81d-7c2a4eb7f523 req-91c074ba-6463-43cf-a72c-31dd0e32ac74 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:58.937282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6ee539e1-afe1-48e2-a81d-7c2a4eb7f523 req-91c074ba-6463-43cf-a72c-31dd0e32ac74 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:58.940079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6ee539e1-afe1-48e2-a81d-7c2a4eb7f523 req-91c074ba-6463-43cf-a72c-31dd0e32ac74 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:58.967180 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6ee539e1-afe1-48e2-a81d-7c2a4eb7f523 req-91c074ba-6463-43cf-a72c-31dd0e32ac74 service nova] Creating event network-vif-plugged:afc66d42-1974-454e-b7b9-5c54e80ec047 for instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 on n-h1-863052-1 Oct 31 14:12:58.975909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6ee539e1-afe1-48e2-a81d-7c2a4eb7f523 req-91c074ba-6463-43cf-a72c-31dd0e32ac74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132655 Oct 31 14:12:58.977069 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1338/2437] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:12:58.999026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef00de91-2424-4d04-a5a6-bbe0646ee7ab tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc8de50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:59.131562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef00de91-2424-4d04-a5a6-bbe0646ee7ab tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.152309 Oct 31 14:12:59.132162 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1339/2438] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:12:58 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:59.136874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:59.147996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:59.160090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:59.160860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:59.162773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:59.163663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:59.164776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:59.166426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:59.300731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:59.324856 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-572d5e10-f089-45d8-b855-9a352d3b88a3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.721460 Oct 31 14:12:59.329439 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1100/2439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:58 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:59.341779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:59.346610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:59.367941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:59.371689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:59.372278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:59.373145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:59.373709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:59.376487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:59.904398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:59.918502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06245fe6-4636-42c3-abf9-57c8a382a4ba tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.781105 Oct 31 14:12:59.920789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1340/2440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:59 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:59.930710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:12:59.932020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:12:59.946360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:59.947048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:59.948070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:59.955943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:12:59.959977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:12:59.960465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:12:59.960886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:12:59.968260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-228f7ec8-4574-45cd-bfe2-3c702e684c69 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.635288 Oct 31 14:12:59.968844 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1101/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:59 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:12:59.975524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:00.004000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:00.016442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.020572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.021047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.021792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.022340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.022775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.327129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:00.338483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b23f91a-f1ec-4358-bda7-d9ed66a7def3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 0.368382 Oct 31 14:13:00.343219 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1102/2442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:59 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:00.348987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:00.350655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:00.362042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:00.373929 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d313fac6-3d23-4ef7-9035-df94decf6344 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.448303 Oct 31 14:13:00.377580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1341/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:12:59 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:00.382159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.382784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.385435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.386258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.386795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.387331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.388184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7aa480c2-9c8e-4d64-86c2-692b3055eba8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107de9430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:00.466703 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7aa480c2-9c8e-4d64-86c2-692b3055eba8 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.087558 Oct 31 14:13:00.474911 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1342/2444] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:00 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:00.479687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:00.480303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:00.497030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.498348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.498348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.500697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.500697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.500697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.679760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:00.695161 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33fb083f-cff8-4e4a-b888-949653b7825e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1317 microversion: 2.1 time: 0.350512 Oct 31 14:13:00.695754 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1103/2445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:00 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:00.847761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:00.856299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48dda9aa-600e-491f-8f03-50bf6f4faa3f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.380325 Oct 31 14:13:00.874278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1343/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:00 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:00.883399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:00.884030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:00.896178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.896474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.896980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.897706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.898198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.898665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.947001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:00.947613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:00.967032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.967860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.968455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:00.971988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:00.972758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:00.973367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.288608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:01.300262 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fa07379-e286-4432-aaa9-0e95cbf93468 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.355723 Oct 31 14:13:01.301434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1344/2447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:00 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:01.304672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:01.309275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:01.310507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:01.312526 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57039cc3-d395-4573-9335-bb260e7212fe tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.433500 Oct 31 14:13:01.313087 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1104/2448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:00 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:01.319379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.320414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.321088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.321991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.323194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.323829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.339166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:01.339801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:01.348443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.348941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.349377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.350081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.351541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.351975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.430396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Locking {{(pid=120641) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 31 14:13:01.512885 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f6489b9-d8d5-4633-9055-bdecaddaeee5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.173493 Oct 31 14:13:01.513596 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1105/2449] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:01 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:13:01.526660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:01.533615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:01.534381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:01.538303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71186df2-9776-4371-a977-723992decc28 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.235548 Oct 31 14:13:01.540901 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1345/2450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:01 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:01.556097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e172232-7718-4be0-9f29-245dca36ac59 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078cf0d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:01.584272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.584883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.585305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.586040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.586508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.586959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.644120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e172232-7718-4be0-9f29-245dca36ac59 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.098237 Oct 31 14:13:01.644120 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1346/2451] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:01 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:01.646721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:01.647428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:01.654610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.655103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.655539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.656237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.656688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.657098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.876592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:01.886972 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a9844cd-2bbf-4f1f-93ca-2b73dd7e7be3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.244713 Oct 31 14:13:01.888122 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1347/2452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:01 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:01.894203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:01.895130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:01.901478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.902708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.903377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.904462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:01.905142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:01.905768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:01.995054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:02.003647 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1bdd2b8-7640-43d6-a0bf-bcf0c02feb14 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 0.483831 Oct 31 14:13:02.004245 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1106/2453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:01 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:02.028983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:02.045315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.046939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.047541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.069308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:02.080533 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-667936a9-c561-4764-9741-d37d38f4e2f3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1467 microversion: 2.1 time: 0.191145 Oct 31 14:13:02.081446 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1348/2454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:01 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1467 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:02.161281 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] HTTP exception thrown: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b is locked Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Request method failure captured: Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action HTTP/1.1 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 15 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9atnPLnJ7oYvWhon-XMkYD9jenoZFcnReG9sz4J4tIhwlxQqFLppcUKvacmC8VIlUCSeHaQ7i4_1nCrhXlBPmJY7C7hIyq9GxE288Kt-wH2mpf6tl_3IOrIBnznGyy4mj6HhY3jFzHGTkTOiowRHLTDdTGpZ6Tek5OWekLLTptxm9I Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43d946eea72d40e08829491c65b4e750", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43d946eea72d40e08829491c65b4e750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f6d0e8b2b04b47e69d87f436eb387941 Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: {"os-stop": {}} Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b is locked Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd1d5ebb5-529e-4b8b-9908-39905e0c9a9b', 'body': {'os-stop': {}}} Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b is locked Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b is locked Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b is locked Oct 31 14:13:02.164311 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:02.168688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Returning 409 to user: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b is locked {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:02.170907 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e3ab5a8-db96-4a4a-886f-8e13e6858a58 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 409 len: 107 microversion: 2.1 time: 0.146750 Oct 31 14:13:02.172102 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1107/2455] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:02 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 107 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:13:02.190402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:02.191411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:02.198888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.200467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.201136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.202661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.203869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.204701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.292923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Unlocking {{(pid=120641) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 31 14:13:02.310275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:02.312302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:02.322235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.322995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.323431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.324182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.324639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.325056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.383687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:02.412010 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4aaa152-01e7-4828-9229-9a36b7181532 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.235496 Oct 31 14:13:02.418330 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1108/2456] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:02 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:02.426775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:02.427673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:02.436180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.437069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.437942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.438830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.440232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.441937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.696119 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26fb311c-1e9d-4d72-b822-91465de925d5 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1618 microversion: 2.1 time: 0.595268 Oct 31 14:13:02.699388 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1349/2457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:02 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1618 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:02.714583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e31ca498-cf4b-48da-80a5-4cfc27876a19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:02.720511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:02.726905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e31ca498-cf4b-48da-80a5-4cfc27876a19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.727681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e31ca498-cf4b-48da-80a5-4cfc27876a19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.730929 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd0ffe11-decd-4b2b-bae0-fe9be71c1b46 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.310256 Oct 31 14:13:02.744509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1109/2458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:02 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:02.744606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e31ca498-cf4b-48da-80a5-4cfc27876a19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.744716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:02.744716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:02.747323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.748046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.748595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.749368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:02.749908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:02.750455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:02.824105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e31ca498-cf4b-48da-80a5-4cfc27876a19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Going to try to stop instance {{(pid=120640) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:13:02.917627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e31ca498-cf4b-48da-80a5-4cfc27876a19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.216197 Oct 31 14:13:02.921850 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1350/2459] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:02 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:02.935491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e748dd9c-25a5-450d-9a56-4f7de9b7468e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10777a1f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:03.008423 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e748dd9c-25a5-450d-9a56-4f7de9b7468e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.082840 Oct 31 14:13:03.018089 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1351/2460] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:02 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:03.023794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d8e980d-05e8-4baa-854f-af8dd71d1731 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: .version_select at 0x7fe10784f310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-403815337", "policies": ["affinity"]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:03.026030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:03.038559 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a35375b-750d-4461-9a6e-0e2ef2230409 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.304420 Oct 31 14:13:03.041679 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1110/2461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:02 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:03.047505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:03.048311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:03.055796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.056491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.057105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.058682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.059507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.060308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.064179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2d8e980d-05e8-4baa-854f-af8dd71d1731 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:03.083584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2d8e980d-05e8-4baa-854f-af8dd71d1731 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:03.226330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2d8e980d-05e8-4baa-854f-af8dd71d1731 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:03.241908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2d8e980d-05e8-4baa-854f-af8dd71d1731 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:03.267012 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d8e980d-05e8-4baa-854f-af8dd71d1731 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.247073 Oct 31 14:13:03.268628 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1352/2462] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 31 14:13:03 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:03.273556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ded55cf1-0c2a-413c-b087-425e000d108f req-b99b464e-aa6a-4fd4-a779-d8f48306e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac09d929-a71d-4ae1-8395-99a281a5b3a7", "name": "network-vif-plugged", "status": "completed", "tag": "934b105d-4ebe-4255-b58c-a813f5992a2a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:03.318318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ded55cf1-0c2a-413c-b087-425e000d108f req-b99b464e-aa6a-4fd4-a779-d8f48306e1b7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.319341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ded55cf1-0c2a-413c-b087-425e000d108f req-b99b464e-aa6a-4fd4-a779-d8f48306e1b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.320337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ded55cf1-0c2a-413c-b087-425e000d108f req-b99b464e-aa6a-4fd4-a779-d8f48306e1b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.353624 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ded55cf1-0c2a-413c-b087-425e000d108f req-b99b464e-aa6a-4fd4-a779-d8f48306e1b7 service nova] Creating event network-vif-plugged:934b105d-4ebe-4255-b58c-a813f5992a2a for instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 on n-h1-863052-1 Oct 31 14:13:03.363410 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ded55cf1-0c2a-413c-b087-425e000d108f req-b99b464e-aa6a-4fd4-a779-d8f48306e1b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093348 Oct 31 14:13:03.365849 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1353/2463] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:03.391111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:03.393086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:03.419618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:03.427958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.431495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.432238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.433123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.433740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.434388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.453994 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c07d8fb3-4e1a-4356-adf8-160ca93f9bc3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.397230 Oct 31 14:13:03.457803 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1111/2464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:03 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:03.534979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-673127276", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ebaf5c65-4529-4783-9bf3-8e3889cf058d"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:03.640696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:03.693910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:03.700329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:03.706840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5f6d81d-6ceb-4c20-944a-a3e02334d9ed tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1312 microversion: 2.1 time: 0.338647 Oct 31 14:13:03.707757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1354/2465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:03 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:03.760707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:03.761425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:03.768193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.770052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.771410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.772420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:03.774586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:03.775881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:03.951868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:03.952549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:03.952768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:03.953181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:03.953595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:03.960835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:03.972651 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee049f99-95d4-4cef-bc2f-69fa1150088e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.215698 Oct 31 14:13:03.973330 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1355/2466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:03 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:04.015783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.016356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.016963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.019204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.019204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.022461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.025080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ce6130d-f6e1-4e29-b79c-82fb416bf0cc tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078b8b80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:04.044009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:04.050795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:04.068887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Going to run 2 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:04.071470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:04.084574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ce6130d-f6e1-4e29-b79c-82fb416bf0cc tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.064008 Oct 31 14:13:04.085839 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1356/2467] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:04.092121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:04.093009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:04.106109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.106981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.107632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.108729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.109394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.110027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.143636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120641) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 31 14:13:04.169771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:04.176533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:04.233770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:04.241278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:04.248120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:04.266216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=f13c7aba-81f6-434a-ba87-aeab18d06614,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:04.295421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:04.312493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df523e0b-0961-461a-bb1c-f4c9e85064d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.224638 Oct 31 14:13:04.313543 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1357/2468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:04.354622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:04.359994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:04.432469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:04.440564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:04.491246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:04.492013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:04.497014 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d3d4225-1179-441f-b1e6-d1a3a201763e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.968396 Oct 31 14:13:04.504419 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1112/2469] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 31 14:13:04.510617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.511403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.512036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.512868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.513442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.514000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.516019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:04.526661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:04.527792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Searching by: {'deleted': False, 'project_id': '8fadd213d9f34565a0cf36487701aea2'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:04.559090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.559906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.560509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.561524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.562243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.562878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.602131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:04.656655 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0214bde0-6be8-4d8b-bbad-0327ca053157 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.150700 Oct 31 14:13:04.657623 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1113/2470] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/servers => generated 1002 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:04.670646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b59c78f7-49f6-49ff-8804-42f5dac79056 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:04.671267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b59c78f7-49f6-49ff-8804-42f5dac79056 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:04.747353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b59c78f7-49f6-49ff-8804-42f5dac79056 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:04.759018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b59c78f7-49f6-49ff-8804-42f5dac79056 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1218 microversion: 2.1 time: 0.092779 Oct 31 14:13:04.759789 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1114/2471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:04.791419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:04.792047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:04.811856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:04.812029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.812431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.812877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.813596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:04.819334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:04.819837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:04.824909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45578641-817a-43a1-8d20-4b88c6e3d76d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.337676 Oct 31 14:13:04.834831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1358/2472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:04.999664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:05.000966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:05.012765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.013292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.017084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.020006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.020525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.022463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.027002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:05.038299 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-addddefd-e068-4507-8e7b-fbd24b72ce1d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1462 microversion: 2.1 time: 0.250580 Oct 31 14:13:05.039530 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1115/2473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1462 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:05.338754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:05.366110 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59fafba8-e802-4b6f-8ed6-6d4f6567672f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.370965 Oct 31 14:13:05.370806 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1359/2474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:04 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:05.387838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8b3dc98-c352-4b1a-a454-5228801a4e5d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1077b8940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:05.427502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:05.428221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:05.453388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.455886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.456835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.461544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.462034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.463781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.481387 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8b3dc98-c352-4b1a-a454-5228801a4e5d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.108532 Oct 31 14:13:05.482496 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1360/2475] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:05 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:05.494133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:05.503038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:05.511930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.512331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.512952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.513901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.515137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.515911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.755211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:05.765847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15928d66-736f-4aed-9646-a47c2afed938 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.282107 Oct 31 14:13:05.766777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1361/2476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:05 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:05.785367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-241baa30-55d1-4bc5-b633-679ca13b77ca req-9a781649-3313-4853-920f-de37db0d1fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd0646-c655-4849-88ee-7314178eebc3", "name": "network-vif-plugged", "status": "completed", "tag": "8dee12a1-38ae-4b8a-b790-6c8e7d2d073f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:05.796206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-241baa30-55d1-4bc5-b633-679ca13b77ca req-9a781649-3313-4853-920f-de37db0d1fe4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.796852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-241baa30-55d1-4bc5-b633-679ca13b77ca req-9a781649-3313-4853-920f-de37db0d1fe4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.797426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-241baa30-55d1-4bc5-b633-679ca13b77ca req-9a781649-3313-4853-920f-de37db0d1fe4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.815211 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-241baa30-55d1-4bc5-b633-679ca13b77ca req-9a781649-3313-4853-920f-de37db0d1fe4 service nova] Creating event network-vif-plugged:8dee12a1-38ae-4b8a-b790-6c8e7d2d073f for instance e8cd0646-c655-4849-88ee-7314178eebc3 on n-h1-863052-1 Oct 31 14:13:05.822347 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-241baa30-55d1-4bc5-b633-679ca13b77ca req-9a781649-3313-4853-920f-de37db0d1fe4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049335 Oct 31 14:13:05.824520 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1362/2477] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:05.832232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:05.835606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:05.844579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.845921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.846534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.847280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:05.847989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:05.848500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:05.888255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'flavor' on Instance uuid 692cbab4-8865-401a-8f21-4d26f7607f58 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:13:06.108188 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bd6eab4-2517-47f1-8654-4ac5387b97f3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/action" status: 200 len: 32 microversion: 2.1 time: 0.281701 Oct 31 14:13:06.109567 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1363/2478] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:05 2022] POST /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:13:06.116533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:06.117898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:06.128588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.129990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.130875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.131868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.132610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.133339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.273107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:06.286413 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-873d3c1a-3695-45d7-8df5-b3a99cc36d28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1222 microversion: 2.1 time: 0.175255 Oct 31 14:13:06.287004 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1364/2479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:06 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:06.292197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:06.292981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:06.299246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.299937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.300569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.301281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.301887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.302492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.581825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:06.590688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49b40556-a352-41da-aaef-b61c2eb7bf1e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1613 microversion: 2.1 time: 1.533406 Oct 31 14:13:06.594310 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1116/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:05 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1613 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:06.602326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:06.602943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:06.614827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.615044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29d4a993-64d0-43bb-ad64-12cd681d00a1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.326415 Oct 31 14:13:06.615317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.615777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.616463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.616979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.617463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.627610 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1365/2481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:06.632652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:06.639018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:06.657144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.657649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.660666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.663281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.663760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.664196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.833162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:06.843140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-352bc69e-921d-4ede-9b95-ee0c78ed9c63 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.243918 Oct 31 14:13:06.849228 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1117/2482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:06 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:06.858247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f9e4f0a-4d5b-497b-a51e-a46f96846923 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fbd03a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:06.907299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:06.917285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f6a0e64-26d1-4983-9704-d9764f64cb98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1307 microversion: 2.1 time: 0.288506 Oct 31 14:13:06.927335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1366/2483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:06 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:06.938945 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f9e4f0a-4d5b-497b-a51e-a46f96846923 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.087921 Oct 31 14:13:06.940129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:06.940704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:06.941559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1118/2484] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:06 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:06.947684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.948177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.948612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.960662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:06.961031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:06.961946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:06.975102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:06.978956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:07.013312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:07.017814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:07.018543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:07.019518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:07.022078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:07.022784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:07.146814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '38260ec4f3224dbab9150b268c3e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcc3f4c72f6453dad21d46f19cabe16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:07.147506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] flavor_id is None. Assuming migration. {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 31 14:13:07.148469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:13:07.408141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:07.424190 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-214b7336-0df4-4f58-bfe5-f4b61dd7d911 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.481248 Oct 31 14:13:07.441849 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1119/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:06 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:07.633594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-874148504", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "e6f4900d-1c94-49b6-9d64-814a34ca8412"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:07.760052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] validate_networks() for [('e6f4900d-1c94-49b6-9d64-814a34ca8412', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:07.939096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-465ff077-b1e0-4338-835f-c2576fe533e9 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7/action" status: 202 len: 0 microversion: 2.1 time: 1.010544 Oct 31 14:13:07.944467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1367/2486] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:06 2022] POST /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7/action => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:07.950279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:07.950690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:07.961501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:07.962075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:07.962679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:07.963940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:07.964408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:07.966388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:08.067986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:08.085086 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34f6013c-12cc-4dd6-98ca-0f8f5122452e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1270 microversion: 2.1 time: 0.139266 Oct 31 14:13:08.091071 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1368/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:07 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:08.110225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:08.117838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:08.145700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:08.146805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:08.148345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:08.149230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:08.150279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:08.151043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:08.550840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:08.573200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b519f242-17e5-40b4-8ba6-f8eeb188c2eb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.478764 Oct 31 14:13:08.582560 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1369/2488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:08 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:08.594301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:08.598275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:08.642505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:08.643344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:08.644241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:08.645393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:08.646622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:08.648231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:08.696323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:08.980272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:08.988830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c713642a-a43a-4bb0-9e59-35b2b7e28bc1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.403461 Oct 31 14:13:09.005591 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1370/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:08 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:09.011961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:09.012593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:09.019571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.020213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.020760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.021637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.022104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.022579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.189874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:09.190560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:09.191115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:09.191528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:09.191945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:09.212360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.212854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.213291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.214024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.218605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.219297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.272264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Getting quotas for project b9a113f86e2047aca741e92fbc200efc. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:09.284570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Getting quotas for user 11f100f7c1e14e63866708635b26081d and project b9a113f86e2047aca741e92fbc200efc. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:09.320744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:09.323517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:09.457133 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2cadaba6-fa0b-498d-98a7-7de7a49fcf2c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.009733 Oct 31 14:13:09.458951 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1120/2490] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:09.476463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:09.477246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:09.492984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.495042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.496900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.497812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.498947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.499619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.686637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:09.695119 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6559ebb3-4fe9-40e1-b938-388e4529da40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1488 microversion: 2.1 time: 0.688299 Oct 31 14:13:09.713856 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1371/2491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:09 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1488 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:09.733304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94add0f0-8c52-4372-a8b7-87414e628d9c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1076c13a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:09.873200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94add0f0-8c52-4372-a8b7-87414e628d9c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.155227 Oct 31 14:13:09.881508 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1372/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:09 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:09.896409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:09.897052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:09.909936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.910625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.911082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:09.920719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:09.921282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:09.921942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:10.082674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:10.091611 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-408f7998-c0bd-4784-9b8c-5b80763282d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1471 microversion: 2.1 time: 0.630230 Oct 31 14:13:10.101988 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1121/2493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:09 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1471 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:10.116968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:10.124009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:10.134847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:10.146930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:10.147765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:10.148735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:10.149422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:10.150068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:10.328976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:10.351891 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37de471e-9a2a-4d8f-9cd6-596b91f7276d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1276 microversion: 2.1 time: 0.248358 Oct 31 14:13:10.356123 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1122/2494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:10 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:10.375268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1344337135", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "e6f4900d-1c94-49b6-9d64-814a34ca8412"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:10.501174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:10.517802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-790071a2-a249-4831-9d5d-67d8955743bb tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.640352 Oct 31 14:13:10.523369 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1373/2495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:09 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:10.529642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:10.536331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:10.555636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] validate_networks() for [('e6f4900d-1c94-49b6-9d64-814a34ca8412', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:10.562433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:10.574759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:10.575254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:10.576000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:10.576464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:10.576881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:11.016482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:11.028542 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4db51f1a-0fd5-4edb-9cbc-a8c52ce71464 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.502377 Oct 31 14:13:11.029501 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1374/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:10 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:11.037802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f781eeff-b15e-48c2-b165-53fd53ac5703 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:11.054756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f781eeff-b15e-48c2-b165-53fd53ac5703 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:11.055397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f781eeff-b15e-48c2-b165-53fd53ac5703 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:11.057630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f781eeff-b15e-48c2-b165-53fd53ac5703 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:11.112556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f781eeff-b15e-48c2-b165-53fd53ac5703 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Going to try to stop instance {{(pid=120640) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:13:11.244589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f781eeff-b15e-48c2-b165-53fd53ac5703 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3/action" status: 202 len: 0 microversion: 2.1 time: 0.212932 Oct 31 14:13:11.260648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1375/2497] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:11 2022] POST /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:11.275628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:11.276364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:11.312569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:11.313338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:11.315218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:11.316323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:11.317019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:11.318268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:11.770574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:11.779973 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38eeb8a2-e289-42fd-9798-56a764198aec tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.517673 Oct 31 14:13:11.799793 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1376/2498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:11 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:11.809534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ab6eca7-4aeb-4d06-9018-bb9d31edd95d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107871160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:11.875654 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ab6eca7-4aeb-4d06-9018-bb9d31edd95d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.074670 Oct 31 14:13:11.885209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1377/2499] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:11 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:11.891330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:11.891957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:11.900248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:11.901263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:11.901711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:11.902449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:11.902908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:11.903334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.219595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:12.235520 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adf4687a-c481-4fbc-81c0-522c29a98ced tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1471 microversion: 2.1 time: 0.349108 Oct 31 14:13:12.237654 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1378/2500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:11 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:12.271078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:12.274648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:12.293840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.295930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.296983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.299884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.300561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.302497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.383786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:12.386898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:12.387523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:12.387926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:12.388357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:12.435729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.436236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.436682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.437436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.442630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.446542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.523119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Getting quotas for project b9a113f86e2047aca741e92fbc200efc. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:12.561556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Getting quotas for user 11f100f7c1e14e63866708635b26081d and project b9a113f86e2047aca741e92fbc200efc. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:12.631042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:12.643263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:12.777977 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8afd3bf8-2a45-47e4-9fbe-2246c15b6a9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419736 Oct 31 14:13:12.797467 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1123/2501] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:12.808772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:12.814539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:12.817229 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-210f1940-7caa-4ac6-8b44-3b57a5cf0493 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.578082 Oct 31 14:13:12.817359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:12.822055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1379/2502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:12 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:12.826727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:12.827349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:12.841339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.841877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.842364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.843003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.843159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.843499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.843608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.843969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.844076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:12.846988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:12.847470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:12.849203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.256240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:13.325942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:13.344538 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e99b055b-8e6c-433a-bdcf-37b2d7a5a7ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.543424 Oct 31 14:13:13.347453 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1124/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:12 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:13.367034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:13.367671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:13.402431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:13.404590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:13.405535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.408513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:13.409376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:13.410035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.697214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:13.708058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f01c0fb5-7692-420b-9f78-0223e395c722 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1655 microversion: 2.1 time: 0.359226 Oct 31 14:13:13.713729 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1125/2504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:13 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1655 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:13.718945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f9a065d1-f67f-4ee2-8392-0488b715496e req-8e44eec7-6e0e-4c43-a5cd-2c849b376d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d5de8e-2266-4ca2-9f82-53d7cdc36247", "tag": "6ea97b08-9db3-4387-998f-fd78a653651c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:13.748288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f9a065d1-f67f-4ee2-8392-0488b715496e req-8e44eec7-6e0e-4c43-a5cd-2c849b376d2d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:13.749052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f9a065d1-f67f-4ee2-8392-0488b715496e req-8e44eec7-6e0e-4c43-a5cd-2c849b376d2d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:13.749661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f9a065d1-f67f-4ee2-8392-0488b715496e req-8e44eec7-6e0e-4c43-a5cd-2c849b376d2d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.753839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:13.762469 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd12cd44-97a7-4894-9ee1-fcf521d30c20 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.939266 Oct 31 14:13:13.771785 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f9a065d1-f67f-4ee2-8392-0488b715496e req-8e44eec7-6e0e-4c43-a5cd-2c849b376d2d service nova] Creating event network-changed:6ea97b08-9db3-4387-998f-fd78a653651c for instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 on n-h2-863052-1 Oct 31 14:13:13.782137 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1380/2505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:12 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:13.787742 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f9a065d1-f67f-4ee2-8392-0488b715496e req-8e44eec7-6e0e-4c43-a5cd-2c849b376d2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072413 Oct 31 14:13:13.789033 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1126/2506] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:13.802093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:13.805331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:13.821151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:13.821806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:13.822355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.823376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:13.823916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:13.824517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.914351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-74b4fb88-a687-4a04-b2b4-a50bb42a5927 req-fd06fbfe-12d3-41b2-9062-14d92a05f219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13c7aba-81f6-434a-ba87-aeab18d06614", "tag": "8f7dd073-3aef-4857-ab11-3bf91526c747"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:13.935768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-74b4fb88-a687-4a04-b2b4-a50bb42a5927 req-fd06fbfe-12d3-41b2-9062-14d92a05f219 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:13.937431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-74b4fb88-a687-4a04-b2b4-a50bb42a5927 req-fd06fbfe-12d3-41b2-9062-14d92a05f219 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:13.941378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-74b4fb88-a687-4a04-b2b4-a50bb42a5927 req-fd06fbfe-12d3-41b2-9062-14d92a05f219 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:13.965284 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-74b4fb88-a687-4a04-b2b4-a50bb42a5927 req-fd06fbfe-12d3-41b2-9062-14d92a05f219 service nova] Creating event network-changed:8f7dd073-3aef-4857-ab11-3bf91526c747 for instance f13c7aba-81f6-434a-ba87-aeab18d06614 on n-h2-863052-1 Oct 31 14:13:13.971858 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-74b4fb88-a687-4a04-b2b4-a50bb42a5927 req-fd06fbfe-12d3-41b2-9062-14d92a05f219 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188098 Oct 31 14:13:13.973063 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1381/2507] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:13.979149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-399324026", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "451", "networks": [{"uuid": "e6f4900d-1c94-49b6-9d64-814a34ca8412"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:14.068561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] validate_networks() for [('e6f4900d-1c94-49b6-9d64-814a34ca8412', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:14.086271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:14.096121 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc7202c0-0c60-4933-bb7f-889148fa49d8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.305165 Oct 31 14:13:14.102806 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1127/2508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:13 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:14.112993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4b49c14-e6ff-4ea5-b842-c1ac16c6ef1f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fc2f8b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:14.199571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4b49c14-e6ff-4ea5-b842-c1ac16c6ef1f tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1455 microversion: 2.1 time: 0.095092 Oct 31 14:13:14.204724 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1128/2509] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:14 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:14.212186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:14.214294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:14.221221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.221879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.222569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.223766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.224640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.225268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.453984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:14.467674 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99dd95b5-c717-48ef-9562-6acce0e1fd0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.260618 Oct 31 14:13:14.470857 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1129/2510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:14 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:14.477695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c6dfa42-d79b-4d66-adba-f5ca2c505678 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:14.489207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c6dfa42-d79b-4d66-adba-f5ca2c505678 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.489730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c6dfa42-d79b-4d66-adba-f5ca2c505678 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.490253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c6dfa42-d79b-4d66-adba-f5ca2c505678 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.494388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:14.515158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c6dfa42-d79b-4d66-adba-f5ca2c505678 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Going to try to start instance {{(pid=120641) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 14:13:14.560242 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c6dfa42-d79b-4d66-adba-f5ca2c505678 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.087875 Oct 31 14:13:14.560939 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1130/2511] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:14 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:14.566698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:14.567452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:14.573987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.574503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.574940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.575691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.576150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.576573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.735754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:14.752263 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97fb1ca5-d322-4d9a-a86f-67b531306d99 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.190076 Oct 31 14:13:14.753057 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1131/2512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:14 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:14.772708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:14.773397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:14.774079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:14.774754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:14.775406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:14.777774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:14.779117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:14.781215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:14.784261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:14.793811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.794827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.797205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.798261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.799132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.799786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.812087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.812764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.813306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.815255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.815978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.816508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.823327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Getting quotas for project b9a113f86e2047aca741e92fbc200efc. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:14.845118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Getting quotas for user 11f100f7c1e14e63866708635b26081d and project b9a113f86e2047aca741e92fbc200efc. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:14.870532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:14.873353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:14.943586 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92c10152-ae93-46b8-af23-9bde88de0e85 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968934 Oct 31 14:13:14.945751 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1382/2513] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:14.951332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:14.952184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:14.962117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.962941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.963618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:14.964547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:14.965378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:14.966151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.124889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:15.139309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-56fe5a7e-ef96-46d9-bdd9-1245eb9a6108 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.365584 Oct 31 14:13:15.140192 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1132/2514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:14 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.159984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.160635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:15.166789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.167174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.167614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.168321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.168765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.169193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.328862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:15.336646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82510008-d707-44da-a479-d63f03a67061 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1664 microversion: 2.1 time: 0.389601 Oct 31 14:13:15.353200 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1383/2515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:14 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1664 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.359531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5278542a-d4ec-46ca-a300-13f950526fbf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.360369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5278542a-d4ec-46ca-a300-13f950526fbf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:15.437043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5278542a-d4ec-46ca-a300-13f950526fbf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:15.437378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:15.447425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5278542a-d4ec-46ca-a300-13f950526fbf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1220 microversion: 2.1 time: 0.092770 Oct 31 14:13:15.448952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1384/2516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.454755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.455371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:15.461173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.462016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.462824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.463781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.464502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.465076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.469261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd5bd584-f5ac-4884-986e-d2343135731a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.312312 Oct 31 14:13:15.473951 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1133/2517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.494580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c70bc019-5006-4f4b-9adc-1e2945642d79 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107f40af0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.559324 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c70bc019-5006-4f4b-9adc-1e2945642d79 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1464 microversion: 2.1 time: 0.084013 Oct 31 14:13:15.560269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1134/2518] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1464 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.565438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.566342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:15.573813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.574433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.575069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.576189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.576707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.577326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.720864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:15.731101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed011449-0ae7-4a9b-a14a-e6a196d8ebf1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.280589 Oct 31 14:13:15.731735 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1385/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.742833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dac876bf-0617-4536-afb5-38e79089b01a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a11c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.785134 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dac876bf-0617-4536-afb5-38e79089b01a tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 200 len: 1464 microversion: 2.1 time: 0.052115 Oct 31 14:13:15.785917 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1386/2520] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 1464 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.790199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.791128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:15.797417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.797585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.797963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.799330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.799778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.800198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.816699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:15.824182 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36e04746-ecd5-4523-a659-a5343363ddb2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.262696 Oct 31 14:13:15.824978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1135/2521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:15.846978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:15.847916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:15.854317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.855082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.855732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:15.856712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:15.857240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:15.857681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.043627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:16.057129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6672e2c0-70ce-4f02-b69d-d2da207bdf98 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.269735 Oct 31 14:13:16.057877 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1387/2522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:16.063385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-46066c7b-f7b3-4583-8f95-034bb10637e8 req-590c99f1-0e7b-4f94-8e5d-944169634ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55df226-8bb5-4356-8465-5b2936c41cff", "tag": "ef96cb54-c6d9-4ee8-9523-dc0e4738f622"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:16.079236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-46066c7b-f7b3-4583-8f95-034bb10637e8 req-590c99f1-0e7b-4f94-8e5d-944169634ba8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.080257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-46066c7b-f7b3-4583-8f95-034bb10637e8 req-590c99f1-0e7b-4f94-8e5d-944169634ba8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.080689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-46066c7b-f7b3-4583-8f95-034bb10637e8 req-590c99f1-0e7b-4f94-8e5d-944169634ba8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.099216 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-46066c7b-f7b3-4583-8f95-034bb10637e8 req-590c99f1-0e7b-4f94-8e5d-944169634ba8 service nova] Creating event network-changed:ef96cb54-c6d9-4ee8-9523-dc0e4738f622 for instance e55df226-8bb5-4356-8465-5b2936c41cff on n-h1-863052-1 Oct 31 14:13:16.106128 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-46066c7b-f7b3-4583-8f95-034bb10637e8 req-590c99f1-0e7b-4f94-8e5d-944169634ba8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046745 Oct 31 14:13:16.107356 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1388/2523] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:16.114551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:16.137604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-60caae7d-43ff-4f67-9857-edb2e97bf4bf tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1479 microversion: 2.1 time: 0.297389 Oct 31 14:13:16.144003 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1136/2524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:15 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1479 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:16.165033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:16.166144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:16.173542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.174154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.174926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.175865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.176533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.177183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.360559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:16.361732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:16.369191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.370067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.370934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.371887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.372492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.372924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.424814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:16.436178 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89555971-5399-4dd3-aad5-c12db1830256 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.275924 Oct 31 14:13:16.437268 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1389/2525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:16 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:16.479635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:16.481621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:16.490493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.491360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.492136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.493353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.494266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.494872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.662432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:16.670930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:16.675799 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62c9c6d2-b5cd-4130-84f4-d858f4ef0818 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1216 microversion: 2.1 time: 0.206453 Oct 31 14:13:16.691789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8937dc1d-f7c0-4ad1-9277-b90a483f0ed8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1664 microversion: 2.1 time: 0.324281 Oct 31 14:13:16.694605 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1390/2526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:16 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:16.700046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:16.701023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:16.708064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.708619 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1137/2527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:16 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1664 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:16.709076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.709719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.710715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.711395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.712035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.757675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:16.758328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:16.769916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.770457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.770903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:16.771620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:16.772364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:16.773186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.117568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.128968 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-51f08d44-9325-462c-8c56-677307dacc2d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.375530 Oct 31 14:13:17.129647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1138/2528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:16 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:17.134545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.135231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:17.143416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.144169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.145891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.146971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.148008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.148653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.153364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.163255 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3a55585-49a6-4676-b2eb-747abbad78f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.467212 Oct 31 14:13:17.163855 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1391/2529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:16 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.185407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.186040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:17.192721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.193211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.193653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.194400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.195287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.195741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.201312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:17.335486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.344954 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d3a5875-311e-4b74-8db5-414692bc653d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.169341 Oct 31 14:13:17.346728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1392/2530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.352333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.353034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:17.362271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.362775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.363220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.364141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.364372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.364802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.379540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.394982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc9031fa-83ae-4ccf-a6e4-fabd55687d3c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.263885 Oct 31 14:13:17.413410 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1139/2531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.460334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.460971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:17.476526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.477031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.477477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.478214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.478676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.479619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.712420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.722071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.723872 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-14f8486f-8837-47e1-99ec-9e4afa42b2ec tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.267286 Oct 31 14:13:17.726771 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1140/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.731277 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5eee697-ae2a-4352-8085-513bcf30a985 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1466 microversion: 2.1 time: 0.383409 Oct 31 14:13:17.736613 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1393/2533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1466 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.737567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.738366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:17.745400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.745899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.746373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.747136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.747782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.748210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.754002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7ab43e07-0907-49ea-9c67-02ded36b431a req-1e05ca46-8764-4d12-89b3-947c3ce006f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea2bec9-7f33-4d04-b417-d68ac0c3e19a", "tag": "8641d05e-a4e9-4d0b-86cc-d4dbca95b99d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:17.764033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7ab43e07-0907-49ea-9c67-02ded36b431a req-1e05ca46-8764-4d12-89b3-947c3ce006f2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.764438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7ab43e07-0907-49ea-9c67-02ded36b431a req-1e05ca46-8764-4d12-89b3-947c3ce006f2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.764864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7ab43e07-0907-49ea-9c67-02ded36b431a req-1e05ca46-8764-4d12-89b3-947c3ce006f2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.777064 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7ab43e07-0907-49ea-9c67-02ded36b431a req-1e05ca46-8764-4d12-89b3-947c3ce006f2 service nova] Creating event network-changed:8641d05e-a4e9-4d0b-86cc-d4dbca95b99d for instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a on n-h1-863052-1 Oct 31 14:13:17.781939 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7ab43e07-0907-49ea-9c67-02ded36b431a req-1e05ca46-8764-4d12-89b3-947c3ce006f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055598 Oct 31 14:13:17.783115 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1141/2534] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:17.791208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.791912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:17.798440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.799005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.799485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.800140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:17.800656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:17.801105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:17.867630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.878029 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68b90c0a-5c02-49e6-91a8-58908b1bf28f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1278 microversion: 2.1 time: 0.144700 Oct 31 14:13:17.879039 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1394/2535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1278 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.884042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f614d3b5-0734-4457-9ae6-b9a5f7d2cff2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078ee4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:17.943816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:17.953817 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86a8c173-52f4-414d-aab2-009e78f7621d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1664 microversion: 2.1 time: 0.166650 Oct 31 14:13:17.955044 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1142/2536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:17.992562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f614d3b5-0734-4457-9ae6-b9a5f7d2cff2 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-10-31T14%3A11%3A02Z" status: 200 len: 1902 microversion: 2.1 time: 0.112171 Oct 31 14:13:17.993148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1395/2537] 10.222.0.27 () {58 vars in 1199 bytes} [Mon Oct 31 14:13:17 2022] GET /compute/v2.1/images?changes-since=2022-10-31T14%3A11%3A02Z => generated 1902 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:18.008143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b2bed1e-bece-4843-be90-80642945737d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107db10d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.083086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b2bed1e-bece-4843-be90-80642945737d tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-404662035" status: 200 len: 484 microversion: 2.1 time: 0.078638 Oct 31 14:13:18.083870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1143/2538] 10.222.0.27 () {58 vars in 1229 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-404662035 => generated 484 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:18.096547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-415c77ac-2332-44f8-a573-32f8b8350a51 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1077b5670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.153013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.153808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:18.160411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.160904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.161341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.162084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.162561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.163017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.195699 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-415c77ac-2332-44f8-a573-32f8b8350a51 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?server=554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 958 microversion: 2.1 time: 0.102842 Oct 31 14:13:18.197619 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1396/2539] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/images?server=554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 958 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:18.203295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.204252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:18.212101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.212821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.213433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.214440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.215043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.215617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.353416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:18.366667 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8d2b101-8581-4b1a-acd9-55d98cdd2034 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.217695 Oct 31 14:13:18.368476 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1144/2540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:18.373888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f7fc80e-c7df-4fc2-95b9-83c31cd23c63 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107f2b670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.446425 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f7fc80e-c7df-4fc2-95b9-83c31cd23c63 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 484 microversion: 2.1 time: 0.076132 Oct 31 14:13:18.447026 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1145/2541] 10.222.0.27 () {58 vars in 1317 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b => generated 484 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:18.459497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.460129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:18.467534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.468093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.468224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.469100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.469630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.470016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.771450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:18.785099 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32480015-3d3f-4d32-b898-05256261a3ad tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.337022 Oct 31 14:13:18.786379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1146/2542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:18.791240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.792055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:18.799957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.800717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.802020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.802359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.803062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.804167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.897858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:18.906304 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20063397-8601-45e3-89b3-a05dbb26bd57 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.707108 Oct 31 14:13:18.907169 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1397/2543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:18.913251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14ebdbb1-9717-4bac-9528-6f1c803ec2a7 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10fb09e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.976201 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14ebdbb1-9717-4bac-9528-6f1c803ec2a7 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 484 microversion: 2.1 time: 0.067078 Oct 31 14:13:18.977014 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1398/2544] 10.222.0.27 () {58 vars in 1303 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b => generated 484 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:18.981932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:18.982780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:18.989317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.989811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.990283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:18.990984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:18.991436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:18.992045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.028784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:19.041141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48f6de22-90da-4e80-bd64-4986717fb5be tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.253430 Oct 31 14:13:19.042184 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1147/2545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:19.046966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:19.047810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:19.053988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.054726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.055379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.056262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.056893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.057506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.261056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:19.271815 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea8c250d-5610-4b1b-8310-8c6fc31adfad tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.293474 Oct 31 14:13:19.272417 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1399/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:18 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:19.280411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:19.281039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:19.303306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.303957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.306201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.308457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.310412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.311316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.601665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:19.609668 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2646333d-6cd3-4dab-8b59-b7cc818bd1bc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.566201 Oct 31 14:13:19.610428 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1148/2547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:19 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:19.615768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adb95e3a-9fd9-4487-87f4-d475c684f37e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107479670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:19.668352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:19.678474 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf720028-77b0-451f-b45d-1d1261193098 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.405031 Oct 31 14:13:19.679052 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1400/2548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:19 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:19.684312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:19.685102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:19.691572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.692226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.692814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.693676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.694295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.694863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.748763 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-adb95e3a-9fd9-4487-87f4-d475c684f37e tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.136721 Oct 31 14:13:19.760311 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1149/2549] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:13:19 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:19.760311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:19.760311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:19.763262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.763762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.764206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.764918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:19.765594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:19.765796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:19.784250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:19.908978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:19.917456 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84e83bc0-da21-46d7-8277-acd687f447ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.167010 Oct 31 14:13:19.931280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1150/2550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:19 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:19.944123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30691a39-d950-40e7-974e-c68ef2c13373 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe10c6a6ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.022151 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30691a39-d950-40e7-974e-c68ef2c13373 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.089469 Oct 31 14:13:20.022999 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1151/2551] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:13:19 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.031137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:20.041810 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-676d04ad-036f-4f11-9b91-9dfe22fe79b4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.361563 Oct 31 14:13:20.042421 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1401/2552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:19 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.046610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.051999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.053017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.059845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.065277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.065851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.066556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.067302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.067761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.068192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.075723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.076247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.076856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.077629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.078009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.090026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.235150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:20.247256 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3510233c-9a34-4228-9139-09bc8eb10262 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.222365 Oct 31 14:13:20.248325 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1152/2553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.253971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:20.254890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.261821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.262670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.263338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.264245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.264933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.265560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.329183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Unlocking {{(pid=120641) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 31 14:13:20.358440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:20.367333 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efd5873d-2d00-44ad-8e53-d88157bcd8c7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.319409 Oct 31 14:13:20.367916 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1402/2554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.372809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80cfb417-613e-4449-8be4-435defd64fa4 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107810280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.384377 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c83fcb4-bdf8-4ea8-9412-038fd8fd2c6d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.134419 Oct 31 14:13:20.385205 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1153/2555] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:20 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:20.395603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.396227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.402587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.403080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.403673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.404360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.404882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.405369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.458913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80cfb417-613e-4449-8be4-435defd64fa4 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.089650 Oct 31 14:13:20.460794 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1403/2556] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:20.467078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.468610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.476785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.477510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.478193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.479297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.479951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.480572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.577549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:20.588549 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de15777c-c29a-4370-b163-11ee9529993f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.200997 Oct 31 14:13:20.598508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1154/2557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.613350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.614380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.622422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.622920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.623363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.624172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.624524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.624949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.725673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:20.739332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c31b2c82-e12d-4c22-82d9-31b598cced9f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.275798 Oct 31 14:13:20.750959 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1404/2558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.762044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2fd246bb-f426-4732-a96c-ed8f052390a4 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1076c9670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.791874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:20.803369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81889477-5da7-4d2b-a45d-a88c6b7d11ee tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.203409 Oct 31 14:13:20.804527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1155/2559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.809995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.810694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.822350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.823026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.823986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.824703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.825157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.825578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.874580 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2fd246bb-f426-4732-a96c-ed8f052390a4 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-10-31T14%3A10%3A54Z" status: 200 len: 6332 microversion: 2.1 time: 0.122296 Oct 31 14:13:20.875278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1405/2560] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-31T14%3A10%3A54Z => generated 6332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:20.880320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2883440d-b6ca-475d-90ef-5d26e1775b9f req-b87a755f-d19f-41cf-91e6-a6a80b90978a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d5de8e-2266-4ca2-9f82-53d7cdc36247", "name": "network-vif-plugged", "status": "completed", "tag": "6ea97b08-9db3-4387-998f-fd78a653651c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:20.892928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2883440d-b6ca-475d-90ef-5d26e1775b9f req-b87a755f-d19f-41cf-91e6-a6a80b90978a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.893619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2883440d-b6ca-475d-90ef-5d26e1775b9f req-b87a755f-d19f-41cf-91e6-a6a80b90978a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.894290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2883440d-b6ca-475d-90ef-5d26e1775b9f req-b87a755f-d19f-41cf-91e6-a6a80b90978a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.908580 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2883440d-b6ca-475d-90ef-5d26e1775b9f req-b87a755f-d19f-41cf-91e6-a6a80b90978a service nova] Creating event network-vif-plugged:6ea97b08-9db3-4387-998f-fd78a653651c for instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 on n-h2-863052-1 Oct 31 14:13:20.916861 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2883440d-b6ca-475d-90ef-5d26e1775b9f req-b87a755f-d19f-41cf-91e6-a6a80b90978a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038911 Oct 31 14:13:20.917785 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1406/2561] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:20.930983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:20.931893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:20.951117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.953535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.955478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:20.956434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:20.957708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:20.959400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.036777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.045924 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b59e24a8-b7c3-4efc-bd47-41584ecfa88b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.240225 Oct 31 14:13:21.046896 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1156/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.051633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48379e29-5161-46e1-8b44-fa4a242694d9 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107db1940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.108726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48379e29-5161-46e1-8b44-fa4a242694d9 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-404662035" status: 200 len: 664 microversion: 2.1 time: 0.060770 Oct 31 14:13:21.110821 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1157/2563] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-404662035 => generated 664 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:21.116088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ebb7754c-7f5d-40c6-ba10-2aa622ba95f5 req-3201e820-7fe2-4083-8dde-5caa80ab5c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea579a46-25e3-4eb5-932b-6560f541013d", "tag": "ee35761d-886d-45ee-84b9-2b3093c4eb60"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:21.128692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ebb7754c-7f5d-40c6-ba10-2aa622ba95f5 req-3201e820-7fe2-4083-8dde-5caa80ab5c12 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.129265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ebb7754c-7f5d-40c6-ba10-2aa622ba95f5 req-3201e820-7fe2-4083-8dde-5caa80ab5c12 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.130136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ebb7754c-7f5d-40c6-ba10-2aa622ba95f5 req-3201e820-7fe2-4083-8dde-5caa80ab5c12 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.142722 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ebb7754c-7f5d-40c6-ba10-2aa622ba95f5 req-3201e820-7fe2-4083-8dde-5caa80ab5c12 service nova] Creating event network-changed:ee35761d-886d-45ee-84b9-2b3093c4eb60 for instance ea579a46-25e3-4eb5-932b-6560f541013d on n-h2-863052-1 Oct 31 14:13:21.147606 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ebb7754c-7f5d-40c6-ba10-2aa622ba95f5 req-3201e820-7fe2-4083-8dde-5caa80ab5c12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035288 Oct 31 14:13:21.148458 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1158/2564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:21.153803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.154342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.161016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.161772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.162313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.163107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.163636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.164129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.217168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.225574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86f6d283-b651-428e-9841-72137696011d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.300621 Oct 31 14:13:21.239473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1407/2565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:20 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.247460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa9af630-f9ba-48c4-b51e-e7e70ff2a925 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107cb8dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.303405 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa9af630-f9ba-48c4-b51e-e7e70ff2a925 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1466 microversion: 2.1 time: 0.060722 Oct 31 14:13:21.315238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.315810 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1408/2566] 10.222.0.27 () {58 vars in 1338 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b => generated 1466 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.319250 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05281a64-6d17-41e8-bf5f-acdc252c86f5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.169716 Oct 31 14:13:21.319825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1159/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.321365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.321995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.324241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.325007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.328437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.328940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.329430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.330129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.330764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.331350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.331471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.331918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.332360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.333060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.333517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.333946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.468508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.468986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.476597 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3db07b2-93e0-4f88-801b-11736bf0cb8f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.159334 Oct 31 14:13:21.476842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-498f4100-204a-4617-a717-96082821c076 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.156048 Oct 31 14:13:21.477330 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1409/2568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.478636 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1160/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.482025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dce21164-2ee4-4eac-bd86-0239d408d395 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078263a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.483852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.484541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.495266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.495759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.496199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.496901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.497358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.497810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.535533 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dce21164-2ee4-4eac-bd86-0239d408d395 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1466 microversion: 2.1 time: 0.057109 Oct 31 14:13:21.536110 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1410/2570] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fc4f9e762-ff51-4111-946e-50eaa69df94b => generated 1466 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.540936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:21.541478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.547825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.548895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.549333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.550024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.550503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.550928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.619434 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac1f238e-5464-463d-af12-d0802bd0e8e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.081828 Oct 31 14:13:21.623076 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1411/2571] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:21 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:21.625357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73e0ac3d-0efc-4a7e-9149-eeab8d0ee128 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107810280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.633706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.641490 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff8d2355-005d-48db-acda-6f001c650aae tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.161690 Oct 31 14:13:21.642092 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1161/2572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.646521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.647127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.652869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.653392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.653833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.654608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.655070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.655493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.716487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73e0ac3d-0efc-4a7e-9149-eeab8d0ee128 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.094983 Oct 31 14:13:21.717237 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1412/2573] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.722764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.723464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.732445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.732445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.732445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.732445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.733027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.733310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.788416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.796230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-56f1545c-7a21-4a56-8be1-333088e3253e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.153108 Oct 31 14:13:21.796800 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1162/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.801889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-158fd3d5-0fd1-4b55-8e93-fcfa830afc76 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107ce3430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.868159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-158fd3d5-0fd1-4b55-8e93-fcfa830afc76 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.070324 Oct 31 14:13:21.868731 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1163/2575] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.870991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:21.873520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.874618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:21.879055 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b405ac8-b5ed-451c-8d23-04ad5da00171 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1673 microversion: 2.1 time: 0.161086 Oct 31 14:13:21.879793 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1413/2576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:21.880303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.880721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.881164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.881865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:21.882366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:21.882783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:21.885720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81e73e80-78e0-41a7-99d3-15b54bb3cbee tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe1078263a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:21.932752 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81e73e80-78e0-41a7-99d3-15b54bb3cbee tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/cf380c16-a362-46be-bffa-e45fdf8f7e66" status: 200 len: 784 microversion: 2.1 time: 0.050216 Oct 31 14:13:21.943267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1414/2577] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/cf380c16-a362-46be-bffa-e45fdf8f7e66 => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:21.948591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ece9db5d-b960-426d-b56f-67e5ae4d9b00 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107739790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.005538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ece9db5d-b960-426d-b56f-67e5ae4d9b00 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.061228 Oct 31 14:13:22.011120 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1415/2578] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:22.023511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-093e78f7-0420-4dcc-ac49-cd43c8aaf677 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107c08550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.037124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:22.045038 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae6478a9-2410-416a-98a3-57966fa77d5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.175051 Oct 31 14:13:22.045617 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1164/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:21 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:22.074462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.076248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:22.083045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.084074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.084519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.085219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.085829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.086445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.229877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:22.237629 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5534f69f-eabf-4bc2-a21c-22d4df102ba6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.167559 Oct 31 14:13:22.242196 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1165/2580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:22.343447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.344145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:22.354354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.354858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.355380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.356221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.356782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.357099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.473087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:22.503244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:22.512005 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b72e94f-3306-4c39-8167-6b66c718ea9c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.172360 Oct 31 14:13:22.512595 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1166/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:22.517204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.517816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:22.523795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.524284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.524727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.525524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.525988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.526444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.594234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=36 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:22.658694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-093e78f7-0420-4dcc-ac49-cd43c8aaf677 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f" status: 204 len: 0 microversion: 2.1 time: 0.639179 Oct 31 14:13:22.662159 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1416/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] DELETE /compute/v2.1/images/8239ccff-0a6b-41fa-8345-55ab70da997f => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:22.667982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.668572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:22.679027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.679625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.680088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.681148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.681887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.682365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.693765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:22.702200 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c6581ad-a2f6-4a9b-bf04-b273223cb7fa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.188508 Oct 31 14:13:22.702784 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1167/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:22.710546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3caa2341-88de-4193-ac4b-8ff80a7075ee tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107ce3820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.904661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:22.913333 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8609b8ad-ec93-4c48-9104-6a6e0cccf0b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1517 microversion: 2.1 time: 0.250109 Oct 31 14:13:22.913896 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1417/2584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:22.918492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:22.919105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:22.926422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.926923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.927362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:22.928057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:22.928509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:22.929522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.072178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.080629 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd4cad0c-ee0d-45d0-9948-2ab2ae1e0753 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.165676 Oct 31 14:13:23.081191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1418/2585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.087262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.087879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.095360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.095846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.096696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.097675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.098137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.098592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.117083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:23.163647 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3caa2341-88de-4193-ac4b-8ff80a7075ee tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a" status: 204 len: 0 microversion: 2.1 time: 0.457103 Oct 31 14:13:23.164257 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1168/2586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:22 2022] DELETE /compute/v2.1/images/37120411-815c-462c-844e-d424815d933a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:23.173204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c7aba-81f6-434a-ba87-aeab18d06614", "name": "network-vif-plugged", "status": "completed", "tag": "8f7dd073-3aef-4857-ab11-3bf91526c747"}, {"server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "name": "network-vif-unplugged", "status": "completed", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}, {"server_uuid": "e55df226-8bb5-4356-8465-5b2936c41cff", "name": "network-vif-plugged", "status": "completed", "tag": "ef96cb54-c6d9-4ee8-9523-dc0e4738f622"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:23.184457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.184941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.185385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.200422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Creating event network-vif-plugged:8f7dd073-3aef-4857-ab11-3bf91526c747 for instance f13c7aba-81f6-434a-ba87-aeab18d06614 on n-h2-863052-1 Oct 31 14:13:23.201063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Creating event network-vif-unplugged:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:13:23.201578 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] Creating event network-vif-plugged:ef96cb54-c6d9-4ee8-9523-dc0e4738f622 for instance e55df226-8bb5-4356-8465-5b2936c41cff on n-h1-863052-1 Oct 31 14:13:23.214825 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-232cedf0-a7aa-4162-a06d-b50cbba5a853 req-b2490ffe-8eef-4a4e-846e-0c604e62a220 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.044958 Oct 31 14:13:23.215757 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1169/2587] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:23.223052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.223052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.233710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.234238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.236078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.236828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.237299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.237738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.243727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:23.258952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.275649 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee82523a-83be-402d-b3fa-1e0af92186e0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1653 microversion: 2.1 time: 0.192987 Oct 31 14:13:23.279140 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1419/2588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1653 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.289526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d818f4aa-2107-43ee-b57c-efe96d67db3c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107a11c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.402905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.411829 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d27ce6b6-546b-4e2f-8b39-7e64dc78737f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1318 microversion: 2.1 time: 0.194684 Oct 31 14:13:23.412481 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1170/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.418402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.422107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.429962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.430498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.430943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.431651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.432107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.432538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.565746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.574106 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8275399-6756-4e87-aa29-5f7207081611 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.160462 Oct 31 14:13:23.574851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1171/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.579712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:23.580320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.586621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.586951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.587089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.587774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.588222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.588629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.661658 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2e1df425-b6ac-4bdf-812c-a5f2cbc68e72 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.085454 Oct 31 14:13:23.662503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1172/2591] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:23 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:23.667784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.669038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.676811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.677303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.677743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.678512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.679086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.679522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.757867 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d818f4aa-2107-43ee-b57c-efe96d67db3c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a" status: 204 len: 0 microversion: 2.1 time: 0.477181 Oct 31 14:13:23.758482 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1420/2592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] DELETE /compute/v2.1/images/252d9c32-dadc-45f5-b1c2-bbe25593ce3a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:23.763067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.763673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.769637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.770101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.770593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.771501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.771961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.772386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.821437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.830402 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9bde7867-98b9-4ca5-817a-3391d7c39b89 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.166873 Oct 31 14:13:23.830992 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1173/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.835809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.836427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.842125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.842643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.843086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.843920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.844388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.845341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.907970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.916394 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4279162f-7989-483b-9287-577112b4ba57 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1660 microversion: 2.1 time: 0.156920 Oct 31 14:13:23.917238 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1421/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1660 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.922072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.922790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:23.935928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.936422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.936861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.937554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:23.938004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:23.938452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:23.963981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:13:23.982844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:23.992254 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2e079f0-199a-41cd-819f-23deaa485083 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.160265 Oct 31 14:13:23.993753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1174/2595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:23.999007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:23.999614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.005513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.006272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.007071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.007909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.008592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.009153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.051200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-662cf975-9439-45c9-ae46-4bc132f08b69 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 204 len: 0 microversion: 2.1 time: 0.132342 Oct 31 14:13:24.054907 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1422/2596] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:23 2022] DELETE /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:24.060314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.061027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.068270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.069218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.069665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.070407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.071283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.071814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.155709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:24.165245 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e54bb511-c1bb-4a3a-a99e-96e39e0a86db tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1523 microversion: 2.1 time: 0.170058 Oct 31 14:13:24.166002 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1175/2597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:23 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:24.171831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.172647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.188075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.189157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.189157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.189743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.190233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.190671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.218896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:24.227672 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38c347a8-efd7-4755-befa-163dc671b7f3 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1474 microversion: 2.1 time: 0.171512 Oct 31 14:13:24.228248 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1423/2598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1474 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:24.333299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:24.341451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b290db87-778a-4e88-b5d1-d350eacf9a42 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.173922 Oct 31 14:13:24.342016 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1176/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:24.436011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.436623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.442599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.443081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.443516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.444203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.444656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.445074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.575476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:24.583736 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0835bc6c-746c-4707-9665-58745f43a77d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1467 microversion: 2.1 time: 0.151687 Oct 31 14:13:24.584337 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1424/2600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1467 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:24.604078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.604704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.606072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.606836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.611480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.612206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.612654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.613367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.613495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.613824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.614063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.614284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.614685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.615492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.616000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.616482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.759249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:24.762324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:24.771206 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8743696c-3cf8-4885-8135-32bb9e18cdd5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.171194 Oct 31 14:13:24.771804 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1177/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:24.774784 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43d10ab6-2846-4d78-b539-ac286181043f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1318 microversion: 2.1 time: 0.172536 Oct 31 14:13:24.775445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1425/2602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:24.853908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.854506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.860556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.861043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.861486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.862205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.862669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.863098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.941066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:24.941853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:24.943818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:24.949729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.950251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.950689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.951380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:24.951846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:24.952271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:24.993078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.002716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a511ab59-977a-4abe-ae10-74c2b573d940 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.152680 Oct 31 14:13:25.003320 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1178/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:25.016441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:25.017134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:25.023027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.023512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.023954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.024644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.025123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.025548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.084729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.092609 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d464f7ba-3c20-4762-aef1-59ef8fb377ca tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1660 microversion: 2.1 time: 0.155941 Oct 31 14:13:25.093278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1426/2604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:24 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1660 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:25.156644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.164434 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4c7ebb3-d1c3-4b36-bbb5-4f02c09fc6de tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.151697 Oct 31 14:13:25.165009 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1179/2605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:25 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:25.189321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:25.189946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:25.196314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.196794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.197235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.197925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.198417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.198845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.230817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a25b537a-7874-4442-89a8-c5189f0580a0 req-2a7c4e9e-1527-4ee3-b7d7-e0b98bc5b433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d8072b-22d5-4efb-a8f0-cbc64db7474b", "name": "network-vif-unplugged", "status": "completed", "tag": "aad909a1-be8f-4014-b4ee-a410a747fb4c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:25.241133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a25b537a-7874-4442-89a8-c5189f0580a0 req-2a7c4e9e-1527-4ee3-b7d7-e0b98bc5b433 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.241651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a25b537a-7874-4442-89a8-c5189f0580a0 req-2a7c4e9e-1527-4ee3-b7d7-e0b98bc5b433 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.242062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a25b537a-7874-4442-89a8-c5189f0580a0 req-2a7c4e9e-1527-4ee3-b7d7-e0b98bc5b433 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.256005 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a25b537a-7874-4442-89a8-c5189f0580a0 req-2a7c4e9e-1527-4ee3-b7d7-e0b98bc5b433 service nova] Creating event network-vif-unplugged:aad909a1-be8f-4014-b4ee-a410a747fb4c for instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b on n-h2-863052-1 Oct 31 14:13:25.261446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a25b537a-7874-4442-89a8-c5189f0580a0 req-2a7c4e9e-1527-4ee3-b7d7-e0b98bc5b433 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034557 Oct 31 14:13:25.262044 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1180/2606] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:13:25.267085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:25.267809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:25.273857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.274384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.274820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.275512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.275965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.276392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.331224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.339050 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a6d378c-0bec-48f0-8b06-d8acac1d2286 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1523 microversion: 2.1 time: 0.154259 Oct 31 14:13:25.339650 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1427/2607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:25 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:25.365259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:25.365877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:25.372094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.372574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.373003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.373687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.374136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.374577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.413048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.422286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-754e1eda-0361-4339-accf-9066db394a98 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1474 microversion: 2.1 time: 0.159023 Oct 31 14:13:25.422874 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1181/2608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:25 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1474 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:25.445747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:25.546538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.555074 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5b18f88-6c3b-4d7d-a1d6-5d799c4eef45 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.194216 Oct 31 14:13:25.555648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1428/2609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:25 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:25.792921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:25.793511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:25.797507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:25.798159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:25.800945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.801438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.801878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.802628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.803084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.803512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.804539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.805095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.805594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.806392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:25.806912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:25.808788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:25.932922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.939187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:25.941136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-def971d6-b62e-45e7-9acb-f81c904aad56 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.152091 Oct 31 14:13:25.941947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1182/2610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:25 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:25.947427 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87dc29c1-e073-4ecc-809f-08bf19441d92 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1318 microversion: 2.1 time: 0.153720 Oct 31 14:13:25.948183 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1429/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:25 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.027368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.028183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.034975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.035468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.035935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.036643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.037098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.037521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.120215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.122532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.135398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.136009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.136649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.137739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.139743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.139743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.196213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.205239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b55cbe8e-aed5-4abd-a04d-9ade6cb83da5 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.182605 Oct 31 14:13:26.205807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1183/2612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.210424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.211027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.216958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.217448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.217885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.218604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.219053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.219474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.294479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.302389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-226e19e3-dc16-4327-93ce-e42cafca4686 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.188468 Oct 31 14:13:26.303159 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1430/2613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.326301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.326929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.334216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.335389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.335710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.336409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.336862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.337286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.361021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.369864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e4a48b9b-2f1c-4b07-b523-5c528c1f5f82 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.163031 Oct 31 14:13:26.370657 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1184/2614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.377733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.378375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.384376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.384861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.385296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.385981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.386456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.386915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.518624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.526688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-990567b6-f5ef-4268-8481-1adbbec6b277 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1523 microversion: 2.1 time: 0.155240 Oct 31 14:13:26.527269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1185/2615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.531727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.532342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.538204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.539140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.539594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.540299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.540859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.541184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.554344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.557129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:26.562898 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdea97fd-e184-4e06-85a7-2d638abbe3b1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.241490 Oct 31 14:13:26.564209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1431/2616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:26.585005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.585724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.592283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.592855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.595775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.595775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.595775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.595775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.699383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.708054 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1abe5dad-9191-4750-9a5d-7d8d5898ea18 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1474 microversion: 2.1 time: 0.179707 Oct 31 14:13:26.722564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1186/2617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1474 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.729775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.730451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.737214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.737994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.738246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.738906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.739374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.739806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.892705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:26.902349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb43ca7e-65fa-4f7a-8992-477dea114675 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.178656 Oct 31 14:13:26.903282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1187/2618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:26.928696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:26.929438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:26.935834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.936331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.936775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:26.937512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:26.937966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:26.938431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.085543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.093628 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c27682e8-2607-4781-bf97-28d7a30ddae0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.171786 Oct 31 14:13:27.094379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1188/2619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:27.102550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.103081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:27.110115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.111336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.111770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.114000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.114826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.114963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.132338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.141057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-871a3905-b638-4f04-b528-4835e5cc67b3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.566442 Oct 31 14:13:27.141925 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1432/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:26 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:27.146880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.147740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:27.153854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.154634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.155295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.156204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.156851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.158001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.283173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.292918 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d9d9009-1382-4ccd-82c2-64f11064765c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.194399 Oct 31 14:13:27.293945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1189/2621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:27.300192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.301078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:27.308478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:27.310802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.311524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.312166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.313098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.314020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.315446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.416944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.426530 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-218f4135-2a99-4b0f-b2c3-8bd233ee4715 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1467 microversion: 2.1 time: 0.283067 Oct 31 14:13:27.427428 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1433/2622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:27.450142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.450928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:27.458282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.458912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.459453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.460421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.461102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.461664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.481956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.496866 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2cfdcd02-d158-448a-acff-4b07886b3820 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.201525 Oct 31 14:13:27.497648 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1190/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:27.568738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b13ba246-9643-4afc-b712-ce3e296192ba req-7e465a95-a738-4df9-960c-88b416900f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea2bec9-7f33-4d04-b417-d68ac0c3e19a", "name": "network-vif-plugged", "status": "completed", "tag": "8641d05e-a4e9-4d0b-86cc-d4dbca95b99d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:27.578742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b13ba246-9643-4afc-b712-ce3e296192ba req-7e465a95-a738-4df9-960c-88b416900f6c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.579983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b13ba246-9643-4afc-b712-ce3e296192ba req-7e465a95-a738-4df9-960c-88b416900f6c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.580518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b13ba246-9643-4afc-b712-ce3e296192ba req-7e465a95-a738-4df9-960c-88b416900f6c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.592649 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b13ba246-9643-4afc-b712-ce3e296192ba req-7e465a95-a738-4df9-960c-88b416900f6c service nova] Creating event network-vif-plugged:8641d05e-a4e9-4d0b-86cc-d4dbca95b99d for instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a on n-h1-863052-1 Oct 31 14:13:27.597885 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b13ba246-9643-4afc-b712-ce3e296192ba req-7e465a95-a738-4df9-960c-88b416900f6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099292 Oct 31 14:13:27.599049 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1191/2624] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:27.604638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.605420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:27.611887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.612461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.613184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.613906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.614470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.614908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.726120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.756267 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a111f281-39b7-403b-9631-078aad693ec9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.309813 Oct 31 14:13:27.757230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1434/2625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:27.767778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e4d3ef21-1202-4ee7-a6ae-de9d4cc6bf5d req-d2bc7363-f37e-4d13-a80d-9af6199aeed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f9e762-ff51-4111-946e-50eaa69df94b", "name": "network-vif-deleted", "tag": "98a382a7-f2e3-4e9d-bd8c-950abec1c5f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:27.780081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:27.784565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e4d3ef21-1202-4ee7-a6ae-de9d4cc6bf5d req-d2bc7363-f37e-4d13-a80d-9af6199aeed7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.785600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e4d3ef21-1202-4ee7-a6ae-de9d4cc6bf5d req-d2bc7363-f37e-4d13-a80d-9af6199aeed7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.786608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e4d3ef21-1202-4ee7-a6ae-de9d4cc6bf5d req-d2bc7363-f37e-4d13-a80d-9af6199aeed7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.804372 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e4d3ef21-1202-4ee7-a6ae-de9d4cc6bf5d req-d2bc7363-f37e-4d13-a80d-9af6199aeed7 service nova] Creating event network-vif-deleted:98a382a7-f2e3-4e9d-bd8c-950abec1c5f8 for instance c4f9e762-ff51-4111-946e-50eaa69df94b on n-h1-863052-1 Oct 31 14:13:27.827870 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e4d3ef21-1202-4ee7-a6ae-de9d4cc6bf5d req-d2bc7363-f37e-4d13-a80d-9af6199aeed7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067713 Oct 31 14:13:27.832642 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1435/2626] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:27.846407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.856980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.861948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:27.869181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Searching by: {'reservation_id': 'r-vpn0yyb6', 'deleted': False, 'project_id': '8fadd213d9f34565a0cf36487701aea2'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:27.870866 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ea8b745-4374-4df9-961d-a9b45aecb989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.270356 Oct 31 14:13:27.874842 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1192/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:27.881640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.882123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.882587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.883300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.883746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.886404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:27.887022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:27.889006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.896617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.897497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.897641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.898375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:27.899147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:27.899582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:27.974921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:28.045133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:28.069308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.077221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5207e32-f179-4854-9144-4d97ca337488 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.201717 Oct 31 14:13:28.077800 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1193/2628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.082441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.083038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.088598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.090214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.090214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.090214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.090759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.091195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.112305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.118764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.119494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.119919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.228794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.237815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-918a9332-3707-41c4-9b2c-0c73e369ae6b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1508 microversion: 2.1 time: 0.158922 Oct 31 14:13:28.250203 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1194/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.250480 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b77e6bd8-335a-408d-b865-37a0db1986c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-vpn0yyb6" status: 200 len: 2927 microversion: 2.1 time: 0.407138 Oct 31 14:13:28.250480 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1436/2630] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 31 14:13:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vpn0yyb6 => generated 2927 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.250480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.250480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.257507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.257507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.262802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.263291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.263731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.264429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.264885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.265318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.272174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.272967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.273704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.276349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.276349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.276349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.297614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.298704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.299147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.299595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lazy-loading 'fault' on Instance uuid c4f9e762-ff51-4111-946e-50eaa69df94b {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:13:28.340281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.348473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ccb90294-1ea1-4390-8162-4726e76c67de tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 200 len: 1308 microversion: 2.1 time: 0.108793 Oct 31 14:13:28.349046 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1195/2631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.353921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.354791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.362012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.362533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.362968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.363690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.364148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.364577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.415472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.423960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-477dc957-0508-486b-8af6-ad501710e651 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.179263 Oct 31 14:13:28.424740 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1437/2632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.429254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0830a0a-3f62-4556-8936-caf0ae1e5b28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.456333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_groups [None req-d0830a0a-3f62-4556-8936-caf0ae1e5b28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Querying cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) for 2 instances {{(pid=120640) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 14:13:28.457038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0830a0a-3f62-4556-8936-caf0ae1e5b28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.457514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0830a0a-3f62-4556-8936-caf0ae1e5b28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.457942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0830a0a-3f62-4556-8936-caf0ae1e5b28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.488017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0830a0a-3f62-4556-8936-caf0ae1e5b28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ebaf5c65-4529-4783-9bf3-8e3889cf058d" status: 200 len: 265 microversion: 2.1 time: 0.062362 Oct 31 14:13:28.488600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1438/2633] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/os-server-groups/ebaf5c65-4529-4783-9bf3-8e3889cf058d => generated 265 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:28.493132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.493823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.497264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.499970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.500452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.500882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.501611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.502058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.502505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.505654 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df69085e-f1fe-4875-8586-c1aa3b1395e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 200 len: 1508 microversion: 2.1 time: 0.155648 Oct 31 14:13:28.506416 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1196/2634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.510504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.511115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.516709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.517201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.517638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.518367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.518825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.519250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.637321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.645236 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa820389-61c6-4793-a632-ab8ee73c5da3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.155633 Oct 31 14:13:28.649656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1439/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.654839 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-54b8e46c-f588-475d-a1b1-fddaa8a11ca7 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1618 microversion: 2.1 time: 0.147557 Oct 31 14:13:28.655343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.656030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.662683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.663375 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1197/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1618 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:28.663538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.664156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.664847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.665290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.665711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.677754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.678811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.685691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.686529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.687178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.688300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.689641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.690303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.692585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:13:28.784597 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3960272-e080-43dc-9d56-0f656a6c5ffd tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 204 len: 0 microversion: 2.1 time: 0.136344 Oct 31 14:13:28.785546 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1440/2637] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:28 2022] DELETE /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:28.790848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.791799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.798731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.799225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.799659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.800793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.800793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.801184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.876082 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df9f6dbc-26ed-4672-ac26-560117f2c154 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1618 microversion: 2.1 time: 0.202768 Oct 31 14:13:28.876669 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1198/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1618 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:28.901818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:28.902714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:28.912315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.912823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.916813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.916813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:28.916813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:28.916813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:28.989941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:28.999478 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02b15118-96df-4202-b5ef-9e4869dc1f4f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.212804 Oct 31 14:13:29.000338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1441/2639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:29.005954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc6e3693-0486-4fa0-ab02-9d12b98f7300 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: .version_select at 0x7fe10fae4d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1110060446", "policies": ["anti-affinity"]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:29.024470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bc6e3693-0486-4fa0-ab02-9d12b98f7300 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.030772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bc6e3693-0486-4fa0-ab02-9d12b98f7300 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.079921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:29.088233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bc6e3693-0486-4fa0-ab02-9d12b98f7300 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.089072 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ca7d88c-ee79-45b2-af9d-404e1f6d3cbd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.190804 Oct 31 14:13:29.104806 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1199/2640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:28 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:29.107383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bc6e3693-0486-4fa0-ab02-9d12b98f7300 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.112067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1049452709", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7791d1cc-91a3-4ccc-9a62-bb64b1bcdeec"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:29.127698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc6e3693-0486-4fa0-ab02-9d12b98f7300 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.125257 Oct 31 14:13:29.134199 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1442/2641] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 31 14:13:29 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:29.177742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] validate_networks() for [('7791d1cc-91a3-4ccc-9a62-bb64b1bcdeec', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:29.237019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-788424039", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "431848c5-29cc-4b3f-ac54-018d6815c5df"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:29.291740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:29.526940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:29.527359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:29.527907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:29.528445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:29.528931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:29.545515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.546068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.546666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.547546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.548845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.549273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.568074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.573967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.590101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Going to run 2 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:29.594614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:29.607172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:29.608593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:29.609255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:29.610250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:29.611384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:29.636721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.637209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.637669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.638661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.640073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.640720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.641185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120640) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 31 14:13:29.660960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Getting quotas for project bd0bd0633fab41348c29a69aebb7b069. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.661664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.667515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Getting quotas for user 79995efa070844cf94985c291b8388b7 and project bd0bd0633fab41348c29a69aebb7b069. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.667683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.682385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:29.685106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:29.716246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.722582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.733764 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-459ea16e-0e6e-4728-ab16-00db3b079fea tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627793 Oct 31 14:13:29.734676 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1200/2642] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:29.739448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=93cc4318-5153-4651-ba90-0df7a8541800,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:29.745867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:29.746518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: c4f9e762-ff51-4111-946e-50eaa69df94b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:29.754417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.754921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.755372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.756086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.756624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.757063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.780861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] HTTP exception thrown: Instance c4f9e762-ff51-4111-946e-50eaa69df94b could not be found. Oct 31 14:13:29.785094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Request method failure captured: Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b HTTP/1.1 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9dtJvBsCTSRAeZgMq2q5DZfAygJzlIsF6sMRIFyU8uT4-esSdGwSBglxGsTeboUF374ZdSI3-GX3VJYzcA1jnwSZ6ZY58SmgM2oeFynXHcZ1V9577aSia8NgITsGjGWgsXGClC44BGDu3uVmSYcjUZ66L-uOItoLbFIg9hMFhA8tJA Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c84be206a0324a14bf3c77ec4e50f940 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListImageFiltersTestJSON-1517154764 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c84be206a0324a14bf3c77ec4e50f940", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c84be206a0324a14bf3c77ec4e50f940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c84be206a0324a14bf3c77ec4e50f940"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c84be206a0324a14bf3c77ec4e50f940"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListImageFiltersTestJSON-1517154764 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c84be206a0324a14bf3c77ec4e50f940 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1517154764 Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListImageFiltersTestJSON-1517154764-project Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: c81d9c4b657d43bfb9d3d88c171a54ea Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListImageFiltersTestJSON-1517154764-project Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c4f9e762-ff51-4111-946e-50eaa69df94b could not be found. Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c4f9e762-ff51-4111-946e-50eaa69df94b'} Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f9e762-ff51-4111-946e-50eaa69df94b could not be found. Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f9e762-ff51-4111-946e-50eaa69df94b could not be found. Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:29.788488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f9e762-ff51-4111-946e-50eaa69df94b could not be found. Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Returning 404 to user: Instance c4f9e762-ff51-4111-946e-50eaa69df94b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb9d8243-7c91-4edc-bcf9-389472ff1e31 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b" status: 404 len: 111 microversion: 2.1 time: 0.049874 Oct 31 14:13:29.794074 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1201/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:29 2022] GET /compute/v2.1/servers/c4f9e762-ff51-4111-946e-50eaa69df94b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:29.802888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:29.803510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:29.810353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.811144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.811829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.812719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.813333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.813950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.814543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.821368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.880712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:29.886415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'server_group_members'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:29.930196 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-250b3bfb-efb2-42f1-8796-cbd1fc2d957a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.696786 Oct 31 14:13:29.931150 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1443/2644] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 31 14:13:29.936205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ea91eba6-8a33-49b6-8c3a-81fe1c0453b8 req-c3a3fb4a-27a8-494b-ac43-dc75a59c4f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d8072b-22d5-4efb-a8f0-cbc64db7474b", "name": "network-vif-plugged", "status": "completed", "tag": "aad909a1-be8f-4014-b4ee-a410a747fb4c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:29.948529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ea91eba6-8a33-49b6-8c3a-81fe1c0453b8 req-c3a3fb4a-27a8-494b-ac43-dc75a59c4f36 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.949383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ea91eba6-8a33-49b6-8c3a-81fe1c0453b8 req-c3a3fb4a-27a8-494b-ac43-dc75a59c4f36 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.949638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ea91eba6-8a33-49b6-8c3a-81fe1c0453b8 req-c3a3fb4a-27a8-494b-ac43-dc75a59c4f36 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.961335 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ea91eba6-8a33-49b6-8c3a-81fe1c0453b8 req-c3a3fb4a-27a8-494b-ac43-dc75a59c4f36 service nova] Creating event network-vif-plugged:aad909a1-be8f-4014-b4ee-a410a747fb4c for instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b on n-h2-863052-1 Oct 31 14:13:29.966434 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ea91eba6-8a33-49b6-8c3a-81fe1c0453b8 req-c3a3fb4a-27a8-494b-ac43-dc75a59c4f36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034014 Oct 31 14:13:29.967262 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1444/2645] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:29.973052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:29.973737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:29.980324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.982514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.982968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.983671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:29.984124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:29.984543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:29.991490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.000385 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9cd327e3-5821-4375-8908-06839c018ace tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.205930 Oct 31 14:13:30.010215 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1202/2646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:29 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.019706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7cccc82e-0fb9-4ae2-9ce5-f8650c308fe4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.022806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7cccc82e-0fb9-4ae2-9ce5-f8650c308fe4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:30.103533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cccc82e-0fb9-4ae2-9ce5-f8650c308fe4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.112315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7cccc82e-0fb9-4ae2-9ce5-f8650c308fe4 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1218 microversion: 2.1 time: 0.108524 Oct 31 14:13:30.113444 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1203/2647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:30 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.118599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.119791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:30.126564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.127364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.127960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.128856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.129474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.129941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.171917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:13:30.210974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:30.228515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.237743 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94c04395-ad7e-46c0-a7c8-fd864f0419b0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.269277 Oct 31 14:13:30.239042 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1445/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:29 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.244367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.249786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.251761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Searching by: {'deleted': False, 'project_id': '8fadd213d9f34565a0cf36487701aea2'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:30.272427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.273348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.273585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.275098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.275355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.275846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.322947 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f09a6685-12f1-4216-9e62-da6bf0f19f67 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 204 len: 0 microversion: 2.1 time: 0.207864 Oct 31 14:13:30.323546 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1204/2649] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:30 2022] DELETE /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:30.334819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.337659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:30.349262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.349764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.350238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.350952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.351411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.356045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.398441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:30.495893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c9acb71-a4b7-45b3-a5e1-657f8bcb7d62 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.255209 Oct 31 14:13:30.497031 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1446/2650] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:13:30 2022] GET /compute/v2.1/servers => generated 1662 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.503018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.503629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:30.509922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.510445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.510879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.511566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.512012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.512837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.607761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.617879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2d302886-2d7b-4968-afcb-fc1c1445f328 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.292789 Oct 31 14:13:30.635507 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1205/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:30 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.642601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.643798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:30.651989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.653627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.655266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.656578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:30.657530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:30.658378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:30.714553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.728498 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ab18c3c-686f-43d2-b7f3-210cfbda29b2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.230317 Oct 31 14:13:30.730656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1447/2652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:30 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.740738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd1aecf3-82f2-4bee-ba71-b188598c3738 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:30.741464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd1aecf3-82f2-4bee-ba71-b188598c3738 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:30.861036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd1aecf3-82f2-4bee-ba71-b188598c3738 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.878545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:30.879417 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd1aecf3-82f2-4bee-ba71-b188598c3738 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1218 microversion: 2.1 time: 0.144680 Oct 31 14:13:30.890285 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1448/2653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:30 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:30.890566 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4619d003-4c37-48a1-9c0c-8dd4d66eaa24 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1472 microversion: 2.1 time: 0.251702 Oct 31 14:13:30.890566 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1206/2654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:30 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:31.036733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:31.039116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:31.046283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.046772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.048424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.049126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.049575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.049996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.137198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:31.137819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:31.147971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.150015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.150661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.153170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.153679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.154137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.231003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:31.231192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:31.239944 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67024453-0c0d-420d-aac7-011577550139 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1270 microversion: 2.1 time: 0.107117 Oct 31 14:13:31.240140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f445bc3-94a1-473d-9645-b10e77dcea1c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.215076 Oct 31 14:13:31.240555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1449/2655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:31 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:31.242293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1207/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:31 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:31.263960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:31.264620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:31.271374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.271894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.272316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.273008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.273475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.273902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.402846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:31.410960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fb43ab6-6b04-4571-aeba-f120ae80a007 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.151014 Oct 31 14:13:31.411529 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1450/2657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:31 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:31.646563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:31.647107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:31.653432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.653843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.654305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.654995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.655447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.655869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.760093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:31.761825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:31.768891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.769727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.770345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.771224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.771828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.772558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.830644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:31.840949 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0afc94c7-5c57-4c01-b1e9-705392910d22 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.198711 Oct 31 14:13:31.841529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1208/2658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:31 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:31.911501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:31.912296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:31.920807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.920807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.920807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.921127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:31.921511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:31.921933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:31.992909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:32.000902 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e837d356-870c-4168-b130-02d0488b57bd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1222 microversion: 2.1 time: 0.097367 Oct 31 14:13:32.001829 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1209/2659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:31 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:32.022230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:32.022891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:32.029028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.029528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.029974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.031029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.031214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.031607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.057659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:32.070054 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e24e547-5fc9-44a4-a1ce-b7f9feb7156e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.314078 Oct 31 14:13:32.078340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1451/2660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:31 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:32.084113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ece13ce7-a750-4b16-a627-b2af05c2f0c6 req-15806967-7585-4e53-9ed3-cf802f5bc161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea579a46-25e3-4eb5-932b-6560f541013d", "name": "network-vif-plugged", "status": "completed", "tag": "ee35761d-886d-45ee-84b9-2b3093c4eb60"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:32.099243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ece13ce7-a750-4b16-a627-b2af05c2f0c6 req-15806967-7585-4e53-9ed3-cf802f5bc161 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.099806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ece13ce7-a750-4b16-a627-b2af05c2f0c6 req-15806967-7585-4e53-9ed3-cf802f5bc161 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.100376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ece13ce7-a750-4b16-a627-b2af05c2f0c6 req-15806967-7585-4e53-9ed3-cf802f5bc161 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.112835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ece13ce7-a750-4b16-a627-b2af05c2f0c6 req-15806967-7585-4e53-9ed3-cf802f5bc161 service nova] Creating event network-vif-plugged:ee35761d-886d-45ee-84b9-2b3093c4eb60 for instance ea579a46-25e3-4eb5-932b-6560f541013d on n-h2-863052-1 Oct 31 14:13:32.119595 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ece13ce7-a750-4b16-a627-b2af05c2f0c6 req-15806967-7585-4e53-9ed3-cf802f5bc161 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Oct 31 14:13:32.120608 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1452/2661] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:32.254775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:32.265453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:32.266405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:32.280989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-236e0724-44f8-43ab-aeef-f457216387c5 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1472 microversion: 2.1 time: 0.262181 Oct 31 14:13:32.282594 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1210/2662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:32 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:32.283454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.284194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.293696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.294643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.295128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.295564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.300266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:32.301246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:32.320065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.321048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.322210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.323297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.323964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.324545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.406955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:32.415054 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0ec5744-f8ea-4940-ba81-7caccee5a97a tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1276 microversion: 2.1 time: 0.131095 Oct 31 14:13:32.415617 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1211/2663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:32 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:32.434663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:32.435489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:32.442239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.442801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.443309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.444072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.444663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.445155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.583705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:32.591888 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a30d9f57-a37c-405e-98df-ef73b0926d7f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1320 microversion: 2.1 time: 0.161280 Oct 31 14:13:32.592475 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1212/2664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:32 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:32.814355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:32.827003 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5522b5c0-f9d5-4a75-96d0-712dc746adac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.566449 Oct 31 14:13:32.845200 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1453/2665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:32 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:32.867111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:32.867740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:32.884446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.884959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.885406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:32.886132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:32.889567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:32.890053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.029828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:33.029828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:33.041011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.041831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.042483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.043383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.044029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.044643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.070562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:33.169428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:33.184779 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c76bd9ae-6384-477d-b14a-e46c648be0cd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1270 microversion: 2.1 time: 0.164953 Oct 31 14:13:33.185793 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1454/2666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:33 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:33.194845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:33.196019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:33.207062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.207698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.208265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.209131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.209660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.210441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.213804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:33.228061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-762c2660-a281-4833-915c-28d08dfaf4bd tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.365203 Oct 31 14:13:33.242029 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1213/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:32 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:33.307102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:33.307728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:33.316560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.317058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.317505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.318251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.318883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.319456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.578811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:33.592982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:33.610442 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbe7cdc6-303f-406f-b760-71c2c1cb3134 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1472 microversion: 2.1 time: 0.304615 Oct 31 14:13:33.610689 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40e7f41b-742b-474f-905a-3fb601a84748 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.420537 Oct 31 14:13:33.611473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1455/2668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:33 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:33.630552 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1214/2669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:33 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:33.643947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f55931f2-c571-4314-b2ea-2f037a672c53 req-6ecf5c9d-1695-4b38-84cb-57d6dcf669ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d8072b-22d5-4efb-a8f0-cbc64db7474b", "name": "network-vif-deleted", "tag": "aad909a1-be8f-4014-b4ee-a410a747fb4c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:33.646766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:33.647648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:33.666125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.667175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.669099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f55931f2-c571-4314-b2ea-2f037a672c53 req-6ecf5c9d-1695-4b38-84cb-57d6dcf669ab service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.669755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.670727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.672160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.673235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.673671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f55931f2-c571-4314-b2ea-2f037a672c53 req-6ecf5c9d-1695-4b38-84cb-57d6dcf669ab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.674157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f55931f2-c571-4314-b2ea-2f037a672c53 req-6ecf5c9d-1695-4b38-84cb-57d6dcf669ab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.692844 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f55931f2-c571-4314-b2ea-2f037a672c53 req-6ecf5c9d-1695-4b38-84cb-57d6dcf669ab service nova] Creating event network-vif-deleted:aad909a1-be8f-4014-b4ee-a410a747fb4c for instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b on n-h2-863052-1 Oct 31 14:13:33.711963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f55931f2-c571-4314-b2ea-2f037a672c53 req-6ecf5c9d-1695-4b38-84cb-57d6dcf669ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076630 Oct 31 14:13:33.712590 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1215/2670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:33.717846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:33.718572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:33.733752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.734207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.735500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:33.736214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:33.736676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:33.737103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.004665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.018102 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3f596b2-c697-4bea-a1e8-92dfc10e940c tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.384060 Oct 31 14:13:34.019358 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1456/2671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:33 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.026283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.029302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.030419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.035262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-231223ec-0023-47bb-8e4d-e3c7e43eca10 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1511 microversion: 2.1 time: 0.321382 Oct 31 14:13:34.038557 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1216/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:33 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.044874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.045613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.046295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.052041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.052778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.053371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.061136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.061925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.072933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.074043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.074043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.074655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.075123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.075555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.384901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.395466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb2729e8-4517-4033-886e-888807586d95 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1512 microversion: 2.1 time: 0.338421 Oct 31 14:13:34.397172 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1217/2673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.405815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.406895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.434313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.435170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.437661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.439288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.440346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.441091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.531175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.541372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.545019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48deaaa5-536a-4031-ac24-da5175c9dba4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1276 microversion: 2.1 time: 0.143117 Oct 31 14:13:34.545565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1218/2674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.550603 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51d76bb3-f6c6-4540-b78e-b5a260302336 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.529833 Oct 31 14:13:34.551631 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1457/2675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.566640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6d5f4179-a994-4f28-8358-d0f368bb91f0 req-275dca3f-08f9-4dc8-9446-3fc82a7a5df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d8072b-22d5-4efb-a8f0-cbc64db7474b", "name": "network-vif-unplugged", "status": "completed", "tag": "aad909a1-be8f-4014-b4ee-a410a747fb4c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:34.571321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.586773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6d5f4179-a994-4f28-8358-d0f368bb91f0 req-275dca3f-08f9-4dc8-9446-3fc82a7a5df1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.587268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6d5f4179-a994-4f28-8358-d0f368bb91f0 req-275dca3f-08f9-4dc8-9446-3fc82a7a5df1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.587707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6d5f4179-a994-4f28-8358-d0f368bb91f0 req-275dca3f-08f9-4dc8-9446-3fc82a7a5df1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.589527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.599973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.600787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.601447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.603427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.604119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.604905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.623546 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6d5f4179-a994-4f28-8358-d0f368bb91f0 req-275dca3f-08f9-4dc8-9446-3fc82a7a5df1 service nova] Creating event network-vif-unplugged:aad909a1-be8f-4014-b4ee-a410a747fb4c for instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b on n-h2-863052-1 Oct 31 14:13:34.628680 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6d5f4179-a994-4f28-8358-d0f368bb91f0 req-275dca3f-08f9-4dc8-9446-3fc82a7a5df1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080429 Oct 31 14:13:34.629619 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1219/2676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:34.640859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.644651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.655723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.656214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.656652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.657897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.664176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.664724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.911664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.923157 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71439fa0-7346-4e07-8b2e-d1d376ac7e0c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.370358 Oct 31 14:13:34.941779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:34.942816 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1458/2677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.950575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.953154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.953842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e89084c-e25c-49aa-a303-4cddb734f37e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 200 len: 1513 microversion: 2.1 time: 0.322806 Oct 31 14:13:34.960119 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1220/2678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:34.962303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.963021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.963697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.964399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.964901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.965322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.982496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:34.982958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:34.989625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.990014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.990463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:34.991428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:34.991886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:34.992310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.050201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.050822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.051264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.053040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lazy-loading 'fault' on Instance uuid 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:13:35.133309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81d9c4b657d43bfb9d3d88c171a54ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84be206a0324a14bf3c77ec4e50f940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.135686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:35.144715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-716bea4e-33b4-4343-81b0-5324ce2be687 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 200 len: 1307 microversion: 2.1 time: 0.173161 Oct 31 14:13:35.145891 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1221/2679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:35.152241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:35.158239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.159725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:35.173563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.174370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.175061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.176331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.176649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.177286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.281012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.295693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:35.310808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a689be33-7f3a-4b0b-b751-e984193e0d7a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.348525 Oct 31 14:13:35.322926 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1459/2680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:34 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:35.328159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:35.328159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:35.348348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.349314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.351267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.353208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.356060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.357101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.396419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.403004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.403527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.403975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.591511 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e39f26b0-7377-48b6-823e-b1dddad0c671 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.443499 Oct 31 14:13:35.599537 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1222/2681] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:13:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:35.620018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:35.620969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:35.629022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.629740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.630574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.631499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.632156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.633008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.707970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.716607 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e1a70bb-e9e4-4a87-b8b4-6d345bda3541 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1276 microversion: 2.1 time: 0.115424 Oct 31 14:13:35.717207 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1223/2682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:35 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:35.732447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:35.733072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:35.741218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.741715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.742220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.742931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.743379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.743806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.883571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.891353 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6278924-b948-42a2-b5c1-d1b017261467 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1476 microversion: 2.1 time: 0.171892 Oct 31 14:13:35.891928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1224/2683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:35 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:35.896545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-247ee378-4819-4a6f-92f1-303f8687c850 req-7397715b-30f9-404f-b525-8d152bf124c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cc4318-5153-4651-ba90-0df7a8541800", "tag": "095d436c-a631-482e-b16e-f7db214f3648"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:35.902553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:35.906547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-247ee378-4819-4a6f-92f1-303f8687c850 req-7397715b-30f9-404f-b525-8d152bf124c9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.907722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-247ee378-4819-4a6f-92f1-303f8687c850 req-7397715b-30f9-404f-b525-8d152bf124c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.908159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-247ee378-4819-4a6f-92f1-303f8687c850 req-7397715b-30f9-404f-b525-8d152bf124c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.920160 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-247ee378-4819-4a6f-92f1-303f8687c850 req-7397715b-30f9-404f-b525-8d152bf124c9 service nova] Creating event network-changed:095d436c-a631-482e-b16e-f7db214f3648 for instance 93cc4318-5153-4651-ba90-0df7a8541800 on n-h1-863052-1 Oct 31 14:13:35.925787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-247ee378-4819-4a6f-92f1-303f8687c850 req-7397715b-30f9-404f-b525-8d152bf124c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 Oct 31 14:13:35.926432 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1225/2684] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:35.931796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:35.936953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:35.937804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-874148504', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:35.943206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.943898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.944222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.944962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:35.945424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:35.945856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:35.995506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:36.009919 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fff5d7b-ba42-427f-b7df-efe85f23dc33 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.694074 Oct 31 14:13:36.013383 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1460/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:35 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:36.017746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2558a6bb-6abd-46c6-9ab5-5645c87adad6 req-f17eb1c2-6951-4580-a711-2e296169056c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fa22d-4fa6-4d0d-94cd-3d6021d6bd88", "name": "network-vif-deleted", "tag": "d702e847-334c-469d-bc0c-103c6bbeb648"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:36.030271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2558a6bb-6abd-46c6-9ab5-5645c87adad6 req-f17eb1c2-6951-4580-a711-2e296169056c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.030870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2558a6bb-6abd-46c6-9ab5-5645c87adad6 req-f17eb1c2-6951-4580-a711-2e296169056c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.031398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2558a6bb-6abd-46c6-9ab5-5645c87adad6 req-f17eb1c2-6951-4580-a711-2e296169056c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.042825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:36.049019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2558a6bb-6abd-46c6-9ab5-5645c87adad6 req-f17eb1c2-6951-4580-a711-2e296169056c service nova] Creating event network-vif-deleted:d702e847-334c-469d-bc0c-103c6bbeb648 for instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 on n-h2-863052-1 Oct 31 14:13:36.054234 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2558a6bb-6abd-46c6-9ab5-5645c87adad6 req-f17eb1c2-6951-4580-a711-2e296169056c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040759 Oct 31 14:13:36.055218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1461/2686] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:36.062297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:36.063211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:36.078448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.079364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.079741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.080559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.081021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.081607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.122280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:36.128699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.129879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.129879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.399334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:36.411892 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c014311c-5a80-4524-8758-f46ee732a742 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.354788 Oct 31 14:13:36.418431 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1462/2687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:36 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:36.433258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:36.434679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] [instance: 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:36.444900 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f74554f-4725-49ef-8426-9a651d8fa4c6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-874148504" status: 200 len: 1515 microversion: 2.1 time: 0.517053 Oct 31 14:13:36.462260 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1226/2688] 10.222.0.27 () {58 vars in 1261 bytes} [Mon Oct 31 14:13:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-874148504 => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:36.462260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:36.462260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:36.462921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.462921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.462921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.462921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.462921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.462921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.463394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.463394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.463394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.463394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.463394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.463394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.484936 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] HTTP exception thrown: Instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 could not be found. Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Request method failure captured: Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 HTTP/1.1 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9dtJvBsCTSRAeZgMq2q5DZfAygJzlIsF6sMRIFyU8uT4-esSdGwSBglxGsTeboUF374ZdSI3-GX3VJYzcA1jnwSZ6ZY58SmgM2oeFynXHcZ1V9577aSia8NgITsGjGWgsXGClC44BGDu3uVmSYcjUZ66L-uOItoLbFIg9hMFhA8tJA Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c84be206a0324a14bf3c77ec4e50f940 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ListImageFiltersTestJSON-1517154764 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c84be206a0324a14bf3c77ec4e50f940", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c84be206a0324a14bf3c77ec4e50f940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c84be206a0324a14bf3c77ec4e50f940"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c84be206a0324a14bf3c77ec4e50f940"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ListImageFiltersTestJSON-1517154764 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c84be206a0324a14bf3c77ec4e50f940 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1517154764 Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ListImageFiltersTestJSON-1517154764-project Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c81d9c4b657d43bfb9d3d88c171a54ea Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ListImageFiltersTestJSON-1517154764-project Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 could not be found. Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '554fa22d-4fa6-4d0d-94cd-3d6021d6bd88'} Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 could not be found. Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 could not be found. Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:36.486816 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 could not be found. Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:36.491462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Returning 404 to user: Instance 554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:36.492031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c813911-171f-4123-accb-202b38929afd tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88" status: 404 len: 111 microversion: 2.1 time: 0.066071 Oct 31 14:13:36.496642 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1463/2689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:36 2022] GET /compute/v2.1/servers/554fa22d-4fa6-4d0d-94cd-3d6021d6bd88 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:36.501874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:36.507072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:36.508090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:36.514712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.515217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.515798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.517155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.517683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.518179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.629916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:36.708124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:36.734355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:36.734990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:36.735477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:36.939093 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6775eb15-59b6-43d4-8315-71fdbb3de2dc tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.440339 Oct 31 14:13:36.955368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1464/2690] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 31 14:13:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:36.977023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0d21b4b-17cd-40e2-816f-1b7f19ab2293 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe106d9dd30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:37.264581 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0d21b4b-17cd-40e2-816f-1b7f19ab2293 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/images/f109a740-fac7-487c-af12-b27f04b50101" status: 204 len: 0 microversion: 2.1 time: 0.307528 Oct 31 14:13:37.265318 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1465/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:36 2022] DELETE /compute/v2.1/images/f109a740-fac7-487c-af12-b27f04b50101 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:37.282788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:37.284836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:37.296945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.297438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.298464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.300694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.301320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.301756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.343971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:37.353530 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95f782ed-87be-40eb-8565-cd27fbce0322 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.906538 Oct 31 14:13:37.354114 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1227/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:36 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:37.359604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:37.360977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:37.367041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.367793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.368439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.369707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.370523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.371114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.617153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:37.625503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:37.626820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29a86bf8-9f5c-456b-8ea8-d0154c1e51c6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1475 microversion: 2.1 time: 0.270420 Oct 31 14:13:37.627705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1228/2693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:37 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1475 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:37.642092 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86a49fd5-3fe2-4af0-a2f4-99ccc3775295 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.373874 Oct 31 14:13:37.644522 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1466/2694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:37 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:37.648293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:37.651334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:37.652111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:37.656706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:37.658228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.servers [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Removing options 'limit' from query {{(pid=120641) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 14:13:37.659418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:37.666667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.667620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.668482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.669569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.669763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.670353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.670644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.671080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.671201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.672157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.672287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.673141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.714331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:37.721277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:37.721768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:37.722251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:37.857554 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0be1ff8a-de8b-48ea-911b-b10c9a687e20 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.228764 Oct 31 14:13:37.858429 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1229/2695] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:13:37 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:37.864467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb458569-6cd9-4546-ba66-2fe584a95724 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe107f728b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.112317 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb458569-6cd9-4546-ba66-2fe584a95724 tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/images/07943914-46ae-49f0-9f46-9b0387c2eb67" status: 204 len: 0 microversion: 2.1 time: 0.252646 Oct 31 14:13:38.113022 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1230/2696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:37 2022] DELETE /compute/v2.1/images/07943914-46ae-49f0-9f46-9b0387c2eb67 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:38.117793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.118455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:38.125310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.125847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.126315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.127121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.127598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.128027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.239945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.250152 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cadca6c7-8bac-4b93-bcda-fe4aca58c3d3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.603524 Oct 31 14:13:38.251008 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1467/2697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:37 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.262894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.262894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.262894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:38.267948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.268652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.269640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.270609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.271110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.271539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.275967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.285692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a9d84c27-0ab7-4e63-bcc6-2be732780a8c tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.171647 Oct 31 14:13:38.302699 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1231/2698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.306751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:38.307428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d0609f-9492-4513-9c47-3ad56a1ed00b", "tag": "b91b70ec-3ae1-41c4-a39e-ed4dde057310"}, {"server_uuid": "ac09d929-a71d-4ae1-8395-99a281a5b3a7", "name": "network-vif-unplugged", "status": "completed", "tag": "934b105d-4ebe-4255-b58c-a813f5992a2a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:38.318066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.318587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.319070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.342271 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Creating event network-changed:b91b70ec-3ae1-41c4-a39e-ed4dde057310 for instance 01d0609f-9492-4513-9c47-3ad56a1ed00b on n-h1-863052-1 Oct 31 14:13:38.343053 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Creating event network-vif-unplugged:934b105d-4ebe-4255-b58c-a813f5992a2a for instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 on n-h2-863052-1 Oct 31 14:13:38.343860 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65ce099c-663d-4785-afc2-8c751cabedbd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.091866 Oct 31 14:13:38.345083 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1468/2699] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.349982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-834dbf60-09bf-42d7-8763-258cd10a450c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] Calling method '.version_select at 0x7fe106e8c8b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.355798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:13:38.384435 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d2fe7cc9-323c-4365-8fdd-a1de02c87014 req-d0d68d88-f132-40e1-83d0-4fd81a5e74ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.080474 Oct 31 14:13:38.385664 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1232/2700] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:38.391273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.396238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.396742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.servers [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Removing options 'limit' from query {{(pid=120641) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 14:13:38.397568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:38.403587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.412031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.412667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.413556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.414264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.415328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.450338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:38.483632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a31d6064-f501-4dc2-b570-05d7e70f0f11 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.096373 Oct 31 14:13:38.484615 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1233/2701] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.490706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.494908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:38.506000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.506644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.507256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.508077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.508767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.509310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.654525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.664361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7133a833-bb6c-4092-a39b-640dfa34de9f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.178411 Oct 31 14:13:38.672040 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-834dbf60-09bf-42d7-8763-258cd10a450c tempest-ListImageFiltersTestJSON-1517154764 tempest-ListImageFiltersTestJSON-1517154764-project] 10.222.0.27 "DELETE /compute/v2.1/images/7afea0bc-5c04-4874-abab-6b63d04d10b8" status: 204 len: 0 microversion: 2.1 time: 0.321997 Oct 31 14:13:38.676350 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1234/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.676620 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1469/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:38 2022] DELETE /compute/v2.1/images/7afea0bc-5c04-4874-abab-6b63d04d10b8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:38.681325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.682071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:38.688470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.688958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.689589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.690312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.690771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.691313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.696574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.701521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.702555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:38.708614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.709248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.710025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.710853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.711305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.711726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.762048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:38.799871 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c09b8719-9727-4acc-bdc9-b2872bf26071 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.111362 Oct 31 14:13:38.809681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1235/2704] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers => generated 1010 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.815699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.816320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:38.823074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.823820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.824418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.825294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.825923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.826567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.930231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.938918 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-001f531c-97fb-4cb0-9a2f-0727a06f3d08 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1475 microversion: 2.1 time: 0.260703 Oct 31 14:13:38.946686 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1470/2705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:38.954467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:38.961402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.962103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:38.974791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.975276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.975710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.976443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:38.977038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:38.977899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:38.987808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:38.997864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1a6a21c-2d00-4830-a5d4-711e7b87200e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.186832 Oct 31 14:13:39.005135 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1236/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:39.073049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:39.137872 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97dbfbcf-36ec-466e-9bb6-551b21d2e506 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.189849 Oct 31 14:13:39.138669 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1471/2707] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:13:38 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:39.152064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.156916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:39.157386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.servers [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Removing options 'limit' from query {{(pid=120641) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 14:13:39.158027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:39.163144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.163618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.164044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.164760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.165205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.165618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.190715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00dcd57a-6756-4902-a886-3068fddf5fb7 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.042230 Oct 31 14:13:39.191214 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1237/2708] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:39.203666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.208970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:39.209641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-874148504', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:39.214797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.215285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.215718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.216429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.216888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.217311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.273395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.274009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:39.286101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.286842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.287544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.288427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.288963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.296944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.333705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:39.445907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:39.448359 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f33f10d4-a17b-44a6-ad9f-a78411d16294 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-874148504" status: 200 len: 345 microversion: 2.1 time: 0.248474 Oct 31 14:13:39.449529 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1472/2709] 10.222.0.27 () {58 vars in 1240 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-874148504 => generated 345 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:13:39.455843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.456790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:39.464100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.465099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.466200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.467520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.468236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.468881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.596976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:39.605211 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6da2d13f-646f-4253-84e0-24e080e0267e tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.335560 Oct 31 14:13:39.606503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1238/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:39.611916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6db4961-5e96-4425-bb3d-cd6f6a04ff19 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:39.618257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6db4961-5e96-4425-bb3d-cd6f6a04ff19 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.619220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6db4961-5e96-4425-bb3d-cd6f6a04ff19 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.619853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6db4961-5e96-4425-bb3d-cd6f6a04ff19 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.622891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:39.649243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6db4961-5e96-4425-bb3d-cd6f6a04ff19 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:13:39.698262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6db4961-5e96-4425-bb3d-cd6f6a04ff19 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "POST /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff/action" status: 202 len: 0 microversion: 2.1 time: 0.090064 Oct 31 14:13:39.699204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1239/2711] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:39 2022] POST /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:39.704913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.705700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:39.712416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.713101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.713622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.714549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.715183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.715668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.744279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:39.754796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e358ef0-5899-442c-b913-ae1fc2562088 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.303665 Oct 31 14:13:39.755385 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1473/2712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:39.760630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.761388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:39.774082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.775431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.775990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.776779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.777310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.777830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.873179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:39.886495 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68565ba4-1690-41e7-8797-99d96ac39056 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.185733 Oct 31 14:13:39.887628 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1240/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:39.963846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:39.965285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:39.979646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.980134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.980573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:39.981269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:39.981984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:39.982138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.102412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:40.114633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6f0d6a7-d6d8-4b8a-873a-2916f633c258 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.358077 Oct 31 14:13:40.116394 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1474/2714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:40.122379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:40.122992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:40.131677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.132169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.132608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.133484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.133917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.134541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.190036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:40.200451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea7f4cb0-0ce6-4087-83d8-e672cc0a44a4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1475 microversion: 2.1 time: 0.241546 Oct 31 14:13:40.201255 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1241/2715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:39 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1475 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:40.303574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:40.313049 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81ffd41b-1bb3-4070-8a8c-fa1e7d3d5583 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.194824 Oct 31 14:13:40.327179 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1475/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:40 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:40.463391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac09d929-a71d-4ae1-8395-99a281a5b3a7", "tag": "934b105d-4ebe-4255-b58c-a813f5992a2a"}, {"name": "network-changed", "server_uuid": "eecea86c-329f-445c-9538-c3cab17d0bde", "tag": "9f73e3de-ff4b-4d09-8389-6d6de3b296c7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:40.481127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.481633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.482085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.520734 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Creating event network-changed:934b105d-4ebe-4255-b58c-a813f5992a2a for instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 on n-h2-863052-1 Oct 31 14:13:40.521233 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Creating event network-changed:9f73e3de-ff4b-4d09-8389-6d6de3b296c7 for instance eecea86c-329f-445c-9538-c3cab17d0bde on n-h2-863052-1 Oct 31 14:13:40.528602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:13:40.544955 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-548df90a-c299-4dda-abc1-8535a03b1a69 req-613f8929-dbfa-4586-b9f7-5cb47ada1bd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088782 Oct 31 14:13:40.546282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1242/2717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:40.629457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:40.630384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:40.638187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.638874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.639533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.640504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.641101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.641709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.783171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:40.783886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:40.795844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.796350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.798740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.799471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.800342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.800781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.811843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:40.835602 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-849acf38-1ecc-4444-a672-a95af4d45119 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.207032 Oct 31 14:13:40.850214 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1476/2718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:40 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:40.909158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:40.909850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:40.917413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.918066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.918672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:40.919519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:40.920105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:40.920599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.057249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:41.065539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e25d80bc-e485-4a6b-b417-def62e0a3f15 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1498 microversion: 2.1 time: 0.160470 Oct 31 14:13:41.070205 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1477/2719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:40 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:41.142848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:41.143713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:41.150498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.150986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.151428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.152129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.152578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.153001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.186658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:41.196092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f9609f2-978a-44a1-9bf4-dc52c4b9ddd1 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1737 microversion: 2.1 time: 0.420766 Oct 31 14:13:41.196769 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1243/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:40 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1737 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:41.225909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:41.226878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:41.234119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.235005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.235669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.236366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.237347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.238081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.319893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:41.337600 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf0078e0-ac73-4ba2-a848-4a96822eccf3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.199390 Oct 31 14:13:41.342242 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1478/2721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:41 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:41.343160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:41.343761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:41.358906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.359538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.360206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.360905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.361352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.361771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.578000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:41.585961 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-deac33de-6d32-4489-90e5-5a8103738ddd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1475 microversion: 2.1 time: 0.365674 Oct 31 14:13:41.586891 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1244/2722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:41 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:41.597942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:41.607449 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae46978e-d766-4262-9dd3-bf2edef9709a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.267627 Oct 31 14:13:41.607964 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1479/2723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:41 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:41.864347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:41.865532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:41.876218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.878846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.879293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:41.880185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:41.881354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:41.881783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.089463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:42.090823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:42.106917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.107853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.108519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.109672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.110930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.113241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.410809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:42.429714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:42.431227 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32b14146-1ee6-49ad-9ae3-f3a9a109f529 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 200 len: 1475 microversion: 2.1 time: 0.344918 Oct 31 14:13:42.450803 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1480/2724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:42 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 1475 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:42.454913 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5bddf28-b126-41a6-b35e-c768d8eb5d13 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.594900 Oct 31 14:13:42.458100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1245/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:41 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:42.461960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:42.462974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:42.468823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:42.472669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:42.476589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:42.478659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.478925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.479364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.480866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.484276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.484952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.485864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.486859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.487747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.490778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.491240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.491669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.953055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:42.963020 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10b35acd-28b9-4f9f-8907-61b12f3b01b2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1717 microversion: 2.1 time: 0.511515 Oct 31 14:13:42.963983 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1481/2726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:42 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1717 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:42.968736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1814219491"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:42.972205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:42.979216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.979933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.980575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:42.981450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:42.982071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:42.982680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.201154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:43.212272 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf57c0d4-2bae-42fa-a6c6-dcd688aed221 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.753374 Oct 31 14:13:43.225113 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1246/2727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:42 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:43.231318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b2a28b9e-d3ba-4dd7-b7c7-450568dff4a4 req-f7ec95a9-6f88-4fd6-a248-8bb31fa7a764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d0609f-9492-4513-9c47-3ad56a1ed00b", "name": "network-vif-plugged", "status": "completed", "tag": "b91b70ec-3ae1-41c4-a39e-ed4dde057310"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:43.260370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b2a28b9e-d3ba-4dd7-b7c7-450568dff4a4 req-f7ec95a9-6f88-4fd6-a248-8bb31fa7a764 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.260864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b2a28b9e-d3ba-4dd7-b7c7-450568dff4a4 req-f7ec95a9-6f88-4fd6-a248-8bb31fa7a764 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.261302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b2a28b9e-d3ba-4dd7-b7c7-450568dff4a4 req-f7ec95a9-6f88-4fd6-a248-8bb31fa7a764 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.297065 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b2a28b9e-d3ba-4dd7-b7c7-450568dff4a4 req-f7ec95a9-6f88-4fd6-a248-8bb31fa7a764 service nova] Creating event network-vif-plugged:b91b70ec-3ae1-41c4-a39e-ed4dde057310 for instance 01d0609f-9492-4513-9c47-3ad56a1ed00b on n-h1-863052-1 Oct 31 14:13:43.312869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b2a28b9e-d3ba-4dd7-b7c7-450568dff4a4 req-f7ec95a9-6f88-4fd6-a248-8bb31fa7a764 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085090 Oct 31 14:13:43.314092 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1247/2728] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:43.323495 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acf8278a-9153-4083-bb2a-0196d6ccbb61 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3/action" status: 202 len: 0 microversion: 2.1 time: 0.358163 Oct 31 14:13:43.324015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:43.324440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1482/2729] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:42 2022] POST /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:13:43.324724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:43.329833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:43.330787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:43.331750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.332245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.332702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.333417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.333872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.334362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.352916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.353661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.354232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.355124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.355644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.356704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.514689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:43.536790 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d357138-e50b-4ada-968a-0d67efb6941b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.210867 Oct 31 14:13:43.550607 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1483/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:43 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:43.558130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:43.558672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:43.564949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.565444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.565918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.566868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.567347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.567775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.650430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Cannot 'detach_volume' instance 692cbab4-8865-401a-8f21-4d26f7607f58 while it is in vm_state rescued Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments/601ea56b-505c-412e-9248-017047aaf8dc HTTP/1.1 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot 'detach_volume' instance 692cbab4-8865-401a-8f21-4d26f7607f58 while it is in vm_state rescued Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': '692cbab4-8865-401a-8f21-4d26f7607f58', 'id': '601ea56b-505c-412e-9248-017047aaf8dc'} Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 692cbab4-8865-401a-8f21-4d26f7607f58 while it is in vm_state rescued Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:43.652196 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 692cbab4-8865-401a-8f21-4d26f7607f58 while it is in vm_state rescued Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 409 to user: Cannot 'detach_volume' instance 692cbab4-8865-401a-8f21-4d26f7607f58 while it is in vm_state rescued {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:43.656717 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a136766a-04c1-4a95-9db9-377778a4d812 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments/601ea56b-505c-412e-9248-017047aaf8dc" status: 409 len: 152 microversion: 2.1 time: 0.101971 Oct 31 14:13:43.658194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1484/2731] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:13:43 2022] DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments/601ea56b-505c-412e-9248-017047aaf8dc => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:13:43.662816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e118f616-4fce-490b-a1b3-5bb5548c7b6d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fb58790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:43.714325 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e118f616-4fce-490b-a1b3-5bb5548c7b6d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.054960 Oct 31 14:13:43.715132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1485/2732] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:43 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:43.720348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:43.720966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:43.727132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.727628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.728068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.728768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.729231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.729671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.786965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:43.795945 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-292abd89-8c8f-4503-85a4-8554cf609589 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1473 microversion: 2.1 time: 0.480490 Oct 31 14:13:43.796973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1248/2733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:43 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:43.805384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:43.806443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:43.832450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.834403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.835198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.836158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.837506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.838958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.876425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:43.886341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28c471ac-5948-4e9d-bc5f-49b095925649 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.170129 Oct 31 14:13:43.887942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1486/2734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:43 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:43.962418 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d9a2176-a8b1-42f9-b5b4-f125b52aff21 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/action" status: 202 len: 0 microversion: 2.1 time: 0.163901 Oct 31 14:13:43.963729 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1249/2735] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:43 2022] POST /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:13:43.972416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:43.973255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:43.979774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.980494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.980923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:43.981791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:43.982583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:43.983788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:44.126201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:44.139329 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-519bd236-edfb-42ef-9ba5-199ecb782953 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1725 microversion: 2.1 time: 0.171469 Oct 31 14:13:44.140396 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1487/2736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:43 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:44.244324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:44.247765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:44.262024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:44.263404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:44.264167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:44.265828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:44.266833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:44.268182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:44.564107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:44.564687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:44.580720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:44.581240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:44.581690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:44.582619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:44.583089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:44.583527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:44.822819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:44.834795 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a77598e-bc95-413b-b7a4-80c91dc32b6f tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.601397 Oct 31 14:13:44.835404 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1250/2737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:44 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:44.844126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f440b65-7c83-456b-ac67-d30a6590de38 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107903820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:44.928820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f440b65-7c83-456b-ac67-d30a6590de38 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.091304 Oct 31 14:13:44.936262 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1251/2738] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:44 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:44.942282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:44.952197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:44.968621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:44.969173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:44.969652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:44.970445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:44.970904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:44.973524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.058833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:45.074770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acafe4a6-f132-4103-adcb-9674e4b00395 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.514375 Oct 31 14:13:45.075995 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1488/2739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:44 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:45.082808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:45.083644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:45.093757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.094787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.095421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.096303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.098150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.098791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.132790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:45.323994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:45.334820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35078f4f-63ab-4b0d-95a5-fc8adffe3f9f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1470 microversion: 2.1 time: 0.396449 Oct 31 14:13:45.335779 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1252/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:44 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:45.363971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:45.364593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:45.383781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.384275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.384948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.385671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.386123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.386735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.454392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:45.462595 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1c2396b-357f-46ac-8b90-88a2e3c386b9 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1318 microversion: 2.1 time: 0.384666 Oct 31 14:13:45.467483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1489/2741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:45 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:45.472551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-823c025b-3236-45e5-bfe3-afd191d92256 req-53093c8b-c483-4cdd-9496-28ed3f369058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc4318-5153-4651-ba90-0df7a8541800", "name": "network-vif-plugged", "status": "completed", "tag": "095d436c-a631-482e-b16e-f7db214f3648"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:45.501794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-823c025b-3236-45e5-bfe3-afd191d92256 req-53093c8b-c483-4cdd-9496-28ed3f369058 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.502325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-823c025b-3236-45e5-bfe3-afd191d92256 req-53093c8b-c483-4cdd-9496-28ed3f369058 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.502768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-823c025b-3236-45e5-bfe3-afd191d92256 req-53093c8b-c483-4cdd-9496-28ed3f369058 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.534673 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-823c025b-3236-45e5-bfe3-afd191d92256 req-53093c8b-c483-4cdd-9496-28ed3f369058 service nova] Creating event network-vif-plugged:095d436c-a631-482e-b16e-f7db214f3648 for instance 93cc4318-5153-4651-ba90-0df7a8541800 on n-h1-863052-1 Oct 31 14:13:45.552050 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-823c025b-3236-45e5-bfe3-afd191d92256 req-53093c8b-c483-4cdd-9496-28ed3f369058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083194 Oct 31 14:13:45.552673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1490/2742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:45.559117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:45.560146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:45.568303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.569730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.570683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.571698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.572321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.573147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.712541 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd5542bb-ebe6-43d7-b05a-6432dcf3a850 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7/action" status: 204 len: 0 microversion: 2.1 time: 0.157803 Oct 31 14:13:45.713568 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1491/2743] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:13:45 2022] POST /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7/action => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:45.724424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:45.725824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:45.738484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.739523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.741738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.742933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.744521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.746159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.872050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:45.884417 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f2ca0fe-5c6c-490b-b05e-63096c34098d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1725 microversion: 2.1 time: 0.534577 Oct 31 14:13:45.885746 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1253/2744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:45 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1725 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:45.890581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:45.891972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:45.898874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.899604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.900196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:45.901062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:45.901661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:45.902302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.059569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:46.069650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9076b6d0-1dc9-4138-95f7-5fcf91bbe051 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1470 microversion: 2.1 time: 0.351161 Oct 31 14:13:46.083041 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1492/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:45 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:46.089236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74a9ffba-3d7a-4155-badd-f207285e3f06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fac7280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:46.150261 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74a9ffba-3d7a-4155-badd-f207285e3f06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.065297 Oct 31 14:13:46.151090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1493/2746] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:46 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:46.163831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:46.164450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:46.171658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.172152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.173127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.173837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.174331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.174760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.329136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:46.336931 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c437b127-4f76-43d9-ae27-bab1a542f7a2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.176910 Oct 31 14:13:46.350577 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1494/2747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:46 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:46.512852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:46.513839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:46.533177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.534312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.534760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.537577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.538249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.539982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.702389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:46.718131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:46.730003 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2e4e3016-f5a8-44c2-b226-b86cd376b8c5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.842882 Oct 31 14:13:46.731396 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1254/2748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:45 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:46.742161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:46.752398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1cacea7-87cf-4317-9991-0fdfa943bea3 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1507 microversion: 2.1 time: 0.271189 Oct 31 14:13:46.755594 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1495/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:46 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:46.778313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:46.779031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:46.788012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.788556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.788990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.793496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.794198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.794787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.922132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:46.926712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:46.948039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.951976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.952615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:46.957998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:46.962092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:46.964596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.096995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:47.110568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:47.117705 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9cb1c215-a7e7-443d-82d7-8ad6139214f5 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1507 microversion: 2.1 time: 0.343497 Oct 31 14:13:47.121448 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1255/2750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:46 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:47.148703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:47.151729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:47.164560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.165126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.165810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.175644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.176428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.177962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.262472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:47.279963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d536dec-b6c7-4582-813d-3fb8ed84fba4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1725 microversion: 2.1 time: 0.369538 Oct 31 14:13:47.281698 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1496/2751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:46 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1725 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:47.290502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:47.294745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:47.304583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.305727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.306600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.307358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.307923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.308353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.424476 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83843a5e-a515-4487-8d6e-f02d2e168a94 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "PUT /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1079 microversion: 2.1 time: 0.140935 Oct 31 14:13:47.434276 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1497/2752] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:13:47 2022] PUT /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1079 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:47.434866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-064ed37f-91ea-4281-9ede-203c4a542d77 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1076c91f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:47.492947 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-064ed37f-91ea-4281-9ede-203c4a542d77 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.065140 Oct 31 14:13:47.494703 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1498/2753] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:47 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:47.508270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:47.509096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:47.518281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.519066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.519660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.521379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.522614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.523240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.711056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:47.722750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:47.732278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77bf0387-f0bf-4739-8259-b9185acfb15b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1470 microversion: 2.1 time: 0.609437 Oct 31 14:13:47.739256 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1256/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:47 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1470 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:47.746074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:47.757630 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1549268e-4c2f-416e-aeae-da47f82b042b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.261635 Oct 31 14:13:47.766571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:47.767621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:47.782814 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1499/2755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:47 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:47.783372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.783870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.784312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.785241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.785471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.785917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.806688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:47.809772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:47.835009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.835970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.836770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:47.838015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:47.838965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:47.840040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.253161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:48.262796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8bed51fa-028b-4cc8-aacb-63f2ca51042e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.478381 Oct 31 14:13:48.279553 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1500/2756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:47 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:48.279553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-650dbb94-54d9-4410-8afe-fa46df1b5cc8 req-09d734e7-dcc7-4b2e-8d9b-6944ff1bdcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecea86c-329f-445c-9538-c3cab17d0bde", "name": "network-vif-plugged", "status": "completed", "tag": "9f73e3de-ff4b-4d09-8389-6d6de3b296c7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:48.284065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-650dbb94-54d9-4410-8afe-fa46df1b5cc8 req-09d734e7-dcc7-4b2e-8d9b-6944ff1bdcc9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.284065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-650dbb94-54d9-4410-8afe-fa46df1b5cc8 req-09d734e7-dcc7-4b2e-8d9b-6944ff1bdcc9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.284065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-650dbb94-54d9-4410-8afe-fa46df1b5cc8 req-09d734e7-dcc7-4b2e-8d9b-6944ff1bdcc9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.299284 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-650dbb94-54d9-4410-8afe-fa46df1b5cc8 req-09d734e7-dcc7-4b2e-8d9b-6944ff1bdcc9 service nova] Creating event network-vif-plugged:9f73e3de-ff4b-4d09-8389-6d6de3b296c7 for instance eecea86c-329f-445c-9538-c3cab17d0bde on n-h2-863052-1 Oct 31 14:13:48.306777 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-650dbb94-54d9-4410-8afe-fa46df1b5cc8 req-09d734e7-dcc7-4b2e-8d9b-6944ff1bdcc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040623 Oct 31 14:13:48.312125 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1501/2757] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:48.323714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:48.325442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:48.336870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.338501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.338955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.342079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.342795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.343237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.556044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:48.570429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-860230bd-3c49-4deb-a589-7cfc259662ad tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1505 microversion: 2.1 time: 0.827667 Oct 31 14:13:48.571053 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1257/2758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:47 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:48.588634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-beced1e4-78aa-4cab-ac19-81c4092efb0b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107dd38b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:48.675056 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-beced1e4-78aa-4cab-ac19-81c4092efb0b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.102930 Oct 31 14:13:48.675649 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1258/2759] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:48 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:48.686969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:48.687599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:48.705604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.706103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.706612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.707477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.708015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.708662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.798871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:48.809952 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cdeeddf2-6927-4d7b-bafe-71c843d69869 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1731 microversion: 2.1 time: 0.496546 Oct 31 14:13:48.811680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1502/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:48 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1731 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:48.817808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:48.818723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:48.825713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.826436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.827029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:48.827909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:48.828519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:48.829138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.041834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:49.051357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fd51d2a-0ed2-4a18-9da4-41e5b88d4e0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1470 microversion: 2.1 time: 0.238207 Oct 31 14:13:49.052384 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1503/2761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:48 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:49.059846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:49.060489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:49.086831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.087327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.094979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.096048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.096541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.096988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.170819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:49.208316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:49.226745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2386aa16-0c40-4a41-8aee-cc78a3070833 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1505 microversion: 2.1 time: 0.545714 Oct 31 14:13:49.227986 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1259/2762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:48 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:49.244511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=14 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:49.250517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:49.262147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:49.277302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.282495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.288352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.290455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.297335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.297989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.398570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:49.413318 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3e444b7-a185-4432-bf56-a3e7a7d04730 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1318 microversion: 2.1 time: 0.359569 Oct 31 14:13:49.413912 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1504/2763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:49 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:49.437467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:49.446957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:49.452931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.453426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.454657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.455364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.455956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.456446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.462241 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d6f49a5-9628-4639-ad11-68760c6204a0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232596 Oct 31 14:13:49.462951 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1260/2764] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:13:49 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:49.467519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:49.468432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:49.480330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.484982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.485476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.486253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.486719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.487141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.590783 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e054e0e9-7b27-4f3e-87ef-7c37484a8589 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "PUT /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1081 microversion: 2.1 time: 0.175162 Oct 31 14:13:49.591830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1505/2765] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:13:49 2022] PUT /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1081 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:49.610088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:49.610736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:49.617834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.618379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.618825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.619838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:49.620296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:49.620717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:49.979600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:49.985515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:49.989282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:49.993203 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d585bd66-a022-4c18-964b-2f8e3cf9703c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.529127 Oct 31 14:13:49.997421 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1261/2766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:49 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:50.001564 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d765d76d-3f2c-4f13-956e-9e7ab99a5462 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1507 microversion: 2.1 time: 0.393146 Oct 31 14:13:50.002320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1506/2767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:49 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:50.026308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f30234b-a42c-4608-b02b-03e3f8c60e8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1079e70d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:50.033700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:50.034806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:50.050729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.051565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.054406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.055307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.055867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.056552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.123250 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f30234b-a42c-4608-b02b-03e3f8c60e8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.123288 Oct 31 14:13:50.132686 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1262/2768] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:49 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:50.147580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:50.148206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:50.211045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.211592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.211989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.218587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.219313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.219766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.689676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:50.700088 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31181860-eb25-49cd-ae83-7f77c17ac7e0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1470 microversion: 2.1 time: 0.565478 Oct 31 14:13:50.700747 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1263/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:50 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1470 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:50.705989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d4f7259e-9c1b-4415-94db-f8c459119617 req-d277fbd4-500f-43c6-a27e-f2411116ead1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd0646-c655-4849-88ee-7314178eebc3", "name": "network-vif-plugged", "status": "completed", "tag": "8dee12a1-38ae-4b8a-b790-6c8e7d2d073f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:50.753657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:50.762084 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef90e1cd-6e0b-4b65-a198-110702c965d7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1507 microversion: 2.1 time: 0.733613 Oct 31 14:13:50.767898 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1507/2770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:50 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1507 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:50.771283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d4f7259e-9c1b-4415-94db-f8c459119617 req-d277fbd4-500f-43c6-a27e-f2411116ead1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.774009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d4f7259e-9c1b-4415-94db-f8c459119617 req-d277fbd4-500f-43c6-a27e-f2411116ead1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.780039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d4f7259e-9c1b-4415-94db-f8c459119617 req-d277fbd4-500f-43c6-a27e-f2411116ead1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.784087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:50.788387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:50.820700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.821202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.821641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.822392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.822846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.823274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.830969 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d4f7259e-9c1b-4415-94db-f8c459119617 req-d277fbd4-500f-43c6-a27e-f2411116ead1 service nova] Creating event network-vif-plugged:8dee12a1-38ae-4b8a-b790-6c8e7d2d073f for instance e8cd0646-c655-4849-88ee-7314178eebc3 on n-h1-863052-1 Oct 31 14:13:50.839882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d4f7259e-9c1b-4415-94db-f8c459119617 req-d277fbd4-500f-43c6-a27e-f2411116ead1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137744 Oct 31 14:13:50.841123 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1264/2771] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:50.851484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:50.854010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:50.862835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.863633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.865013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.865980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:50.866853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:50.868184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:50.943934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:13:51.162544 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0014c9e9-d543-404d-8369-6d57c0dcc4e7 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 204 len: 0 microversion: 2.1 time: 0.316809 Oct 31 14:13:51.170722 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1265/2772] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:50 2022] DELETE /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:51.182143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:51.183230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:51.195060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.195280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:51.196629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.197250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.198479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.199427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.200007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.204124 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f0ecc50-bebc-4949-88f6-278c35e87f8a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1468 microversion: 2.1 time: 0.435103 Oct 31 14:13:51.215711 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1508/2773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:50 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1468 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:51.232540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20ff9744-e6cb-4d94-898f-2fdb03062c1c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107c7d670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:51.340584 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20ff9744-e6cb-4d94-898f-2fdb03062c1c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.129085 Oct 31 14:13:51.346340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1509/2774] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:51 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:51.358712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:51.360580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:51.374217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.375153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.375822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.376833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.377479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.378091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.420646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:13:51.475533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:51.486520 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02b3aa00-6a7d-4a07-941b-d09be690e485 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.318714 Oct 31 14:13:51.493633 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1266/2775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:51 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:51.498756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:51.499369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:51.510797 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Instance is already in deleting state, ignoring this request Oct 31 14:13:51.511730 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dedeb49f-ad3d-4395-a3d2-a0f0695c339b tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 204 len: 0 microversion: 2.1 time: 0.163972 Oct 31 14:13:51.523248 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1510/2776] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:51 2022] DELETE /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:13:51.527373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.527871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.528309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.529343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.529461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.529869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.773574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90e05fd8-35c5-474d-bb1f-e33ed89cd1d7 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Action: 'create', calling method: .version_select at 0x7fe1077b80d0>, body: {"keypair": {"name": "tempest-keypair-1320855171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOUdOMnAHqfAmIdXxrkoVo9Ut6Qp2uzXmZnvOt+ta+uozd9sJtUWS6WptHsGITi2NioilCNdvlybJMOnHPDOs/J2x8FGV7cyyzbzAFrNdsdkcSuR6soZzM7oXHXHNsGZg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:51.815748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-90e05fd8-35c5-474d-bb1f-e33ed89cd1d7 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Getting quotas for project a6782805032845bc8ef132fedc3bf720. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:51.833860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-90e05fd8-35c5-474d-bb1f-e33ed89cd1d7 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Getting quotas for user a9746fac207c4c9b9957107b6da3a6a3 and project a6782805032845bc8ef132fedc3bf720. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:51.866816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:51.877628 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02d442e4-9de7-46b8-8700-1ce74d8351f7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 200 len: 1468 microversion: 2.1 time: 0.382557 Oct 31 14:13:51.878240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1267/2777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:51 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:51.891733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:51.895094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:51.910718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.911710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.912315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.913288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.913905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.918514 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90e05fd8-35c5-474d-bb1f-e33ed89cd1d7 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.394017 Oct 31 14:13:51.937518 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1511/2778] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:13:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:51.942378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.954028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:51.955787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:51.984678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.993023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.993765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:51.994975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:51.995606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:51.997416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:52.351981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:52.368885 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fc74178-0a98-401a-b049-4104b1e80502 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1462 microversion: 2.1 time: 0.428255 Oct 31 14:13:52.371993 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1512/2779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:51 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1462 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:52.393431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:52.415812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:52.419648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Searching by: {'reservation_id': 'r-xgrw6sfr', 'deleted': False, 'project_id': '8fadd213d9f34565a0cf36487701aea2'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:13:52.420931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:52.431309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb50ed8e-1b42-41a9-a20f-020e67327158 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1513 microversion: 2.1 time: 0.551379 Oct 31 14:13:52.432088 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1268/2780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:51 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1513 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:52.435207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:52.440292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:52.441496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:52.444776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:52.446723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:52.451582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:52.457850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-59489124-c48c-4429-b5a9-b7aa34c4c754 req-745ef90e-eb8b-40a7-8f5e-dd30dda66d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692cbab4-8865-401a-8f21-4d26f7607f58", "tag": "0296bd5e-8bc5-4e14-bf85-884f06420d0e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:52.487730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-59489124-c48c-4429-b5a9-b7aa34c4c754 req-745ef90e-eb8b-40a7-8f5e-dd30dda66d82 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:52.490784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-59489124-c48c-4429-b5a9-b7aa34c4c754 req-745ef90e-eb8b-40a7-8f5e-dd30dda66d82 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:52.491784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-59489124-c48c-4429-b5a9-b7aa34c4c754 req-745ef90e-eb8b-40a7-8f5e-dd30dda66d82 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:52.535688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-59489124-c48c-4429-b5a9-b7aa34c4c754 req-745ef90e-eb8b-40a7-8f5e-dd30dda66d82 service nova] Creating event network-changed:0296bd5e-8bc5-4e14-bf85-884f06420d0e for instance 692cbab4-8865-401a-8f21-4d26f7607f58 on n-h2-863052-1 Oct 31 14:13:52.549637 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-59489124-c48c-4429-b5a9-b7aa34c4c754 req-745ef90e-eb8b-40a7-8f5e-dd30dda66d82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112183 Oct 31 14:13:52.552123 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1269/2781] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:52.567690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff56485d-6b79-4432-9646-0926ee50854d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1079b9af0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:52.709483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff56485d-6b79-4432-9646-0926ee50854d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.155766 Oct 31 14:13:52.711004 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1270/2782] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:52 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:52.715624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:52.716553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:52.727185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:52.728277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:52.728962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:52.731762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:52.733092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:52.734448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:52.822994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:13:53.088479 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35c5bf1b-423f-4b84-bc0d-26c1d7450acc tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1613 microversion: 2.1 time: 0.376246 Oct 31 14:13:53.090841 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1271/2783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:52 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1613 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:53.102785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:53.103640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:53.122331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:53.123319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:53.123938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:53.125526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:53.126321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:53.126918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:53.136619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:53.165284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:53.171470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:53.174814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:53.724918 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0123886f-605a-41f9-9693-75764472249b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-xgrw6sfr" status: 200 len: 2929 microversion: 2.1 time: 1.348718 Oct 31 14:13:53.725538 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1513/2784] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 31 14:13:52 2022] GET /compute/v2.1/servers/detail?reservation_id=r-xgrw6sfr => generated 2929 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:53.743219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c844b4a1-ffbb-4083-a9fd-75529d6bc709 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '.version_select at 0x7fe107d6d550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:53.750332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c844b4a1-ffbb-4083-a9fd-75529d6bc709 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:53.752254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c844b4a1-ffbb-4083-a9fd-75529d6bc709 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:53.752855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c844b4a1-ffbb-4083-a9fd-75529d6bc709 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:53.769730 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c844b4a1-ffbb-4083-a9fd-75529d6bc709 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.043190 Oct 31 14:13:53.793717 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1514/2785] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:13:53 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:53.831610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fd20e706-0c21-4742-a5af-e196c3b29edc req-4f5210e0-171b-4867-93eb-319fb885b5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac09d929-a71d-4ae1-8395-99a281a5b3a7", "name": "network-vif-plugged", "status": "completed", "tag": "934b105d-4ebe-4255-b58c-a813f5992a2a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:53.895651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fd20e706-0c21-4742-a5af-e196c3b29edc req-4f5210e0-171b-4867-93eb-319fb885b5de service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:53.896673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fd20e706-0c21-4742-a5af-e196c3b29edc req-4f5210e0-171b-4867-93eb-319fb885b5de service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:53.898538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fd20e706-0c21-4742-a5af-e196c3b29edc req-4f5210e0-171b-4867-93eb-319fb885b5de service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:53.912954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:53.923009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f1941da-6ccb-4ce4-80a9-f4faec951d9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.827165 Oct 31 14:13:53.929750 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1272/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:53 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:53.935020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:53.972515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:53.982579 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fd20e706-0c21-4742-a5af-e196c3b29edc req-4f5210e0-171b-4867-93eb-319fb885b5de service nova] Creating event network-vif-plugged:934b105d-4ebe-4255-b58c-a813f5992a2a for instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 on n-h2-863052-1 Oct 31 14:13:54.001033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.002099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.006095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.006687 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fd20e706-0c21-4742-a5af-e196c3b29edc req-4f5210e0-171b-4867-93eb-319fb885b5de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206614 Oct 31 14:13:54.007181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.007759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.009503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.015317 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1515/2787] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:54.025779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa034be3-4fb7-45f6-8dcb-06a2da8aeee5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe106eab4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:54.165414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa034be3-4fb7-45f6-8dcb-06a2da8aeee5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.144445 Oct 31 14:13:54.165808 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1516/2788] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:54 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:54.181590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85a6ff11-d71d-44df-a048-3937786a40b8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:54.225738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_groups [None req-85a6ff11-d71d-44df-a048-3937786a40b8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Querying cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) for 2 instances {{(pid=120640) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 14:13:54.226508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a6ff11-d71d-44df-a048-3937786a40b8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.231995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a6ff11-d71d-44df-a048-3937786a40b8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.232457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a6ff11-d71d-44df-a048-3937786a40b8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.280399 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85a6ff11-d71d-44df-a048-3937786a40b8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/431848c5-29cc-4b3f-ac54-018d6815c5df" status: 200 len: 271 microversion: 2.1 time: 0.112924 Oct 31 14:13:54.280929 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1517/2789] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:13:54 2022] GET /compute/v2.1/os-server-groups/431848c5-29cc-4b3f-ac54-018d6815c5df => generated 271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:54.296805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5f5da753-a78d-448d-9d77-9fa9fcb8a4d1 req-545b3266-3fdf-4596-b0c0-bb3a4b25ba38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d0609f-9492-4513-9c47-3ad56a1ed00b", "name": "network-vif-deleted", "tag": "b91b70ec-3ae1-41c4-a39e-ed4dde057310"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:54.326839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79995efa070844cf94985c291b8388b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0bd0633fab41348c29a69aebb7b069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:54.338762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5746cada-55e2-4653-be6a-5524fc44d7a2 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 200 len: 1303 microversion: 2.1 time: 0.407509 Oct 31 14:13:54.339352 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1273/2790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:53 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 1303 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:54.341862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f5da753-a78d-448d-9d77-9fa9fcb8a4d1 req-545b3266-3fdf-4596-b0c0-bb3a4b25ba38 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.344386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f5da753-a78d-448d-9d77-9fa9fcb8a4d1 req-545b3266-3fdf-4596-b0c0-bb3a4b25ba38 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.347327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f5da753-a78d-448d-9d77-9fa9fcb8a4d1 req-545b3266-3fdf-4596-b0c0-bb3a4b25ba38 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.357458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-902957042", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:54.383025 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5f5da753-a78d-448d-9d77-9fa9fcb8a4d1 req-545b3266-3fdf-4596-b0c0-bb3a4b25ba38 service nova] Creating event network-vif-deleted:b91b70ec-3ae1-41c4-a39e-ed4dde057310 for instance 01d0609f-9492-4513-9c47-3ad56a1ed00b on n-h1-863052-1 Oct 31 14:13:54.404906 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5f5da753-a78d-448d-9d77-9fa9fcb8a4d1 req-545b3266-3fdf-4596-b0c0-bb3a4b25ba38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120535 Oct 31 14:13:54.405681 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1518/2791] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:54.418898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:54.419616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:54.445384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.455854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.456471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.457440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.458043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.458644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.493851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:54.771237 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-880004bb-653c-45db-a07e-be3280a74f44 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 200 len: 1619 microversion: 2.1 time: 0.359448 Oct 31 14:13:54.786329 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1519/2792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:54 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 1619 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:54.792889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f8b30ae1-b71f-405a-bd89-e1fe849565fe req-dfd241d4-3e85-4c9b-8014-62b042060e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692cbab4-8865-401a-8f21-4d26f7607f58", "tag": "0296bd5e-8bc5-4e14-bf85-884f06420d0e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:54.809451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f8b30ae1-b71f-405a-bd89-e1fe849565fe req-dfd241d4-3e85-4c9b-8014-62b042060e38 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.810255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f8b30ae1-b71f-405a-bd89-e1fe849565fe req-dfd241d4-3e85-4c9b-8014-62b042060e38 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.810945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f8b30ae1-b71f-405a-bd89-e1fe849565fe req-dfd241d4-3e85-4c9b-8014-62b042060e38 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.832456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f8b30ae1-b71f-405a-bd89-e1fe849565fe req-dfd241d4-3e85-4c9b-8014-62b042060e38 service nova] Creating event network-changed:0296bd5e-8bc5-4e14-bf85-884f06420d0e for instance 692cbab4-8865-401a-8f21-4d26f7607f58 on n-h2-863052-1 Oct 31 14:13:54.839305 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f8b30ae1-b71f-405a-bd89-e1fe849565fe req-dfd241d4-3e85-4c9b-8014-62b042060e38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050992 Oct 31 14:13:54.840801 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1520/2793] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:13:54.847628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:54.848844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:54.857949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.859048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.859676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:54.860853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:54.861546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:54.862152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.193903 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f9d0117-7c8f-4b67-b59c-85ebfb0e4921 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 200 len: 1619 microversion: 2.1 time: 0.350153 Oct 31 14:13:55.209116 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1521/2794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:54 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 1619 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:55.241183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:55.242360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:55.269563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.272570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.273160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.277248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.279360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.280454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.550607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:55.551190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:55.551486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:55.551892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:55.552302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:55.559260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:55.577167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.577678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.578123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.579487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.579945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.580371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.605103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:55.616727 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-193ac8c8-83cd-4959-a754-8fe2dc6649ae tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.401104 Oct 31 14:13:55.627995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:55.638995 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1522/2795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:55 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:55.645253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for user 4d15f804765e48e3a279a902cde38dec and project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:55.656103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18ad43a7-eb86-4936-8285-9e743d5bf946 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078265e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:55.673614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:55.678715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:55.726037 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18ad43a7-eb86-4936-8285-9e743d5bf946 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.085840 Oct 31 14:13:55.727244 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1523/2796] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:55 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:55.732868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:55.733661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: 01d0609f-9492-4513-9c47-3ad56a1ed00b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:55.740188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.740946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.741604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.743275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.743897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.744750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.778751 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] HTTP exception thrown: Instance 01d0609f-9492-4513-9c47-3ad56a1ed00b could not be found. Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Request method failure captured: Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b HTTP/1.1 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9d4aXwFPcDjLFH913ZozU7zw92xHDS5TWaZUlCh1DYigTtS03LUxtuUyYSn14RpJ2zRDfNeMIYb890g-ck0cQ0lg8f7fiV5sZqzNYOXbBGbLWCKV0YkoC3fknEBGapc59FjXtRBQs9Xfkb0Y5ZmxETNHD1oyMTCtMpPQoj4FL6cigY Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd0bd0633fab41348c29a69aebb7b069", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 79995efa070844cf94985c291b8388b7 Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 01d0609f-9492-4513-9c47-3ad56a1ed00b could not be found. Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '01d0609f-9492-4513-9c47-3ad56a1ed00b'} Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d0609f-9492-4513-9c47-3ad56a1ed00b could not be found. Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d0609f-9492-4513-9c47-3ad56a1ed00b could not be found. Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:55.780949 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d0609f-9492-4513-9c47-3ad56a1ed00b could not be found. Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.785011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Returning 404 to user: Instance 01d0609f-9492-4513-9c47-3ad56a1ed00b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:55.785850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04fbf9bb-a5e9-420e-aaae-68a9721d272f tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b" status: 404 len: 111 microversion: 2.1 time: 0.055271 Oct 31 14:13:55.789301 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1524/2797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:55 2022] GET /compute/v2.1/servers/01d0609f-9492-4513-9c47-3ad56a1ed00b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:55.795947 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d054a050-07cf-4541-8db6-98078e471c7c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452682 Oct 31 14:13:55.797073 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1274/2798] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:55.804330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:55.805598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-958884730", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3a5f08e7-abcf-4dac-baf3-4b84313cf486"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:55.810381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:55.831964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.839130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.849951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.850916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:55.851542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:55.852503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:55.879863 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] HTTP exception thrown: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Request method failure captured: Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b HTTP/1.1 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9d4aXwFPcDjLFH913ZozU7zw92xHDS5TWaZUlCh1DYigTtS03LUxtuUyYSn14RpJ2zRDfNeMIYb890g-ck0cQ0lg8f7fiV5sZqzNYOXbBGbLWCKV0YkoC3fknEBGapc59FjXtRBQs9Xfkb0Y5ZmxETNHD1oyMTCtMpPQoj4FL6cigY Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd0bd0633fab41348c29a69aebb7b069", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 79995efa070844cf94985c291b8388b7 Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f5d8072b-22d5-4efb-a8f0-cbc64db7474b'} Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:55.892042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:55.896402 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:55.898625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Returning 404 to user: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:55.899608 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69a5bac7-0776-43c1-85e5-13896d0c0ed8 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 404 len: 111 microversion: 2.1 time: 0.100770 Oct 31 14:13:55.900103 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1275/2799] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:55 2022] DELETE /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:55.906726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20afde4b-3828-4342-a7e5-437fd944c1d8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:55.913464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20afde4b-3828-4342-a7e5-437fd944c1d8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:55.923220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:56.053286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20afde4b-3828-4342-a7e5-437fd944c1d8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:56.061081 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20afde4b-3828-4342-a7e5-437fd944c1d8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1212 microversion: 2.1 time: 0.159537 Oct 31 14:13:56.066860 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1276/2800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:55 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1212 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:56.071908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:56.074891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: f5d8072b-22d5-4efb-a8f0-cbc64db7474b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:56.089874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.092710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.093156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.093886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.099540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.100009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.131810 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] HTTP exception thrown: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Request method failure captured: Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b HTTP/1.1 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9d4aXwFPcDjLFH913ZozU7zw92xHDS5TWaZUlCh1DYigTtS03LUxtuUyYSn14RpJ2zRDfNeMIYb890g-ck0cQ0lg8f7fiV5sZqzNYOXbBGbLWCKV0YkoC3fknEBGapc59FjXtRBQs9Xfkb0Y5ZmxETNHD1oyMTCtMpPQoj4FL6cigY Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd0bd0633fab41348c29a69aebb7b069", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 79995efa070844cf94985c291b8388b7 Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f5d8072b-22d5-4efb-a8f0-cbc64db7474b'} Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:56.133469 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.137475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Returning 404 to user: Instance f5d8072b-22d5-4efb-a8f0-cbc64db7474b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:56.142458 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80c18214-e6c2-449c-ae18-01b77bb5ba32 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b" status: 404 len: 111 microversion: 2.1 time: 0.074196 Oct 31 14:13:56.143582 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1277/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:56 2022] GET /compute/v2.1/servers/f5d8072b-22d5-4efb-a8f0-cbc64db7474b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:56.154989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:56.155782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:56.168146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.174604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.177468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.178294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.178764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.179192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.209332 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] HTTP exception thrown: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Request method failure captured: Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 HTTP/1.1 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9d4aXwFPcDjLFH913ZozU7zw92xHDS5TWaZUlCh1DYigTtS03LUxtuUyYSn14RpJ2zRDfNeMIYb890g-ck0cQ0lg8f7fiV5sZqzNYOXbBGbLWCKV0YkoC3fknEBGapc59FjXtRBQs9Xfkb0Y5ZmxETNHD1oyMTCtMpPQoj4FL6cigY Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd0bd0633fab41348c29a69aebb7b069", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 79995efa070844cf94985c291b8388b7 Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e51a9543-d5a1-47c3-913e-c5453fc4a538'} Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:56.210944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Returning 404 to user: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:56.214572 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-540cc332-4f93-4c42-a6e6-bad3418d4abf tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 404 len: 111 microversion: 2.1 time: 0.065013 Oct 31 14:13:56.222497 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1278/2802] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:13:56 2022] DELETE /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:56.227350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:56.228796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] [instance: e51a9543-d5a1-47c3-913e-c5453fc4a538] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:56.241453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.243758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.244643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.252613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.253412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.254013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.257160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:56.275948 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] HTTP exception thrown: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Request method failure captured: Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 HTTP/1.1 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9d4aXwFPcDjLFH913ZozU7zw92xHDS5TWaZUlCh1DYigTtS03LUxtuUyYSn14RpJ2zRDfNeMIYb890g-ck0cQ0lg8f7fiV5sZqzNYOXbBGbLWCKV0YkoC3fknEBGapc59FjXtRBQs9Xfkb0Y5ZmxETNHD1oyMTCtMpPQoj4FL6cigY Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd0bd0633fab41348c29a69aebb7b069", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd0bd0633fab41348c29a69aebb7b069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: bd0bd0633fab41348c29a69aebb7b069 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-968698221 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 79995efa070844cf94985c291b8388b7 Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerDiskConfigTestJSON-968698221-project Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e51a9543-d5a1-47c3-913e-c5453fc4a538'} Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:13:56.287330 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. Oct 31 14:13:56.291169 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:13:56.293572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] Returning 404 to user: Instance e51a9543-d5a1-47c3-913e-c5453fc4a538 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:13:56.295075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0911fb90-88d5-4344-85bc-fcb5e5948619 tempest-ServerDiskConfigTestJSON-968698221 tempest-ServerDiskConfigTestJSON-968698221-project] 10.222.0.27 "GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538" status: 404 len: 111 microversion: 2.1 time: 0.071450 Oct 31 14:13:56.297810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1279/2803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:56 2022] GET /compute/v2.1/servers/e51a9543-d5a1-47c3-913e-c5453fc4a538 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:13:56.654675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:56.657388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:56.667480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.668508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.669391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.670433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.671521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.676865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.800210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:56.800786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:56.801290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:56.801958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:56.802475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:56.852546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.866687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.869698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.873202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:56.875859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:56.878797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:56.919881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:56.929065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:56.976073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:56.984834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:56.996627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:57.007177 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb3c323c-1d1b-4920-9b15-750e3e5c5431 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.358630 Oct 31 14:13:57.010433 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1280/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:56 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:57.021661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34294546-3ad6-4d0b-98cb-70ad049ffbc8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1079799d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:57.054987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:13:57.075843 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2e33414-4380-40fd-bd21-59673ef3ced3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286554 Oct 31 14:13:57.076818 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1525/2805] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:57.096776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "d62ca6bd-750f-43fd-8102-65076634a256"}], "security_groups": [{"name": "tempest-securitygroup--1402123534"}], "key_name": "tempest-keypair-1320855171", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:13:57.156996 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34294546-3ad6-4d0b-98cb-70ad049ffbc8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.144030 Oct 31 14:13:57.158261 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1281/2806] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:57 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:57.162846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:57.163464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:57.199677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:57.200207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:57.200819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:57.201699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:57.205282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:57.205889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:57.362595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:57.370760 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72f1023a-e8b1-4bb8-a304-0384dd3d2622 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1208 microversion: 2.1 time: 0.211437 Oct 31 14:13:57.372628 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1282/2807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:57 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1208 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:57.377720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47e5a820-c8ec-410e-8ad2-ab87ec470a9e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:57.378538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47e5a820-c8ec-410e-8ad2-ab87ec470a9e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:57.385324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] validate_networks() for [('d62ca6bd-750f-43fd-8102-65076634a256', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:13:57.435588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-47e5a820-c8ec-410e-8ad2-ab87ec470a9e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:57.444633 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47e5a820-c8ec-410e-8ad2-ab87ec470a9e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1216 microversion: 2.1 time: 0.070752 Oct 31 14:13:57.445324 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1283/2808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:57 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:58.037491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:58.044137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:58.059063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.059922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.060617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.061562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.062284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.062936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.472676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:13:58.476350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:13:58.476702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:13:58.477331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:13:58.477910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:13:58.492942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:58.494398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.495076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.497083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.498030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.501641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.502446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.505643 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fedd8f3a-bbb7-4f17-b280-24b3f9d08dc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.470808 Oct 31 14:13:58.519446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1284/2809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:58 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:13:58.519833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-979e937e-6c36-41e5-872c-e2e335c6c442 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10c187b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:58.574617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Getting quotas for project a6782805032845bc8ef132fedc3bf720. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:13:58.586987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Getting quotas for user a9746fac207c4c9b9957107b6da3a6a3 and project a6782805032845bc8ef132fedc3bf720. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:13:58.610745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:13:58.614467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:13:58.617281 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-979e937e-6c36-41e5-872c-e2e335c6c442 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.107779 Oct 31 14:13:58.618597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1285/2810] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:58 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:58.631522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:58.639793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:58.658676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.660244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.661793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.662759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.664900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.665799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.690244 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e26c812-17cf-425c-b4eb-2ce5395c1687 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.603832 Oct 31 14:13:58.697934 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1526/2811] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:13:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:13:58.705849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:58.707218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:58.714207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.714937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.715597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.716825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:58.717778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:58.718572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:58.857895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:58.868079 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5295e8a7-9feb-4c7d-9fee-6d9c275196ff tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1268 microversion: 2.1 time: 0.168228 Oct 31 14:13:58.872464 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1527/2812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:58 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:58.878974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f79e65ad-88de-4080-abbd-3f0dd45a5680 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:58.879880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f79e65ad-88de-4080-abbd-3f0dd45a5680 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:58.937254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:58.945787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6131e3c6-e49b-4f78-b8cf-4f276c16f8e2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1270 microversion: 2.1 time: 0.322870 Oct 31 14:13:58.946411 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1286/2813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:58 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1270 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:59.016718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f79e65ad-88de-4080-abbd-3f0dd45a5680 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:59.026752 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f79e65ad-88de-4080-abbd-3f0dd45a5680 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1226 microversion: 2.1 time: 0.152818 Oct 31 14:13:59.027498 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1528/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:58 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1226 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:59.533179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:59.533807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:59.554362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:59.555049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:59.555512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:59.556285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:59.556732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:59.557161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:59.634415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46a736c4-4f67-49df-8084-3c273bb2da63 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10784f310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:59.738557 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46a736c4-4f67-49df-8084-3c273bb2da63 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.108526 Oct 31 14:13:59.741554 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1529/2815] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:13:59 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:59.898799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:59.899148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:59.933484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:13:59.938995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:59.939508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:59.939954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:59.951989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63db582c-d9eb-46a4-9be6-c6da43e1a80e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1522 microversion: 2.1 time: 0.423663 Oct 31 14:13:59.952607 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1287/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:59 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:13:59.965502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:59.967488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:13:59.973190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:13:59.975995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:13:59.976617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:13:59.998606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:13:59.998872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:00.010804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:00.011840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:00.012486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:00.013080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:00.438642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:00.456199 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9aee6909-dd0f-40ef-92ee-c913de76c0ad tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.482967 Oct 31 14:14:00.457050 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1288/2817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:59 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:00.478249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:00.487003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:00.521117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:00.522853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:00.524057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:00.525027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:00.525676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:00.526388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:00.825936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:00.835847 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7f05cfec-6231-4cae-8aa4-c67811bafb91 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1278 microversion: 2.1 time: 0.377562 Oct 31 14:14:00.836437 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1289/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:00 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1278 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:00.843698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8988908e-af88-4c86-9193-2510724d6938 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10c3114c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:00.921199 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8988908e-af88-4c86-9193-2510724d6938 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.083677 Oct 31 14:14:00.931615 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1290/2819] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:00 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:00.980052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:00.981064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:00.995008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:00.996995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:00.999763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:01.006865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:01.007889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:01.008793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:01.188869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:01.198552 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fd61059-16b0-433b-b372-ec0df6076cca tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1274 microversion: 2.1 time: 1.305179 Oct 31 14:14:01.199822 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1530/2820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:13:59 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1274 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:01.498441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:01.498441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:01.498441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:01.519319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:01.520037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:01.527159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:01.529437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:01.530435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:01.788348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:01.797180 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86f78801-3028-45a7-a9ee-3fa72314b709 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1499 microversion: 2.1 time: 0.821304 Oct 31 14:14:01.811157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1291/2821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:00 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1499 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:01.822039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:01.828792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:01.831293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:01.837113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:01.837809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:01.838446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:01.839358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:01.839988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:01.840570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:01.953986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:02.015219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:02.025895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70f4c772-ac14-47f4-982c-573b8eebb83c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.549620 Oct 31 14:14:02.043180 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b7607bf-c911-4da9-8e9d-31c5d6feb7f6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.225522 Oct 31 14:14:02.044557 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1292/2822] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 31 14:14:01 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:02.049930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:02.056463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:02.059678 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1531/2823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:01 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:02.065881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc57e148-567e-4419-868d-1e5522f68f5f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1076c9d30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:02.074003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.074578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.075393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.076382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.077214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.077792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.136334 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc57e148-567e-4419-868d-1e5522f68f5f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.074842 Oct 31 14:14:02.137477 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1532/2824] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:02 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:02.145554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a1d152c-8149-4e4f-a516-7fefbc1919a4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:02.156186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a1d152c-8149-4e4f-a516-7fefbc1919a4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.157506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a1d152c-8149-4e4f-a516-7fefbc1919a4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.158125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a1d152c-8149-4e4f-a516-7fefbc1919a4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.180489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:02.195660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a1d152c-8149-4e4f-a516-7fefbc1919a4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 14:14:02.260879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:02.275207 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93cfaee4-5a2b-4c55-aef8-91cfc1e68e74 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1284 microversion: 2.1 time: 0.228440 Oct 31 14:14:02.275799 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1293/2825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:02 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:02.278265 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a1d152c-8149-4e4f-a516-7fefbc1919a4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "POST /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff/action" status: 202 len: 0 microversion: 2.1 time: 0.137525 Oct 31 14:14:02.280003 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1533/2826] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:02 2022] POST /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:14:02.284271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:02.285156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:02.326142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:02.332540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:02.347551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.352942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.353885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.358953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.361820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.363390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.364157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.374903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.380103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.384371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.388395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.389334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.683455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:02.694090 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf35cd64-cf5b-44f0-9cce-461d0f1b0124 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1274 microversion: 2.1 time: 0.415689 Oct 31 14:14:02.698943 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1294/2827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:02 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1274 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:02.717021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3d4624cc-bcd0-48f5-8a96-5acdb0e44112 req-0f9b36d6-3857-48a8-8191-344b32a00d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3385c0-7051-44c4-8e83-6b96d554f351", "tag": "48c46c97-9e28-4345-a0eb-cc9d36b8ce37"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:02.743528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3d4624cc-bcd0-48f5-8a96-5acdb0e44112 req-0f9b36d6-3857-48a8-8191-344b32a00d78 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:02.744482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3d4624cc-bcd0-48f5-8a96-5acdb0e44112 req-0f9b36d6-3857-48a8-8191-344b32a00d78 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:02.747178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3d4624cc-bcd0-48f5-8a96-5acdb0e44112 req-0f9b36d6-3857-48a8-8191-344b32a00d78 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:02.778034 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3d4624cc-bcd0-48f5-8a96-5acdb0e44112 req-0f9b36d6-3857-48a8-8191-344b32a00d78 service nova] Creating event network-changed:48c46c97-9e28-4345-a0eb-cc9d36b8ce37 for instance 5b3385c0-7051-44c4-8e83-6b96d554f351 on n-h1-863052-1 Oct 31 14:14:02.789019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3d4624cc-bcd0-48f5-8a96-5acdb0e44112 req-0f9b36d6-3857-48a8-8191-344b32a00d78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085120 Oct 31 14:14:02.789918 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1295/2828] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:03.064601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:03.075833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:03.100450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:03.102402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:03.106930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:03.109920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:03.111456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:03.116554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:03.325356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:03.334768 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab5972af-945d-4f02-b57e-1bdf81402412 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1508 microversion: 2.1 time: 1.034947 Oct 31 14:14:03.338673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1534/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:02 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1508 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:03.349318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-454e5d5b-81b8-43dd-b6b0-4494d15c1754 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1076c9d30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:03.468544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-454e5d5b-81b8-43dd-b6b0-4494d15c1754 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.128433 Oct 31 14:14:03.469435 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1535/2830] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:03 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:03.480779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:03.483864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:03.505330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:03.508056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:03.508516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:03.511693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:03.512228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:03.514134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:03.682602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:03.692024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-695a32e2-ceee-4d35-bb29-e060f62b7679 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.633718 Oct 31 14:14:03.695186 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1296/2831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:03 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:03.708355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:03.724930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:03.725795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:03.728753 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3d2f72cf-259b-4293-acd4-def0d9a54b55 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1284 microversion: 2.1 time: 0.249875 Oct 31 14:14:03.732575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1536/2832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:03 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:03.734540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:03.735697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:03.736290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:03.737147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:03.737738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:03.738493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:04.066661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:04.091639 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a95a748-a4ef-4d51-86a8-2766c413a58c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.369953 Oct 31 14:14:04.092900 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1297/2833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:03 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:04.356726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:04.358100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:04.382427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:04.383177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:04.383772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:04.384652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:04.385258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:04.385971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:04.484944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1b886fe-9728-4059-bd8f-99a4985bf6da tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10783fa60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:04.598724 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1b886fe-9728-4059-bd8f-99a4985bf6da tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.117723 Oct 31 14:14:04.599317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1298/2834] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:04 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:04.719295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:04.719917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:04.730908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:04.731398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:04.731832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:04.732535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:04.732983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:04.741175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:04.752809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:04.770544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-438371f8-d4d3-47ab-9b18-9e74dffcfb76 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1508 microversion: 2.1 time: 0.410320 Oct 31 14:14:04.776720 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1537/2835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:04 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:04.799417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:04.804891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:04.832215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:04.832735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:04.833180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:04.833908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:04.834389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:04.845991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:05.155388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:05.167613 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3f04e4c-507c-45ac-9b6f-ac1a5feba739 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.389798 Oct 31 14:14:05.168478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1538/2836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:04 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:05.199089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:05.199909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:05.206925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:05.207713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:05.208315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:05.209221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:05.210014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:05.210638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:05.479369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:05.493563 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f15bba98-82d7-4ec1-9451-b57f4b9ab345 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.313932 Oct 31 14:14:05.501683 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1539/2837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:05 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:05.513565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c46ac936-c792-4b51-8c0e-ecc9cb098d9c req-74b4c66e-262f-4cab-a07f-a51e05316046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cef1984-eed0-4d85-b69a-cb399c0def17", "tag": "cae5c960-baef-499d-a404-f92b3bf1ac99"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:05.534945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c46ac936-c792-4b51-8c0e-ecc9cb098d9c req-74b4c66e-262f-4cab-a07f-a51e05316046 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:05.536180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c46ac936-c792-4b51-8c0e-ecc9cb098d9c req-74b4c66e-262f-4cab-a07f-a51e05316046 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:05.536863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c46ac936-c792-4b51-8c0e-ecc9cb098d9c req-74b4c66e-262f-4cab-a07f-a51e05316046 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:05.539703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:05.551689 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c46ac936-c792-4b51-8c0e-ecc9cb098d9c req-74b4c66e-262f-4cab-a07f-a51e05316046 service nova] Creating event network-changed:cae5c960-baef-499d-a404-f92b3bf1ac99 for instance 9cef1984-eed0-4d85-b69a-cb399c0def17 on n-h2-863052-1 Oct 31 14:14:05.556770 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5d686cf-c144-4fcb-a6bd-a914c388fefc tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.843019 Oct 31 14:14:05.559431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c46ac936-c792-4b51-8c0e-ecc9cb098d9c req-74b4c66e-262f-4cab-a07f-a51e05316046 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055998 Oct 31 14:14:05.561101 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1540/2838] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:05.571498 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1299/2839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:04 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:05.616183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0476e732-2844-4e9c-879e-916676e4e18a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078b19d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:05.669275 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0476e732-2844-4e9c-879e-916676e4e18a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.057144 Oct 31 14:14:05.680826 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1541/2840] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:05 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:05.798267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:05.798975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:05.810825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:05.814865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:05.816489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:05.818284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:05.820020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:05.821206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.205308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:06.206619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:06.219437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.221580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.224661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.225685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.226557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.227210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.228199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:06.243285 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a53960fa-ae4f-4993-a8f4-b0df49623d9e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1512 microversion: 2.1 time: 0.449919 Oct 31 14:14:06.247547 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1300/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:05 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:06.274030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:06.279378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:06.280079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.servers [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Removing options 'limit' from query {{(pid=120641) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 14:14:06.281026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:06.282936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.283602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.284210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.285112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.285832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.286427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.288018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca727d8d-4fbd-4b08-8733-e468e3413046 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.017772 Oct 31 14:14:06.296087 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1301/2842] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 31 14:14:06 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:14:06.301814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:06.302701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:06.312579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.314095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.317060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.317963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.318463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.318906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.571699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:06.574403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:06.582305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:06.590852 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a814e15-68ad-435c-a60c-f024860ade52 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.389785 Oct 31 14:14:06.595905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-919c2c82-e8d4-4f05-a95f-6689d7ebf197 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1512 microversion: 2.1 time: 0.298417 Oct 31 14:14:06.596463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1542/2843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:06 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:06.603276 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1302/2844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:06 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:06.608327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:06.609666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:06.614351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:06.616448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:06.625766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.626579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.628757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.629668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.630380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.631063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.632072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.632699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.636322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.637363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:06.637957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:06.638871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:06.964972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:06.977308 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96a830d6-22ff-4818-97ba-8a80b4dcee5e tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.379396 Oct 31 14:14:06.981244 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1543/2845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:06 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:06.987376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-36968a12-9761-423d-83fb-2bfe05798bf0 req-eeb040e5-0d18-4477-92ec-b73c54f710ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88180ebf-6fce-4644-9070-031baa73152e", "tag": "d13d1b50-d491-4054-816a-0ef015b077ef"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:07.016480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-36968a12-9761-423d-83fb-2bfe05798bf0 req-eeb040e5-0d18-4477-92ec-b73c54f710ce service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.018956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-36968a12-9761-423d-83fb-2bfe05798bf0 req-eeb040e5-0d18-4477-92ec-b73c54f710ce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.020175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-36968a12-9761-423d-83fb-2bfe05798bf0 req-eeb040e5-0d18-4477-92ec-b73c54f710ce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.059083 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-36968a12-9761-423d-83fb-2bfe05798bf0 req-eeb040e5-0d18-4477-92ec-b73c54f710ce service nova] Creating event network-changed:d13d1b50-d491-4054-816a-0ef015b077ef for instance 88180ebf-6fce-4644-9070-031baa73152e on n-h1-863052-1 Oct 31 14:14:07.074070 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-36968a12-9761-423d-83fb-2bfe05798bf0 req-eeb040e5-0d18-4477-92ec-b73c54f710ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090853 Oct 31 14:14:07.076609 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1544/2846] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:07.085826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:07.092208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:07.099263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:07.111812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.114581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.115201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.117564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.122436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.123197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.130155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27a3b794-3a16-44b9-bac8-c5c6b4c3884b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.520155 Oct 31 14:14:07.135338 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1303/2847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:06 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:07.153823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7cbf1a6-5a69-4680-92a8-8a6175b43b6d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078a0d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:07.260445 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7cbf1a6-5a69-4680-92a8-8a6175b43b6d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.117311 Oct 31 14:14:07.261724 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1304/2848] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:07 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:07.624070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:07.629431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:07.630904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:07.639095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.639860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.640514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.641625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.642334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.643058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.654839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:07.665045 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbdc0439-bbf5-4bfb-b525-0b6fe08ddfa5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 200 len: 1513 microversion: 2.1 time: 0.585989 Oct 31 14:14:07.666253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1545/2849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:07 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 1513 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:07.697960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:07.699132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:07.708277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.709382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.710010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.711103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:07.711796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:07.712764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:07.819330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:07.831604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89ebdf1b-2c59-4e8f-a621-1df0fcad4c05 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.208158 Oct 31 14:14:07.832369 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1305/2850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:07 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:08.009077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.010251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:08.012599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:08.026815 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fb3efd3-5f0d-4206-8faf-87ca7e4a2ae3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1511 microversion: 2.1 time: 0.334994 Oct 31 14:14:08.027436 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1546/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:07 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:08.047333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.052328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.053109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.053824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.054626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.055146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.055892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.071434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:08.072272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:08.274074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.274602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.275043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.275773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.276229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.276654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.293713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:08.321426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef794c2f-fcdb-491f-b6c3-cd62ab784fc0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.317424 Oct 31 14:14:08.324890 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1306/2852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:08.333201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.334052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:08.341682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.343209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.343924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.344860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.345518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.346151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.407264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:08.487801 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77a63dc9-387d-4f54-9a88-6117b388496d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.438010 Oct 31 14:14:08.489240 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1547/2853] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:08.501466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee9c27be-9407-4ef6-bb26-6c2ae2d4f196 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078cf550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.611572 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee9c27be-9407-4ef6-bb26-6c2ae2d4f196 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1412 microversion: 2.1 time: 0.120969 Oct 31 14:14:08.612393 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1548/2854] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:08.636160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.637284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:08.653622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.654286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.655028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.656658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.657363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.658828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.710074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:08.725251 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-480e73af-3a29-4159-a8b7-92eba9f595f4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.399199 Oct 31 14:14:08.725838 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1307/2855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:08.857324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.858209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:08.865932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.866461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.866937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.867610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.868072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.868489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.885112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:08.899517 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7143ffe-c076-4f20-b071-e70172dab89b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1512 microversion: 2.1 time: 0.286252 Oct 31 14:14:08.918276 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1549/2856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:08.926585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:08.927550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:08.933759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.934488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.935087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:08.936083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:08.936691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:08.937259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.021184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=20 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:09.057891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.066026 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c31c33a2-7f9e-4fb5-b2bc-0f10eefce911 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.214107 Oct 31 14:14:09.074209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1308/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:09.176445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.187418 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c4cbe56-f0db-4d74-a327-43fa06f1c6a0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 200 len: 1513 microversion: 2.1 time: 0.265274 Oct 31 14:14:09.188614 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1550/2858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:08 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:09.215004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.215839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:09.223481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.224476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.225076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.225971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.226618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.227248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.348120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.348742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:09.359684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.360161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.360535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.361375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.361836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.363005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.452632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.462917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20831aa5-844f-498a-a3d5-5fc221b4ea13 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1511 microversion: 2.1 time: 0.253541 Oct 31 14:14:09.478437 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1309/2859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:09.486406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.491757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.492775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:09.499302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.500107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.501020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.501848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.502798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.503918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.541434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:09.576518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.580553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.589670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.590465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.590694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c966e43-594b-4593-a525-ec4ce6821ce5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.247564 Oct 31 14:14:09.591438 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1551/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:09.591868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.633020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff2f4051-abf7-488d-9d9a-c122d10852dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107989430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.706549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff2f4051-abf7-488d-9d9a-c122d10852dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1421 microversion: 2.1 time: 0.079492 Oct 31 14:14:09.708790 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1552/2861] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:09.723688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2aff4fa-d52b-405c-9292-1f48a694a5a3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078f5310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.742416 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c186c1e2-2208-4d92-8a0d-fa7cf153b8cf tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.259560 Oct 31 14:14:09.754666 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1310/2862] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:09.754666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.754666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:09.760086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.760611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.762090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.762986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.763449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.763881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.807799 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2aff4fa-d52b-405c-9292-1f48a694a5a3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 200 len: 1421 microversion: 2.1 time: 0.089255 Oct 31 14:14:09.809526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1553/2863] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:09.820152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.827616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.829274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:09.917244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:09.926231 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d8638bc-3aef-4cb5-b2f7-01af9badbea3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.179791 Oct 31 14:14:09.926749 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1311/2864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:09.931682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-345a3908-f977-4053-abd9-2d5201eb474c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107813820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:09.982202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.983084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.983225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:09.983836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:09.984830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:09.985571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.020101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:10.040465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:10.070157 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e3aabe07-6d88-4c41-87cc-70e42fc691c0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.258474 Oct 31 14:14:10.072664 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1554/2865] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 31 14:14:09 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:10.089821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:10.095638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:10.096730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:10.102767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.103319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.104014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.104902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.105522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.106132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.209870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:10.295810 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-281a1045-85b5-4707-a0f8-f86d67c83453 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.211206 Oct 31 14:14:10.303444 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1555/2866] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 31 14:14:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:10.320293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:10.321151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:10.328888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.329455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.329958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.331020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.331753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.332239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.549244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:10.564103 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c78fa360-d56a-4270-9333-44424ae93f71 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.265751 Oct 31 14:14:10.583303 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1556/2867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:10 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:10.597685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:10.607635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:10.608805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:10.617534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.618240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.619419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.627266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.627759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.628197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.712857 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-345a3908-f977-4053-abd9-2d5201eb474c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 204 len: 0 microversion: 2.1 time: 0.784860 Oct 31 14:14:10.713511 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1312/2868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:09 2022] DELETE /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:10.723107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:10.733367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:10.745286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.746642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.747455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.748574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.749259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.749971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.783398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:10.847598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3752ffa2-8eb4-4ec4-8795-9d5356cfbcdd tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.262815 Oct 31 14:14:10.848726 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1557/2869] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 31 14:14:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:10.860850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:10.861553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:10.869949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.870711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.871467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.873846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.874544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.876266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.909741 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c67fa9ae-4fcb-4135-97aa-490161c3c71d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.193415 Oct 31 14:14:10.910836 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1313/2870] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:10 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:14:10.926795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:10.927393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:10.934317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.935182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.935799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.936781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:10.938053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:10.938850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:10.993126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:11.111852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b38845e-6af3-4aeb-ac23-f6ff6ad5e10b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 204 len: 0 microversion: 2.1 time: 0.196366 Oct 31 14:14:11.113228 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1314/2871] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:10 2022] DELETE /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:11.120098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:11.127969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:11.129025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': '-874148504', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:11.136741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.137529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.139009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.139956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.144275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.145866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.265750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:11.337728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:11.340467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3957681a-2a18-41b0-8c98-a2b1d5bdecea tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-874148504" status: 200 len: 345 microversion: 2.1 time: 0.225141 Oct 31 14:14:11.341548 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1315/2872] 10.222.0.27 () {58 vars in 1156 bytes} [Mon Oct 31 14:14:11 2022] GET /compute/v2.1/servers?name=-874148504 => generated 345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:11.349043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e241b55-1014-4b66-9f55-8632597ef623 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.497745 Oct 31 14:14:11.354604 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1558/2873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:10 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:11.357112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:11.358052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:11.362905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9d64924f-0559-493a-995c-aa812d946758 req-7a13f876-ec2d-4405-ac9e-e857aca9de93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3385c0-7051-44c4-8e83-6b96d554f351", "name": "network-vif-plugged", "status": "completed", "tag": "48c46c97-9e28-4345-a0eb-cc9d36b8ce37"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:11.368481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.369402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.370022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.371534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.372067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.372581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.389452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d64924f-0559-493a-995c-aa812d946758 req-7a13f876-ec2d-4405-ac9e-e857aca9de93 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.389935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d64924f-0559-493a-995c-aa812d946758 req-7a13f876-ec2d-4405-ac9e-e857aca9de93 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.390402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d64924f-0559-493a-995c-aa812d946758 req-7a13f876-ec2d-4405-ac9e-e857aca9de93 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.426553 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9d64924f-0559-493a-995c-aa812d946758 req-7a13f876-ec2d-4405-ac9e-e857aca9de93 service nova] Creating event network-vif-plugged:48c46c97-9e28-4345-a0eb-cc9d36b8ce37 for instance 5b3385c0-7051-44c4-8e83-6b96d554f351 on n-h1-863052-1 Oct 31 14:14:11.432189 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9d64924f-0559-493a-995c-aa812d946758 req-7a13f876-ec2d-4405-ac9e-e857aca9de93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075809 Oct 31 14:14:11.432990 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1559/2874] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:11.441231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:11.442387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:11.466768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.466768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.467096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.467892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:11.469310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:11.470715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:11.571212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:11.580803 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff047f05-b111-4064-9399-1f6e7e381e94 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1670 microversion: 2.1 time: 0.237922 Oct 31 14:14:11.597469 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1316/2875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:11 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:11.597469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-928504738", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:11.663110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] validate_networks() for [('d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:14:12.101776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:14:12.103817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:14:12.104307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:14:12.104728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:14:12.105133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:14:12.120365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.122038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.122675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.124637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.126542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.127279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.136437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:12.151009 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bef56f82-1329-4dfb-b5e8-7f102c36f989 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.713949 Oct 31 14:14:12.151591 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1560/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:11 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:12.152482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:12.162571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.163099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:14:12.171415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for user ec707d34966e44aa93900eebc62a6a93 and project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:14:12.179466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:12.180498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:12.186860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.188884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.189711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.190792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.191425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.192011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.198428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:14:12.202311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:12.256135 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d34e340-32d3-4426-962b-7d5d7bb93fb5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673316 Oct 31 14:14:12.257070 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1317/2877] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:14:12.263813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.264066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:12.272537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.273455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.274051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.275169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.275892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.276465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.292110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:12.303054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:12.382416 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-656801ac-3bf1-48fe-86c1-4ea683542d62 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.229529 Oct 31 14:14:12.383479 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1561/2878] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 31 14:14:12 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:12.390472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-731d07d7-91e6-41c9-a07a-13d9d2023893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.391100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-731d07d7-91e6-41c9-a07a-13d9d2023893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:12.477552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:12.487921 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52772c51-4841-431b-b416-709417cb9219 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.229067 Oct 31 14:14:12.504428 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1318/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:12 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:12.508006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.508628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:12.514560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.515048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.516016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.516726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.518202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.518202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.554283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-731d07d7-91e6-41c9-a07a-13d9d2023893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:12.572725 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-731d07d7-91e6-41c9-a07a-13d9d2023893 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1207 microversion: 2.1 time: 0.188124 Oct 31 14:14:12.576000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1562/2880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:12 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1207 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:12.591319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.608807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:12.609848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-87414850', 'deleted': False, 'project_id': 'b9a113f86e2047aca741e92fbc200efc'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:12.621645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.622483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.624235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.626018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.626795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.627782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.811533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:12.821252 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a0e69e55-17a5-4b27-b8ed-295ecb321d84 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.316903 Oct 31 14:14:12.837919 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1319/2881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:12 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:12.837919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.837919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:12.847690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.848198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.848641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.849352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:12.849811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:12.850276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:12.867570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:14:12.977319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6d6e561-cb19-4ed7-a226-b128cb8e958c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-87414850" status: 200 len: 345 microversion: 2.1 time: 0.399760 Oct 31 14:14:12.978230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1563/2882] 10.222.0.27 () {58 vars in 1226 bytes} [Mon Oct 31 14:14:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-87414850 => generated 345 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:12.992534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:12.993511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:13.002260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.003053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.003706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.004774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.005432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.006040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.034039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:13.163507 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d1cbefc8-c964-49bf-9bd6-88485e8bdc28 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 204 len: 0 microversion: 2.1 time: 0.175565 Oct 31 14:14:13.167467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1564/2883] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:12 2022] DELETE /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:14:13.173565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:13.174301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:13.186987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.188018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.188452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.189153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.189591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.193007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.334147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:13.346563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-956e548a-3c0a-4161-b6a3-d53a0b696f5d tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1670 microversion: 2.1 time: 0.519356 Oct 31 14:14:13.347750 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1320/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:12 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1670 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:13.366938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:13.367996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:13.385017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.385736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.386474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.387352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.388647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.389234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.508511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:13.517693 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cc6b15d-8346-4173-bf28-17f80486dbe6 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1517 microversion: 2.1 time: 0.348887 Oct 31 14:14:13.532050 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1565/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:13 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1517 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:13.540833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:13.541445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:13.548241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.548727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.549167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.549861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.550356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.550767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.623896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:13.638423 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64e53de2-96f4-4e41-9802-4fa4cb1cec4c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.287177 Oct 31 14:14:13.640204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1321/2886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:13 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:13.648917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:13.650387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:13.662495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.664254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.665232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.666263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.669072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.670209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.790487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:13.798965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-14a66ef4-3eb8-4c96-9d22-2602c2a78614 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1203 microversion: 2.1 time: 0.157343 Oct 31 14:14:13.799543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1322/2887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:13 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:13.810300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-53ee5a34-7f30-4300-b6c9-2ab5dae4252c req-b0134224-2d94-4b73-9be3-37752e811b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88180ebf-6fce-4644-9070-031baa73152e", "name": "network-vif-plugged", "status": "completed", "tag": "d13d1b50-d491-4054-816a-0ef015b077ef"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:13.825232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:13.834261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-53ee5a34-7f30-4300-b6c9-2ab5dae4252c req-b0134224-2d94-4b73-9be3-37752e811b3e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.834754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-53ee5a34-7f30-4300-b6c9-2ab5dae4252c req-b0134224-2d94-4b73-9be3-37752e811b3e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.835187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-53ee5a34-7f30-4300-b6c9-2ab5dae4252c req-b0134224-2d94-4b73-9be3-37752e811b3e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.838002 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bd77d02-f83f-46f5-aaac-06d195871aab tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.304734 Oct 31 14:14:13.841246 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1566/2888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:13 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:13.852197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:13.853019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:13.865023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.865421 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-53ee5a34-7f30-4300-b6c9-2ab5dae4252c req-b0134224-2d94-4b73-9be3-37752e811b3e service nova] Creating event network-vif-plugged:d13d1b50-d491-4054-816a-0ef015b077ef for instance 88180ebf-6fce-4644-9070-031baa73152e on n-h1-863052-1 Oct 31 14:14:13.865999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.866675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.868268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.868899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.869797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.878983 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-53ee5a34-7f30-4300-b6c9-2ab5dae4252c req-b0134224-2d94-4b73-9be3-37752e811b3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076715 Oct 31 14:14:13.891208 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1323/2889] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:13.902715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-45df9e6d-c805-4b9a-9656-6881e8b41ff3 req-7ad11a29-03f0-42b5-95ec-557b39a52c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd0646-c655-4849-88ee-7314178eebc3", "name": "network-vif-deleted", "tag": "8dee12a1-38ae-4b8a-b790-6c8e7d2d073f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:13.928041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45df9e6d-c805-4b9a-9656-6881e8b41ff3 req-7ad11a29-03f0-42b5-95ec-557b39a52c10 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:13.930188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45df9e6d-c805-4b9a-9656-6881e8b41ff3 req-7ad11a29-03f0-42b5-95ec-557b39a52c10 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:13.930863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45df9e6d-c805-4b9a-9656-6881e8b41ff3 req-7ad11a29-03f0-42b5-95ec-557b39a52c10 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:13.949714 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-45df9e6d-c805-4b9a-9656-6881e8b41ff3 req-7ad11a29-03f0-42b5-95ec-557b39a52c10 service nova] Creating event network-vif-deleted:8dee12a1-38ae-4b8a-b790-6c8e7d2d073f for instance e8cd0646-c655-4849-88ee-7314178eebc3 on n-h1-863052-1 Oct 31 14:14:13.955801 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-45df9e6d-c805-4b9a-9656-6881e8b41ff3 req-7ad11a29-03f0-42b5-95ec-557b39a52c10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062221 Oct 31 14:14:13.956920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1324/2890] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:14.055080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:14.063510 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-440f09f3-b377-4224-bbee-38f176e96f0d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.220732 Oct 31 14:14:14.064657 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1567/2891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:13 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:14.372505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:14.373833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:14.389399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.390337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.391766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.392730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.393393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.394005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.544844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:14.545461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:14.552119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.552617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.553051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.553748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.554213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.554641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.705120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:14.714029 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83b5c8f1-77ac-42a2-affc-23e666c9bb17 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1517 microversion: 2.1 time: 0.172886 Oct 31 14:14:14.714921 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1568/2892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:14 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:14.728183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:14.729192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:14.738688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.739285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.740016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.741254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.741679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.742212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.938796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:14.947100 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5b719af-180c-4d55-9e63-1ddb7d1a37ea tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1312 microversion: 2.1 time: 0.226189 Oct 31 14:14:14.948179 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1569/2893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:14 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:14.953438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:14.954486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:14.960218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:14.961935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.962636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.963287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.964363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:14.965032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:14.965660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:14.969637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:14.988710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:14.996969 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-386959bf-7496-49f4-a5d9-a073c01666ef tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1675 microversion: 2.1 time: 0.629176 Oct 31 14:14:14.997864 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1325/2894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:14 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1675 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:15.002578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:15.003413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:15.010020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.010777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.011436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.012331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.012969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.013591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.038199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:15.048059 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5a92aa1-add4-4a2a-a7b6-0dc5b7bb90d1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1203 microversion: 2.1 time: 0.098596 Oct 31 14:14:15.048774 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1570/2895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:14 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1203 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:15.086753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:15.087684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:15.094414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.095001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.095532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.096451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.097351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.097997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.264385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:15.273166 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-075a2a96-6891-4a22-9a48-08fed7a8874c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.190656 Oct 31 14:14:15.276469 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1571/2896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:15 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:15.305679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:15.314936 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01f76197-7a22-4367-bb8c-c2c8e5ae8278 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1352 microversion: 2.1 time: 0.315798 Oct 31 14:14:15.315527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1326/2897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:14 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1352 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:15.738792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:15.739429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:15.740542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-987691600", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "e3df024c-0683-4f31-bada-09bf3f1afba3"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:15.746384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.746869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.747891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.748605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.749070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.749486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.819470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] validate_networks() for [('e3df024c-0683-4f31-bada-09bf3f1afba3', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:14:15.931514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:15.940373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a62d46b-4686-41e3-bfec-44f96dac5b37 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1517 microversion: 2.1 time: 0.205567 Oct 31 14:14:15.941142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1327/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:15 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:15.947018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3504f955-3a4c-4ece-ae9a-afc9484e5fd1 req-4add638e-9ff9-4172-ae54-4c18e16e1612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cef1984-eed0-4d85-b69a-cb399c0def17", "name": "network-vif-plugged", "status": "completed", "tag": "cae5c960-baef-499d-a404-f92b3bf1ac99"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:15.963533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3504f955-3a4c-4ece-ae9a-afc9484e5fd1 req-4add638e-9ff9-4172-ae54-4c18e16e1612 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.963939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3504f955-3a4c-4ece-ae9a-afc9484e5fd1 req-4add638e-9ff9-4172-ae54-4c18e16e1612 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.965208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3504f955-3a4c-4ece-ae9a-afc9484e5fd1 req-4add638e-9ff9-4172-ae54-4c18e16e1612 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.977896 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3504f955-3a4c-4ece-ae9a-afc9484e5fd1 req-4add638e-9ff9-4172-ae54-4c18e16e1612 service nova] Creating event network-vif-plugged:cae5c960-baef-499d-a404-f92b3bf1ac99 for instance 9cef1984-eed0-4d85-b69a-cb399c0def17 on n-h2-863052-1 Oct 31 14:14:15.982963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3504f955-3a4c-4ece-ae9a-afc9484e5fd1 req-4add638e-9ff9-4172-ae54-4c18e16e1612 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039868 Oct 31 14:14:15.983575 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1328/2899] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:15.989697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:15.990445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:15.996983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.997473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.997909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:15.998650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:15.999165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:15.999818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.146774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.155059 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fbd354fc-064e-4c8d-9451-a18bb3e45999 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1462 microversion: 2.1 time: 0.169547 Oct 31 14:14:16.166743 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1329/2900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:15 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1462 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:16.179627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.180527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.186814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.187880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.188325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.189039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.189484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.189905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.345624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:14:16.346067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:14:16.346596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:14:16.346993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:14:16.347412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:14:16.349577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.356429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.356916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.357343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c4dcdc3-81a9-4c67-a741-1cf5dc1237a7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1675 microversion: 2.1 time: 0.189476 Oct 31 14:14:16.357470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.357910 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1330/2901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:16.358059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.358660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.359153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.375682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.376389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.377094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Getting quotas for project 20d49ed6200644f29b9535a6d11cbebc. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:14:16.382572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.382759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Getting quotas for user 91b4fb47043b44afa4f155efca4f240c and project 20d49ed6200644f29b9535a6d11cbebc. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:14:16.383208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.383711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.384535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.384980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.385395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.396186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:14:16.398521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:16.448088 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b5619bf-5b00-42df-88d5-f6871cd51942 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833524 Oct 31 14:14:16.448930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1572/2902] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:14:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:14:16.451820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.459534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:16.462355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.466075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5431bc3-9e84-4595-9d1a-e8628a2dcdc1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1203 microversion: 2.1 time: 0.094020 Oct 31 14:14:16.466692 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1331/2903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1203 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:16.483404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.483404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.483404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.483404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.483404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.483404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.490590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.491371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.499890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.500384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.500819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.501516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.501963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.502415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.580266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.587115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Old instance type m1.heat2, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:14:16.597198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:14:16.597616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:14:16.598085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:14:16.598517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:14:16.598921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:14:16.692150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.701845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9d60e75-0cd6-4068-a6f2-c3721ce1425b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.214985 Oct 31 14:14:16.713050 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1332/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:16.729629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.730273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.741771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.744889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.745318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.746041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.746528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.746948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.763874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe5aaaab-d64c-4bd9-82e0-1a6be526e023 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351/action" status: 202 len: 0 microversion: 2.1 time: 0.308404 Oct 31 14:14:16.770647 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1573/2905] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:16 2022] POST /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:14:16.775625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acabbd12-ac4a-4b94-b4cb-33f3d1dd1ad3 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.776254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acabbd12-ac4a-4b94-b4cb-33f3d1dd1ad3 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.865850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-acabbd12-ac4a-4b94-b4cb-33f3d1dd1ad3 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.879158 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acabbd12-ac4a-4b94-b4cb-33f3d1dd1ad3 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1216 microversion: 2.1 time: 0.107351 Oct 31 14:14:16.882031 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1574/2906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:16.889908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.894530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.904081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.904607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.905225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.905940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.910790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.911239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.951624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:16.961109 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca99b424-62be-41ad-9f74-a1d0cfe18df4 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1542 microversion: 2.1 time: 0.246913 Oct 31 14:14:16.961811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1333/2907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1542 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:16.969794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:16.970993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:16.978499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.979198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.979794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:16.980667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:16.981293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:16.981870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.136152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:17.148269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-052e3fde-7175-47b7-996c-b7747802b714 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1517 microversion: 2.1 time: 0.183352 Oct 31 14:14:17.148850 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1334/2908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:17.162271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:17.162271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:17.165927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.166699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.166970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.167582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.168094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.174861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.181510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:17.192694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c59c42cc-8b71-4c18-bc57-e6b18c90a049 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.309522 Oct 31 14:14:17.193881 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1575/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:16 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:17.272190 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1234eba8-2723-40c8-86d3-2029a0d486fb tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122262 Oct 31 14:14:17.272797 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1335/2910] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:14:17 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:17.381901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:17.391931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:17.412115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.412721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.413248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.414033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.414590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.415092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.491135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:17.492225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:17.501132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.502002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.502688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.504292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.504912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.505574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.577311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:17.585780 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0f6a191-5fc3-4d49-870a-2803a0b363c1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1675 microversion: 2.1 time: 0.207654 Oct 31 14:14:17.590745 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1576/2911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:17 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1675 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:17.605566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:17.616020 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4782562a-c8d1-4bc0-87d2-f8333afe8b19 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1203 microversion: 2.1 time: 0.128554 Oct 31 14:14:17.631667 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1336/2912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:17 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1203 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:17.728219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:17.729266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:17.736101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.736816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.737247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.738553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.739058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.739455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.905209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:17.907188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:17.907805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:17.914114 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10e6ce0b-8136-4e13-9856-33a7d295b8fe tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.189849 Oct 31 14:14:17.914731 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1577/2913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:17 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:17.926769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.927642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.928233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.929093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:17.929708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:17.930128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:17.948631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:18.007789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:18.016002 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb3d6d1c-a09f-4dcb-977b-6d019ad1ef84 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1220 microversion: 2.1 time: 0.113087 Oct 31 14:14:18.016576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1337/2914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:17 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:18.173792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:18.174498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:18.181599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.183230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.183230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.185571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.186776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.187481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.217872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:18.219355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:18.226775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.227451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.228051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.228920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.229513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.230279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.340545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:18.349538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-003ea898-62e8-4f29-b5e1-38ea62440ad0 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1517 microversion: 2.1 time: 0.181233 Oct 31 14:14:18.350369 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1578/2915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:18 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:18.477923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-571597e6-dc5a-41af-8660-f4f3e5135379 req-69cb7c15-b19c-4b2f-8e68-7c3786017f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88180ebf-6fce-4644-9070-031baa73152e", "tag": "d13d1b50-d491-4054-816a-0ef015b077ef"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:18.486052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:18.492292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-571597e6-dc5a-41af-8660-f4f3e5135379 req-69cb7c15-b19c-4b2f-8e68-7c3786017f87 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.493272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-571597e6-dc5a-41af-8660-f4f3e5135379 req-69cb7c15-b19c-4b2f-8e68-7c3786017f87 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.493705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-571597e6-dc5a-41af-8660-f4f3e5135379 req-69cb7c15-b19c-4b2f-8e68-7c3786017f87 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.494593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7c3b833-1a4f-4e1f-9697-07dbfe2ea9a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.280747 Oct 31 14:14:18.510189 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-571597e6-dc5a-41af-8660-f4f3e5135379 req-69cb7c15-b19c-4b2f-8e68-7c3786017f87 service nova] Creating event network-changed:d13d1b50-d491-4054-816a-0ef015b077ef for instance 88180ebf-6fce-4644-9070-031baa73152e on n-h1-863052-1 Oct 31 14:14:18.511262 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1338/2916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:18 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:18.513988 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-571597e6-dc5a-41af-8660-f4f3e5135379 req-69cb7c15-b19c-4b2f-8e68-7c3786017f87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040774 Oct 31 14:14:18.514621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1579/2917] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:18.616111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:18.616295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:18.627450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.627967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.628416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.630550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.631051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.631489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.640061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:18.641473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:18.652539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.653143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.653592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.656465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.656962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.657403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.810447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:18.825932 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba244b3d-46c8-46db-9c44-431878cdf9b8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1203 microversion: 2.1 time: 0.184771 Oct 31 14:14:18.827186 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1580/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:18 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:18.872648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:18.883246 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d410717e-dd58-4c31-b1b2-ed571adcdfcd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1675 microversion: 2.1 time: 0.271399 Oct 31 14:14:18.884614 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1339/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:18 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:18.936792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:18.937981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:18.953860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.959198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.959979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:18.960926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:18.962583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:18.963891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.039793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:19.040403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:19.047911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.048775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.050737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.051670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.052285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.052866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.140201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:19.149582 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0a38c14-a976-4b4d-8378-600e7fb16834 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1220 microversion: 2.1 time: 0.113667 Oct 31 14:14:19.150844 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1340/2920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:19 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:19.207249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:19.217342 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf61f3dc-6336-4b90-91db-2ce5c68845ee tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.284261 Oct 31 14:14:19.219684 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1581/2921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:18 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:19.373267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:19.374027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:19.381427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.382032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.382595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.383434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.384084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.384516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.519560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:19.520465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:19.528584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.529074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.529903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.531390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.531847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.532268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.546018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:19.555404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58a5c078-6724-4571-8779-deaee65ec3fe tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1517 microversion: 2.1 time: 0.186311 Oct 31 14:14:19.567280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1341/2922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:19 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:19.683944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:19.694283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dab5ce93-adc0-467b-bda9-c1fc1dce251f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.179024 Oct 31 14:14:19.694283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1582/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:19 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:19.855056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:19.855889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:19.874208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.875050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.875688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.876598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.877207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.877798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.911015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:19.911939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:19.918923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.919645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.920491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.921362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:19.925729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:19.926438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:19.995066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:20.007781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bed736f0-ac8e-443c-b699-f1d2a7d675bb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1203 microversion: 2.1 time: 0.158659 Oct 31 14:14:20.008613 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1342/2924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:19 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:20.178560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:20.179164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:20.186132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.186878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.187509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.188565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.189193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.189772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.273114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:20.283094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-13d00564-f271-4990-84b5-e26691d53fa2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1212 microversion: 2.1 time: 0.109478 Oct 31 14:14:20.283746 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1343/2925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:20 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:20.288888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:20.289699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:20.298721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.299786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.301253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.302211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.302838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.303492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.351896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:20.360166 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12afe027-4439-4e11-9f94-74fc2f005af4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.455024 Oct 31 14:14:20.360966 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1583/2926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:19 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:20.453000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:20.460876 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-033cf949-0690-4265-8fe4-352fc7a40ae2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.175914 Oct 31 14:14:20.461447 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1344/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:20 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:20.580164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:20.581089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:20.591382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.593176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.596352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.597567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.598296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.599193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.606744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6d6086e0-ab65-45bf-88dd-31fa491079d9 req-9a966b00-e1e6-4cdb-b419-39564c7d51fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea579a46-25e3-4eb5-932b-6560f541013d", "name": "network-vif-deleted", "tag": "ee35761d-886d-45ee-84b9-2b3093c4eb60"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:20.617001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6d6086e0-ab65-45bf-88dd-31fa491079d9 req-9a966b00-e1e6-4cdb-b419-39564c7d51fb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.617719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6d6086e0-ab65-45bf-88dd-31fa491079d9 req-9a966b00-e1e6-4cdb-b419-39564c7d51fb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.618379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6d6086e0-ab65-45bf-88dd-31fa491079d9 req-9a966b00-e1e6-4cdb-b419-39564c7d51fb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.631407 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6d6086e0-ab65-45bf-88dd-31fa491079d9 req-9a966b00-e1e6-4cdb-b419-39564c7d51fb service nova] Creating event network-vif-deleted:ee35761d-886d-45ee-84b9-2b3093c4eb60 for instance ea579a46-25e3-4eb5-932b-6560f541013d on n-h2-863052-1 Oct 31 14:14:20.636565 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6d6086e0-ab65-45bf-88dd-31fa491079d9 req-9a966b00-e1e6-4cdb-b419-39564c7d51fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034165 Oct 31 14:14:20.641337 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1345/2928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:20.687836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:20.695862 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8ef792d-6fb9-47bb-903a-4414d3f65bc2 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1475 microversion: 2.1 time: 0.120645 Oct 31 14:14:20.696639 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1584/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:20 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1475 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:20.720045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:20.721067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:20.727941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.728544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.728988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.729688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:20.730274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:20.730665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:20.866919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:20.874852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed91eae7-54a7-4edf-bb3b-aed96430aab8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.159476 Oct 31 14:14:20.875421 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1346/2930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:20 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:21.034694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:21.036228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:21.046502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.047497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.048202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.048909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.049368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.049877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.113789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:21.123436 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd3dd563-88f2-4f29-817a-05037fd5ad74 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1259 microversion: 2.1 time: 0.094265 Oct 31 14:14:21.124049 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1585/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:21 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1259 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:21.308817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:21.309462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:21.316127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.316619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.317056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.317747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.318316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.318656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.379377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:21.388393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-274188f3-01a6-475b-91f4-6e9c6a67a86f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1212 microversion: 2.1 time: 0.083447 Oct 31 14:14:21.389209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1347/2932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:21 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:21.484899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:21.485521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:21.492014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.492496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.492929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.493609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.494063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.494761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.621224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:21.629378 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97bd560d-022e-4fa7-a6c2-67a006ab83c1 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1316 microversion: 2.1 time: 0.148407 Oct 31 14:14:21.629949 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1586/2933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:21 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:21.720350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:21.721006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:21.727929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.728434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.728875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.729583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.730708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.731206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.767242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.767725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.768161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.768606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lazy-loading 'fault' on Instance uuid ea579a46-25e3-4eb5-932b-6560f541013d {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:21.807534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:21.815589 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f2aafe6-3ebe-442d-8ad2-1a0ded17330e tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1310 microversion: 2.1 time: 0.099714 Oct 31 14:14:21.816171 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1348/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:21 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:21.898405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:21.899139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:21.906750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.907485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.908133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:21.909476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:21.910387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:21.910892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.145588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:22.145911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:22.146558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:22.148271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:22.150850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:22.154401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.154998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.155539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.156120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc9844c6-709d-41bd-960e-7c75f6f2b19a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.261679 Oct 31 14:14:22.156427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.166221 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1587/2935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:21 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:22.166663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.166663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.192665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:22.228014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:22.237936 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3c0e7fa-ae96-4877-b098-0ab96d4767b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1265 microversion: 2.1 time: 0.096126 Oct 31 14:14:22.238561 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1349/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:22 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:22.412266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:22.412824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:22.419532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.420130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.420581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.421277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.421788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.422241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.487950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:22.496170 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdef60c3-12b9-4a2a-ab3a-28ad5fcee2b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1268 microversion: 2.1 time: 0.088720 Oct 31 14:14:22.496762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1588/2937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:22 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1268 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:22.653112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:22.654297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:22.663132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.663557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.664014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.664685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.665135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.665558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.828861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:22.839891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:22.840649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:22.841251 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6e16ae8-7c04-4c2c-88e8-a73ad8a1aadc tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1466 microversion: 2.1 time: 0.191796 Oct 31 14:14:22.842095 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1350/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:22 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1466 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:22.849014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.850016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.850665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.851564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.852237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.852880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.876447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:22.879292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:22.890057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.890920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.891353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.892309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.893053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.893708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.916368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:22.917148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:22.917661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:22.918214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lazy-loading 'fault' on Instance uuid ea579a46-25e3-4eb5-932b-6560f541013d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:23.055267 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78462ff3-40c5-4484-a2e9-a18b9f04d6e8 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1617 microversion: 2.1 time: 0.190830 Oct 31 14:14:23.055851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1351/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:22 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1617 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:23.093080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:23.102208 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-390e3a7f-1724-4278-a050-44ad68c11475 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1310 microversion: 2.1 time: 0.266982 Oct 31 14:14:23.102820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1589/2940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:22 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1310 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:23.187880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:23.188502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:23.190674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-776143013", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3a5f08e7-abcf-4dac-baf3-4b84313cf486"]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:23.194726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:23.195206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:23.195646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:23.196349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:23.196810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:23.197239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:23.257951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:14:23.368623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:23.377684 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be821391-2867-48ae-9d03-db87291b6759 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.199952 Oct 31 14:14:23.378352 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1352/2941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:23 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:23.384322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:23.385038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:23.391739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:23.392291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:23.392877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:23.393628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:23.394302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:23.394924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:23.539958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:23.548007 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d161b114-74c5-4c8c-a310-e47756168b40 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.168267 Oct 31 14:14:23.548600 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1353/2942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:23 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:23.553640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:23.554281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:23.561053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:23.561556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:23.562067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:23.562820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:23.563275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:23.563728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:23.580331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:23.629738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:23.637988 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd91939a-4b50-4412-b505-c5bb7ee9e1b8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1274 microversion: 2.1 time: 0.088328 Oct 31 14:14:23.638633 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1354/2943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:23 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:24.128354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:24.129007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:24.135735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.136228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.136725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.137538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.138157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.138630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.142291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:14:24.150284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:14:24.150821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:14:24.151345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:14:24.151655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:14:24.168899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.169499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.170053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.170881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.172273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.172770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.179895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=21 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:24.191098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.192100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.192933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:14:24.193061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.193766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lazy-loading 'fault' on Instance uuid ea579a46-25e3-4eb5-932b-6560f541013d {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:24.199452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:14:24.228915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:14:24.231924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:24.247755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:24.259005 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad6c8dfd-28f9-402a-928f-49e507cd48ec tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 200 len: 1310 microversion: 2.1 time: 0.134317 Oct 31 14:14:24.259589 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1355/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:24 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 1310 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:24.291206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50f36a28-285a-41c8-8fe6-d389c7a8d7b7 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109524 Oct 31 14:14:24.292734 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1590/2945] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:14:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:14:24.303611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8beec1e5-7d58-40a9-936e-ef2f658a5245 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:24.304249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8beec1e5-7d58-40a9-936e-ef2f658a5245 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:24.380366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8beec1e5-7d58-40a9-936e-ef2f658a5245 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:24.393134 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8beec1e5-7d58-40a9-936e-ef2f658a5245 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1216 microversion: 2.1 time: 0.093397 Oct 31 14:14:24.394446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1356/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:24 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:24.403407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:24.404003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:24.413806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.414498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.415019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.415813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.416430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.417307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.572788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:24.573659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:24.583244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.583804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.584256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.585218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.585588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.586372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.777671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:24.787073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8507344b-2bd0-4c4d-b75f-963b85020550 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.219624 Oct 31 14:14:24.787787 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1357/2947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:24 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:24.792462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:24.793110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:24.799399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.799899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.800342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.801048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:24.801513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:24.801938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:24.822609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:24.836083 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d4ae410-5279-4585-bc35-3a3c2627d250 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1471 microversion: 2.1 time: 0.438358 Oct 31 14:14:24.836679 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1591/2948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:24 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1471 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:24.878536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:24.887984 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65208b67-d953-478f-8f9e-26e03c8e05c8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1274 microversion: 2.1 time: 0.099043 Oct 31 14:14:24.888663 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1358/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:24 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:25.287374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:25.291290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: ea579a46-25e3-4eb5-932b-6560f541013d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:25.312474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-505a4852-827e-4d6f-b150-a55525d77656 req-455f693c-f27f-4ad7-89ad-4446f6d83645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e505dec-1e44-49fa-9142-6f61b3c3dcba", "tag": "47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:25.333775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.337153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.337635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.338113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:25.339263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.340667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-505a4852-827e-4d6f-b150-a55525d77656 req-455f693c-f27f-4ad7-89ad-4446f6d83645 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.341086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.341217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-505a4852-827e-4d6f-b150-a55525d77656 req-455f693c-f27f-4ad7-89ad-4446f6d83645 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.341621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-505a4852-827e-4d6f-b150-a55525d77656 req-455f693c-f27f-4ad7-89ad-4446f6d83645 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.343962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.364625 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-505a4852-827e-4d6f-b150-a55525d77656 req-455f693c-f27f-4ad7-89ad-4446f6d83645 service nova] Creating event network-changed:47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75 for instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba on n-h2-863052-1 Oct 31 14:14:25.384954 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-505a4852-827e-4d6f-b150-a55525d77656 req-455f693c-f27f-4ad7-89ad-4446f6d83645 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088830 Oct 31 14:14:25.385869 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1359/2950] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:25.387525 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] HTTP exception thrown: Instance ea579a46-25e3-4eb5-932b-6560f541013d could not be found. Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Request method failure captured: Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d HTTP/1.1 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fyq9JwM6HSSGCjziAZwYLh_uXfHCKkk74tUywQPwrn4Jhv6LeGqy09UVlrfcSLCWwSC6AgijymQmOIHTYioIxqGYJvuut3hUAMXnLFX6NS7rLLA31wya-BYN_kHe5Eb5l6dG5kFLOSQcoBjLd6clkCX0Nf-Hd-2vEMHaIscI3XGls Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b9a113f86e2047aca741e92fbc200efc Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9a113f86e2047aca741e92fbc200efc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b9a113f86e2047aca741e92fbc200efc Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ListServerFiltersTestJSON-1661317145-project Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 11f100f7c1e14e63866708635b26081d Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ListServerFiltersTestJSON-1661317145-project Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ea579a46-25e3-4eb5-932b-6560f541013d could not be found. Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ea579a46-25e3-4eb5-932b-6560f541013d'} Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea579a46-25e3-4eb5-932b-6560f541013d could not be found. Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea579a46-25e3-4eb5-932b-6560f541013d could not be found. Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:25.389783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea579a46-25e3-4eb5-932b-6560f541013d could not be found. Oct 31 14:14:25.395613 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:25.398404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Returning 404 to user: Instance ea579a46-25e3-4eb5-932b-6560f541013d could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:14:25.399891 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7fe829b-c6c3-4ac3-b328-12a21de80361 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d" status: 404 len: 111 microversion: 2.1 time: 0.121167 Oct 31 14:14:25.400883 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1592/2951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:25 2022] GET /compute/v2.1/servers/ea579a46-25e3-4eb5-932b-6560f541013d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:14:25.410222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:25.410752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:25.421178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:25.422530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:25.422964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.423466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.423908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.424613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.425067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.425492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.430720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.431224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.431684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.432391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.432850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.433280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.454752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:25.564024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a9d3c58-06c1-4096-b383-8f252ba0baa4 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 204 len: 0 microversion: 2.1 time: 0.158637 Oct 31 14:14:25.564622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1360/2952] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:25 2022] DELETE /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:25.572857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:25.573556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:25.580078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.580629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.581071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.581976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.582426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.582852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.645266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:25.653957 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42cf289d-80bb-41ac-ad70-46b29f58a3c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1268 microversion: 2.1 time: 0.238686 Oct 31 14:14:25.654954 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1593/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:25 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1268 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:25.727814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:25.735596 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-345bbd12-217b-451b-86fc-c6b984ce804b tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 200 len: 1519 microversion: 2.1 time: 0.166749 Oct 31 14:14:25.736258 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1361/2954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:25 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:25.810523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:25.811129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:25.817270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.817748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.818195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.818867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.819312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.819725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.859041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:25.859582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:25.865462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.865962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.866413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:25.867104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:25.867557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:25.867979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.020813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:26.032038 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a02eb8f-60d2-4e6c-b485-07ddf48c1a6f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.176605 Oct 31 14:14:26.032637 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1362/2955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:25 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:26.038852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:26.039473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:26.046620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:26.047129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:26.047565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.049205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:26.049692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:26.050283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.127366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:26.147495 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2f51a14-85bc-4f8f-98ea-f473144f5cfa tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.340531 Oct 31 14:14:26.150733 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1594/2956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:25 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:26.306938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:26.315544 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d11fcf9b-ad62-4162-b0cc-a6807aedce2b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.281886 Oct 31 14:14:26.316871 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1363/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:26 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:26.678186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:26.678804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:26.685764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:26.686284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:26.686729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.687991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:26.688449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:26.688880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.758302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:26.759021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:26.775383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:26.786899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:26.787363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.788492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:26.789117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:26.789874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:26.833978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:26.844106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d39c84e-cfdc-4066-aea1-2fd6178fec83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.169079 Oct 31 14:14:26.861095 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1595/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:26 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:26.993809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:27.006359 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1efa885-3512-439b-a9b4-d9b81c5dd76d tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 200 len: 1519 microversion: 2.1 time: 0.251837 Oct 31 14:14:27.006988 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1364/2959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:26 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:27.057751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:27.058857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:27.065362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.065906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.066454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.067684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.068223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.068725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.173582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:27.174396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:27.180772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.181383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.182086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.183292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.184291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.184796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.305428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:27.314465 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d956b9f-3d5e-4c1c-867c-efae442b0d5b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.261370 Oct 31 14:14:27.327019 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1596/2960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:27 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:27.339352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:27.340591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:27.341209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:27.348000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.348702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.349309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4107748f-7ff6-4e7c-a0f8-7cace1d329e9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.180781 Oct 31 14:14:27.349471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.350225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1365/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:27 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:27.350547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.351151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.351748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.418559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fa650bdf-f237-4774-be92-c0a45436f54d req-262dc0f2-e8b2-43b9-9f47-3dc9ebb08e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b38e55-8de4-410e-a50b-3f7bb1b1a8e1", "tag": "5b66d6a7-caf2-42a2-896d-d35600a3cd96"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:27.428010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fa650bdf-f237-4774-be92-c0a45436f54d req-262dc0f2-e8b2-43b9-9f47-3dc9ebb08e71 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.428707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fa650bdf-f237-4774-be92-c0a45436f54d req-262dc0f2-e8b2-43b9-9f47-3dc9ebb08e71 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.429134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fa650bdf-f237-4774-be92-c0a45436f54d req-262dc0f2-e8b2-43b9-9f47-3dc9ebb08e71 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.440704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fa650bdf-f237-4774-be92-c0a45436f54d req-262dc0f2-e8b2-43b9-9f47-3dc9ebb08e71 service nova] Creating event network-changed:5b66d6a7-caf2-42a2-896d-d35600a3cd96 for instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 on n-h2-863052-1 Oct 31 14:14:27.445466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fa650bdf-f237-4774-be92-c0a45436f54d req-262dc0f2-e8b2-43b9-9f47-3dc9ebb08e71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030465 Oct 31 14:14:27.446066 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1366/2962] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:27.580592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:27.588216 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cbb2b47-105b-41d2-a84d-2930a6be7cb2 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.251569 Oct 31 14:14:27.588977 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1597/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:27 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:27.876727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:27.879891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:27.887390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.888178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.888846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:27.889973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:27.891284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:27.892249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.028925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:28.030784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:28.040720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.041460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.042444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.043524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.045117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.046132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.108246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.110957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.116009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.116698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lazy-loading 'fault' on Instance uuid 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:28.194652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:28.206922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4e7ce6c-145a-44de-9d5c-b921010a5798 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 200 len: 1311 microversion: 2.1 time: 0.181532 Oct 31 14:14:28.209765 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1598/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:28 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 1311 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:28.340333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:28.341213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:28.350747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.351161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.351603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.352318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.352771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.353196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.580995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:28.600695 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2713dbc0-1d8a-4971-b488-65f72391eb47 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.735836 Oct 31 14:14:28.610781 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1367/2965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:27 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:28.624145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:28.625066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:28.634212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.634706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.635148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.635863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.637520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.638570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.907733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:28.917031 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2d727dd4-5888-47b1-bf6e-939db864527e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.297327 Oct 31 14:14:28.930749 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1368/2966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:28 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:28.938913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:28.939537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:28.946209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.947157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.947598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.948309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:28.948766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:28.949194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:28.984561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:28.993904 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5563f639-e5e0-4f14-bf90-4bd23d01d0cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.657671 Oct 31 14:14:28.994777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1599/2967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:28 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:29.164149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:29.173933 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c7b03ad-de78-498c-9496-e5aa5af1b8ed tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.241852 Oct 31 14:14:29.174693 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1369/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:28 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:29.195827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a96ee6b0-2f22-438f-a943-e0f8ebd11df5 req-e7760c4c-2c6d-4e8c-8bfb-fa99d7f831b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5003288-803c-4978-9978-481913ea83ba", "tag": "33882760-ff33-41e2-b172-5c8ca241464d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:29.207806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a96ee6b0-2f22-438f-a943-e0f8ebd11df5 req-e7760c4c-2c6d-4e8c-8bfb-fa99d7f831b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.208286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a96ee6b0-2f22-438f-a943-e0f8ebd11df5 req-e7760c4c-2c6d-4e8c-8bfb-fa99d7f831b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.208720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a96ee6b0-2f22-438f-a943-e0f8ebd11df5 req-e7760c4c-2c6d-4e8c-8bfb-fa99d7f831b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.221800 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a96ee6b0-2f22-438f-a943-e0f8ebd11df5 req-e7760c4c-2c6d-4e8c-8bfb-fa99d7f831b0 service nova] Creating event network-changed:33882760-ff33-41e2-b172-5c8ca241464d for instance a5003288-803c-4978-9978-481913ea83ba on n-h2-863052-1 Oct 31 14:14:29.227302 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a96ee6b0-2f22-438f-a943-e0f8ebd11df5 req-e7760c4c-2c6d-4e8c-8bfb-fa99d7f831b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035166 Oct 31 14:14:29.228811 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1600/2969] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:29.244844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:29.245476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:29.252632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.253348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.254104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.255128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.255588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.256024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.272616 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] HTTP exception thrown: Instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a could not be found. Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Request method failure captured: Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a HTTP/1.1 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fyq9JwM6HSSGCjziAZwYLh_uXfHCKkk74tUywQPwrn4Jhv6LeGqy09UVlrfcSLCWwSC6AgijymQmOIHTYioIxqGYJvuut3hUAMXnLFX6NS7rLLA31wya-BYN_kHe5Eb5l6dG5kFLOSQcoBjLd6clkCX0Nf-Hd-2vEMHaIscI3XGls Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b9a113f86e2047aca741e92fbc200efc Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9a113f86e2047aca741e92fbc200efc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b9a113f86e2047aca741e92fbc200efc Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListServerFiltersTestJSON-1661317145-project Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 11f100f7c1e14e63866708635b26081d Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListServerFiltersTestJSON-1661317145-project Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a could not be found. Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '4ea2bec9-7f33-4d04-b417-d68ac0c3e19a'} Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a could not be found. Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a could not be found. Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:29.274331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a could not be found. Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Returning 404 to user: Instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7d4079b-8876-46db-a9ab-f60717db0c45 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a" status: 404 len: 111 microversion: 2.1 time: 0.037835 Oct 31 14:14:29.279811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1370/2970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:29 2022] GET /compute/v2.1/servers/4ea2bec9-7f33-4d04-b417-d68ac0c3e19a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:14:29.288658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:29.290501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:29.296071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:29.300498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.301008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.302750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.303483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.304064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.304381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.333002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:29.425519 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08cb7fc7-5a58-4fc0-acaf-b2d2d576d4d3 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 204 len: 0 microversion: 2.1 time: 0.144182 Oct 31 14:14:29.426444 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1601/2971] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:29 2022] DELETE /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:29.434963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:29.435593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:29.443803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.444829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.445329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.446621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.447538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.447992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.560287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-de9fb570-9fa3-4017-b000-bd698e0f1b64 req-9cdf815c-7a9f-4f42-80dc-ee43fbc08541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea2bec9-7f33-4d04-b417-d68ac0c3e19a", "name": "network-vif-deleted", "tag": "8641d05e-a4e9-4d0b-86cc-d4dbca95b99d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:29.572919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-de9fb570-9fa3-4017-b000-bd698e0f1b64 req-9cdf815c-7a9f-4f42-80dc-ee43fbc08541 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.573409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-de9fb570-9fa3-4017-b000-bd698e0f1b64 req-9cdf815c-7a9f-4f42-80dc-ee43fbc08541 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.573844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-de9fb570-9fa3-4017-b000-bd698e0f1b64 req-9cdf815c-7a9f-4f42-80dc-ee43fbc08541 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.585945 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-de9fb570-9fa3-4017-b000-bd698e0f1b64 req-9cdf815c-7a9f-4f42-80dc-ee43fbc08541 service nova] Creating event network-vif-deleted:8641d05e-a4e9-4d0b-86cc-d4dbca95b99d for instance 4ea2bec9-7f33-4d04-b417-d68ac0c3e19a on n-h1-863052-1 Oct 31 14:14:29.591124 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-de9fb570-9fa3-4017-b000-bd698e0f1b64 req-9cdf815c-7a9f-4f42-80dc-ee43fbc08541 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116122 Oct 31 14:14:29.591766 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1602/2972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:29.633356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:29.634001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:29.641644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.642155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.642620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.643615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.644085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.644514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.682360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:29.690918 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4654db2-6b45-434b-bc54-c98d0a1dbb9c tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1518 microversion: 2.1 time: 0.260426 Oct 31 14:14:29.691746 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1371/2973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:29 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:29.781995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:29.789888 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81daf2f1-f995-4ad7-9dd3-258b0c296c5b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.162221 Oct 31 14:14:29.790692 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1603/2974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:29 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:29.943979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:29.944489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:29.951473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.951964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.952438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.953137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:29.953620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:29.954052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:29.956854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:30.018004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:30.018671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:30.026318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.026814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.027259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.027962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.028418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.028847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.090117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:30.098403 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bea1adf8-a5d9-43a4-8e14-2c550898d632 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.158339 Oct 31 14:14:30.101001 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1372/2975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:29 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:30.164609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:30.166990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:30.175679 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b75e1e5-b5c5-4ab2-a4aa-317fb9243dab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.162591 Oct 31 14:14:30.176283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1604/2976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:30 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:30.197181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:30.197821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:30.204755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.205276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.205762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.206511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.206967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.207420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.341925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:30.350215 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fad315ed-93fb-4081-81ae-74c3a102a80b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.157079 Oct 31 14:14:30.350785 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1373/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:30 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:30.714190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:30.714850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:30.722806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.723288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.723724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.724406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.724857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.725302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.813647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:30.814287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:30.820415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.820904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.821344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.822041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:30.822534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:30.822960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:30.861835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:30.870132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4f3d5c0-9529-44a5-b7b4-b15997c37730 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1518 microversion: 2.1 time: 0.159850 Oct 31 14:14:30.870737 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1605/2978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:30 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:31.027451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:31.035537 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2d97f47-8823-410b-bf3d-d730bf52c844 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.226315 Oct 31 14:14:31.036114 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1374/2979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:30 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:31.121322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:31.121964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:31.128566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.129047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.129481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.130186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.130641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.131066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.198933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:31.199550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:31.205485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.206001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.206423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.207698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.208267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.208720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.285419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:31.297736 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62f55b43-1ffb-4487-89c1-a4340b28ef8e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.180409 Oct 31 14:14:31.298728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1606/2980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:31 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:31.344634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:31.352340 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f265c9d3-dd40-41ba-9ec5-11309355a70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.157203 Oct 31 14:14:31.353138 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1375/2981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:31 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:31.373518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:31.374059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:31.380097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.380591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.381031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.381736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.382221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.382663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.596637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:31.604672 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38f9c2bf-2d02-4707-b5b7-e06695c662bc tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.235396 Oct 31 14:14:31.605348 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1607/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:31 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:31.804745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2dcaf27f-94a1-4ef9-87ee-982545f837f1 req-7fcb0db6-4e07-4e94-a2ad-23c37a14e146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55df226-8bb5-4356-8465-5b2936c41cff", "name": "network-vif-deleted", "tag": "ef96cb54-c6d9-4ee8-9523-dc0e4738f622"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:31.817415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2dcaf27f-94a1-4ef9-87ee-982545f837f1 req-7fcb0db6-4e07-4e94-a2ad-23c37a14e146 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.818671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2dcaf27f-94a1-4ef9-87ee-982545f837f1 req-7fcb0db6-4e07-4e94-a2ad-23c37a14e146 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.819112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2dcaf27f-94a1-4ef9-87ee-982545f837f1 req-7fcb0db6-4e07-4e94-a2ad-23c37a14e146 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.833309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2dcaf27f-94a1-4ef9-87ee-982545f837f1 req-7fcb0db6-4e07-4e94-a2ad-23c37a14e146 service nova] Creating event network-vif-deleted:ef96cb54-c6d9-4ee8-9523-dc0e4738f622 for instance e55df226-8bb5-4356-8465-5b2936c41cff on n-h1-863052-1 Oct 31 14:14:31.838959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2dcaf27f-94a1-4ef9-87ee-982545f837f1 req-7fcb0db6-4e07-4e94-a2ad-23c37a14e146 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038066 Oct 31 14:14:31.841227 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1376/2983] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:31.894405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:31.895117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:31.903687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.904351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.904893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.906349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.906906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.907696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.942728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:31.943216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:31.943653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:31.944107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lazy-loading 'fault' on Instance uuid e55df226-8bb5-4356-8465-5b2936c41cff {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:31.987450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f100f7c1e14e63866708635b26081d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a113f86e2047aca741e92fbc200efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:31.996043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad67ccbb-6b25-44c6-824b-a68e944f61a9 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 200 len: 1310 microversion: 2.1 time: 0.106214 Oct 31 14:14:31.996725 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1608/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:31 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:32.061423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:32.062809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:32.070279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.070769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.071300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.071995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.072442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.072888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.219684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:32.227893 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5b51842-b7dc-4c9e-b9ce-997bfb360b2d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.171258 Oct 31 14:14:32.228401 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1377/2985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:32 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:32.320691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:32.321302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:32.328473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.328950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.329384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.330057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.330536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.330959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.376726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:32.377339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:32.383736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.384225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.384663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.385373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.385829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.386276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.471479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:32.480286 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19b54b21-4c5b-4c08-b65a-c2ea29728203 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.163240 Oct 31 14:14:32.482056 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1609/2986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:32 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:32.619834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:32.628837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:32.629153 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a6d49329-aabe-49e3-8203-eb2ec842ed8d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.256511 Oct 31 14:14:32.629687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:32.630260 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1378/2987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:32 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:32.635789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.636149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.636583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.637268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:32.637711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:32.638332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:32.770276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:32.777905 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9e3d467-7931-4fa5-8e63-189f211216d8 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.153387 Oct 31 14:14:32.778889 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1610/2988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:32 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:33.019843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:33.020365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] [instance: e55df226-8bb5-4356-8465-5b2936c41cff] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:33.026302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.026785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.027215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.027896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.028352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.028773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.042015 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] HTTP exception thrown: Instance e55df226-8bb5-4356-8465-5b2936c41cff could not be found. Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Request method failure captured: Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff HTTP/1.1 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fyq9JwM6HSSGCjziAZwYLh_uXfHCKkk74tUywQPwrn4Jhv6LeGqy09UVlrfcSLCWwSC6AgijymQmOIHTYioIxqGYJvuut3hUAMXnLFX6NS7rLLA31wya-BYN_kHe5Eb5l6dG5kFLOSQcoBjLd6clkCX0Nf-Hd-2vEMHaIscI3XGls Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b9a113f86e2047aca741e92fbc200efc Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9a113f86e2047aca741e92fbc200efc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9a113f86e2047aca741e92fbc200efc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b9a113f86e2047aca741e92fbc200efc Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1661317145 Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListServerFiltersTestJSON-1661317145-project Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 11f100f7c1e14e63866708635b26081d Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListServerFiltersTestJSON-1661317145-project Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e55df226-8bb5-4356-8465-5b2936c41cff could not be found. Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e55df226-8bb5-4356-8465-5b2936c41cff'} Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55df226-8bb5-4356-8465-5b2936c41cff could not be found. Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55df226-8bb5-4356-8465-5b2936c41cff could not be found. Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:33.043679 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55df226-8bb5-4356-8465-5b2936c41cff could not be found. Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] Returning 404 to user: Instance e55df226-8bb5-4356-8465-5b2936c41cff could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9079a28-43c7-45d2-8414-0ec67401cde5 tempest-ListServerFiltersTestJSON-1661317145 tempest-ListServerFiltersTestJSON-1661317145-project] 10.222.0.27 "GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff" status: 404 len: 111 microversion: 2.1 time: 0.029869 Oct 31 14:14:33.048007 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1379/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:33 2022] GET /compute/v2.1/servers/e55df226-8bb5-4356-8465-5b2936c41cff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:14:33.252638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:33.253295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:33.260946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.261461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.261892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.262615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.263065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.263487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.498824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:33.504806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:33.505943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:33.508598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-831e763d-b9cc-4aa8-b610-8e7235b2134a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.260444 Oct 31 14:14:33.509272 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1611/2990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:33 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:33.517702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.518852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.519464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.521589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.522548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.523273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.652678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:33.653385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:33.660076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.660860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.661484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.662624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.663140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.663778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.704268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:33.712415 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bec2f280-c7a8-4e1b-9cd2-48d320d7e578 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.212924 Oct 31 14:14:33.713008 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1380/2991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:33 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:33.804495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:33.805590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:33.813584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.814028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.814494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.815250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.815762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.816337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.860616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:33.878086 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-418d239d-013a-4c01-9311-c6f760236a64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.228741 Oct 31 14:14:33.879170 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1612/2992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:33 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:33.884384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9e92a85c-4ac5-49d8-87ea-6b712d700a73 req-c1d1d15d-5c72-4c54-a57f-4994c568377e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e505dec-1e44-49fa-9142-6f61b3c3dcba", "name": "network-vif-plugged", "status": "completed", "tag": "47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:33.902820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e92a85c-4ac5-49d8-87ea-6b712d700a73 req-c1d1d15d-5c72-4c54-a57f-4994c568377e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:33.903581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e92a85c-4ac5-49d8-87ea-6b712d700a73 req-c1d1d15d-5c72-4c54-a57f-4994c568377e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:33.904489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e92a85c-4ac5-49d8-87ea-6b712d700a73 req-c1d1d15d-5c72-4c54-a57f-4994c568377e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:33.919877 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9e92a85c-4ac5-49d8-87ea-6b712d700a73 req-c1d1d15d-5c72-4c54-a57f-4994c568377e service nova] Creating event network-vif-plugged:47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75 for instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba on n-h2-863052-1 Oct 31 14:14:33.928417 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9e92a85c-4ac5-49d8-87ea-6b712d700a73 req-c1d1d15d-5c72-4c54-a57f-4994c568377e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046674 Oct 31 14:14:33.929979 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1613/2993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:34.058592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:34.076160 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3639841c-7d52-4c49-9db6-762de97fd2ca tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.277770 Oct 31 14:14:34.098073 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1381/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:33 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:34.533694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:34.534519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:34.536671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:34.537418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:34.544952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:34.546057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:34.547232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:34.548038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:34.548601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:34.549145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:34.700925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:34.712591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8a29577-a43e-4600-8ba7-4d8a91463e71 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.184543 Oct 31 14:14:34.713265 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1614/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:34 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:34.735877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:34.736493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:34.738548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:34.744966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:34.745454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:34.745890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:34.746614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:34.747071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:34.747495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:34.885417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:34.891785 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18db3d90-b30e-4719-adb8-87ed203c27e6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1307 microversion: 2.1 time: 0.159765 Oct 31 14:14:34.892437 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1382/2996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:34 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:34.914465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:34.915088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:34.921886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:34.922398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:34.922833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:34.923525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:34.923980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:34.924420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.061376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:35.069449 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9013295-8ecc-433e-ba7d-4f222e129bbe tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.160238 Oct 31 14:14:35.078312 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1615/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:34 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:35.115532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:35.116311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:35.123238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:35.123730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:35.124218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.124943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:35.125423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:35.125874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.258462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:35.266110 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e4664ed3-f26e-4ce1-8d23-e6477b81ace9 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.154787 Oct 31 14:14:35.266708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1383/2998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:35 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:35.736927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:35.738352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:35.746083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:35.746978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:35.747649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.748573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:35.749271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:35.749909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.916240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:35.916940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:35.925354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:35.926313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:35.926842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.927676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:35.928163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:35.928592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:35.988566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:36.001104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed65de35-c065-4034-b06a-8d5cf7a64baa tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.267769 Oct 31 14:14:36.002976 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1616/2999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:35 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:36.007798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2f40b393-faef-467c-bbcb-6dc7aa80cb9c req-08c40a6b-3c33-42d8-8fd6-e9921f0df57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b38e55-8de4-410e-a50b-3f7bb1b1a8e1", "name": "network-vif-plugged", "status": "completed", "tag": "5b66d6a7-caf2-42a2-896d-d35600a3cd96"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:36.018066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2f40b393-faef-467c-bbcb-6dc7aa80cb9c req-08c40a6b-3c33-42d8-8fd6-e9921f0df57e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.018585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2f40b393-faef-467c-bbcb-6dc7aa80cb9c req-08c40a6b-3c33-42d8-8fd6-e9921f0df57e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.019012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2f40b393-faef-467c-bbcb-6dc7aa80cb9c req-08c40a6b-3c33-42d8-8fd6-e9921f0df57e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.032429 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2f40b393-faef-467c-bbcb-6dc7aa80cb9c req-08c40a6b-3c33-42d8-8fd6-e9921f0df57e service nova] Creating event network-vif-plugged:5b66d6a7-caf2-42a2-896d-d35600a3cd96 for instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 on n-h2-863052-1 Oct 31 14:14:36.039544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2f40b393-faef-467c-bbcb-6dc7aa80cb9c req-08c40a6b-3c33-42d8-8fd6-e9921f0df57e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Oct 31 14:14:36.040518 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1617/3000] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:36.095282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:36.095997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:36.107322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.107735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.108183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.108934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.109395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.109881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:36.115080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.121451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04cedf34-b581-409c-ba2e-7e8007717627 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1488 microversion: 2.1 time: 0.209871 Oct 31 14:14:36.122910 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1384/3001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:35 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1488 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:36.146679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:36.147205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:36.165934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.166864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.170606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.175708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.176494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.177369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.216712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lazy-loading 'flavor' on Instance uuid 9e505dec-1e44-49fa-9142-6f61b3c3dcba {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:36.302138 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd9e4170-10f6-4a1c-90fa-191863dea6dc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba/action" status: 202 len: 0 microversion: 2.1 time: 0.158985 Oct 31 14:14:36.306376 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1385/3002] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:36 2022] POST /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:14:36.312186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:36.313072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:36.319515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.320007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.320483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.321149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.321821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.322277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.459357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:36.470915 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48f07b21-d2c6-4278-a302-710ecf5cec0e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.381594 Oct 31 14:14:36.472135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1618/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:36 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:36.477480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:36.478314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:36.485968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.486728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.487356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.488214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:36.488846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:36.489459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:36.493109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:36.509390 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ae350b5-b7ad-4acf-961a-e10b3a59c7fb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.201334 Oct 31 14:14:36.509994 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1386/3004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:36 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:36.752306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:36.762506 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da4e3c20-cae7-416e-93a2-c37eef1f1e1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1496 microversion: 2.1 time: 0.288909 Oct 31 14:14:36.763085 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1619/3005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:36 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1496 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:37.024998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:37.025644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:37.034276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.034907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.035356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.036068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.036738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.037389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.212970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:37.223943 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-91034785-2782-437f-a39e-eb54cb142d09 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.202812 Oct 31 14:14:37.224733 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1387/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:37 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:37.497951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:37.498832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:37.505793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.506325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.506759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.507460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.507907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.508325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.534083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:37.534739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:37.548871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.549444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.549902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.550700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.551160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.551592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.568618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:37.700967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:37.709819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b19b809-0dc2-4364-9be6-884e6def960f tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1316 microversion: 2.1 time: 0.180161 Oct 31 14:14:37.711085 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1388/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:37 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:37.788086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:37.788772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:37.795168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.795669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.796654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.797370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:37.797827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:37.798282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:37.954403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:37.972117 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b7ff2c5-31de-4745-b1b1-fb2cb1661205 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 200 len: 1479 microversion: 2.1 time: 0.187952 Oct 31 14:14:37.973031 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1389/3008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:37 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 1479 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:37.996849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1597064647"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:38.000723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:38.008693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.009510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.010277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.013122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.013940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.015489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.056371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:38.065947 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ced9f93d-cdd3-4c9d-a5ac-67ea5fd42ce4 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.572786 Oct 31 14:14:38.067137 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1620/3009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:37 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:38.230715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ba800fd-368c-47bf-8bcf-cf1c19df303e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba/action" status: 202 len: 0 microversion: 2.1 time: 0.238406 Oct 31 14:14:38.231672 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1390/3010] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:37 2022] POST /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 31 14:14:38.243405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9ed1bd5-5f9a-4232-88c2-48072c80af49 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1076c1310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:38.258829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:38.261412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:38.276211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.277529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.278586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.279808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.281081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.281855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.320840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9ed1bd5-5f9a-4232-88c2-48072c80af49 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.081667 Oct 31 14:14:38.323569 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1621/3011] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:38 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:38.546496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:38.559273 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d427308-1e23-453d-9656-27322f578d68 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.306861 Oct 31 14:14:38.561878 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1391/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:38 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:38.734243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:38.735569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:38.739893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d0b3e7d3-e9ee-4178-987f-2fc7545b35ca req-0f17e5a0-ddff-4648-8582-1efe2a0255b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5003288-803c-4978-9978-481913ea83ba", "name": "network-vif-plugged", "status": "completed", "tag": "33882760-ff33-41e2-b172-5c8ca241464d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:38.744101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.745536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.746109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.747063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.747628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.748347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.752603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d0b3e7d3-e9ee-4178-987f-2fc7545b35ca req-0f17e5a0-ddff-4648-8582-1efe2a0255b9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:38.753341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d0b3e7d3-e9ee-4178-987f-2fc7545b35ca req-0f17e5a0-ddff-4648-8582-1efe2a0255b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:38.753925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d0b3e7d3-e9ee-4178-987f-2fc7545b35ca req-0f17e5a0-ddff-4648-8582-1efe2a0255b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:38.774308 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d0b3e7d3-e9ee-4178-987f-2fc7545b35ca req-0f17e5a0-ddff-4648-8582-1efe2a0255b9 service nova] Creating event network-vif-plugged:33882760-ff33-41e2-b172-5c8ca241464d for instance a5003288-803c-4978-9978-481913ea83ba on n-h2-863052-1 Oct 31 14:14:38.798347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d0b3e7d3-e9ee-4178-987f-2fc7545b35ca req-0f17e5a0-ddff-4648-8582-1efe2a0255b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065685 Oct 31 14:14:38.800084 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1392/3013] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:39.071363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:39.087322 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3e1e8fa-f7df-448a-80aa-252b2db46d2d tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1506 microversion: 2.1 time: 0.357765 Oct 31 14:14:39.089944 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1622/3014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:38 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:39.103822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.104537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.121919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.122988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.137573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.140160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.140644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.141401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.141847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.142306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.146940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.148185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.148832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.151591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.152399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.155824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.210681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:39.235367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-572de53d-31b2-4417-b70b-6cb4ddbddfc7 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1/ips" status: 200 len: 110 microversion: 2.1 time: 0.120817 Oct 31 14:14:39.237883 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1623/3015] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1/ips => generated 110 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:39.254467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.255714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.264462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.265883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.266805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.267801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.268968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.269681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.310699 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-449acba0-a07c-44a9-a005-0790a84891ad tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1/ips" status: 200 len: 110 microversion: 2.1 time: 0.064988 Oct 31 14:14:39.312278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1624/3016] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1/ips => generated 110 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:39.324973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.326093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.336207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.337593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.338533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.339526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.348644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.349492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.392712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e55ca6e8-60d5-4c7f-9f1a-8c654b13161b tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1/ips/tempest-ServerAddressesTestJSON-1625464800-network" status: 200 len: 95 microversion: 2.1 time: 0.072964 Oct 31 14:14:39.396045 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1625/3017] 10.222.0.27 () {58 vars in 1401 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1/ips/tempest-ServerAddressesTestJSON-1625464800-network => generated 95 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:14:39.404474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b71fcde-2c37-402e-9f54-07c9fdef37f4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107979b80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.441198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:39.480313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b71fcde-2c37-402e-9f54-07c9fdef37f4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.082771 Oct 31 14:14:39.484129 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-909185f8-a4d9-4c06-895b-2ebb7273f33d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.397761 Oct 31 14:14:39.486679 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1626/3018] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:39.487192 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1393/3019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:39.493436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.495038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.520080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.521328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.524558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.526257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.527989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.529934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.576045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:39.583957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.584823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.596621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.597309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.598590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.601501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.602294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.605241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.708426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a608dc41-8f31-4148-9c7d-6e99ce49899e tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "DELETE /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 204 len: 0 microversion: 2.1 time: 0.219441 Oct 31 14:14:39.709261 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1627/3020] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:39 2022] DELETE /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:39.719152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.719797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.727313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.727858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.728362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.729109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.729561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.730029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.800233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:39.809239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c692654-d1fb-4482-b4b2-3c28772aa57d tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.229709 Oct 31 14:14:39.810292 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1394/3021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:39.816544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.817479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.823885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.824503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.825051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.825922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.826544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.827091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.838686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'services' on Instance uuid 692cbab4-8865-401a-8f21-4d26f7607f58 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:39.926505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9e97c58-dfe9-4779-a967-41779e9be54a tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments/601ea56b-505c-412e-9248-017047aaf8dc" status: 202 len: 0 microversion: 2.1 time: 0.212503 Oct 31 14:14:39.927416 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1628/3022] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:14:39 2022] DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments/601ea56b-505c-412e-9248-017047aaf8dc => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:14:39.935954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:39.938549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:39.945100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.945605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.946051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:39.946975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:39.947441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:39.947951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:40.005839 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9be9168-2f44-4d63-a659-a4002a7cd4bc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074145 Oct 31 14:14:40.007107 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1629/3023] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:40.030158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:40.042319 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7adafa9e-1db8-4326-9611-1d02bc1a7adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1512 microversion: 2.1 time: 0.229366 Oct 31 14:14:40.058359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1395/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:39 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:40.502659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c5383d3-a546-4f62-9aeb-bcd594344a1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107b8c5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:40.512473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:40.514458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:40.527020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:40.528736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:40.529410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:40.533423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:40.534178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:40.534838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:40.591677 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c5383d3-a546-4f62-9aeb-bcd594344a1f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.093785 Oct 31 14:14:40.592479 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1630/3025] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:40 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:40.724995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:40.735476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49e89eff-b4d3-49fe-9f0f-22175a698c1e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.227609 Oct 31 14:14:40.736252 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1396/3026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:40 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:40.842580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:40.849290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:40.867793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:40.868311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:40.868756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:40.869729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:40.870258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:40.870627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.020541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:41.023329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:41.032321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:41.033055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:41.034931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.035985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:41.036879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:41.037506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.135682 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c2215d7-4dc3-48df-96da-2419e1fb3b81 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120106 Oct 31 14:14:41.137008 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1397/3027] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:41 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:41.144212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:41.154006 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff2cd1ec-c5d6-4ffd-83a7-e25055282e8b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.322984 Oct 31 14:14:41.156439 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1631/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:40 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:41.159581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:41.161229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:41.174616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:41.175584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:41.176128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.176863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:41.177322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:41.177754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.439710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:41.448473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34642a8c-626d-420a-90bc-673dc8bb27bb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1512 microversion: 2.1 time: 0.309889 Oct 31 14:14:41.449323 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1398/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:41 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:41.540717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1711800153", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6179cdbb-0802-4df8-bd21-4260bbcffecd"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:41.594824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] validate_networks() for [('6179cdbb-0802-4df8-bd21-4260bbcffecd', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:14:41.607725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bb9fe1c-a213-4fa5-a43b-8bb95f2215e0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fb7e820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:41.653773 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bb9fe1c-a213-4fa5-a43b-8bb95f2215e0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.049688 Oct 31 14:14:41.654672 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1399/3030] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:41 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:41.760208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:41.760820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:41.767780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:41.768384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:41.768804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.769396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:41.769850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:41.770301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:41.942852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:41.951348 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2bdddc0-d2f7-4f2c-bbad-23abc18c2934 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.194989 Oct 31 14:14:41.952033 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1400/3031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:41 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:42.008802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:14:42.009259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:14:42.009772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:14:42.010197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:14:42.010618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:14:42.020475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.020991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.021629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.022408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.022870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.023304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.041577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Getting quotas for project 58d16a8ba8654fcb89e4b2bb728ab416. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:14:42.047305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Getting quotas for user ea6c7ea2f8564f4aa738cc3b4a8c47d8 and project 58d16a8ba8654fcb89e4b2bb728ab416. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:14:42.060650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Going to run 3 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:14:42.063692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:42.099498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=9ae1f056-3eda-4431-a1c0-86ce69a96a1e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:42.134596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=6aceb4a5-f090-47d8-954e-42c61d5dd1c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:42.148971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.151989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:42.159745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.160244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.160695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.161546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.161854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.167010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.225911 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be19a52e-8c37-4b98-9d0e-52fdac2aff4b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834491 Oct 31 14:14:42.227326 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1632/3032] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:14:42.232949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.234019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:42.243873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.244891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.245509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.246792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.247405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.247985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.252376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4faa3552-17d9-4a2c-a0eb-0b1cb79abae0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107254 Oct 31 14:14:42.252977 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1401/3033] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:42.289270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.318003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:42.318700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:14:42.355754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.356523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.357221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.358126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.358802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.359393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.392804 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e60ae92b-6b84-47c3-8478-e09224aab806 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.135518 Oct 31 14:14:42.400107 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1402/3034] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/servers => generated 1018 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:42.413159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-42533453-8184-45d2-9915-5006cae0797d req-30845229-a5d3-4975-9817-e394827cb696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e505dec-1e44-49fa-9142-6f61b3c3dcba", "name": "network-vif-plugged", "status": "completed", "tag": "47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:42.431922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-42533453-8184-45d2-9915-5006cae0797d req-30845229-a5d3-4975-9817-e394827cb696 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.432415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-42533453-8184-45d2-9915-5006cae0797d req-30845229-a5d3-4975-9817-e394827cb696 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.433494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-42533453-8184-45d2-9915-5006cae0797d req-30845229-a5d3-4975-9817-e394827cb696 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.449531 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-42533453-8184-45d2-9915-5006cae0797d req-30845229-a5d3-4975-9817-e394827cb696 service nova] Creating event network-vif-plugged:47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75 for instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba on n-h2-863052-1 Oct 31 14:14:42.456107 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-42533453-8184-45d2-9915-5006cae0797d req-30845229-a5d3-4975-9817-e394827cb696 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060892 Oct 31 14:14:42.456989 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1403/3035] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:42.465425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab7cd97b-16e9-4bf8-874d-a3bd871e3e9f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.466557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab7cd97b-16e9-4bf8-874d-a3bd871e3e9f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:42.502261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:42.510857 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-474bce3d-3829-4b68-bb3a-d4277b0f9d44 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1316 microversion: 2.1 time: 0.282032 Oct 31 14:14:42.511955 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1633/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:42.519067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.519067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:42.529869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.531579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.532267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.533684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.535713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.537159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.554298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab7cd97b-16e9-4bf8-874d-a3bd871e3e9f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:42.565235 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab7cd97b-16e9-4bf8-874d-a3bd871e3e9f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1223 microversion: 2.1 time: 0.105802 Oct 31 14:14:42.567611 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1404/3037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:42.671516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00dc432e-7555-431b-bb1a-2a569f8e76fb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10791a0d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.740208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00dc432e-7555-431b-bb1a-2a569f8e76fb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.073124 Oct 31 14:14:42.741420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1405/3038] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:42.773374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:42.785346 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7da3ce07-9708-4c53-84f8-afae9e361adb tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1512 microversion: 2.1 time: 0.272034 Oct 31 14:14:42.786832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1634/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:42.975927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:42.976550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:42.982899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.983393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.983835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:42.984531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:42.984991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:42.985420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.200123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:43.212537 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-785b59e2-427b-4d19-8380-171479dea061 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.240549 Oct 31 14:14:43.213644 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1406/3040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:42 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:43.265210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:43.268968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:43.276391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.277241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.277906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.279147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.279846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.280563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.324628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50fdb21b-1f86-4464-abf1-ca9d1272fcaa tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064104 Oct 31 14:14:43.326536 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1635/3041] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:43 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:43.538012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:43.538986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:43.547436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:43.557448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.562623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.565440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.569027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.570607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.573523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.591209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:43.591992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:43.596209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:43.613693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.616961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.617632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.618625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.620638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.621416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.747311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:43.759503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-258f31c7-8f8e-493b-94ca-3c517fae2fe2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1227 microversion: 2.1 time: 0.173000 Oct 31 14:14:43.781886 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1636/3042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:43 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1227 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:43.786917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9effa875-1361-4b20-966d-958407a74fb2 req-ef6ebb7e-171d-47e5-aba3-fc3137def741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b38e55-8de4-410e-a50b-3f7bb1b1a8e1", "name": "network-vif-deleted", "tag": "5b66d6a7-caf2-42a2-896d-d35600a3cd96"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:43.797042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9effa875-1361-4b20-966d-958407a74fb2 req-ef6ebb7e-171d-47e5-aba3-fc3137def741 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.797502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9effa875-1361-4b20-966d-958407a74fb2 req-ef6ebb7e-171d-47e5-aba3-fc3137def741 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.797929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9effa875-1361-4b20-966d-958407a74fb2 req-ef6ebb7e-171d-47e5-aba3-fc3137def741 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.813938 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9effa875-1361-4b20-966d-958407a74fb2 req-ef6ebb7e-171d-47e5-aba3-fc3137def741 service nova] Creating event network-vif-deleted:5b66d6a7-caf2-42a2-896d-d35600a3cd96 for instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 on n-h2-863052-1 Oct 31 14:14:43.819573 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9effa875-1361-4b20-966d-958407a74fb2 req-ef6ebb7e-171d-47e5-aba3-fc3137def741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036212 Oct 31 14:14:43.820672 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1637/3043] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:43.826392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7d87689-5207-4342-94d5-ecdb26b945cf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fc38c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:43.833145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:43.856362 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37158bd5-5323-4347-be94-25d22b9e5c81 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1466 microversion: 2.1 time: 0.320415 Oct 31 14:14:43.856985 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1407/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:43 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1466 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:43.878061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:43.879808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:43.891855 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7d87689-5207-4342-94d5-ecdb26b945cf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.069767 Oct 31 14:14:43.892597 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1638/3045] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:43 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:43.899966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.900727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.901910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.903636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.904517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.905535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.914003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:43.916330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:43.934225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.945854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.946575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:43.948577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:43.950701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:43.953556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:44.009329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:44.012010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:44.039842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05e8db30-90dd-478a-8b88-b5b287d544d5 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1301 microversion: 2.1 time: 0.177815 Oct 31 14:14:44.041392 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1408/3046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:43 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1301 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:44.196284 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02d034d6-2411-4da3-88f4-091ce5d7a2b0 tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1617 microversion: 2.1 time: 0.302003 Oct 31 14:14:44.197068 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1639/3047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:43 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1617 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:44.236947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:44.237680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:44.247659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:44.248262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:44.249446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:44.252008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:44.254323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:44.255023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:44.339366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:44.344039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:44.356987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:44.360004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:44.360699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:44.361818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:44.362565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:44.364125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:44.411585 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db6f07bc-2ac9-414c-92e9-641cc8598a3d tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077293 Oct 31 14:14:44.417219 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1640/3048] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:44 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:44.443743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-78163749", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3a5f08e7-abcf-4dac-baf3-4b84313cf486"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:44.521059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:14:44.835331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:44.847530 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b724b4b2-07da-4106-b5c2-a263238999d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.614495 Oct 31 14:14:44.850486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1409/3049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:44 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:44.860679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:44.862842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:44.886891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:44.887679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:44.889103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:44.891039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:44.892660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:44.894917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.099912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:14:45.100320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:14:45.100558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:14:45.101344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:14:45.101995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:14:45.142385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.143846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.146375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.149104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.150941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.152498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.157996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:45.176372 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25f67930-92ba-461d-9a8f-7e7bdac89fef tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1275 microversion: 2.1 time: 0.324408 Oct 31 14:14:45.182743 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1410/3050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:44 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1275 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:45.200567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b838a7f-a3a2-4e53-81c6-b41ae36a34d7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fb27af0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:45.245826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:14:45.264194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Getting quotas for user 233f870e154b4a868781aecb8585e6dc and project 8fadd213d9f34565a0cf36487701aea2. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:14:45.312836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:14:45.320733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:14:45.350526 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b838a7f-a3a2-4e53-81c6-b41ae36a34d7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.166506 Oct 31 14:14:45.364818 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1411/3051] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:45 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:45.389387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:45.395947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:45.415265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.415770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.416219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.429892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.431314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.431961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.536825 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4692047d-7b35-4171-90c8-cde4a63f3edb tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093687 Oct 31 14:14:45.546789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1641/3052] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:14:45.560628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:45.565803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.571821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:45.586065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.586686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.587172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lazy-loading 'fault' on Instance uuid 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:14:45.622285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.635437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.637675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.639448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.645212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.653033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.715806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b4fb47043b44afa4f155efca4f240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d49ed6200644f29b9535a6d11cbebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:45.731959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bda96442-1f19-4872-9edd-eee6f5f3f061 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 200 len: 1306 microversion: 2.1 time: 0.365748 Oct 31 14:14:45.732544 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1412/3053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:45 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 1306 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:45.750332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-66f393e6-843e-4108-b27a-c4facfa3411f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:45.765605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-66f393e6-843e-4108-b27a-c4facfa3411f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:45.798580 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4f48def-a684-44d6-a9ca-161bd0890477 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244498 Oct 31 14:14:45.799266 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1642/3054] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:45 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:45.886745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:45.887405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:45.905305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.911718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.913190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.914869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:45.920127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:45.923463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:45.957498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-66f393e6-843e-4108-b27a-c4facfa3411f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:45.973960 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-66f393e6-843e-4108-b27a-c4facfa3411f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1215 microversion: 2.1 time: 0.234145 Oct 31 14:14:45.980179 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1413/3055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:45 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:46.205368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:46.206225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:46.219370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:46.223362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:46.224769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:46.227319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:46.228275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:46.229856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:46.434528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:46.445431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d4ce163-9a93-4030-891e-21462eb87cd0 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1281 microversion: 2.1 time: 0.245566 Oct 31 14:14:46.452975 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1414/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:46 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:46.466038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47e6cf12-9d51-4731-8225-102b4af68eeb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe106d733a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:46.542623 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47e6cf12-9d51-4731-8225-102b4af68eeb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.088240 Oct 31 14:14:46.554813 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1415/3057] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:46 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:46.732979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:46.737174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:46.763205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:46.765544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] [instance: 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:46.771838 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f623ddb8-1fb6-4e7f-b761-23da66c45ee3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 0.898998 Oct 31 14:14:46.774992 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1643/3058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:45 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:46.789867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:46.792146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:46.793971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:46.798207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:46.799185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:46.801311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:46.814852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:46.829854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:46.855843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:46.857981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:46.865962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:46.871739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:46.872511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:46.873820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:46.888140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] HTTP exception thrown: Instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 could not be found. Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Request method failure captured: Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 HTTP/1.1 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9g3dsRP1WrizMti9-mLBW3SvvONDi66m_i3apSyXqQavqht8b0M20nA_TUNZiDh5UlSzU7ikmqpMnfERIDFKVVW1E9apfd3Lj8vN8hv0fdKIhtlT_VMUMA0I9XsZxBRtjhijAz39MIjFL5VIf6ZoFXiX7tij-E-H7gqDEmN6jOUX3E Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 20d49ed6200644f29b9535a6d11cbebc Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerAddressesTestJSON-980056906 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20d49ed6200644f29b9535a6d11cbebc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20d49ed6200644f29b9535a6d11cbebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20d49ed6200644f29b9535a6d11cbebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20d49ed6200644f29b9535a6d11cbebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerAddressesTestJSON-980056906 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 20d49ed6200644f29b9535a6d11cbebc Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerAddressesTestJSON-980056906 Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerAddressesTestJSON-980056906-project Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 91b4fb47043b44afa4f155efca4f240c Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerAddressesTestJSON-980056906-project Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 could not be found. Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '61b38e55-8de4-410e-a50b-3f7bb1b1a8e1'} Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 could not be found. Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 could not be found. Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:46.894150 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 could not be found. Oct 31 14:14:46.898316 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:46.904191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] Returning 404 to user: Instance 61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:14:46.908579 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ee10f3c2-995b-4dd6-9b4f-19a735f07a87 tempest-ServerAddressesTestJSON-980056906 tempest-ServerAddressesTestJSON-980056906-project] 10.222.0.27 "GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1" status: 404 len: 111 microversion: 2.1 time: 0.153281 Oct 31 14:14:46.915212 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1416/3059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:46 2022] GET /compute/v2.1/servers/61b38e55-8de4-410e-a50b-3f7bb1b1a8e1 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:14:46.984966 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-974127b4-e453-4409-8107-c76645a1e6ae tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175824 Oct 31 14:14:46.986578 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1644/3060] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:46 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:47.005960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:47.006738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:47.016395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:47.017287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:47.017886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:47.018981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:47.019711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:47.020554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:47.133984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:47.154999 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c51f2691-2323-4f25-b411-9dfe5820b542 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1219 microversion: 2.1 time: 0.153909 Oct 31 14:14:47.175671 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1417/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:46 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:47.487191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:47.488916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:47.511340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:47.519361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:47.523960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:47.525487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:47.529533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:47.534502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:47.564496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c743897-28f3-49cc-8e6e-f7b56691703f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe106d731f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:47.675133 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c743897-28f3-49cc-8e6e-f7b56691703f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.115142 Oct 31 14:14:47.676881 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1418/3062] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:47 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:47.804209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:47.816878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:47.822616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:47.823942 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f9ca54c-4655-4efc-bdeb-b3f51b65783b tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1281 microversion: 2.1 time: 0.346575 Oct 31 14:14:47.825931 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1645/3063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:47 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1281 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:47.848506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:47.849194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:47.851336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:47.857135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:47.859889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:47.862070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:48.008228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:48.015570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:48.047103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:48.047891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:48.050091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:48.051693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:48.053166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:48.053800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:48.185739 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8fcc2c3-0392-422f-b79d-e0e29ade45c9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190810 Oct 31 14:14:48.204745 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1646/3064] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:47 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:48.221518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:48.222137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:48.247459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:48.247952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:48.248393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:48.256327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:48.256867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:48.264390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:48.706600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:48.730467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab0abbea-d28c-4b2a-b146-8d0a12211e3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1267 microversion: 2.1 time: 0.523893 Oct 31 14:14:48.737319 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1647/3065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:48 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1267 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:48.749609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e6b62f0-841a-4146-950a-70ad606cdf10 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107a749d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:48.867853 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e6b62f0-841a-4146-950a-70ad606cdf10 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.128323 Oct 31 14:14:48.871253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1648/3066] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:48 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:48.887593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:48.899530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:48.904167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:48.912400 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f65120b-3d03-48e2-8309-d20e1a248123 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1476 microversion: 2.1 time: 1.116023 Oct 31 14:14:48.935816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:48.936756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:48.937166 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1419/3067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:47 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1476 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:48.937801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:48.938878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:48.939608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:48.940299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:49.211619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:49.214312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:49.241308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:49.241913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:49.246208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:49.255475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:49.255968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:49.256414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:49.319374 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d0ecae7-d7bf-40bd-b3ca-efb786eca523 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111462 Oct 31 14:14:49.325563 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1420/3068] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:49 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:14:49.756308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:49.757068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:49.771467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:49.772403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:49.773086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:49.774866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:49.775991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:49.778103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:49.855649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:49.864306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2370d82-a06c-410b-a7a3-c8e67efaa439 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.990727 Oct 31 14:14:49.879670 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1649/3069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:48 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:49.893905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9b84361-6eea-432e-90d8-257e9d85a05a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107731ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:49.968566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9b84361-6eea-432e-90d8-257e9d85a05a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.082267 Oct 31 14:14:49.978259 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1650/3070] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:49 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:49.978259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:49.985319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:49.995937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:49.996509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:49.997007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:49.997976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:50.000121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:50.000819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:50.378018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:50.386720 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d50730d-e899-4069-b496-6cbbe1345e17 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1273 microversion: 2.1 time: 0.634611 Oct 31 14:14:50.409507 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1421/3071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:49 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1273 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:50.420117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:50.425034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:50.441429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:50.441925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:50.442418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:50.443113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:50.443578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:50.450026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:50.507786 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47c848c8-31b6-4363-a8be-7db49b6097e4 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096361 Oct 31 14:14:50.516562 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1422/3072] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:50 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:50.856020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:50.865154 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73f7ac28-e4f1-460a-8390-beb6bac60ceb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.894082 Oct 31 14:14:50.870341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1651/3073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:49 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:50.893463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:50.894099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:50.909928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:50.910711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:50.911162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:50.911883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:50.912345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:50.915544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:50.990102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a205f3f6-987e-4362-af9f-53260d51c5b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107a748b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:51.082910 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a205f3f6-987e-4362-af9f-53260d51c5b7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.100255 Oct 31 14:14:51.083504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1652/3074] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:50 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:51.378354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d02489af-d7c3-42ff-b148-1329c1f37075 req-26348c39-b993-417e-b3e8-7d6a6331319b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e668e80e-5f5c-48ba-b09f-544c72d227e0", "tag": "5e4ed363-4229-4ab0-b179-1fcfb87a6e3c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:51.410074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d02489af-d7c3-42ff-b148-1329c1f37075 req-26348c39-b993-417e-b3e8-7d6a6331319b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.411025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d02489af-d7c3-42ff-b148-1329c1f37075 req-26348c39-b993-417e-b3e8-7d6a6331319b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.412263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d02489af-d7c3-42ff-b148-1329c1f37075 req-26348c39-b993-417e-b3e8-7d6a6331319b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:51.441102 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d02489af-d7c3-42ff-b148-1329c1f37075 req-26348c39-b993-417e-b3e8-7d6a6331319b service nova] Creating event network-changed:5e4ed363-4229-4ab0-b179-1fcfb87a6e3c for instance e668e80e-5f5c-48ba-b09f-544c72d227e0 on n-h2-863052-1 Oct 31 14:14:51.454948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d02489af-d7c3-42ff-b148-1329c1f37075 req-26348c39-b993-417e-b3e8-7d6a6331319b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083246 Oct 31 14:14:51.457487 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1653/3075] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:51.472050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:51.472805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:51.492395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.492904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.493348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:51.494729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.495062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.499362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:51.558546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:51.569959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f820b25f-eecb-45cf-9dfd-7a84cf9663a2 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.681601 Oct 31 14:14:51.574974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1423/3076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:50 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:51.582374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:51.593621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:51.603784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.604477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.605241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:51.606113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.606764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.607343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:51.647813 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a06d77f-6372-4e91-97d8-b3b39552fa03 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071414 Oct 31 14:14:51.648668 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1424/3077] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:51 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:51.663511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:51.680583 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f098c6f-3a75-4c2c-9543-92821b3884b2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1273 microversion: 2.1 time: 0.220519 Oct 31 14:14:51.700368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1654/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:51 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:51.899582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:51.904051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:51.917284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.921702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.922405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:51.923303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:51.926483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:51.927129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:52.103608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7df6b6f7-f434-4c6a-b56d-935b55f6a60c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107b8c5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:52.202421 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7df6b6f7-f434-4c6a-b56d-935b55f6a60c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.107045 Oct 31 14:14:52.203320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1655/3079] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:52 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:52.372728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:52.578034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:52.593646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00682baa-8db6-4f39-a0b1-033eed5c7707 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.690673 Oct 31 14:14:52.606874 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1425/3080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:51 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:52.611244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:52.611871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:52.630608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:52.631114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:52.631977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:52.633716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:52.637817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:52.642700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:52.660442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:52.662948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:52.677707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:52.678223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:52.678662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:52.679359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:52.679813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:52.680232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:52.737127 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69ebc018-6d12-4d4f-b283-38d5a8b550db tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080549 Oct 31 14:14:52.738032 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1426/3081] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:14:52 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 14:14:52.742866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:52.743716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:52.751449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:52.752118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:52.752718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:52.753577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:52.754426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:52.755031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.012680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:53.022140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3068bf0d-1cad-4d9f-84b1-1d781e020791 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.424349 Oct 31 14:14:53.022757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1656/3082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:52 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:53.027787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:53.030545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:53.037385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.038024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.038710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.038959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:53.039427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.040087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.040517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.050689 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b384ec04-0dd0-44f5-9e7b-4ad1b7c6d722 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1273 microversion: 2.1 time: 0.311308 Oct 31 14:14:53.063206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1427/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:52 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:53.101359 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Cannot 'reboot' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action HTTP/1.1 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 28 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: {"reboot": {"type": "HARD"}} Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot 'reboot' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a4d9b505-33df-4dbd-8bd8-13c69bd80ad2', 'body': {'reboot': {'type': 'HARD'}}} Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:14:53.103586 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.107990 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.110096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 409 to user: Cannot 'reboot' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:14:53.111210 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43bfcadf-e356-4bfb-a9c9-9b1e733fec93 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action" status: 409 len: 145 microversion: 2.1 time: 0.087364 Oct 31 14:14:53.112000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1657/3084] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:53 2022] POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action => generated 145 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:14:53.131329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:53.146635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:53.158445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.159190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.159878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.161067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.161884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.162567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.204125 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Cannot 'rebuild' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action HTTP/1.1 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 65 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'rebuild' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a4d9b505-33df-4dbd-8bd8-13c69bd80ad2', 'body': {'rebuild': {'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66'}}} Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:14:53.207264 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued Oct 31 14:14:53.211195 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:14:53.218662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd3b73ed-bdac-41e4-86c4-348e914371c0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1066c6160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:53.224777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 409 to user: Cannot 'rebuild' instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 while it is in vm_state rescued {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:14:53.228169 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b0ed88e-8026-4444-b17d-33e4b45ec053 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action" status: 409 len: 146 microversion: 2.1 time: 0.106024 Oct 31 14:14:53.229354 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1428/3085] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:14:53 2022] POST /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2/action => generated 146 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:14:53.254525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:53.255502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:53.269621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.277130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.278910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.280544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.292764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.294003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.321548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd3b73ed-bdac-41e4-86c4-348e914371c0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.106434 Oct 31 14:14:53.325887 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1658/3086] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:53 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:53.375654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3385c0-7051-44c4-8e83-6b96d554f351", "name": "network-vif-unplugged", "status": "completed", "tag": "48c46c97-9e28-4345-a0eb-cc9d36b8ce37"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:53.385370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:53.401020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.402004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.403122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.429419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:53.436857 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] Creating event network-vif-unplugged:48c46c97-9e28-4345-a0eb-cc9d36b8ce37 for instance 5b3385c0-7051-44c4-8e83-6b96d554f351 on n-h2-863052-1 Oct 31 14:14:53.471551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:14:53.523864 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-360cf7a8-45f6-4857-b791-398208cd08d5 req-b804c43f-f5d8-422b-906b-b78471ffe4ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154845 Oct 31 14:14:53.524474 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1659/3087] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:53.537333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8fa1a56c-13cf-4137-91e3-bab3421f2a47 req-6c6b680a-82ba-4844-9408-9458e7797c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae1f056-3eda-4431-a1c0-86ce69a96a1e", "tag": "75f1ea29-444b-4ba9-b12f-f501ed3c813a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:53.551169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8fa1a56c-13cf-4137-91e3-bab3421f2a47 req-6c6b680a-82ba-4844-9408-9458e7797c47 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.551691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8fa1a56c-13cf-4137-91e3-bab3421f2a47 req-6c6b680a-82ba-4844-9408-9458e7797c47 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.552120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8fa1a56c-13cf-4137-91e3-bab3421f2a47 req-6c6b680a-82ba-4844-9408-9458e7797c47 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.557004 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4e40af4-8d8b-4e69-9a34-f08652ad0be2 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 204 len: 0 microversion: 2.1 time: 0.314534 Oct 31 14:14:53.557609 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1429/3088] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:53 2022] DELETE /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:53.566391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:53.567089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:53.592514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.593773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.594293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.595054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.595511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.595928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.600626 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8fa1a56c-13cf-4137-91e3-bab3421f2a47 req-6c6b680a-82ba-4844-9408-9458e7797c47 service nova] Creating event network-changed:75f1ea29-444b-4ba9-b12f-f501ed3c813a for instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e on n-h1-863052-1 Oct 31 14:14:53.613688 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8fa1a56c-13cf-4137-91e3-bab3421f2a47 req-6c6b680a-82ba-4844-9408-9458e7797c47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087783 Oct 31 14:14:53.614569 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1660/3089] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:53.631299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:53.632015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:53.640057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.640574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.641970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.646218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:53.647093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:53.647795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:53.844113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:53.852611 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5e93bc0-3b6d-4bb5-8ad3-a5aa697537a2 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.225666 Oct 31 14:14:53.853453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1661/3090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:53 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:54.046274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:54.047662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:54.060042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:54.061004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:54.061673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:54.062457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:54.063015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:54.063529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:54.245891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:54.255057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a29a3edb-b0b6-482e-8efb-6fffa581e0aa tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.213762 Oct 31 14:14:54.262300 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1662/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:54 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:54.266690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:54.269517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:54.289295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:54.291337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:54.292615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:54.296109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:54.296592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:54.297034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:54.386242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:54.394846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-362a078d-5a58-47de-ab7e-425c881d71c4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1273 microversion: 2.1 time: 0.137552 Oct 31 14:14:54.395441 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1663/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:54 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:54.416439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2a5738d-f60c-4082-9e20-0f9e3bdd84c2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1076c10d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:54.474673 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2a5738d-f60c-4082-9e20-0f9e3bdd84c2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.062881 Oct 31 14:14:54.475837 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1664/3093] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:54 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:54.712020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:54.721051 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20da3c59-987e-44f8-9a30-19468ae2789f tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1691 microversion: 2.1 time: 1.158688 Oct 31 14:14:54.743802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1430/3094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:53 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1691 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:54.881117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:54.881903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:54.900968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:54.901884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:54.902600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:54.903600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:54.904278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:54.905170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.197912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:55.234858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:55.253805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a96f5bb2-81e8-4d28-b820-a67b2284005b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.380627 Oct 31 14:14:55.280550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:55.280947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:55.285247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1665/3095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:54 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:55.292394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:55.292902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:55.293349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.294645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:55.296728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:55.297340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.417313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:55.417928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:55.429949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:55.437752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:55.438331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:55.438784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.439522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:55.439980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:55.440402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.718494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:55.730488 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06655675-4046-4659-b5df-32ddefbdc63a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.317352 Oct 31 14:14:55.731117 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1666/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:55 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:55.747358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d61d87b0-5f82-4603-bebd-be9db515fe21 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107440160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:55.855076 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d61d87b0-5f82-4603-bebd-be9db515fe21 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.122900 Oct 31 14:14:55.855883 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1667/3097] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:55 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:55.861940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:55.862463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:55.868777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:55.869730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:55.870359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.871208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:55.871835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:55.872417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:55.924377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:14:55.963499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:55.967043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:56.066502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db4902e8-ab76-4492-811a-9f168eb02eca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 204 len: 0 microversion: 2.1 time: 0.209033 Oct 31 14:14:56.071281 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1668/3098] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:14:55 2022] DELETE /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:14:56.078924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aceb4a5-f090-47d8-954e-42c61d5dd1c1", "tag": "1008d00d-e812-4b2f-bd0b-3f604f21a847"}, {"name": "network-changed", "server_uuid": "5b3385c0-7051-44c4-8e83-6b96d554f351", "tag": "48c46c97-9e28-4345-a0eb-cc9d36b8ce37"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:56.092112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.093138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.093941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.114734 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Creating event network-changed:1008d00d-e812-4b2f-bd0b-3f604f21a847 for instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 on n-h1-863052-1 Oct 31 14:14:56.115848 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Creating event network-changed:48c46c97-9e28-4345-a0eb-cc9d36b8ce37 for instance 5b3385c0-7051-44c4-8e83-6b96d554f351 on n-h2-863052-1 Oct 31 14:14:56.123328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:14:56.138467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7fc0ae91-ec64-49bb-9b85-b7a30bbb210c req-3035d48f-f8ea-4e64-8a14-238b10f005b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064754 Oct 31 14:14:56.139419 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1669/3099] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:56.145799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:56.146571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:56.154689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.156083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.156533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.157389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.159162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.159625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.207552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:56.215714 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8a83191-ac8a-439b-82a3-127432f99874 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.940198 Oct 31 14:14:56.218950 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1431/3100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:55 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:56.230052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:56.230963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:56.247139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.248014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.248670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.251031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.251654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.252238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.340772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:56.352680 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dfc4804-3131-481f-b172-3a8b406e5963 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1691 microversion: 2.1 time: 0.211960 Oct 31 14:14:56.353656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1670/3101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:56 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:56.359085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:56.359696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:56.365611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.366407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.367002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.367858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.368476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.369047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.574969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:56.584679 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf49d8c7-a634-4152-a973-c4636b7cab57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.229632 Oct 31 14:14:56.586373 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1671/3102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:56 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:56.631573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:56.644621 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6cb67364-6065-4d0e-aa7e-cb4fc64ebe8f tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1666 microversion: 2.1 time: 0.421532 Oct 31 14:14:56.667300 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1432/3103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:56 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:56.755705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:56.756650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:56.779472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.780962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.781592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.782486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:56.783093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:56.783520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:56.871730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b294a2f0-2977-4859-a5c5-6f63fc8113c3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107821280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:56.935809 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b294a2f0-2977-4859-a5c5-6f63fc8113c3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.068061 Oct 31 14:14:56.937387 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1433/3104] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:56 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:56.957780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:56.971566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18ead15c-2287-412e-b291-53ba53de25c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.220771 Oct 31 14:14:56.973628 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1672/3105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:56 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:57.245781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:57.247056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:57.254362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:57.255124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:57.255788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:57.256765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:57.257594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:57.258263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:57.379433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:57.380983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:57.391647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:57.392479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:57.393206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:57.394128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:57.394792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:57.395379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:58.133694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:58.142454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d0ace28-6434-41f7-8699-bcdd1be83fc7 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1691 microversion: 2.1 time: 0.767740 Oct 31 14:14:58.147139 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1673/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:57 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1691 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:14:58.154140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:58.154814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:58.176617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:58.177056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:58.177504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:58.178244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:58.178711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:58.179143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:58.388916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:58.403720 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-075493ff-ee99-4b17-bcbb-e853ac9f2468 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 1.163104 Oct 31 14:14:58.411042 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1434/3107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:57 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:58.417117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:58.424950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:58.441231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:58.445584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:58.448651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:58.449670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:58.450405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:58.452343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:58.763621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:58.772456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9de46b93-3c98-43af-9232-2e1f35454e25 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.624677 Oct 31 14:14:58.773057 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1674/3108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:58 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:58.786087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b898f993-db92-4466-bc8d-ca437e201f56 req-484285c7-114b-4afc-b2a5-eedbefc36f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e668e80e-5f5c-48ba-b09f-544c72d227e0", "name": "network-vif-plugged", "status": "completed", "tag": "5e4ed363-4229-4ab0-b179-1fcfb87a6e3c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:58.808202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b898f993-db92-4466-bc8d-ca437e201f56 req-484285c7-114b-4afc-b2a5-eedbefc36f66 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:58.812282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b898f993-db92-4466-bc8d-ca437e201f56 req-484285c7-114b-4afc-b2a5-eedbefc36f66 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:58.813073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b898f993-db92-4466-bc8d-ca437e201f56 req-484285c7-114b-4afc-b2a5-eedbefc36f66 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:58.836902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b898f993-db92-4466-bc8d-ca437e201f56 req-484285c7-114b-4afc-b2a5-eedbefc36f66 service nova] Creating event network-vif-plugged:5e4ed363-4229-4ab0-b179-1fcfb87a6e3c for instance e668e80e-5f5c-48ba-b09f-544c72d227e0 on n-h2-863052-1 Oct 31 14:14:58.849292 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b898f993-db92-4466-bc8d-ca437e201f56 req-484285c7-114b-4afc-b2a5-eedbefc36f66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069672 Oct 31 14:14:58.850207 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1675/3109] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:58.866058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5da49a7-ca3d-4e0b-a719-ba69b236b50b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107d64c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:58.968210 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5da49a7-ca3d-4e0b-a719-ba69b236b50b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.116501 Oct 31 14:14:58.969762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1676/3110] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:14:58 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:58.986907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:58.987660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:58.994851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:58.999486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.000171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.003072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.003740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.004348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.330586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:59.347864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa741453-af9f-4cc2-893f-afe111fedeb3 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1666 microversion: 2.1 time: 0.933281 Oct 31 14:14:59.349128 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1435/3111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:58 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1666 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:59.376460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:59.377085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:59.388023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.388536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.389858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.390991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.392863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.394479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.814759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:59.825068 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e56672ab-a275-439a-a055-1d1e9d3e3496 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1691 microversion: 2.1 time: 0.457246 Oct 31 14:14:59.841539 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1436/3112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:59 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1691 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:59.851953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:59.852799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:59.859315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.860003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.860612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.861488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.862102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.862700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.909252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:14:59.919572 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08623399-7e25-41e4-99e9-8427c4f19582 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.948230 Oct 31 14:14:59.920682 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1677/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:58 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:14:59.951058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-75d9e2de-abb1-4a6d-be0b-ad18d056b50f req-3417f060-e4f7-422c-bbd0-3806419a46d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3cea44-8e46-4870-9e43-350e074a4d76", "tag": "82d3f9a1-6c7d-45af-8683-5ce6b08df0b1"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:14:59.951058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-75d9e2de-abb1-4a6d-be0b-ad18d056b50f req-3417f060-e4f7-422c-bbd0-3806419a46d8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.951058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-75d9e2de-abb1-4a6d-be0b-ad18d056b50f req-3417f060-e4f7-422c-bbd0-3806419a46d8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.951058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-75d9e2de-abb1-4a6d-be0b-ad18d056b50f req-3417f060-e4f7-422c-bbd0-3806419a46d8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:14:59.969810 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-75d9e2de-abb1-4a6d-be0b-ad18d056b50f req-3417f060-e4f7-422c-bbd0-3806419a46d8 service nova] Creating event network-changed:82d3f9a1-6c7d-45af-8683-5ce6b08df0b1 for instance 0c3cea44-8e46-4870-9e43-350e074a4d76 on n-h1-863052-1 Oct 31 14:14:59.976459 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-75d9e2de-abb1-4a6d-be0b-ad18d056b50f req-3417f060-e4f7-422c-bbd0-3806419a46d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054225 Oct 31 14:14:59.977246 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1678/3114] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:14:59.988261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:14:59.988605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:14:59.996294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:14:59.997009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:14:59.997637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:00.000146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:00.001194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:00.001761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:00.139306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:00.153851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f94d85af-8ac8-46c8-8c36-53c7032ef438 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.310453 Oct 31 14:15:00.154848 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1437/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:59 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:00.159761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ab602f8-bbc1-441d-a266-2b035449192b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10791a790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:00.287213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ab602f8-bbc1-441d-a266-2b035449192b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.131016 Oct 31 14:15:00.306551 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1438/3116] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:00 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:00.375178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:00.375805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:00.392947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:00.398217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:00.400948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:00.401936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:00.402601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:00.403215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:00.486262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:00.508395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97269b3a-05fc-49c2-8c63-302ff70dc21c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1475 microversion: 2.1 time: 0.524156 Oct 31 14:15:00.526968 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1679/3117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:14:59 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1475 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:00.850944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:00.851863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:00.863147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:00.873158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:00.873922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:00.875376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:00.875844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:00.876271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.081860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:01.103990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acfc953f-b728-4586-b3be-9259ec9645a3 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1623 microversion: 2.1 time: 0.252311 Oct 31 14:15:01.105211 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1680/3118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:00 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1623 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:01.120624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-404988c9-6ffd-4806-922c-0cfb7513b7cb req-8ead9a9d-c7fa-4e96-95be-52baf10f0444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae1f056-3eda-4431-a1c0-86ce69a96a1e", "name": "network-vif-plugged", "status": "completed", "tag": "75f1ea29-444b-4ba9-b12f-f501ed3c813a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:01.124563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:01.137982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ec36294-2951-426a-8f54-962899a742ca tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1598 microversion: 2.1 time: 0.767465 Oct 31 14:15:01.138642 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1439/3119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:00 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1598 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:01.152506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:01.153364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:01.173564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-404988c9-6ffd-4806-922c-0cfb7513b7cb req-8ead9a9d-c7fa-4e96-95be-52baf10f0444 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.174064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-404988c9-6ffd-4806-922c-0cfb7513b7cb req-8ead9a9d-c7fa-4e96-95be-52baf10f0444 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.174527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-404988c9-6ffd-4806-922c-0cfb7513b7cb req-8ead9a9d-c7fa-4e96-95be-52baf10f0444 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.180806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.181684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.182978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.183979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.187034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.187700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.207474 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-404988c9-6ffd-4806-922c-0cfb7513b7cb req-8ead9a9d-c7fa-4e96-95be-52baf10f0444 service nova] Creating event network-vif-plugged:75f1ea29-444b-4ba9-b12f-f501ed3c813a for instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e on n-h1-863052-1 Oct 31 14:15:01.226714 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-404988c9-6ffd-4806-922c-0cfb7513b7cb req-8ead9a9d-c7fa-4e96-95be-52baf10f0444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119917 Oct 31 14:15:01.230369 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1681/3120] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:01.241364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f5902443-1c0d-4a4f-99d8-36c58ea158d3 req-2909563c-ea01-4569-89a2-ac387c88a74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88180ebf-6fce-4644-9070-031baa73152e", "name": "network-vif-deleted", "tag": "d13d1b50-d491-4054-816a-0ef015b077ef"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:01.305290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5902443-1c0d-4a4f-99d8-36c58ea158d3 req-2909563c-ea01-4569-89a2-ac387c88a74b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.306142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5902443-1c0d-4a4f-99d8-36c58ea158d3 req-2909563c-ea01-4569-89a2-ac387c88a74b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.310414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5902443-1c0d-4a4f-99d8-36c58ea158d3 req-2909563c-ea01-4569-89a2-ac387c88a74b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.339546 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f5902443-1c0d-4a4f-99d8-36c58ea158d3 req-2909563c-ea01-4569-89a2-ac387c88a74b service nova] Creating event network-vif-deleted:d13d1b50-d491-4054-816a-0ef015b077ef for instance 88180ebf-6fce-4644-9070-031baa73152e on n-h1-863052-1 Oct 31 14:15:01.357368 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f5902443-1c0d-4a4f-99d8-36c58ea158d3 req-2909563c-ea01-4569-89a2-ac387c88a74b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125507 Oct 31 14:15:01.358705 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1682/3121] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:01.368175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:01.371206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:01.393303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.394427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.395041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.396438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.397648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.398365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.843393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:01.852805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc8281c0-b047-45f7-b92b-53a9f0280d76 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.492675 Oct 31 14:15:01.853630 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1683/3122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:01 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:01.858900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4fac32a-db5d-42ef-994e-0efced5b49cd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1076d1310>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:01.929269 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4fac32a-db5d-42ef-994e-0efced5b49cd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.074360 Oct 31 14:15:01.929863 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1684/3123] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:01 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:01.946661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:01.947283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:01.966802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.967540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.968665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:01.969634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:01.970957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:01.971765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.212661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:02.226035 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17ae349f-859e-4441-b7bf-5158d779bef1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1473 microversion: 2.1 time: 0.286354 Oct 31 14:15:02.239340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1685/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:01 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:02.239956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:02.245406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:02.248585 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a09dd6e-39b6-4934-95c0-7955daf77cc3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 1.107706 Oct 31 14:15:02.249004 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1440/3125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:01 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:02.262820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:02.263680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:02.265102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:02.271758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:02.277888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.278893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.279586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.281076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.281390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.281946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.282210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.282625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.283357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.283670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.283805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.309539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.378088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:02.387834 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0236888-0341-491b-8672-58f2a0700e59 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1623 microversion: 2.1 time: 0.145415 Oct 31 14:15:02.391714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.394250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.396678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.397561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lazy-loading 'fault' on Instance uuid 88180ebf-6fce-4644-9070-031baa73152e {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:02.413142 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1686/3126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:02 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1623 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:02.473211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9746fac207c4c9b9957107b6da3a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6782805032845bc8ef132fedc3bf720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:02.485438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb86aafa-5de8-43e6-8c92-eafd4ea9c4be tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 200 len: 1316 microversion: 2.1 time: 0.232632 Oct 31 14:15:02.486205 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1441/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:02 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:02.883673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:02.884545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:02.897685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.900520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.903106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.906128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:02.906848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:02.907520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:02.944669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3682cf4e-8290-4000-8dab-0ff1d6b0d4f2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10757c280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:03.049534 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3682cf4e-8290-4000-8dab-0ff1d6b0d4f2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.108560 Oct 31 14:15:03.050131 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1442/3128] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:02 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:03.267869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:03.268517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:03.280263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:03.284770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:03.285480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:03.288991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:03.290731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:03.294931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:03.341574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:03.360272 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3d0c5274-8faf-4e6f-b4f9-a1cef14cbd50 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1323 microversion: 2.1 time: 0.481584 Oct 31 14:15:03.374703 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1687/3129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:02 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:03.382257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:03.382257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:03.393005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:03.393665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:03.396381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:03.397250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:03.399147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:03.405334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:03.746996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:03.756913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcf43e3d-de72-42c5-b2f9-35b80c716eb2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.389711 Oct 31 14:15:03.759045 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1688/3130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:03 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:03.770899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:03.772909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:03.783202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:03.784480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:03.785081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:03.785964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:03.786825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:03.787523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:03.807324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:04.025402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:04.039793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff109ba5-bc88-4444-9948-98a8ff59887f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.274955 Oct 31 14:15:04.041870 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1689/3131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:03 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:04.059115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:04.060384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:04.068899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.069781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.070444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.071328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.072242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.073003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.112546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.113509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.114122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.114767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'fault' on Instance uuid 692cbab4-8865-401a-8f21-4d26f7607f58 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:04.174664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:04.183326 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ba5be0e-ca09-4a90-9b1b-b2197190d2ac tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 200 len: 1335 microversion: 2.1 time: 0.140087 Oct 31 14:15:04.186986 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1690/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:04 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 1335 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:04.192419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-bb64f376-8843-4c02-9703-745784f879c2 req-d2a9953e-f2fe-4b79-8587-c5f37f141448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692cbab4-8865-401a-8f21-4d26f7607f58", "name": "network-vif-deleted", "tag": "0296bd5e-8bc5-4e14-bf85-884f06420d0e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:04.204075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb64f376-8843-4c02-9703-745784f879c2 req-d2a9953e-f2fe-4b79-8587-c5f37f141448 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.204918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb64f376-8843-4c02-9703-745784f879c2 req-d2a9953e-f2fe-4b79-8587-c5f37f141448 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.205999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb64f376-8843-4c02-9703-745784f879c2 req-d2a9953e-f2fe-4b79-8587-c5f37f141448 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.221008 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-bb64f376-8843-4c02-9703-745784f879c2 req-d2a9953e-f2fe-4b79-8587-c5f37f141448 service nova] Creating event network-vif-deleted:0296bd5e-8bc5-4e14-bf85-884f06420d0e for instance 692cbab4-8865-401a-8f21-4d26f7607f58 on n-h2-863052-1 Oct 31 14:15:04.226967 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-bb64f376-8843-4c02-9703-745784f879c2 req-d2a9953e-f2fe-4b79-8587-c5f37f141448 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038476 Oct 31 14:15:04.231908 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1691/3133] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:04.240966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:04.241935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] [instance: 88180ebf-6fce-4644-9070-031baa73152e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:04.249892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.250996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.251626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.252514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.253135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.253723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.269620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] HTTP exception thrown: Instance 88180ebf-6fce-4644-9070-031baa73152e could not be found. Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Request method failure captured: Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e HTTP/1.1 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9gf2WwWBNFYHL3dM2GijrxKQAQLggA7xQ9_2rn0izS8WeRQRNgxR7KQBH2MX6AL_icoYiflHt_n5h1Lmv_N4qGmVPznSh3QWzhD7JKqmc8esXL148mkPWl0xBpNwDBHm5QE37snauCfng5_xmpMLKjNnLDhe7y9KHYZMWctXi2HU5s Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a6782805032845bc8ef132fedc3bf720 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestFqdnHostnames-1569723205 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6782805032845bc8ef132fedc3bf720", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6782805032845bc8ef132fedc3bf720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6782805032845bc8ef132fedc3bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6782805032845bc8ef132fedc3bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestFqdnHostnames-1569723205 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a6782805032845bc8ef132fedc3bf720 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1569723205 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestFqdnHostnames-1569723205-project Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a9746fac207c4c9b9957107b6da3a6a3 Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestFqdnHostnames-1569723205-project Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 88180ebf-6fce-4644-9070-031baa73152e could not be found. Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '88180ebf-6fce-4644-9070-031baa73152e'} Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88180ebf-6fce-4644-9070-031baa73152e could not be found. Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88180ebf-6fce-4644-9070-031baa73152e could not be found. Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:04.272195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88180ebf-6fce-4644-9070-031baa73152e could not be found. Oct 31 14:15:04.277888 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:04.280585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Returning 404 to user: Instance 88180ebf-6fce-4644-9070-031baa73152e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:04.281929 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ddf35243-e34a-4b85-bcb2-8c1e5fa8f6a0 tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e" status: 404 len: 111 microversion: 2.1 time: 0.048071 Oct 31 14:15:04.283220 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1692/3134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:04 2022] GET /compute/v2.1/servers/88180ebf-6fce-4644-9070-031baa73152e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:04.288546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0986e7f1-ee7a-4157-944e-19d68713dc57 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1066ea160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:04.381444 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0986e7f1-ee7a-4157-944e-19d68713dc57 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.096336 Oct 31 14:15:04.384174 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1693/3135] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:04 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:04.389278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:04.398549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:04.415867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.418528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.421553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.423214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.423891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.425407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.721917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:04.731867 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43adc711-40ad-48ed-8152-3a31306fcb19 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.346519 Oct 31 14:15:04.746495 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1694/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:04 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:04.754384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98a249bf-924b-449c-83c9-f888a99e7c9e tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] Calling method '.version_select at 0x7fe1067269d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:04.804338 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98a249bf-924b-449c-83c9-f888a99e7c9e tempest-ServersTestFqdnHostnames-1569723205 tempest-ServersTestFqdnHostnames-1569723205-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320855171" status: 202 len: 0 microversion: 2.1 time: 0.068799 Oct 31 14:15:04.806668 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1695/3137] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:15:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320855171 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:15:04.815166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:04.816360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:04.825036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.825824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.826964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:04.827856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:04.828463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:04.829038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.149716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:05.164990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e7e022a-6d8a-46a5-bc89-cf985773de83 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 200 len: 1517 microversion: 2.1 time: 0.354813 Oct 31 14:15:05.168260 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1696/3138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:04 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:05.178815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:05.179431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:05.183432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:05.199187 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-85c529fe-d139-4982-8b37-6953368039c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1473 microversion: 2.1 time: 1.933815 Oct 31 14:15:05.214992 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1443/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:03 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1473 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:05.238836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.239335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.239771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.240474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.242397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:05.243668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:05.249617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.250119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.264530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.265069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.265512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.314601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.315112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.315573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.614518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:05.629690 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78751394-b1a8-4627-b3a1-9c6eda4b0405 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.459704 Oct 31 14:15:05.630807 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1697/3140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:05 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:05.647027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:05.648368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:05.663667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.664479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.665108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.668415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.669306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.672486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.861950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:05.873618 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87fbb906-0471-4365-ad52-46740213bf43 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.649959 Oct 31 14:15:05.878908 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1444/3141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:05 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:05.895000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:05.896026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 692cbab4-8865-401a-8f21-4d26f7607f58] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:05.903266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.904123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.905360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.906410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.907102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.907694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.926061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 could not be found. Oct 31 14:15:05.927208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 HTTP/1.1 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 could not be found. Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '692cbab4-8865-401a-8f21-4d26f7607f58'} Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 could not be found. Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 could not be found. Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:05.928318 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 could not be found. Oct 31 14:15:05.932822 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:05.934745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 404 to user: Instance 692cbab4-8865-401a-8f21-4d26f7607f58 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:05.936201 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3a5e1de-028d-40d2-9cdd-8d52f3c53127 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58" status: 404 len: 111 microversion: 2.1 time: 0.054546 Oct 31 14:15:05.937428 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1445/3142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:05 2022] GET /compute/v2.1/servers/692cbab4-8865-401a-8f21-4d26f7607f58 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:05.943489 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6250da9-b0ba-4769-bdf0-6e2780cd6794 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 200 len: 1323 microversion: 2.1 time: 0.311131 Oct 31 14:15:05.944344 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1698/3143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:05 2022] GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:05.948997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e234cddf-46a8-469e-973d-93844d95f3ee tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107ab8550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:05.950099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:05.951183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:05.961888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.978656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.980489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:05.983384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:05.984552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:05.986480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.030657 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e234cddf-46a8-469e-973d-93844d95f3ee tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1438 microversion: 2.1 time: 0.091287 Oct 31 14:15:06.040874 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1446/3144] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:05 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:06.046498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-78a94fbc-b0cc-4003-95a1-67fbabcf05ba req-269175b8-8500-4438-9bd2-94a12aaa6e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aceb4a5-f090-47d8-954e-42c61d5dd1c1", "name": "network-vif-plugged", "status": "completed", "tag": "1008d00d-e812-4b2f-bd0b-3f604f21a847"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:06.068127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-78a94fbc-b0cc-4003-95a1-67fbabcf05ba req-269175b8-8500-4438-9bd2-94a12aaa6e52 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.068830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-78a94fbc-b0cc-4003-95a1-67fbabcf05ba req-269175b8-8500-4438-9bd2-94a12aaa6e52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.070000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-78a94fbc-b0cc-4003-95a1-67fbabcf05ba req-269175b8-8500-4438-9bd2-94a12aaa6e52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.086490 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-78a94fbc-b0cc-4003-95a1-67fbabcf05ba req-269175b8-8500-4438-9bd2-94a12aaa6e52 service nova] Creating event network-vif-plugged:1008d00d-e812-4b2f-bd0b-3f604f21a847 for instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 on n-h1-863052-1 Oct 31 14:15:06.093871 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-78a94fbc-b0cc-4003-95a1-67fbabcf05ba req-269175b8-8500-4438-9bd2-94a12aaa6e52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051521 Oct 31 14:15:06.094981 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1447/3145] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:06.103126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-772b6fe3-6088-4d11-82cb-313a9f5b8eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '.version_select at 0x7fe1078398b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:06.140608 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-772b6fe3-6088-4d11-82cb-313a9f5b8eb6 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982463534" status: 202 len: 0 microversion: 2.1 time: 0.043873 Oct 31 14:15:06.141733 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1448/3146] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982463534 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:15:06.225257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:06.226538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:06.236457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.236963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.238752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.240573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.246125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.246776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.313576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:06.326198 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f85d64d-0104-49a7-bd84-82666a1d76de tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.380566 Oct 31 14:15:06.344251 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1699/3147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:05 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:06.584704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1863418432", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "726ec790-fa70-4df0-af4a-a3e3b994a919"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:06.683813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:06.696265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] validate_networks() for [('726ec790-fa70-4df0-af4a-a3e3b994a919', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:15:06.707881 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7f2a404-22f8-4390-a5fa-708f3139f694 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1470 microversion: 2.1 time: 0.479521 Oct 31 14:15:06.708522 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1449/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:06 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1470 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:06.736344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:06.737150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:06.750883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.751671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.752406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.755185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.755825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.756944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.827936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:06.917445 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93d42d1a-6bb7-41b4-8458-80ee8acc36de tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351/action" status: 204 len: 0 microversion: 2.1 time: 0.185829 Oct 31 14:15:06.919106 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1450/3149] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:15:06 2022] POST /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351/action => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:06.930769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:06.931509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:06.943618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.944469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.945097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:06.946042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:06.946538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:06.947941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:07.437061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:07.445869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64c7c4b4-ad25-4c20-b3e3-7e03254925e4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.524124 Oct 31 14:15:07.448919 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1451/3150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:06 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:07.452091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:07.452698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:07.474372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:07.480338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:07.481092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:07.482037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:07.482863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:07.483495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:07.797037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:07.797629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:07.797896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:07.798342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:07.798769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:07.827453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:07.827960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:07.828418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:07.836822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:07.837723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:07.839785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:07.905267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:07.921691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for user f6d0e8b2b04b47e69d87f436eb387941 and project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:07.964921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:07.972486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:08.074442 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c0c9e57-6501-4b69-a968-78c1cfe806d9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493412 Oct 31 14:15:08.078623 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1700/3151] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:15:08.094644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.102368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:08.136404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.136934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.137362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.140432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.140976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.143590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.425294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:08.448969 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a66d5799-31f8-4e02-a427-1d289ad3e156 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 200 len: 1516 microversion: 2.1 time: 0.368907 Oct 31 14:15:08.455585 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1701/3152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:08 2022] GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 1516 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:08.466646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e177990-2a0d-459e-bb4d-8f0d804c36c7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107731af0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.533590 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e177990-2a0d-459e-bb4d-8f0d804c36c7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1447 microversion: 2.1 time: 0.076542 Oct 31 14:15:08.534254 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1702/3153] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:08 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1447 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:08.539275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39ea7085-e512-448a-b49c-d9f9d6c78bcb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.540165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39ea7085-e512-448a-b49c-d9f9d6c78bcb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:08.559579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:08.567582 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7f07b2e-1c9f-45e6-8c77-0a37aff6e1c7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1470 microversion: 2.1 time: 1.119990 Oct 31 14:15:08.568172 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1452/3154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:07 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1470 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:08.572601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3385c0-7051-44c4-8e83-6b96d554f351", "name": "network-vif-plugged", "status": "completed", "tag": "48c46c97-9e28-4345-a0eb-cc9d36b8ce37"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:08.599098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.599587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.600024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.617052 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] Creating event network-vif-plugged:48c46c97-9e28-4345-a0eb-cc9d36b8ce37 for instance 5b3385c0-7051-44c4-8e83-6b96d554f351 on n-h2-863052-1 Oct 31 14:15:08.619913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-39ea7085-e512-448a-b49c-d9f9d6c78bcb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:08.627335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:15:08.638578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39ea7085-e512-448a-b49c-d9f9d6c78bcb tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1215 microversion: 2.1 time: 0.102670 Oct 31 14:15:08.640538 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-39cd2616-b9a6-44eb-8be3-ed386dbdc910 req-5adc6e1d-c901-4b06-b242-ec4cf511ac2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070871 Oct 31 14:15:08.641339 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1453/3155] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:08.647534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.648420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:08.655459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.655631 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1703/3156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:08 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:08.656292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.657005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.657867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.658558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.659143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.663050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.663961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:08.670723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.671282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.671785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.672495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.673241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.673742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.881930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:08.894792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40e18a94-ff33-4eb6-82b9-550b37037d3e tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 200 len: 1516 microversion: 2.1 time: 0.237929 Oct 31 14:15:08.897029 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1704/3157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:08 2022] GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:08.908473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4238458d-3a08-4257-b481-4da61bdad28d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107731790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.973558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4238458d-3a08-4257-b481-4da61bdad28d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 200 len: 1447 microversion: 2.1 time: 0.072997 Oct 31 14:15:08.974344 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1705/3158] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:08 2022] GET /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 1447 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:08.979400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:08.980294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:08.989252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.990260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.990907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:08.991947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:08.992613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:08.993319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:09.031340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:09.146946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0517f8b4-19bb-4f52-a553-a5ad4cac3c5d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 204 len: 0 microversion: 2.1 time: 0.170878 Oct 31 14:15:09.147648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1706/3159] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:08 2022] DELETE /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:09.154298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d8edd89-a66a-4610-9a6a-6c964fbb68c1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1066da3a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:09.196403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:09.210882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b2a0e7b-7622-450d-98c7-f2e1b2274e4a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.567993 Oct 31 14:15:09.222192 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1454/3160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:08 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:09.231981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:09.233142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:09.239697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:09.240192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:09.240803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:09.241589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:09.242055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:09.242530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:09.637069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:09.648157 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63470392-27f5-4af6-b1e7-242f6f573c71 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 200 len: 1522 microversion: 2.1 time: 0.435231 Oct 31 14:15:09.648788 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1455/3161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:09 2022] GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:09.660456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:09.672545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:09.688548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:09.689353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:09.689942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:09.690831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:09.691566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:09.692141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.022770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:10.038234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4efba004-f6f0-4937-bcb9-1449016e95b8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1470 microversion: 2.1 time: 0.385508 Oct 31 14:15:10.039426 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1456/3162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:09 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:10.048640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:10.050504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:10.065230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:10.067263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.067929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.069712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.071954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.072597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.074624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.256693 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d8edd89-a66a-4610-9a6a-6c964fbb68c1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 204 len: 0 microversion: 2.1 time: 1.107317 Oct 31 14:15:10.258394 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1707/3163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:09 2022] DELETE /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:10.265026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:10.267352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:10.278516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.280027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.280673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.281492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.282095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.282651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.355703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:10.365859 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63cdcab0-e9c8-4bc3-8b8c-be34fed65493 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1267 microversion: 2.1 time: 0.325004 Oct 31 14:15:10.384224 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1457/3164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:10 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:10.390839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:10.391571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:10.398994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.399800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.400400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.401265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.401911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.402693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.437359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:10.649155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0781fb26-0c92-47fa-9bab-f6b75a6f1989 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 204 len: 0 microversion: 2.1 time: 0.263081 Oct 31 14:15:10.650209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1458/3165] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:10 2022] DELETE /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:10.682783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:10.683548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:10.704488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.704999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.706527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:10.707267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:10.707740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:10.708181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:11.266255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:11.270153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:11.280529 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d77da31-999b-4480-bede-479b983a99de tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 1.020499 Oct 31 14:15:11.281925 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1708/3166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:10 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:11.287152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3f239ae-8979-4b0b-baee-358f20b86d17 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 200 len: 1522 microversion: 2.1 time: 0.613923 Oct 31 14:15:11.303304 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1459/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:10 2022] GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:11.309025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:11.309122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:11.311924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-999089175", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:11.342931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:11.343584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:11.344112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:11.344931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:11.345489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:11.345984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:11.956823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] validate_networks() for [('d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:15:12.188332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:12.207092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a47a139-ca26-4d4a-9e9c-0c8735b41450 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1470 microversion: 2.1 time: 0.900453 Oct 31 14:15:12.209680 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1460/3168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:11 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1470 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:12.221047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:12.221677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:12.238154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:12.238682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:12.239126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:12.239840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:12.240301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:12.240853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:12.464974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:12.481599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9c6299a-e213-4347-bb2c-f928a6aed2f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1273 microversion: 2.1 time: 0.270152 Oct 31 14:15:12.484631 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1461/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:12 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:12.500978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-14264bc8-e821-48c0-b67f-3a85c88ccf4d req-90f63ca0-f553-4be3-a20d-caa1af7e88bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3cea44-8e46-4870-9e43-350e074a4d76", "name": "network-vif-plugged", "status": "completed", "tag": "82d3f9a1-6c7d-45af-8683-5ce6b08df0b1"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:12.520947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-14264bc8-e821-48c0-b67f-3a85c88ccf4d req-90f63ca0-f553-4be3-a20d-caa1af7e88bb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:12.521483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-14264bc8-e821-48c0-b67f-3a85c88ccf4d req-90f63ca0-f553-4be3-a20d-caa1af7e88bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:12.531479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-14264bc8-e821-48c0-b67f-3a85c88ccf4d req-90f63ca0-f553-4be3-a20d-caa1af7e88bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:12.581851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-14264bc8-e821-48c0-b67f-3a85c88ccf4d req-90f63ca0-f553-4be3-a20d-caa1af7e88bb service nova] Creating event network-vif-plugged:82d3f9a1-6c7d-45af-8683-5ce6b08df0b1 for instance 0c3cea44-8e46-4870-9e43-350e074a4d76 on n-h1-863052-1 Oct 31 14:15:12.602119 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-14264bc8-e821-48c0-b67f-3a85c88ccf4d req-90f63ca0-f553-4be3-a20d-caa1af7e88bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114823 Oct 31 14:15:12.610429 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1462/3170] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:12.635921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c4b96e80-94ce-4214-aed2-84f7c39ea564 req-f3ece4c3-801d-4732-a71e-ca2de64b8343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae1f056-3eda-4431-a1c0-86ce69a96a1e", "name": "network-vif-deleted", "tag": "75f1ea29-444b-4ba9-b12f-f501ed3c813a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:12.659336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c4b96e80-94ce-4214-aed2-84f7c39ea564 req-f3ece4c3-801d-4732-a71e-ca2de64b8343 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:12.659771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c4b96e80-94ce-4214-aed2-84f7c39ea564 req-f3ece4c3-801d-4732-a71e-ca2de64b8343 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:12.660209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c4b96e80-94ce-4214-aed2-84f7c39ea564 req-f3ece4c3-801d-4732-a71e-ca2de64b8343 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:12.683375 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c4b96e80-94ce-4214-aed2-84f7c39ea564 req-f3ece4c3-801d-4732-a71e-ca2de64b8343 service nova] Creating event network-vif-deleted:75f1ea29-444b-4ba9-b12f-f501ed3c813a for instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e on n-h1-863052-1 Oct 31 14:15:12.702288 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c4b96e80-94ce-4214-aed2-84f7c39ea564 req-f3ece4c3-801d-4732-a71e-ca2de64b8343 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089118 Oct 31 14:15:12.707703 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1463/3171] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:12.751781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:12.756584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:12.774799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:12.775596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:12.787592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:12.789998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:12.790811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:12.793996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:13.374608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:13.390556 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0adcbb40-dd30-4480-baca-1b672dda2945 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1315 microversion: 2.1 time: 0.681524 Oct 31 14:15:13.391812 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1464/3172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:12 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:13.406847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:13.407897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:13.415317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:13.420424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:13.421151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:13.422124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:13.422853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:13.423514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:13.449743 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] HTTP exception thrown: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e HTTP/1.1 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9ae1f056-3eda-4431-a1c0-86ce69a96a1e'} Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:13.464361 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:13.468353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:13.470307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 404 to user: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:13.471407 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd3f120c-3593-44d0-995e-bc4dd5103fd8 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 404 len: 111 microversion: 2.1 time: 0.078356 Oct 31 14:15:13.472542 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1465/3173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:13 2022] GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:13.477727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:13.486447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:13.492837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:13.493593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:13.503648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:13.504693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:13.505386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:13.506033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:14.532297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:14.552451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5601451-b5e1-4e68-8452-091b98a8e063 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1470 microversion: 2.1 time: 1.077642 Oct 31 14:15:14.553069 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1466/3174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:13 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1470 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:14.577373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:14.590311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:14.595498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:14.615662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:14.617202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:14.620836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:14.621858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:14.622516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:14.625464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:14.930745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:14.981087 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea848981-57a7-4d0d-8ab1-185ff90da401 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.421625 Oct 31 14:15:14.983264 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1467/3175] 10.222.0.27 () {58 vars in 1230 bytes} [Mon Oct 31 14:15:14 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:14.993864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:14.999453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:15.019902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:15.020726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:15.021580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:15.027187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:15.029739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:15.030428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:15.537303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:15.538614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:15.539326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:15.539983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:15.540722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:15.575059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:15.575817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:15.576540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:15.581370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:15.582110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:15.583398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:15.655953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:15.664456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for user ec707d34966e44aa93900eebc62a6a93 and project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:15.703100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:15.710686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:15.858217 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b397ad72-dccb-49f3-848d-f18a369de404 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.574047 Oct 31 14:15:15.859145 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1709/3176] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:15:15.873719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:15.874873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:15.893123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:15.903298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:15.904139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:15.905727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:15.906465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:15.908654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.056325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:16.083924 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35342ca2-3a1b-496e-a832-79090d1b6bab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 1.086196 Oct 31 14:15:16.086150 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1468/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:14 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:16.119681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-570531dd-7066-46d2-b894-757813f3378e req-41b621e8-0cf4-4b51-ae9d-21714561b01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e505dec-1e44-49fa-9142-6f61b3c3dcba", "name": "network-vif-deleted", "tag": "47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:16.153729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-570531dd-7066-46d2-b894-757813f3378e req-41b621e8-0cf4-4b51-ae9d-21714561b01a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.155164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-570531dd-7066-46d2-b894-757813f3378e req-41b621e8-0cf4-4b51-ae9d-21714561b01a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.158273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-570531dd-7066-46d2-b894-757813f3378e req-41b621e8-0cf4-4b51-ae9d-21714561b01a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.189642 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-570531dd-7066-46d2-b894-757813f3378e req-41b621e8-0cf4-4b51-ae9d-21714561b01a service nova] Creating event network-vif-deleted:47a6cfdc-4fbb-42d7-8c45-e6a4c876ae75 for instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba on n-h2-863052-1 Oct 31 14:15:16.204426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-570531dd-7066-46d2-b894-757813f3378e req-41b621e8-0cf4-4b51-ae9d-21714561b01a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115605 Oct 31 14:15:16.208811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1469/3178] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:16.221480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d4cd281-5306-4b83-b863-9829c8a8cf95 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d4cd281-5306-4b83-b863-9829c8a8cf95 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: action_args: {} Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 14:15:16.229383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 14:15:16.235781 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:16.245727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d4cd281-5306-4b83-b863-9829c8a8cf95 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:16.249391 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d4cd281-5306-4b83-b863-9829c8a8cf95 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.033534 Oct 31 14:15:16.251647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1470/3179] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 31 14:15:16 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:15:16.267092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:16.269413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:16.288331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.292279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.294455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.299086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.300326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.300991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.625856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:16.636681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb8646b3-a804-4f09-b5af-e995c2326cd1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1462 microversion: 2.1 time: 0.379144 Oct 31 14:15:16.637408 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1471/3180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:16 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1462 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:16.654760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5cbd13c0-924e-453d-aeb9-1d288890b9fc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:16.664812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5cbd13c0-924e-453d-aeb9-1d288890b9fc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:16.806196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5cbd13c0-924e-453d-aeb9-1d288890b9fc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:16.816388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5cbd13c0-924e-453d-aeb9-1d288890b9fc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1207 microversion: 2.1 time: 0.177455 Oct 31 14:15:16.818298 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1472/3181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:16 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1207 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:16.829391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:16.836973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:16.837885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:16.844976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.845875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.846351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.847102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.847557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.848192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.884782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:15:16.923919 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5da65a1c-8d59-4ed4-abfd-cdf87aa1621d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.103594 Oct 31 14:15:16.932732 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1473/3182] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:15:16 2022] GET /compute/v2.1/servers => generated 683 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:16.939848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:16.940502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:16.963838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.964437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.965314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:16.966057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:16.966567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:16.967025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.236426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:17.248158 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95582857-950f-4be5-a3f3-53954ea5045f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1464 microversion: 2.1 time: 1.387525 Oct 31 14:15:17.249279 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1710/3183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:15 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1464 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:17.253946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2b7d2d93-c0be-4a14-bb64-d5c64af93956 req-fef606c1-9a7c-4e0b-9bb4-b0a026cef7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461d8d3d-2f99-4f84-aef3-929c3aec9144", "tag": "e53d63f0-44c3-423c-aac6-64aa47a30c6c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:17.264223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2b7d2d93-c0be-4a14-bb64-d5c64af93956 req-fef606c1-9a7c-4e0b-9bb4-b0a026cef7bb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.264917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2b7d2d93-c0be-4a14-bb64-d5c64af93956 req-fef606c1-9a7c-4e0b-9bb4-b0a026cef7bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.265501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2b7d2d93-c0be-4a14-bb64-d5c64af93956 req-fef606c1-9a7c-4e0b-9bb4-b0a026cef7bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.277776 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2b7d2d93-c0be-4a14-bb64-d5c64af93956 req-fef606c1-9a7c-4e0b-9bb4-b0a026cef7bb service nova] Creating event network-changed:e53d63f0-44c3-423c-aac6-64aa47a30c6c for instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 on n-h2-863052-1 Oct 31 14:15:17.290995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:17.302092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a73f91c-7996-443b-bc38-f21aa7d98278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1462 microversion: 2.1 time: 0.368062 Oct 31 14:15:17.308506 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2b7d2d93-c0be-4a14-bb64-d5c64af93956 req-fef606c1-9a7c-4e0b-9bb4-b0a026cef7bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033604 Oct 31 14:15:17.311978 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1711/3184] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:17.317973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.318405 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1474/3185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:16 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1462 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:17.328517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:17.328978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.servers [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Removing options 'limit' from query {{(pid=120640) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 14:15:17.329848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:17.335083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.335500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.335703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:17.335984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.336420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.337141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.337592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.338017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.346686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.347181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.347630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.348360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.348982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.349414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.366561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:15:17.420952 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49a02e3b-c186-4ec7-a09e-07e844330edf tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.107211 Oct 31 14:15:17.421786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1712/3186] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Oct 31 14:15:17 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:17.426610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.427324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:17.433664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.434276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.434880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.435765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.437148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.437807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.462503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:17.600312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:17.611446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-beb9b0fd-b580-42ac-8b5c-58097a83dde8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 0.291840 Oct 31 14:15:17.626681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1475/3187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:17 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:17.634235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb5e90ed-4cae-4545-ad23-c7513c6a8b65 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'create', calling method: .version_select at 0x7fe1074b0280>, body: {"keypair": {"name": "tempest-keypair-75315945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMCX3P8ftpkGRkQhDNYxvhZgmjuJM1G4H2Ti7Xa+2niY57mGdUUUNPeeiqq62g47k4B4w5kr4h4sffDNiUAmmXwgW1DrEYCGNcyGDzUnD/sZekomEbVgpzHhuC+vAkv7Q=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:17.651359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-bb5e90ed-4cae-4545-ad23-c7513c6a8b65 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:17.657918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-bb5e90ed-4cae-4545-ad23-c7513c6a8b65 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for user 4d15f804765e48e3a279a902cde38dec and project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:17.690686 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb5e90ed-4cae-4545-ad23-c7513c6a8b65 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.062327 Oct 31 14:15:17.692968 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1476/3188] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:15:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:17.698637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb6ed0cc-01d5-44dd-bd07-766f5634f70f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb6ed0cc-01d5-44dd-bd07-766f5634f70f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: action_args: {} Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '-1' Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 14:15:17.704523 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 14:15:17.709606 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.712006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb6ed0cc-01d5-44dd-bd07-766f5634f70f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:17.713431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb6ed0cc-01d5-44dd-bd07-766f5634f70f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.019351 Oct 31 14:15:17.714547 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1477/3189] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Oct 31 14:15:17 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:15:17.722679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.723536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:17.731608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.732857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.733599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.734522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.735147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.735740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.798667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:17.936700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d69f1f8f-ae5d-49d3-b797-879d84926c9a tempest-ServersOnMultiNodesTest-1006202426 tempest-ServersOnMultiNodesTest-1006202426-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1615 microversion: 2.1 time: 0.512933 Oct 31 14:15:17.937447 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1713/3190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:17 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1615 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:17.944593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cb46d7f-1e1a-4332-93ed-359e62b47a9c tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cb46d7f-1e1a-4332-93ed-359e62b47a9c tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: action_args: {} Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'testing' Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 14:15:17.950672 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 14:15:17.955506 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:17.966136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cb46d7f-1e1a-4332-93ed-359e62b47a9c tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:17.967578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5cb46d7f-1e1a-4332-93ed-359e62b47a9c tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.028749 Oct 31 14:15:17.972221 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1714/3191] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:15:17 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:15:17.981531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:17.982651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:17.992273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.993038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.993679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:17.994951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:17.995624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:17.996257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.024099 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d423eb8-64a3-4749-a1d3-b6d1001d1847 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 204 len: 0 microversion: 2.1 time: 0.307964 Oct 31 14:15:18.025653 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1478/3192] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:17 2022] DELETE /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:18.032814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.034045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:18.044089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.045168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.046600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.047534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.048168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.048787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.088633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:18.223424 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc3cef98-ecf2-43c1-9b04-5c5fcd4241e8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 204 len: 0 microversion: 2.1 time: 0.196037 Oct 31 14:15:18.224028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1479/3193] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:18 2022] DELETE /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:18.230108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44815655-6f29-4848-8178-f7f534f32458 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.249946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-44815655-6f29-4848-8178-f7f534f32458 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:18.250786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44815655-6f29-4848-8178-f7f534f32458 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:18.269198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.servers [None req-44815655-6f29-4848-8178-f7f534f32458 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Flavor 'non_existing_flavor' could not be found {{(pid=120641) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 31 14:15:18.273761 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44815655-6f29-4848-8178-f7f534f32458 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.044525 Oct 31 14:15:18.277606 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1480/3194] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Oct 31 14:15:18 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:18.287537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.288943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:18.316109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.317350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.318147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.320912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.323236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.323865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.446388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:18.459344 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-480b6817-e125-4179-b538-34659619bbc7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1267 microversion: 2.1 time: 0.485670 Oct 31 14:15:18.459967 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1715/3195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:17 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1267 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:18.471203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.472852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:18.489485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.490766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.492921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.495875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.496584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.499981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.634221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:18.647403 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-62974eff-9d92-4089-bd96-d45f831f0649 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1508 microversion: 2.1 time: 0.368315 Oct 31 14:15:18.668341 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1481/3196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:18 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:18.677381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.686209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:18.712133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:18.729972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.735575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.737095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.739758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:18.740914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:18.742992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:18.930942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:18.939555 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3993ed76-ca55-4fce-980a-c71a5607cb94 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1470 microversion: 2.1 time: 0.476891 Oct 31 14:15:18.959528 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f2e0c05-5c6f-4292-aad8-96100402991f tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.289515 Oct 31 14:15:18.962194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1482/3197] 10.222.0.27 () {58 vars in 1174 bytes} [Mon Oct 31 14:15:18 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:18.974614 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1716/3198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:18 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1470 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:18.985513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.987935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:18.988594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:18.997867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.001624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:19.008045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.009152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.009609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.010362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.011008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.011600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.018313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.018954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.019413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.020197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.020655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.021155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.160724 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1503b69-430a-4322-b8e4-d41e563db115 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.184724 Oct 31 14:15:19.168342 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1483/3199] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Oct 31 14:15:18 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:19.174930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.181804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.182862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:19.190666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.193942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.194534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.195389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.198066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.198631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.234004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:15:19.276451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.286722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.287584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.288288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.380961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.390331 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f2c4c38-0c6e-4ce3-80db-1586e5e292e6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 0.414464 Oct 31 14:15:19.393527 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1717/3200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:18 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:19.490054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.491016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:19.501695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.506231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.506980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.507991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.508745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.509525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.613539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.640105 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62d999d4-4272-44f7-b2fa-4b82f4fda0c4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1265 microversion: 2.1 time: 0.148755 Oct 31 14:15:19.642063 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1718/3201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:19 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:19.677970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.679072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:19.688725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.689516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.690467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.691543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.692220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.693179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.764233 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-caee2648-c2e9-4116-818d-675b0ec678c9 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.592681 Oct 31 14:15:19.771595 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1484/3202] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:15:19 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:19.800393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a52953b4-1c8c-4413-8d7c-a9b439c62482 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.807520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a52953b4-1c8c-4413-8d7c-a9b439c62482 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.809743 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a52953b4-1c8c-4413-8d7c-a9b439c62482 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014924 Oct 31 14:15:19.811264 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1485/3203] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Oct 31 14:15:19 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:19.828035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.834322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:19.835228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Searching by: {'deleted': False, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:15:19.842382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.843615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.844237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.851043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.851729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.852641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.881805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:15:19.915702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb30f6ec-cb62-4e62-98fc-91de0250e864 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.093087 Oct 31 14:15:19.925422 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1486/3204] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:15:19 2022] GET /compute/v2.1/servers => generated 683 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:19.932510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.933304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:19.941673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.942472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.943062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.943960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.944589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.945450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.961018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] HTTP exception thrown: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e HTTP/1.1 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9ae1f056-3eda-4431-a1c0-86ce69a96a1e'} Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:19.963403 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:19.967967 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:19.970283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 404 to user: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:19.971504 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd55ebdb-42ab-4add-9335-83ec70dc4b98 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 404 len: 111 microversion: 2.1 time: 0.044035 Oct 31 14:15:19.976028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1487/3205] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:19 2022] DELETE /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:19.984965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:19.985985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:19.993513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.994218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.995050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:19.995958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:19.996559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:19.997156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:20.026759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:20.195708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:20.227389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a51ae09-1109-4673-9a41-0c821c31c8fe tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1508 microversion: 2.1 time: 0.552324 Oct 31 14:15:20.249252 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1719/3206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:19 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:20.258537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:20.260638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:20.281045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:20.281954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:20.282616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:20.284042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:20.287237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:20.288498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:20.347916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:20.456956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:20.493051 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ae206ee-e25c-491a-bc0f-f1a63f5c0265 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 204 len: 0 microversion: 2.1 time: 0.239665 Oct 31 14:15:20.493669 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1720/3207] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:20 2022] DELETE /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:20.503845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:20.504567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:20.514838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:20.515360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:20.515809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:20.516534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:20.517073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:20.517841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:20.982108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:21.001918 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e866a1c5-6c62-4e06-8547-0039159ed4fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 0.505443 Oct 31 14:15:21.026672 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1721/3208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:20 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:21.032440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:21.033591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:21.042196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:21.043384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:21.043979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:21.044934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:21.045554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:21.046287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:21.079480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:21.251916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:21.265426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30fb4758-233e-4ce3-bbe9-77125191fe61 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1470 microversion: 2.1 time: 1.288012 Oct 31 14:15:21.270933 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1488/3209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:19 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1470 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:21.275847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:21.282045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:21.299384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:21.300928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:21.302811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:21.305013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:21.308780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:21.309474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:21.310071 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97ad339a-78b8-42b9-8436-028a1a9b7853 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 204 len: 0 microversion: 2.1 time: 0.272804 Oct 31 14:15:21.311761 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1722/3210] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:21 2022] DELETE /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:21.319160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:21.320840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:21.333361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:21.336122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:21.336650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:21.337448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:21.345435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:21.346036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:21.985409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:21.996033 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05da1715-ea43-4f7e-92b3-861134f59725 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1508 microversion: 2.1 time: 0.682898 Oct 31 14:15:22.000899 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1723/3211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:21 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:22.010761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.015010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 9ae1f056-3eda-4431-a1c0-86ce69a96a1e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:22.039432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.040735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.042774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.045348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.046392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.047970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.101100 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] HTTP exception thrown: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e HTTP/1.1 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '9ae1f056-3eda-4431-a1c0-86ce69a96a1e'} Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:22.110142 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. Oct 31 14:15:22.116430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:22.118767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 404 to user: Instance 9ae1f056-3eda-4431-a1c0-86ce69a96a1e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:22.120969 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d58b00cc-747c-4337-89b9-1f2198ba1dd5 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e" status: 404 len: 111 microversion: 2.1 time: 0.117709 Oct 31 14:15:22.122982 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1724/3212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/servers/9ae1f056-3eda-4431-a1c0-86ce69a96a1e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:22.135761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6f30c83-a444-4c62-812e-2ada0714ef74 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '.version_select at 0x7fe1066da550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.147538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f30c83-a444-4c62-812e-2ada0714ef74 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.149156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f30c83-a444-4c62-812e-2ada0714ef74 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.151748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6f30c83-a444-4c62-812e-2ada0714ef74 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.173944 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6f30c83-a444-4c62-812e-2ada0714ef74 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.047399 Oct 31 14:15:22.176181 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1725/3213] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:22.187590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-94ae87ee-dbc7-488f-bfba-17a839b4a700 req-3350af36-f55b-4d48-a9e4-07a8247f60f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3cea44-8e46-4870-9e43-350e074a4d76", "name": "network-vif-deleted", "tag": "82d3f9a1-6c7d-45af-8683-5ce6b08df0b1"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:22.218885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-94ae87ee-dbc7-488f-bfba-17a839b4a700 req-3350af36-f55b-4d48-a9e4-07a8247f60f0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.219581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-94ae87ee-dbc7-488f-bfba-17a839b4a700 req-3350af36-f55b-4d48-a9e4-07a8247f60f0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.221066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-94ae87ee-dbc7-488f-bfba-17a839b4a700 req-3350af36-f55b-4d48-a9e4-07a8247f60f0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.252162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-94ae87ee-dbc7-488f-bfba-17a839b4a700 req-3350af36-f55b-4d48-a9e4-07a8247f60f0 service nova] Creating event network-vif-deleted:82d3f9a1-6c7d-45af-8683-5ce6b08df0b1 for instance 0c3cea44-8e46-4870-9e43-350e074a4d76 on n-h1-863052-1 Oct 31 14:15:22.280220 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-94ae87ee-dbc7-488f-bfba-17a839b4a700 req-3350af36-f55b-4d48-a9e4-07a8247f60f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101033 Oct 31 14:15:22.284298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1726/3214] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:22.304373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.307653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:22.331653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.332388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.333745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.336065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.338523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.343932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.608958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:22.620897 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0427019e-6a57-485d-bca6-4cfaf3153ff9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 1.348656 Oct 31 14:15:22.621689 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1489/3215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:21 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:22.635976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:22.646357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47f9f88f-9319-405a-8a44-b52ea5a6aa6f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 0.360556 Oct 31 14:15:22.648767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.649598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:22.658758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.658950 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1727/3216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:22.659971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.661540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.662517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.664635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.665500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.671433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a190491d-e58e-46e8-b952-8ea405d64cc2 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.693580 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a190491d-e58e-46e8-b952-8ea405d64cc2 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032687 Oct 31 14:15:22.697960 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1728/3217] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:22.711227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.712210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:22.720831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.721578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.722281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.723258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.723919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.725853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.776354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:22.777103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:22.778128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:22.778773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid 0c3cea44-8e46-4870-9e43-350e074a4d76 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:22.859591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:22.870504 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be003f21-08e5-4982-b78e-c6509197908f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 200 len: 1305 microversion: 2.1 time: 0.170919 Oct 31 14:15:22.874594 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1729/3218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:22.881651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-030849f4-1c9a-4217-add3-03459ea66bba tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1409034980", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:22.915489 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-030849f4-1c9a-4217-add3-03459ea66bba tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.039538 Oct 31 14:15:22.916701 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1730/3219] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Oct 31 14:15:22 2022] POST /compute/v2.1/flavors => generated 499 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:22.929867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0dee8e76-3da3-486b-9223-98f247afd82e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:22.939215 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0dee8e76-3da3-486b-9223-98f247afd82e tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014143 Oct 31 14:15:22.942543 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1731/3220] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:23.025454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:23.026279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:23.041471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:23.047055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:23.048046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:23.051943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:23.052899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:23.055346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:23.114621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:23.393424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:23.402335 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd3dc15d-7863-481b-98e2-7dc0ab263d91 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 200 len: 1522 microversion: 2.1 time: 0.757219 Oct 31 14:15:23.403232 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1490/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:22 2022] GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:23.409206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2051075704", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "5407d20c-913a-481b-ba1d-def0218a245c"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:23.476911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:15:23.480106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:23.489269 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be8e91f5-21a4-427f-930a-925f46626795 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1508 microversion: 2.1 time: 0.468996 Oct 31 14:15:23.490048 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1732/3222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:23 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1508 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:23.655971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:23.656927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:23.667488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:23.668585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:23.669659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:23.671329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:23.673766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:23.675753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:23.933248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:23.945957 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0c21192-9564-41b0-aad1-251179f57417 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.298144 Oct 31 14:15:23.946575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1733/3223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:23 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:23.964172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:23.964791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:23.971545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:23.972038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:23.972480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:23.973166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:23.973614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:23.979147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.275194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:24.292437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96a31074-6ce5-43cf-96db-9e1ad7aa53f2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 0.344495 Oct 31 14:15:24.295167 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1734/3224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:23 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:24.314033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:24.314705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 0c3cea44-8e46-4870-9e43-350e074a4d76] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:24.328509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.329006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.329445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.334756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.335353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.339084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.383763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance 0c3cea44-8e46-4870-9e43-350e074a4d76 could not be found. Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 HTTP/1.1 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 0c3cea44-8e46-4870-9e43-350e074a4d76 could not be found. Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '0c3cea44-8e46-4870-9e43-350e074a4d76'} Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3cea44-8e46-4870-9e43-350e074a4d76 could not be found. Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3cea44-8e46-4870-9e43-350e074a4d76 could not be found. Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:24.385582 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3cea44-8e46-4870-9e43-350e074a4d76 could not be found. Oct 31 14:15:24.390907 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:24.399253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance 0c3cea44-8e46-4870-9e43-350e074a4d76 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:24.400342 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed811311-9b02-43bd-8023-2c4277e9ce6f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76" status: 404 len: 111 microversion: 2.1 time: 0.104194 Oct 31 14:15:24.408261 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1735/3225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:24 2022] GET /compute/v2.1/servers/0c3cea44-8e46-4870-9e43-350e074a4d76 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:24.422444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f5d66a3d-b0b0-4784-a855-2992c15a220a req-4afd7a0c-17d8-4749-ac2d-9518383650aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d9b505-33df-4dbd-8bd8-13c69bd80ad2", "name": "network-vif-deleted", "tag": "a66f8122-b950-4e9c-a465-fd2598c6c6e6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:24.439247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5d66a3d-b0b0-4784-a855-2992c15a220a req-4afd7a0c-17d8-4749-ac2d-9518383650aa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.441422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5d66a3d-b0b0-4784-a855-2992c15a220a req-4afd7a0c-17d8-4749-ac2d-9518383650aa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.442066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5d66a3d-b0b0-4784-a855-2992c15a220a req-4afd7a0c-17d8-4749-ac2d-9518383650aa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.477327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f5d66a3d-b0b0-4784-a855-2992c15a220a req-4afd7a0c-17d8-4749-ac2d-9518383650aa service nova] Creating event network-vif-deleted:a66f8122-b950-4e9c-a465-fd2598c6c6e6 for instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 on n-h1-863052-1 Oct 31 14:15:24.492409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f5d66a3d-b0b0-4784-a855-2992c15a220a req-4afd7a0c-17d8-4749-ac2d-9518383650aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082641 Oct 31 14:15:24.493624 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1736/3226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:24.502678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-66579d67-6a45-4a06-8f81-e97f9b4c338e req-fdcdb506-f12b-4a25-b84c-4a5fa2f55315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e668e80e-5f5c-48ba-b09f-544c72d227e0", "name": "network-vif-deleted", "tag": "5e4ed363-4229-4ab0-b179-1fcfb87a6e3c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:24.534720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-66579d67-6a45-4a06-8f81-e97f9b4c338e req-fdcdb506-f12b-4a25-b84c-4a5fa2f55315 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.538621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-66579d67-6a45-4a06-8f81-e97f9b4c338e req-fdcdb506-f12b-4a25-b84c-4a5fa2f55315 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.540414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-66579d67-6a45-4a06-8f81-e97f9b4c338e req-fdcdb506-f12b-4a25-b84c-4a5fa2f55315 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.567133 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-66579d67-6a45-4a06-8f81-e97f9b4c338e req-fdcdb506-f12b-4a25-b84c-4a5fa2f55315 service nova] Creating event network-vif-deleted:5e4ed363-4229-4ab0-b179-1fcfb87a6e3c for instance e668e80e-5f5c-48ba-b09f-544c72d227e0 on n-h2-863052-1 Oct 31 14:15:24.573285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-66579d67-6a45-4a06-8f81-e97f9b4c338e req-fdcdb506-f12b-4a25-b84c-4a5fa2f55315 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077621 Oct 31 14:15:24.574481 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1737/3227] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:24.583625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:24.584455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:24.597422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.598437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.598917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.600720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.601444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.602119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.639218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:24.781889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:24.782410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:24.782872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:24.783518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:24.784022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:24.800092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.800594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.801038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.801772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.817121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.817760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.879058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:24.884693 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d59aa06a-46a2-4d32-ab74-83db92bce4f0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 204 len: 0 microversion: 2.1 time: 0.303562 Oct 31 14:15:24.885455 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1738/3228] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:24 2022] DELETE /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:24.902259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:24.903712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for user 4d15f804765e48e3a279a902cde38dec and project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:24.921553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:24.922306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:24.939282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:24.941123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.941626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.942080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.942817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:24.943276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:24.943707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:24.954945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:25.056395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:25.056683 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26d2448e-8b66-4f52-8c05-fbefc015e6bb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648963 Oct 31 14:15:25.066399 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1491/3229] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:15:25.070928 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2d79b1d-66c1-420a-814e-8bff36ea0b6d tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 200 len: 1480 microversion: 2.1 time: 0.176507 Oct 31 14:15:25.071527 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1739/3230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:24 2022] GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 1480 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:25.073954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:25.075445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:25.076442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:25.077065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:25.084924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.086749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.089017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.089931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.090581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.091399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.108512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.109015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.109460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.110212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.120219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.120749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.139673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.141475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.143572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.144370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lazy-loading 'fault' on Instance uuid a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:25.420291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:25.428938 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5c87268-89fc-4689-997a-978aecfd7306 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 200 len: 1312 microversion: 2.1 time: 0.361329 Oct 31 14:15:25.437920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1492/3231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:25 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:25.443128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:25.448966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:25.463877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.464725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.466202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.467892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.475410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.476178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.480146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:25.492763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-950895af-5b31-4474-9c15-28df6e861f54 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1472 microversion: 2.1 time: 0.417732 Oct 31 14:15:25.493429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1740/3232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:25 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:25.505000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff51f9f1-2491-4b54-964a-d9d85394bd35 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:25.507604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff51f9f1-2491-4b54-964a-d9d85394bd35 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:25.676486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff51f9f1-2491-4b54-964a-d9d85394bd35 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:25.692475 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff51f9f1-2491-4b54-964a-d9d85394bd35 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1279 microversion: 2.1 time: 0.194069 Oct 31 14:15:25.711904 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1741/3233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:25 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:25.721558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:25.724340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:25.733666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.735241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.736487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.738245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.739759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.740735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.836136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:25.848078 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e5aa92c-04db-4e40-8985-b5ddb8dbd1b4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.406630 Oct 31 14:15:25.866828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1493/3234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:25 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:25.879759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-1de845d1-d883-4c16-a7f6-de9372525eb7 req-768d7e00-af16-495a-bea1-5af7f6971e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461d8d3d-2f99-4f84-aef3-929c3aec9144", "name": "network-vif-plugged", "status": "completed", "tag": "e53d63f0-44c3-423c-aac6-64aa47a30c6c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:25.910905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1de845d1-d883-4c16-a7f6-de9372525eb7 req-768d7e00-af16-495a-bea1-5af7f6971e80 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:25.911509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1de845d1-d883-4c16-a7f6-de9372525eb7 req-768d7e00-af16-495a-bea1-5af7f6971e80 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:25.912132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1de845d1-d883-4c16-a7f6-de9372525eb7 req-768d7e00-af16-495a-bea1-5af7f6971e80 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:25.933576 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-1de845d1-d883-4c16-a7f6-de9372525eb7 req-768d7e00-af16-495a-bea1-5af7f6971e80 service nova] Creating event network-vif-plugged:e53d63f0-44c3-423c-aac6-64aa47a30c6c for instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 on n-h2-863052-1 Oct 31 14:15:25.945035 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-1de845d1-d883-4c16-a7f6-de9372525eb7 req-768d7e00-af16-495a-bea1-5af7f6971e80 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076380 Oct 31 14:15:25.945656 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1494/3235] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:26.104640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:26.108414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:26.133076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.133656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.137007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:26.144079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.144898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.145887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:26.288069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.303000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.315219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:26.316148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lazy-loading 'fault' on Instance uuid 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:26.430268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c7ea2f8564f4aa738cc3b4a8c47d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d16a8ba8654fcb89e4b2bb728ab416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:26.448096 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c5044f23-869d-4d80-b5f4-0c25952fde2a tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 200 len: 1313 microversion: 2.1 time: 0.351349 Oct 31 14:15:26.466579 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1495/3236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:26 2022] GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:26.763883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2055256579", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "0ccc7087-73e3-46dd-b7bd-2911c7ccbf32"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:26.856803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:26.866654 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9d6d1dd-8e6a-4683-aa78-ecdf10711804 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 1.151441 Oct 31 14:15:26.869608 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1742/3237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:25 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:26.873495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] validate_networks() for [('0ccc7087-73e3-46dd-b7bd-2911c7ccbf32', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:15:26.888158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:26.889188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: a4d9b505-33df-4dbd-8bd8-13c69bd80ad2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:26.919470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.920846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.921534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:26.922605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.923254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.923930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:26.950855 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 could not be found. Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 HTTP/1.1 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 could not be found. Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a4d9b505-33df-4dbd-8bd8-13c69bd80ad2'} Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 could not be found. Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 could not be found. Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:26.953890 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 could not be found. Oct 31 14:15:26.958536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:26.960182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 404 to user: Instance a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:26.961549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a7b0dd8-9bd6-4778-b2e9-9717444daae9 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2" status: 404 len: 111 microversion: 2.1 time: 0.090751 Oct 31 14:15:26.962619 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1743/3238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:26 2022] GET /compute/v2.1/servers/a4d9b505-33df-4dbd-8bd8-13c69bd80ad2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:26.970311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:26.971512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:26.979156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.980061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.980657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:26.981885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:26.983156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:26.983742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:27.301921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:27.313239 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f52d92ac-47f3-42a8-9c18-412dbfe56f3a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1472 microversion: 2.1 time: 0.349325 Oct 31 14:15:27.327034 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1744/3239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:26 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:27.332349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aceb4a5-f090-47d8-954e-42c61d5dd1c1", "name": "network-vif-deleted", "tag": "1008d00d-e812-4b2f-bd0b-3f604f21a847"}, {"name": "network-changed", "server_uuid": "2c4544a4-f791-409a-9f34-20bdb10acfc3", "tag": "052e069f-ff62-4302-bf3c-acfe4326beea"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:27.360026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:27.367289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:27.368104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:27.368701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:27.390143 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] Creating event network-vif-deleted:1008d00d-e812-4b2f-bd0b-3f604f21a847 for instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 on n-h1-863052-1 Oct 31 14:15:27.394907 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] Creating event network-changed:052e069f-ff62-4302-bf3c-acfe4326beea for instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 on n-h1-863052-1 Oct 31 14:15:27.402389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-452ab925-d3aa-46bb-9755-620c639c8323 req-51199ab5-3b0c-4732-b68c-8a0dab223ca5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.073614 Oct 31 14:15:27.403398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1745/3240] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:27.410327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:27.411113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:27.422107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:27.422641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:27.423123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:27.423794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:27.425218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:27.426313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:27.688878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:27.707479 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a705924-f0ef-4341-ae91-47469f9cd56d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1339 microversion: 2.1 time: 0.302064 Oct 31 14:15:27.717604 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1746/3241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:27 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:27.724947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:27.724947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:27.767647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:27.768262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:27.768943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:27.769901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:27.770643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:27.771290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.035055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:28.052393 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a48cf89-6bb6-43a5-8f48-30401bd028eb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.341825 Oct 31 14:15:28.054473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1747/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:27 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:28.079177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:28.079962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:28.098741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.099274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.099726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.102565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.103038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.103517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.160369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:28.337485 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93644498-96af-423e-868d-092164e54cb0 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 204 len: 0 microversion: 2.1 time: 0.279291 Oct 31 14:15:28.338839 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1748/3243] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:28 2022] DELETE /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:28.348738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:28.350221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: 6aceb4a5-f090-47d8-954e-42c61d5dd1c1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:28.358378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.359189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.360119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.361292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.361982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.362620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.384644 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] HTTP exception thrown: Instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 could not be found. Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 HTTP/1.1 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 could not be found. Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '6aceb4a5-f090-47d8-954e-42c61d5dd1c1'} Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 could not be found. Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 could not be found. Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:28.387015 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 could not be found. Oct 31 14:15:28.391682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:28.393573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 404 to user: Instance 6aceb4a5-f090-47d8-954e-42c61d5dd1c1 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:28.395317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ffa769ed-7574-4e20-89b6-750a3f795294 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1" status: 404 len: 111 microversion: 2.1 time: 0.054068 Oct 31 14:15:28.399734 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1749/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:28 2022] GET /compute/v2.1/servers/6aceb4a5-f090-47d8-954e-42c61d5dd1c1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:28.410876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:28.416488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:28.434944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.438392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.438939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.441894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.442511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.442964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.484290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:28.910187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:28.923629 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8a5ef3a-23d7-4767-93f4-374012d2b29e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1315 microversion: 2.1 time: 0.517985 Oct 31 14:15:28.925619 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1750/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:28 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:28.935747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:28.938794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:28.964880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:28.965882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:28.967197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:28.967776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:28.968351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:28.982328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.982692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.983123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.983976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.984301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.993939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.994999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.995142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.995842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:28.996786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:28.997428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:28.998083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.050350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Getting quotas for project 6b51eed65e464fcdb0706e5d09a5ef05. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:29.058583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Getting quotas for user 26c986efd4cd4cedaef35c2b9e0de55f and project 6b51eed65e464fcdb0706e5d09a5ef05. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:29.078111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:29.079655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.080338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.080870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.081461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid a5003288-803c-4978-9978-481913ea83ba {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:29.082262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:29.157057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-751d1b87-54e9-4d90-a3a2-7014b5d55339 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688968 Oct 31 14:15:29.157956 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1496/3246] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:15:29.163625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:29.164789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:29.174123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.175105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.175966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.177323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.178042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.178430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:29.178845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.191813 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b09377b3-08e7-4666-87f8-e23bc7bb8f7a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 200 len: 1306 microversion: 2.1 time: 0.264889 Oct 31 14:15:29.195167 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1751/3247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:28 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 1306 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:29.234847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:29.235767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] [instance: e668e80e-5f5c-48ba-b09f-544c72d227e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:29.253431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.254309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.254923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.255817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.265202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.265918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.295222 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] HTTP exception thrown: Instance e668e80e-5f5c-48ba-b09f-544c72d227e0 could not be found. Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Request method failure captured: Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 HTTP/1.1 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9hRsFMysKJo96QVEaH8YJ3-41PU6eITGmOJKOsTYk6q2H3rncnM-WshaFBzJYCq_R6K4ymE_7y0NquAM2C23t8zOfzSvQfhDUqJ4Bfmjp0BSrFRdMVLk6LSzT5E87BXADP1WF3sxILUSpioLzDnlYdA0G2BriIRhA9cmE633Bs6GDw Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58d16a8ba8654fcb89e4b2bb728ab416", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58d16a8ba8654fcb89e4b2bb728ab416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 58d16a8ba8654fcb89e4b2bb728ab416 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-340997546 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea6c7ea2f8564f4aa738cc3b4a8c47d8 Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ListServersNegativeTestJSON-340997546-project Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e668e80e-5f5c-48ba-b09f-544c72d227e0 could not be found. Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e668e80e-5f5c-48ba-b09f-544c72d227e0'} Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e668e80e-5f5c-48ba-b09f-544c72d227e0 could not be found. Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e668e80e-5f5c-48ba-b09f-544c72d227e0 could not be found. Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:29.298388 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e668e80e-5f5c-48ba-b09f-544c72d227e0 could not be found. Oct 31 14:15:29.303276 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:29.305320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] Returning 404 to user: Instance e668e80e-5f5c-48ba-b09f-544c72d227e0 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:29.306555 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e50fd939-9839-418e-af46-43e21ac43c64 tempest-ListServersNegativeTestJSON-340997546 tempest-ListServersNegativeTestJSON-340997546-project] 10.222.0.27 "GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0" status: 404 len: 111 microversion: 2.1 time: 0.109819 Oct 31 14:15:29.313187 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1752/3248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:29 2022] GET /compute/v2.1/servers/e668e80e-5f5c-48ba-b09f-544c72d227e0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:29.318611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:29.319472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:29.332122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.332619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.333063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.333771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.334247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.339068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.494643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:29.504988 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e51bd1a-eff7-4b8a-9ef2-71df81b467ff tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1337 microversion: 2.1 time: 0.190306 Oct 31 14:15:29.519961 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1753/3249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:29 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1337 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:29.527191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:29.528506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:29.539310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.539858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.540306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.541057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:29.541678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:29.542150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:29.906765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:29.920493 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15538ffe-b7bc-4025-9653-07223c00b6f8 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.760650 Oct 31 14:15:29.931404 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1497/3250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:29 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:29.937606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-600f2f51-22ee-4e77-9372-4956df243007 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:29.950802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-600f2f51-22ee-4e77-9372-4956df243007 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:30.256202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:30.276055 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07e6439a-29d2-4434-b03f-dbaeeb9a4079 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.753435 Oct 31 14:15:30.278502 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1754/3251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:29 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:30.285402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f5d5f557-810e-4ebf-a282-a689a66ab45d req-810c8457-e0c3-4a53-9296-aea33b9cdf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5003288-803c-4978-9978-481913ea83ba", "name": "network-vif-deleted", "tag": "33882760-ff33-41e2-b172-5c8ca241464d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:30.339381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5d5f557-810e-4ebf-a282-a689a66ab45d req-810c8457-e0c3-4a53-9296-aea33b9cdf87 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.340416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5d5f557-810e-4ebf-a282-a689a66ab45d req-810c8457-e0c3-4a53-9296-aea33b9cdf87 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.341135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5d5f557-810e-4ebf-a282-a689a66ab45d req-810c8457-e0c3-4a53-9296-aea33b9cdf87 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.360460 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f5d5f557-810e-4ebf-a282-a689a66ab45d req-810c8457-e0c3-4a53-9296-aea33b9cdf87 service nova] Creating event network-vif-deleted:33882760-ff33-41e2-b172-5c8ca241464d for instance a5003288-803c-4978-9978-481913ea83ba on n-h2-863052-1 Oct 31 14:15:30.367197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f5d5f557-810e-4ebf-a282-a689a66ab45d req-810c8457-e0c3-4a53-9296-aea33b9cdf87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085342 Oct 31 14:15:30.368666 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1755/3252] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:30.375238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:30.376577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:30.383414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:30.386674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.388109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.389795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.390736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.391517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.392918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.728116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-600f2f51-22ee-4e77-9372-4956df243007 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:30.749846 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-600f2f51-22ee-4e77-9372-4956df243007 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1216 microversion: 2.1 time: 0.815963 Oct 31 14:15:30.751575 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1498/3253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:29 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1216 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:30.756511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:30.761745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: a5003288-803c-4978-9978-481913ea83ba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:30.795770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.796400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.796860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.797603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.798271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.798860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.846046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance a5003288-803c-4978-9978-481913ea83ba could not be found. Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba HTTP/1.1 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a5003288-803c-4978-9978-481913ea83ba could not be found. Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a5003288-803c-4978-9978-481913ea83ba'} Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5003288-803c-4978-9978-481913ea83ba could not be found. Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5003288-803c-4978-9978-481913ea83ba could not be found. Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:30.850119 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5003288-803c-4978-9978-481913ea83ba could not be found. Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance a5003288-803c-4978-9978-481913ea83ba could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:30.854314 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3831f9c0-d4d9-482c-b2bc-09f93be85335 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba" status: 404 len: 111 microversion: 2.1 time: 0.098594 Oct 31 14:15:30.862587 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1499/3254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:30 2022] GET /compute/v2.1/servers/a5003288-803c-4978-9978-481913ea83ba => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:30.868263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:30.869252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:30.876997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.878486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.879265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.880246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.880941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.881605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.909629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:30.924084 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3437122c-edc2-431a-a8c9-cb98fb4bf412 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1501 microversion: 2.1 time: 0.553220 Oct 31 14:15:30.944533 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1756/3255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:30 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1501 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:30.949956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:30.950501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:30.958067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.958858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.959531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:30.960499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:30.961264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:30.962044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.004907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:31.053297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:31.072165 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-55cdff95-644d-42c4-adc6-15add4704bc9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1337 microversion: 2.1 time: 0.207947 Oct 31 14:15:31.073971 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1500/3256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:30 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1337 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:31.084260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:31.086539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:31.111341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.112405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.113908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.116478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.118554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.121406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.206941 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f15329bf-df0e-4e02-bef8-8f72840da1e0 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 204 len: 0 microversion: 2.1 time: 0.266517 Oct 31 14:15:31.208303 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1757/3257] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:30 2022] DELETE /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:31.216065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:31.217021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:31.223970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.224446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.224954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.226376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.227010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.227536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.485624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:31.494856 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0df3e7ef-a8aa-47cb-8c6a-1c1d6bfe6492 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.284018 Oct 31 14:15:31.495450 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1758/3258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:31 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:31.507329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:31.507982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:31.524521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.525059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.525518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.526277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.526742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.527178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.756932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:31.770553 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acfe6aeb-687f-4072-a788-8d6dc7adc221 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1472 microversion: 2.1 time: 0.272059 Oct 31 14:15:31.784712 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1759/3259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:31 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:31.803600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:31.806138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:31.821320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.821821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.822303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.827751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:31.827751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:31.828176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:31.890050 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Removing security group cd14bf6b-825b-420c-a3c8-a20cce33a161 from port e53d63f0-44c3-423c-aac6-64aa47a30c6c Oct 31 14:15:32.137241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:32.149812 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aab3ac0d-943f-426d-a83b-c345098d3746 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.363824 Oct 31 14:15:32.153286 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1760/3260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:31 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:32.167706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:32.168752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:32.180625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:32.181517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:32.182213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:32.183157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:32.184545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:32.185924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:32.292383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:32.305899 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c4c1865-4675-4d73-9136-11f6b5f94ec6 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1268 microversion: 2.1 time: 0.149271 Oct 31 14:15:32.305899 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1761/3261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:32 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:32.314895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:32.317459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:32.326159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:32.327017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:32.327519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:32.328271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:32.328734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:32.329167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:32.623885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:32.649776 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b21cee2d-7d03-4bf4-b4d2-8f6312b6513a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 0.340384 Oct 31 14:15:32.652937 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1762/3262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:32 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:32.665463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:32.666529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:32.680671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:32.684651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:32.685428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:32.687295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:32.688653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:32.689438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:33.454280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c57016556840538b9f426b9cd9e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa005082e4ff47b2a2dca2e27b6e0403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:33.468596 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-197e4694-048f-4b2b-8aa3-30beda212cdc tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 200 len: 1523 microversion: 2.1 time: 0.814357 Oct 31 14:15:33.482386 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1763/3263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:32 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 1523 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:33.482386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:33.482386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:33.494571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:33.494989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:33.495440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:33.496169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:33.497111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:33.497111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:33.995866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:34.009996 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b51de37d-3f0c-45e7-8282-9465b2fe21f9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1472 microversion: 2.1 time: 0.538528 Oct 31 14:15:34.029740 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1764/3264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:33 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:34.038515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:34.046129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:34.059063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:34.059818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:34.068253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:34.069810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:34.071126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:34.071749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:34.576063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7d64db7-fa47-4f22-b944-63be99131247 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144/action" status: 202 len: 0 microversion: 2.1 time: 3.500612 Oct 31 14:15:34.577050 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1501/3265] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:15:31 2022] POST /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144/action => generated 0 bytes in 3502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:15:34.583769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:34.584561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:34.605715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:34.606059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:34.606535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:34.608037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:34.608400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:34.608828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:34.907076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:34.921836 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24177a95-5d27-4e61-9729-eaccd7c0fd5b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.890741 Oct 31 14:15:34.938267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1765/3266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:34 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:34.944463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:34.945120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:34.957403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:34.958194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:34.960372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:34.961276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:34.961964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:34.962570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.000269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:35.321864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:35.341516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0de39ef-c930-4df4-9b43-b81bed6a0051 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1274 microversion: 2.1 time: 0.761440 Oct 31 14:15:35.344832 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1502/3267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:34 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1274 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:35.358731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-65c1e071-4430-40dd-bde8-4d3e171f0361 req-092c3229-680f-4da4-8bc2-a05cf72dcd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921b274b-f2d8-4029-9244-d900095436ad", "name": "network-vif-deleted", "tag": "d554ca38-778d-43b9-ab43-915083194c4a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:35.376032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-65c1e071-4430-40dd-bde8-4d3e171f0361 req-092c3229-680f-4da4-8bc2-a05cf72dcd85 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.376546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-65c1e071-4430-40dd-bde8-4d3e171f0361 req-092c3229-680f-4da4-8bc2-a05cf72dcd85 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.377164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-65c1e071-4430-40dd-bde8-4d3e171f0361 req-092c3229-680f-4da4-8bc2-a05cf72dcd85 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.399476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-65c1e071-4430-40dd-bde8-4d3e171f0361 req-092c3229-680f-4da4-8bc2-a05cf72dcd85 service nova] Creating event network-vif-deleted:d554ca38-778d-43b9-ab43-915083194c4a for instance 921b274b-f2d8-4029-9244-d900095436ad on n-h1-863052-1 Oct 31 14:15:35.419012 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-65c1e071-4430-40dd-bde8-4d3e171f0361 req-092c3229-680f-4da4-8bc2-a05cf72dcd85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070044 Oct 31 14:15:35.421214 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1503/3268] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:35.428869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:35.430094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] [instance: 921b274b-f2d8-4029-9244-d900095436ad] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:35.449874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.450585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.451626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.455659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.457182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.457821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.482538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:35.489561 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] HTTP exception thrown: Instance 921b274b-f2d8-4029-9244-d900095436ad could not be found. Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Request method failure captured: Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad HTTP/1.1 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ccsS0d-TCvHg3vUNl3jWnAuoS-ji1WZBH6pwyI0tIajfkU2hwRiWPXJJbwPpfDooilLYKzjpaGQH0ISCBKmJReVhpfGPjz-67ZSLG97G6nFk61vlT6kij12y3ps1HUNDd5Y_Q9358CvZVowMHRpJc0R_QBmyxo7AbHCqi2qEU8Q_M Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa005082e4ff47b2a2dca2e27b6e0403", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa005082e4ff47b2a2dca2e27b6e0403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fa005082e4ff47b2a2dca2e27b6e0403 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472649748 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b4c57016556840538b9f426b9cd9e540 Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472649748-project Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 921b274b-f2d8-4029-9244-d900095436ad could not be found. Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '921b274b-f2d8-4029-9244-d900095436ad'} Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921b274b-f2d8-4029-9244-d900095436ad could not be found. Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921b274b-f2d8-4029-9244-d900095436ad could not be found. Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:35.491451 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921b274b-f2d8-4029-9244-d900095436ad could not be found. Oct 31 14:15:35.496035 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:35.499729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] Returning 404 to user: Instance 921b274b-f2d8-4029-9244-d900095436ad could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:35.500854 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f964d8de-e6b2-4bf7-bbae-f2f300f5a185 tempest-ServerRescueNegativeTestJSON-1472649748 tempest-ServerRescueNegativeTestJSON-1472649748-project] 10.222.0.27 "GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad" status: 404 len: 111 microversion: 2.1 time: 0.078215 Oct 31 14:15:35.501016 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06187656-66e7-415f-a9b9-dc0933eca47c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 0.560863 Oct 31 14:15:35.505543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1504/3269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:35 2022] GET /compute/v2.1/servers/921b274b-f2d8-4029-9244-d900095436ad => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:35.517957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:35.519170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:35.520820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1766/3270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:34 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:35.527629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.528383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.529123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.530369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.530946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.531471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.536941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:35.540740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:35.552733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.554651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.557054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.558001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.560985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.561637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.682911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:35.836934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:35.868491 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-297aba83-84a3-42a2-96dc-44acee8ef31b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1459 microversion: 2.1 time: 0.360164 Oct 31 14:15:35.870065 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1505/3271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:35 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1459 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:35.894684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:35.895471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:35.913744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.914859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.916723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.918579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:35.920075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:35.921248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:35.964323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:35.994062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a5b5529-cc62-476a-9938-f606d705021b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1472 microversion: 2.1 time: 0.471811 Oct 31 14:15:36.010640 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1767/3272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:35 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1472 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:36.024053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:36.024862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:36.057052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:36.061799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:36.062286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:36.065873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:36.066784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:36.067117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:36.428352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:36.444894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b5d988f-e3b2-4aa6-b2ed-efdba679b5fe tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.440967 Oct 31 14:15:36.459301 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1768/3273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:36 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:36.459301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:36.461912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:36.471122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:36.472162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:36.473142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:36.473988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:36.474713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:36.475849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:36.512789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:36.534070 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-96d651cb-1888-4bc7-b100-7985748222b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.644506 Oct 31 14:15:36.535342 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1506/3274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:35 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:36.550362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:36.551010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:36.565329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:36.569812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:36.570528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:36.572366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:36.573012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:36.573637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.234933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:37.251711 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-362cb98f-6c89-499c-802c-5a0137dfce05 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.803267 Oct 31 14:15:37.272567 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1769/3275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:36 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:37.274074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:37.275128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:37.295382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.295948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.296406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.299308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.299877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.308922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.403552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:37.414448 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-388984db-512e-477d-b5d7-298b86325471 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 0.877865 Oct 31 14:15:37.415617 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1507/3276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:36 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:37.433549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e16612f2-103d-45f2-9537-13009e1e7db7 req-e6241661-9741-4165-a47d-019f0b7c0652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4544a4-f791-409a-9f34-20bdb10acfc3", "name": "network-vif-plugged", "status": "completed", "tag": "052e069f-ff62-4302-bf3c-acfe4326beea"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:37.459812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e16612f2-103d-45f2-9537-13009e1e7db7 req-e6241661-9741-4165-a47d-019f0b7c0652 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.463844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e16612f2-103d-45f2-9537-13009e1e7db7 req-e6241661-9741-4165-a47d-019f0b7c0652 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.465097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e16612f2-103d-45f2-9537-13009e1e7db7 req-e6241661-9741-4165-a47d-019f0b7c0652 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.509446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e16612f2-103d-45f2-9537-13009e1e7db7 req-e6241661-9741-4165-a47d-019f0b7c0652 service nova] Creating event network-vif-plugged:052e069f-ff62-4302-bf3c-acfe4326beea for instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 on n-h1-863052-1 Oct 31 14:15:37.526812 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e16612f2-103d-45f2-9537-13009e1e7db7 req-e6241661-9741-4165-a47d-019f0b7c0652 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109805 Oct 31 14:15:37.528085 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1508/3277] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:37.553132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:37.554714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:37.575426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.577228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.578469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.581094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.583998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.584458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.656972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.657691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.658518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.659131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid 9cef1984-eed0-4d85-b69a-cb399c0def17 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:37.845610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:37.854552 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6a7a8f8-3870-4d2a-bd31-b8646b304e65 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 200 len: 1306 microversion: 2.1 time: 0.325070 Oct 31 14:15:37.873222 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1509/3278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:37 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 1306 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:37.878550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:37.879168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:37.886868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.887644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.887902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.888766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.889737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.889737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.895441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:37.916606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:37.929297 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55bc4876-2fa2-4193-9b72-1332cefce76e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.667746 Oct 31 14:15:37.931222 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1770/3279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:37 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:37.938046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461d8d3d-2f99-4f84-aef3-929c3aec9144", "tag": "e53d63f0-44c3-423c-aac6-64aa47a30c6c"}, {"server_uuid": "9cef1984-eed0-4d85-b69a-cb399c0def17", "name": "network-vif-deleted", "tag": "cae5c960-baef-499d-a404-f92b3bf1ac99"}, {"name": "network-changed", "server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:37.966108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:37.966670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:37.967274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:37.984318 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Creating event network-changed:e53d63f0-44c3-423c-aac6-64aa47a30c6c for instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 on n-h2-863052-1 Oct 31 14:15:37.985054 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Creating event network-vif-deleted:cae5c960-baef-499d-a404-f92b3bf1ac99 for instance 9cef1984-eed0-4d85-b69a-cb399c0def17 on n-h2-863052-1 Oct 31 14:15:37.985737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] Creating event network-changed:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h1-863052-1 Oct 31 14:15:38.002762 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-58042311-6115-4df2-9612-516238ad5099 req-df6f44ab-d0cd-48e7-8cc9-3ec51762e46b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.069971 Oct 31 14:15:38.003988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1771/3280] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:38.009463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:38.010497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:38.017779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.018559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.019155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.020032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.020684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.021271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.483976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:38.496445 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35b9b5e6-944e-4d0e-a06c-3a2002231e68 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.491061 Oct 31 14:15:38.498943 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1772/3281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:38 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:38.504691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:38.505692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:38.513727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.514522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.530975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.532378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.533920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.534589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.765385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:38.776808 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1eb3180-cf0f-4464-a440-212adc304f89 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1307 microversion: 2.1 time: 0.902184 Oct 31 14:15:38.779438 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1510/3282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:37 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1307 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:38.786675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:38.809469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:38.819790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:38.829744 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1eaf991-3e99-47d0-b60d-98b5718a77b7 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.329162 Oct 31 14:15:38.836655 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1773/3283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:38 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:38.850520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.850520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.850520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.850520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.851020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.851433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.870444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:38.871399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:38.879087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.881190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.882033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:38.889461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:38.890252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:38.890890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.013850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:39.315731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:39.324431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bb44813-e29d-4c44-8476-adab25279c53 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.470624 Oct 31 14:15:39.325385 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1774/3284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:38 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:39.330288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:39.331091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 9cef1984-eed0-4d85-b69a-cb399c0def17] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:39.337413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.338091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.338722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.339585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.340193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.340774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.364766 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance 9cef1984-eed0-4d85-b69a-cb399c0def17 could not be found. Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 HTTP/1.1 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 9cef1984-eed0-4d85-b69a-cb399c0def17 could not be found. Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '9cef1984-eed0-4d85-b69a-cb399c0def17'} Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cef1984-eed0-4d85-b69a-cb399c0def17 could not be found. Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cef1984-eed0-4d85-b69a-cb399c0def17 could not be found. Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:39.367049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cef1984-eed0-4d85-b69a-cb399c0def17 could not be found. Oct 31 14:15:39.371983 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:39.376943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance 9cef1984-eed0-4d85-b69a-cb399c0def17 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:39.379616 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76c415f5-7bea-4dc3-a9e0-0ca96572b3a6 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17" status: 404 len: 111 microversion: 2.1 time: 0.051527 Oct 31 14:15:39.383891 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1775/3285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:39 2022] GET /compute/v2.1/servers/9cef1984-eed0-4d85-b69a-cb399c0def17 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:39.388586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-12acb1d6-be92-461d-b64d-03b56594b7fe req-2c629f3c-effe-4689-ad11-574ed9c96541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2760d519-a8cd-41b7-9032-a92c4fa7f15e", "tag": "ef7b6010-bae3-4480-afc9-cebd3341f97f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:39.424847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12acb1d6-be92-461d-b64d-03b56594b7fe req-2c629f3c-effe-4689-ad11-574ed9c96541 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.432049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:39.443293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12acb1d6-be92-461d-b64d-03b56594b7fe req-2c629f3c-effe-4689-ad11-574ed9c96541 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.444384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12acb1d6-be92-461d-b64d-03b56594b7fe req-2c629f3c-effe-4689-ad11-574ed9c96541 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.464049 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0efc511-aef5-4e35-9e42-f0fa678afc6a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 0.678556 Oct 31 14:15:39.465856 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1511/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:38 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:39.509501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:39.510787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:39.517104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-12acb1d6-be92-461d-b64d-03b56594b7fe req-2c629f3c-effe-4689-ad11-574ed9c96541 service nova] Creating event network-changed:ef7b6010-bae3-4480-afc9-cebd3341f97f for instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e on n-h2-863052-1 Oct 31 14:15:39.518624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.520743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.521370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.522211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.522782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.524733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.530049 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-12acb1d6-be92-461d-b64d-03b56594b7fe req-2c629f3c-effe-4689-ad11-574ed9c96541 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146118 Oct 31 14:15:39.530846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1776/3287] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:39.589634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:39.595272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1604640247", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "726ec790-fa70-4df0-af4a-a3e3b994a919"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:39.684526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] validate_networks() for [('726ec790-fa70-4df0-af4a-a3e3b994a919', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:15:39.794903 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6d1dc26-328d-4963-9d0f-a96d5e21c5d3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 204 len: 0 microversion: 2.1 time: 0.313591 Oct 31 14:15:39.795504 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1512/3288] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:39 2022] DELETE /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:39.812283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:39.813320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:39.824082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.824818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.825571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.826393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:39.833056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:39.833688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:39.881408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:40.088867 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f2fcd20-05ba-4b17-968b-a20b02c6d05c tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 204 len: 0 microversion: 2.1 time: 0.287477 Oct 31 14:15:40.089526 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1513/3289] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:39 2022] DELETE /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:40.113437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:40.118151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:40.128016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:40.128862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:40.129513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:40.130586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:40.131326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:40.131999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:40.679360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:40.690850 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-772df334-9198-4057-882f-70a188495ae5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 200 len: 1487 microversion: 2.1 time: 0.599964 Oct 31 14:15:40.692198 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1514/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:40 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 1487 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:40.697112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:40.698018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:40.716427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:40.716942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:40.717396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:40.723060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:40.724017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:40.724644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:40.746665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=22 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:40.793983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:40.795706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:40.795856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:40.796664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:40.797956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:40.818554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:40.819422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:40.820037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:40.822704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:40.823422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:40.826276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:40.869143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:40.879374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Getting quotas for user f6d0e8b2b04b47e69d87f436eb387941 and project 43d946eea72d40e08829491c65b4e750. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:40.902757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:40.909731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:41.042776 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2929dc3-a188-4d0f-b746-b75eb6c3c14a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.453094 Oct 31 14:15:41.059394 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1777/3291] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:15:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:15:41.064383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:41.065002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:41.088616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:41.089109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:41.089742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:41.090630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:41.091760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:41.095026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:41.294945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:41.310823 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a4ab75e-d1a2-4dc2-b8c5-2961c1f3d20b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.616632 Oct 31 14:15:41.330618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1515/3292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:40 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:41.344626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:41.346402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:41.360600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:41.361394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:41.362041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:41.363071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:41.363871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:41.364500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:41.455056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:41.469330 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7398acac-78f8-40b1-a6f8-ada72a905b83 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 200 len: 1474 microversion: 2.1 time: 0.408683 Oct 31 14:15:41.469973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1778/3293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:41 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 1474 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:41.481494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1556937361"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:41.487926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:41.500544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:41.501239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:41.501848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:41.503430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:41.504226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:41.504851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:41.876125 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0881184-4231-4914-9e10-d6bed025e43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3/action" status: 202 len: 0 microversion: 2.1 time: 0.400637 Oct 31 14:15:41.877942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1779/3294] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:15:41 2022] POST /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:15:41.891025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7328ccb2-4835-4ee5-9773-f38d3e9b4677 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:41.905785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7328ccb2-4835-4ee5-9773-f38d3e9b4677 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:42.014584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7328ccb2-4835-4ee5-9773-f38d3e9b4677 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:42.025058 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7328ccb2-4835-4ee5-9773-f38d3e9b4677 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1215 microversion: 2.1 time: 0.143695 Oct 31 14:15:42.025850 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1780/3295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:41 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:42.032749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ecb8cb12-fd2c-43af-a1e7-e5c2c21cfbe4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107440e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:42.134556 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ecb8cb12-fd2c-43af-a1e7-e5c2c21cfbe4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.105397 Oct 31 14:15:42.135174 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1781/3296] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:42 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:42.335647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:42.336565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:42.350987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:42.351909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:42.352563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:42.353458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:42.354068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:42.355292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.029349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:43.042621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86569750-e350-40f7-9006-22bd71b193fa tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.710697 Oct 31 14:15:43.049862 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1782/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:42 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:43.065410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:43.072807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:43.102381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:43.105420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:43.105972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.122355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:43.122983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:43.127177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.365705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:43.377406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5ae81fa-356c-49b7-a778-5b78ef708afa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 2.044076 Oct 31 14:15:43.383850 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1516/3298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:41 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:43.627024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:43.631028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-921399388", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:43.643821 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f0dd5a2-de3c-4c01-93f7-494f2c36400f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 200 len: 1474 microversion: 2.1 time: 0.591599 Oct 31 14:15:43.644427 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1783/3299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:43 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 1474 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:43.664757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:43.666241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:43.692787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:43.695080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:43.695967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.698756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:43.699495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:43.708479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.728900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:43.729660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:43.730353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:43.730985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:43.731676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:43.757002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:43.763427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:43.764206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.765621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:43.766336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:43.766983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:43.805480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Getting quotas for project 8a35b1405c544fed894f3679acb86961. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:43.809041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:43.813685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Getting quotas for user 590eb752d4dd464ab59675bca445da67 and project 8a35b1405c544fed894f3679acb86961. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:43.832449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:43.835672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:43.894784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-682dd0e2-9da8-40c1-b527-5b1f22ec8f8c tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.508808 Oct 31 14:15:43.897309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1517/3300] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:15:43.909703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd6377b8-16e4-4cd3-b00d-15f3a1777439 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10791ae50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:43.994933 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd6377b8-16e4-4cd3-b00d-15f3a1777439 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.094561 Oct 31 14:15:43.996496 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1518/3301] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:43 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:44.005948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-297afa2d-6afd-4516-9283-aaf64613a4e2 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:44.007175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-297afa2d-6afd-4516-9283-aaf64613a4e2 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:44.289233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-297afa2d-6afd-4516-9283-aaf64613a4e2 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:44.305082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-297afa2d-6afd-4516-9283-aaf64613a4e2 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:44.312828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-297afa2d-6afd-4516-9283-aaf64613a4e2 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:44.316947 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-297afa2d-6afd-4516-9283-aaf64613a4e2 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1280 microversion: 2.47 time: 0.319044 Oct 31 14:15:44.322315 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1519/3302] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:43 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1280 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:44.342136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:44.344107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:44.364981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:44.367155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:44.369198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:44.370071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:44.371952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:44.373875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:44.375136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:44.383969 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f15a3c50-c1f7-4430-a4ad-066553d339c3 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1211 microversion: 2.1 time: 0.736287 Oct 31 14:15:44.385912 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1784/3303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:43 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1211 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:44.416788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:44.417438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:44.433008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:44.433614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:44.434195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:44.435106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:44.437927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:44.438518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:45.105403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:45.120113 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a37ccaa5-0184-47c5-aa7b-5046aa9f68a1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.794680 Oct 31 14:15:45.121432 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1520/3304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:44 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:45.129822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:45.130850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:45.148785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:45.149596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:45.150268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:45.151170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:45.151939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:45.152608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:45.395843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:45.406665 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26b96c0d-2cab-4148-beba-562611555d89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 200 len: 1432 microversion: 2.1 time: 0.283314 Oct 31 14:15:45.407247 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1521/3305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:45 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 1432 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:45.430241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e789f323-0454-4ceb-a39d-8415f4a2e782 req-7ff6d6a9-3d4a-4b82-929d-239db6a48f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecea86c-329f-445c-9538-c3cab17d0bde", "name": "network-vif-deleted", "tag": "9f73e3de-ff4b-4d09-8389-6d6de3b296c7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:45.462111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e789f323-0454-4ceb-a39d-8415f4a2e782 req-7ff6d6a9-3d4a-4b82-929d-239db6a48f9d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:45.462623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e789f323-0454-4ceb-a39d-8415f4a2e782 req-7ff6d6a9-3d4a-4b82-929d-239db6a48f9d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:45.463225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e789f323-0454-4ceb-a39d-8415f4a2e782 req-7ff6d6a9-3d4a-4b82-929d-239db6a48f9d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:45.518841 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e789f323-0454-4ceb-a39d-8415f4a2e782 req-7ff6d6a9-3d4a-4b82-929d-239db6a48f9d service nova] Creating event network-vif-deleted:9f73e3de-ff4b-4d09-8389-6d6de3b296c7 for instance eecea86c-329f-445c-9538-c3cab17d0bde on n-h2-863052-1 Oct 31 14:15:45.541109 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e789f323-0454-4ceb-a39d-8415f4a2e782 req-7ff6d6a9-3d4a-4b82-929d-239db6a48f9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120750 Oct 31 14:15:45.560695 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1522/3306] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:45.568004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da306513-d7ae-49e5-87a6-e002eecf5860 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107a4e0d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:45.676828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da306513-d7ae-49e5-87a6-e002eecf5860 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.112972 Oct 31 14:15:45.677607 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1523/3307] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:45 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:45.697522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d6becb76-bd33-46d2-9d57-4057ed74498c req-ce76cab4-13aa-4c9e-bb40-ccc9c4a029b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc4318-5153-4651-ba90-0df7a8541800", "name": "network-vif-deleted", "tag": "095d436c-a631-482e-b16e-f7db214f3648"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:45.734488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d6becb76-bd33-46d2-9d57-4057ed74498c req-ce76cab4-13aa-4c9e-bb40-ccc9c4a029b7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:45.744207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d6becb76-bd33-46d2-9d57-4057ed74498c req-ce76cab4-13aa-4c9e-bb40-ccc9c4a029b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:45.745250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d6becb76-bd33-46d2-9d57-4057ed74498c req-ce76cab4-13aa-4c9e-bb40-ccc9c4a029b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:45.793173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d6becb76-bd33-46d2-9d57-4057ed74498c req-ce76cab4-13aa-4c9e-bb40-ccc9c4a029b7 service nova] Creating event network-vif-deleted:095d436c-a631-482e-b16e-f7db214f3648 for instance 93cc4318-5153-4651-ba90-0df7a8541800 on n-h1-863052-1 Oct 31 14:15:45.809436 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d6becb76-bd33-46d2-9d57-4057ed74498c req-ce76cab4-13aa-4c9e-bb40-ccc9c4a029b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130609 Oct 31 14:15:45.816724 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1524/3308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:45.827390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:45.828101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:45.861241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:45.861795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:45.862272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:45.863010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:45.863464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:45.863889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.203897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:46.217836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:46.228214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:46.230466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19d1bbe7-f62b-48b2-a56a-293ecdcdbe86 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1332 microversion: 2.47 time: 0.412435 Oct 31 14:15:46.235114 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1525/3309] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:45 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1332 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:46.253725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:46.254823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:46.275383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.277290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.277978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.283001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.283789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.284481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.490434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:46.501983 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10f65184-3ec5-4048-b5c7-6531bcea19e5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1273 microversion: 2.1 time: 0.265392 Oct 31 14:15:46.510385 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1526/3310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:46 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:46.551541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:46.552455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:46.571496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.572010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.572462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.585737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.586299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.591554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.626764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:46.657101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3218d812-307a-47ab-a829-7b8b95dd08ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 2.247782 Oct 31 14:15:46.658091 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1785/3311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:44 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:46.678585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:46.679460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:46.696110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.696614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.697055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.697754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.702503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.703220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.735831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:46.795827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:46.796313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:46.796749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:46.797201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid 93cc4318-5153-4651-ba90-0df7a8541800 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:47.105723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:47.114586 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0c1d1ea-c08f-4e3a-bf3d-bb851af24bd9 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.584371 Oct 31 14:15:47.115172 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1527/3312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:46 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:47.146228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5fbd519c-23b5-4900-ae8a-0478aa5cf256 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078a0790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:47.170290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:47.190468 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62703ae3-841f-4f09-a191-01a7c3f3d673 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 200 len: 1308 microversion: 2.1 time: 0.521720 Oct 31 14:15:47.204596 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1786/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:46 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:47.261166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:47.261971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:47.276982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5fbd519c-23b5-4900-ae8a-0478aa5cf256 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.147223 Oct 31 14:15:47.277290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:47.277785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:47.282844 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1528/3314] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:47 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:47.287060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:47.288042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:47.288672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:47.294575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:47.534572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:47.536716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:47.537923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:47.551575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:47.552125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:47.552843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:47.553204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:47.554409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6bdf358-347e-4f9b-a2c7-386cc84d827b tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1338 microversion: 2.47 time: 0.297071 Oct 31 14:15:47.560254 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1787/3315] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:47 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1338 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:47.563305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:47.570573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:47.576342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:47.577094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:47.642280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:47.680635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:47.681246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:47.692359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:47.696366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:47.698528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:47.702461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:47.703146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:47.703774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.255088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:48.265818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:48.283679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6522175c-1a00-44b2-a084-e4f4240b4644 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.751719 Oct 31 14:15:48.287730 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86702a01-e4f5-4da7-ba1f-c44c4d596009 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 0.611014 Oct 31 14:15:48.304800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1788/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:47 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:48.320047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1529/3317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:47 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:48.334193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.335413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.336191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:48.338926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 93cc4318-5153-4651-ba90-0df7a8541800] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:48.349224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.353235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.353992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.354619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.355479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.356184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.356834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.357495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.358697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.359561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.362518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.363149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.395872 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance 93cc4318-5153-4651-ba90-0df7a8541800 could not be found. Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 HTTP/1.1 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 93cc4318-5153-4651-ba90-0df7a8541800 could not be found. Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '93cc4318-5153-4651-ba90-0df7a8541800'} Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cc4318-5153-4651-ba90-0df7a8541800 could not be found. Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cc4318-5153-4651-ba90-0df7a8541800 could not be found. Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:48.399462 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cc4318-5153-4651-ba90-0df7a8541800 could not be found. Oct 31 14:15:48.405335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.410946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance 93cc4318-5153-4651-ba90-0df7a8541800 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:48.412176 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cb2ec04-9e60-4d8c-96bb-cb8df02a92af tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800" status: 404 len: 111 microversion: 2.1 time: 0.082052 Oct 31 14:15:48.412953 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1530/3318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:48 2022] GET /compute/v2.1/servers/93cc4318-5153-4651-ba90-0df7a8541800 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:48.427005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0888181-13b1-4889-9763-f5c7f1e8a328 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107a4eee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.509992 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0888181-13b1-4889-9763-f5c7f1e8a328 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.092673 Oct 31 14:15:48.510943 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1531/3319] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:48 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:48.524101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.524992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: eecea86c-329f-445c-9538-c3cab17d0bde] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:48.549950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.551386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.552310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.555335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.556126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.560762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.594552 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance eecea86c-329f-445c-9538-c3cab17d0bde could not be found. Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde HTTP/1.1 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance eecea86c-329f-445c-9538-c3cab17d0bde could not be found. Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'eecea86c-329f-445c-9538-c3cab17d0bde'} Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecea86c-329f-445c-9538-c3cab17d0bde could not be found. Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecea86c-329f-445c-9538-c3cab17d0bde could not be found. Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:48.602094 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecea86c-329f-445c-9538-c3cab17d0bde could not be found. Oct 31 14:15:48.606112 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:15:48.608337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance eecea86c-329f-445c-9538-c3cab17d0bde could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:48.612621 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25b1d947-5fa7-47d6-94ae-a460f228c19b tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde" status: 404 len: 111 microversion: 2.1 time: 0.100638 Oct 31 14:15:48.613495 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1532/3320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:48 2022] GET /compute/v2.1/servers/eecea86c-329f-445c-9538-c3cab17d0bde => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:48.626598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.627677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:48.641373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.644188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.646028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.647022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.648837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.650229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.719856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:48.728792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd3f8ff5-0401-4c71-a31c-1ebc1984e9e1 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.422401 Oct 31 14:15:48.738886 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1789/3321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:48 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:48.757670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1ba495c-daca-4c31-b7d7-34ba546eb2a8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.846928 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1ba495c-daca-4c31-b7d7-34ba546eb2a8 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/431848c5-29cc-4b3f-ac54-018d6815c5df" status: 204 len: 0 microversion: 2.1 time: 0.106590 Oct 31 14:15:48.847541 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1790/3322] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:15:48 2022] DELETE /compute/v2.1/os-server-groups/431848c5-29cc-4b3f-ac54-018d6815c5df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:48.860784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:48.861436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:48.884792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.890378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.891065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.892813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:48.893503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:48.894103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:48.941975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:49.105428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:49.142657 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e4aa44bb-76a2-45eb-afb7-4a5ea7fa096a tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 204 len: 0 microversion: 2.1 time: 0.287791 Oct 31 14:15:49.148454 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1791/3323] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:48 2022] DELETE /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:49.159997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:49.161357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:49.176896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:49.177809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:49.178601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:49.180448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:49.183065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:49.183785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:49.266155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:49.284930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:49.295393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:49.308706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:49.313319 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a41bbe7b-4c19-4afd-addc-d50773f04ffd tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1338 microversion: 2.47 time: 0.698629 Oct 31 14:15:49.314120 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1533/3324] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:48 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1338 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:49.329717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:49.338621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:49.351921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:49.363983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:49.364737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:49.366371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:49.374192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:49.378744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:49.544049 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d8fcae1-3212-4e9e-bbcd-29c7644f9ef9 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 204 len: 0 microversion: 2.1 time: 0.391644 Oct 31 14:15:49.545582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1792/3325] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:49 2022] DELETE /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:49.560946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:49.562064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:49.577112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:49.579891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:49.580567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:49.581512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:49.582899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:49.591642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:49.878142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:49.894863 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c121ea01-89d8-4bd5-b2c3-94c2c646e6f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.342731 Oct 31 14:15:49.896676 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1793/3326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:49 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:49.912107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b084326-9a80-4fa4-a189-0c99e5231f86 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107cb8f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:50.005293 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b084326-9a80-4fa4-a189-0c99e5231f86 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.106434 Oct 31 14:15:50.009283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1794/3327] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:49 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:50.032169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:50.032866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:50.052697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.054941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.055401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.056136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.056600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.057024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.555053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:50.563738 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc1becdb-f7b1-4b7c-8ba7-13091ec5dcf9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 1.244431 Oct 31 14:15:50.570041 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1534/3328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:49 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:50.575959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-612a7ec8-ff58-4091-ab26-52f2cd594f33 req-1b3e5105-4987-404c-b68a-9174db511585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "name": "network-vif-plugged", "status": "completed", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:50.589038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:50.603126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-612a7ec8-ff58-4091-ab26-52f2cd594f33 req-1b3e5105-4987-404c-b68a-9174db511585 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.603605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-612a7ec8-ff58-4091-ab26-52f2cd594f33 req-1b3e5105-4987-404c-b68a-9174db511585 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.604241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-612a7ec8-ff58-4091-ab26-52f2cd594f33 req-1b3e5105-4987-404c-b68a-9174db511585 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.606066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c5da7c5-a051-445e-a953-07806242e66f tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1473 microversion: 2.1 time: 0.591948 Oct 31 14:15:50.607178 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1795/3329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:50 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1473 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:50.612425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:50.613223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:50.628708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.629218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.629661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.630403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.630862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.631313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.631788 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-612a7ec8-ff58-4091-ab26-52f2cd594f33 req-1b3e5105-4987-404c-b68a-9174db511585 service nova] Creating event network-vif-plugged:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h1-863052-1 Oct 31 14:15:50.646387 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-612a7ec8-ff58-4091-ab26-52f2cd594f33 req-1b3e5105-4987-404c-b68a-9174db511585 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072274 Oct 31 14:15:50.647379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1535/3330] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:50.664723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:50.666315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:50.672018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.675786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.678600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.679825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.681760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.682465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.858911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:50.894370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:50.902968 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53c5978f-8a04-49ad-b656-3e051bce4502 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.294501 Oct 31 14:15:50.904430 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1796/3331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:50 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:50.925964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:50.926934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:50.944687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.947146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.948778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:50.949633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:50.953048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:50.953615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:51.118730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:51.141644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:51.148908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:51.150819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87b035ef-856e-42ff-ba2b-c36afa7460ea tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1359 microversion: 2.47 time: 0.502303 Oct 31 14:15:51.151593 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1536/3332] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:50 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1359 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:51.172768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81811cb6-8c0d-4823-b4d1-6d1fb1d13bcd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078195e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:51.295243 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81811cb6-8c0d-4823-b4d1-6d1fb1d13bcd tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.140989 Oct 31 14:15:51.296235 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1537/3333] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:51 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:51.325749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-681993849"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:51.331757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:51.350808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:51.363993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:51.373093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:51.383441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:51.385346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:51.387299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5de5753e-abde-47a0-9096-eb958bc926b7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.465912 Oct 31 14:15:51.388485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:51.389897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:51.391627 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1797/3334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:50 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:15:51.597991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:51.598989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:51.614669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:51.619090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:51.620408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:51.627284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:51.629519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:51.638372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:51.828920 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab172dff-d57d-4056-891a-432a99085c51 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "POST /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274/action" status: 202 len: 52 microversion: 2.47 time: 0.528718 Oct 31 14:15:51.829956 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1538/3335] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:15:51 2022] POST /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274/action => generated 52 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:15:51.857329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:51.860321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:51.879248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:51.879248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:51.891477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:51.894651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:51.895178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:51.895636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:52.023207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:52.375649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:52.384379 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1f885e2-fd19-4f91-8f76-b0ee3e2fff64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1379 microversion: 2.1 time: 0.790635 Oct 31 14:15:52.392822 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1798/3336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:51 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1379 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:52.398123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:52.402811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:52.416235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:52.417115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:52.418705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:52.419685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:52.421038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:52.423080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:52.480607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:52.599797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:52.708276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d3da6f1-aca6-4169-84fe-5fb2eebccf5d tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 204 len: 0 microversion: 2.47 time: 0.312660 Oct 31 14:15:52.708905 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1799/3337] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:15:52 2022] DELETE /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:15:52.735998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:52.741049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:52.782324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:52.787600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:52.788105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:52.788863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:52.796741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:52.797308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:52.868352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:52.882149 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0481a28-2ea2-4f66-9f26-9c8bc04cccd4 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1473 microversion: 2.1 time: 1.050384 Oct 31 14:15:52.885218 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1539/3338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:51 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1473 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:52.898985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33a67090-5524-4191-a2f3-4b2a05df4e60 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1079030d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:52.999900 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33a67090-5524-4191-a2f3-4b2a05df4e60 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.113102 Oct 31 14:15:53.000685 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1540/3339] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:52 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:53.016554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:53.017475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:53.034035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:53.037826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:53.038522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:53.039764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:53.043409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:53.044184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:53.394425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:53.403031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1feb9596-4681-4691-878f-998729fbee4f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.685403 Oct 31 14:15:53.404463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1800/3340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:52 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:53.411503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2760d519-a8cd-41b7-9032-a92c4fa7f15e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7b6010-bae3-4480-afc9-cebd3341f97f"}, {"server_uuid": "2c4544a4-f791-409a-9f34-20bdb10acfc3", "name": "network-vif-plugged", "status": "completed", "tag": "052e069f-ff62-4302-bf3c-acfe4326beea"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:53.424483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:53.425362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:53.426021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:53.466992 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] Creating event network-vif-plugged:ef7b6010-bae3-4480-afc9-cebd3341f97f for instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e on n-h2-863052-1 Oct 31 14:15:53.471175 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] Creating event network-vif-plugged:052e069f-ff62-4302-bf3c-acfe4326beea for instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 on n-h1-863052-1 Oct 31 14:15:53.502386 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6a446b60-59ac-4a17-9364-24c845106d7e req-f18cf046-e74f-413e-9b2c-2e64c3b490c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096167 Oct 31 14:15:53.517323 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1801/3341] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:53.557838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:53.569074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:53.600483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:53.615161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:53.615770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:53.616750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:53.617326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:53.618655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:53.783551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:53.937667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:53.947827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:53.958236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:53.959538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35261346-21d2-4852-95aa-0ef0631b9e2a tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1365 microversion: 2.47 time: 0.439712 Oct 31 14:15:53.960086 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1802/3342] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:53 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:53.990590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9d4ccaed-5ffd-4582-a7f8-630434b373db req-d56fec74-fe48-4ece-989f-8a64de917abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c7aba-81f6-434a-ba87-aeab18d06614", "name": "network-vif-deleted", "tag": "8f7dd073-3aef-4857-ab11-3bf91526c747"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:54.030553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d4ccaed-5ffd-4582-a7f8-630434b373db req-d56fec74-fe48-4ece-989f-8a64de917abe service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.031044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d4ccaed-5ffd-4582-a7f8-630434b373db req-d56fec74-fe48-4ece-989f-8a64de917abe service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.037141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d4ccaed-5ffd-4582-a7f8-630434b373db req-d56fec74-fe48-4ece-989f-8a64de917abe service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.061958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9d4ccaed-5ffd-4582-a7f8-630434b373db req-d56fec74-fe48-4ece-989f-8a64de917abe service nova] Creating event network-vif-deleted:8f7dd073-3aef-4857-ab11-3bf91526c747 for instance f13c7aba-81f6-434a-ba87-aeab18d06614 on n-h2-863052-1 Oct 31 14:15:54.068922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9d4ccaed-5ffd-4582-a7f8-630434b373db req-d56fec74-fe48-4ece-989f-8a64de917abe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091256 Oct 31 14:15:54.070600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1803/3343] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:54.079955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:54.081397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:54.092964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.093875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.109794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.111294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.112369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.113188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.303497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:54.377436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:54.389601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1957417-a317-423b-b849-6dc239bc4c64 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1529 microversion: 2.1 time: 0.314475 Oct 31 14:15:54.408329 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1804/3344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:54 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1529 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:54.420525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c9b86693-758c-442d-b817-042bd3c4a3d1 req-e02bc083-1880-48ab-8c6e-2d91d0d3dee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1925eb40-8126-4dfb-a83e-41260a763185", "tag": "8ee5c5f5-e47c-4164-8101-26618575bed4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:54.433093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c9b86693-758c-442d-b817-042bd3c4a3d1 req-e02bc083-1880-48ab-8c6e-2d91d0d3dee1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.433974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c9b86693-758c-442d-b817-042bd3c4a3d1 req-e02bc083-1880-48ab-8c6e-2d91d0d3dee1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.435119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c9b86693-758c-442d-b817-042bd3c4a3d1 req-e02bc083-1880-48ab-8c6e-2d91d0d3dee1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.457785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c9b86693-758c-442d-b817-042bd3c4a3d1 req-e02bc083-1880-48ab-8c6e-2d91d0d3dee1 service nova] Creating event network-changed:8ee5c5f5-e47c-4164-8101-26618575bed4 for instance 1925eb40-8126-4dfb-a83e-41260a763185 on n-h1-863052-1 Oct 31 14:15:54.470327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c9b86693-758c-442d-b817-042bd3c4a3d1 req-e02bc083-1880-48ab-8c6e-2d91d0d3dee1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060094 Oct 31 14:15:54.471965 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1805/3345] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:54.482276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:54.483217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:54.493047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.493905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.496697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.497945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.498733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.499377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.577472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:54.578567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:54.579174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:54.579809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid f13c7aba-81f6-434a-ba87-aeab18d06614 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:54.658707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:54.677245 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29a42862-8234-48dc-a8af-7c959965d7fd tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 200 len: 1308 microversion: 2.1 time: 0.203414 Oct 31 14:15:54.684258 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1806/3346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:54 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:54.698638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb20a242-4a2b-4311-b10b-3d9921efae21 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fb09940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:54.795917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb20a242-4a2b-4311-b10b-3d9921efae21 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.109336 Oct 31 14:15:54.796516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1807/3347] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:54 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:54.965449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:54.978115 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2bc1ffe-e22c-4c8e-bcda-38e6279c69f9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 1.974504 Oct 31 14:15:54.993377 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1541/3348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:53 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:55.005175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.006333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.029892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.032123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.033687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.046837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.048444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.050347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.102581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-220990922", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:55.242600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:55.243037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:55.243512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:55.243936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:55.245185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:55.255162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.255539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.255984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.256770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.257513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.258364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.284278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Getting quotas for project 3159df582fdb4aa7a2ebf683eed4248b. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:15:55.291255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Getting quotas for user 829479b263ee49ecb49356967c54a0d3 and project 3159df582fdb4aa7a2ebf683eed4248b. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:15:55.310643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:15:55.314258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:15:55.379324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58b6d29e-4c36-4467-a138-3927b4635a8a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.581736 Oct 31 14:15:55.380739 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1808/3349] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:15:55.385907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.388494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.397523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.398441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.399244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.400205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.400890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.401572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.462859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.473675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-899bc141-899b-400c-a493-ff5fe9b6e5f3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1529 microversion: 2.1 time: 0.479470 Oct 31 14:15:55.496450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1542/3350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:54 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1529 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:55.520365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.523468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.552998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.553494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.561767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.568085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.569553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.570041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.688945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.699179 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf07d6d3-e425-4aa3-8cd5-50c05169d40b tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1316 microversion: 2.1 time: 0.317144 Oct 31 14:15:55.700579 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1809/3351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:55.706003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15711d37-f9a6-49ac-93ce-1b49fb9903f5 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.706956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15711d37-f9a6-49ac-93ce-1b49fb9903f5 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.755651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.782594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-15711d37-f9a6-49ac-93ce-1b49fb9903f5 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.788439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.790265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.792385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-15711d37-f9a6-49ac-93ce-1b49fb9903f5 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.795137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-15711d37-f9a6-49ac-93ce-1b49fb9903f5 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:55.797357 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc7f83a1-11f2-444b-a347-1e062e6743ff tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1365 microversion: 2.47 time: 0.297882 Oct 31 14:15:55.797594 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15711d37-f9a6-49ac-93ce-1b49fb9903f5 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1277 microversion: 2.57 time: 0.095278 Oct 31 14:15:55.798224 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1543/3352] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:55.798845 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1810/3353] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:55.802707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a9568b9-00fb-406b-8bf3-f4a06d782356 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.817341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.818761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: f13c7aba-81f6-434a-ba87-aeab18d06614] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.835811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.836308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.836747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.844996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.845543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.846156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.860919 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a9568b9-00fb-406b-8bf3-f4a06d782356 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/5407d20c-913a-481b-ba1d-def0218a245c" status: 202 len: 0 microversion: 2.1 time: 0.060912 Oct 31 14:15:55.862359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1544/3354] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:55 2022] DELETE /compute/v2.1/flavors/5407d20c-913a-481b-ba1d-def0218a245c => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:15:55.871123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-432671d7-fdb5-4208-8ecd-deb4a5eda7af tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107af5f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.881197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance f13c7aba-81f6-434a-ba87-aeab18d06614 could not be found. Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 HTTP/1.1 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f13c7aba-81f6-434a-ba87-aeab18d06614 could not be found. Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f13c7aba-81f6-434a-ba87-aeab18d06614'} Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13c7aba-81f6-434a-ba87-aeab18d06614 could not be found. Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13c7aba-81f6-434a-ba87-aeab18d06614 could not be found. Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:55.896745 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13c7aba-81f6-434a-ba87-aeab18d06614 could not be found. Oct 31 14:15:55.901783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:55.907051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance f13c7aba-81f6-434a-ba87-aeab18d06614 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:55.915805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94f8630b-a7ef-41a4-8fd7-a0b0b1f32c28 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614" status: 404 len: 111 microversion: 2.1 time: 0.112832 Oct 31 14:15:55.917923 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1811/3355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/servers/f13c7aba-81f6-434a-ba87-aeab18d06614 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:55.932573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f617c4c2-1471-4c0d-a76d-d8c5ca938ad6 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.957942 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-432671d7-fdb5-4208-8ecd-deb4a5eda7af tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.093663 Oct 31 14:15:55.959968 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1545/3356] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:55.964188 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f617c4c2-1471-4c0d-a76d-d8c5ca938ad6 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044264 Oct 31 14:15:55.966293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:55.967115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.973048 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1812/3357] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:55.986413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.986689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:55.987053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.987560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.988334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:55.988858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:55.989343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:55.990374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:55.999615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.000351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.001000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.001772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.002273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.002934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.050960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.052568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.053203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.054360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid c0d5de8e-2266-4ca2-9f82-53d7cdc36247 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:56.056899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:56.064840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Old instance type tempest-test_resize_flavor_-1409034980, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:15:56.076151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:15:56.077184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:15:56.077954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:15:56.078863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:15:56.081908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:15:56.134049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:56.144266 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9e01d33-3c2c-41f0-b23a-9af4e25e3b60 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 200 len: 1308 microversion: 2.1 time: 0.182961 Oct 31 14:15:56.161601 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1546/3358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:55 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:56.182708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:56.190482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:56.208681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.213869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.213869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.228899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.232904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.235861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.288175 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91ec42b8-31a8-44fe-a5a6-76dc5489786f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c/action" status: 202 len: 0 microversion: 2.1 time: 0.307448 Oct 31 14:15:56.289768 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1813/3359] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:15:55 2022] POST /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:15:56.303446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:56.304374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:56.331253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.331963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.332695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.333428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.333882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.334332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.555567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:56.564920 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99ad6882-693d-4951-89f5-531867ab83c5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.402064 Oct 31 14:15:56.579118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1547/3360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:56 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:56.725103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:56.725957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:56.739642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.742404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.743415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.745229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.746091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.746824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.891534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:56.902577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4e39349-037a-4cf4-a96d-3f92809913c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1538 microversion: 2.1 time: 0.603279 Oct 31 14:15:56.906156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1814/3361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:56 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1538 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:56.910887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-66cf915d-4c11-4671-b61c-c334cafea703 req-85757a22-e2b2-4a84-9c5e-bebfa6a77ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d5de8e-2266-4ca2-9f82-53d7cdc36247", "name": "network-vif-deleted", "tag": "6ea97b08-9db3-4387-998f-fd78a653651c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:15:56.936702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-66cf915d-4c11-4671-b61c-c334cafea703 req-85757a22-e2b2-4a84-9c5e-bebfa6a77ffd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:56.937407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-66cf915d-4c11-4671-b61c-c334cafea703 req-85757a22-e2b2-4a84-9c5e-bebfa6a77ffd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:56.938187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-66cf915d-4c11-4671-b61c-c334cafea703 req-85757a22-e2b2-4a84-9c5e-bebfa6a77ffd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:56.968251 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-66cf915d-4c11-4671-b61c-c334cafea703 req-85757a22-e2b2-4a84-9c5e-bebfa6a77ffd service nova] Creating event network-vif-deleted:6ea97b08-9db3-4387-998f-fd78a653651c for instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 on n-h2-863052-1 Oct 31 14:15:56.979505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-66cf915d-4c11-4671-b61c-c334cafea703 req-85757a22-e2b2-4a84-9c5e-bebfa6a77ffd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072013 Oct 31 14:15:56.982093 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1815/3362] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:15:56.991421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:56.994198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.006685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.009712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.014770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.015516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.017557 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5829ba30-596e-4ea8-9967-7795a18a6982 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1505 microversion: 2.1 time: 0.297926 Oct 31 14:15:57.018832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.019432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.019964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.023173 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1548/3363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:56 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:57.032742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.033628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.059210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.062671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.065495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.067828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.068495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.070055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.190766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.205798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.212400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.213668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff55eb20-8d3f-4402-865f-460ff194731e tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1365 microversion: 2.47 time: 0.228269 Oct 31 14:15:57.220827 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1816/3364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:56 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:57.240909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.252167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4eafb10-8024-4cfe-9966-6e3d6e5505d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107cb8940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.263633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.265703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:57.267416 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78700d49-183d-4326-bded-9a97b17ac541 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1329 microversion: 2.57 time: 0.242876 Oct 31 14:15:57.295581 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1549/3365] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:57 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1329 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:57.310100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.310980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.325737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.326265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.326704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.341765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.342367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.343014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.369271 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4eafb10-8024-4cfe-9966-6e3d6e5505d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.145917 Oct 31 14:15:57.370125 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1817/3366] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:57 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:57.384130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.388923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: c0d5de8e-2266-4ca2-9f82-53d7cdc36247] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.399807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.401441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.404722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.405628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.406279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.409618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.457893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 could not be found. Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 HTTP/1.1 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 could not be found. Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c0d5de8e-2266-4ca2-9f82-53d7cdc36247'} Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 could not be found. Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 could not be found. Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:15:57.462047 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 could not be found. Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:15:57.467592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance c0d5de8e-2266-4ca2-9f82-53d7cdc36247 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:15:57.468312 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82be536e-7e72-48b1-add0-a5f37c7e1a51 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247" status: 404 len: 111 microversion: 2.1 time: 0.095788 Oct 31 14:15:57.471631 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1818/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:57 2022] GET /compute/v2.1/servers/c0d5de8e-2266-4ca2-9f82-53d7cdc36247 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:15:57.475689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:57.479264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aab28de7-5d09-4f8a-8cc8-fe07b94487d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.522135 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94f4b129-a675-47b6-a18a-0047bcabc38a tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.224130 Oct 31 14:15:57.528865 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1550/3368] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 31 14:15:57 2022] DELETE /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e/os-server-password => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:57.540224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.545490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.557870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.559924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.561427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.565194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.565968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.568640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.597193 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aab28de7-5d09-4f8a-8cc8-fe07b94487d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ebaf5c65-4529-4783-9bf3-8e3889cf058d" status: 204 len: 0 microversion: 2.1 time: 0.123971 Oct 31 14:15:57.597799 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1819/3369] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:15:57 2022] DELETE /compute/v2.1/os-server-groups/ebaf5c65-4529-4783-9bf3-8e3889cf058d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:15:57.625331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.628201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.640097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4dfb0c0-83fc-4013-a22b-2a4e08dfa9d5 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.109874 Oct 31 14:15:57.647206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1551/3370] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 31 14:15:57 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e/os-server-password => generated 16 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:15:57.661249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.662199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.677623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.678130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.679167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.681449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.682502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.683467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.685798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.686319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.686497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.691434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.693449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.694089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.741264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:57.931930 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d5eff92-d57c-4e43-9072-6a968c34d6c3 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 204 len: 0 microversion: 2.1 time: 0.281698 Oct 31 14:15:57.933223 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1552/3371] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:57 2022] DELETE /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:57.940989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:57.941880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:57.955606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.959230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.962720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:57.965426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:57.966331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:57.969554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.029870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:15:58.209974 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-38ae514f-2eaa-47b9-9684-575b1565b0ea tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 204 len: 0 microversion: 2.1 time: 0.274207 Oct 31 14:15:58.210633 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1553/3372] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:15:57 2022] DELETE /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:15:58.215890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:58.224712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:58.236819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.237313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.242274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.243064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.243893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.250488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.404236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.416853 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e57b94de-1c69-4c23-b57c-91de2020cbec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.816919 Oct 31 14:15:58.419440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1820/3373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:57 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:58.431616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:58.434265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:58.446115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.452822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.456558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.457580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.458290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.458922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.493694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.528898 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84ac1a15-6f57-492c-ac3d-b75443c59f0c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1538 microversion: 2.1 time: 0.313562 Oct 31 14:15:58.529660 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1554/3374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:58 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1538 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:58.562463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:58.563825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:58.576537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.577333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.577994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.578956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.579579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.580204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.824775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.839813 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c032b29b-ae97-4a93-a1db-95c76c25f119 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1511 microversion: 2.1 time: 0.283183 Oct 31 14:15:58.842463 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1555/3375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:58 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:58.848501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:58.849126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:58.867593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.868535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.869260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.870319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.871368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.872061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.872722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.881505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4da33a4-cdd2-4f6c-8b2c-49e99a766671 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1473 microversion: 2.1 time: 0.458463 Oct 31 14:15:58.882778 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1821/3376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:58 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1473 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:58.888236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:58.891038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:58.910216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:58.912144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.912926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.913644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.914628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.915284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.915867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.923857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:58.925606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:58.926317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:58.927044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lazy-loading 'fault' on Instance uuid 35803569-c75f-4c91-ae95-e7a540a15274 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:15:58.979873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.989723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.992720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '590eb752d4dd464ab59675bca445da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35b1405c544fed894f3679acb86961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:58.994043 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-009470b2-a015-49e8-8be1-39969d96cba9 tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 200 len: 1370 microversion: 2.47 time: 0.150400 Oct 31 14:15:58.995568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1556/3377] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:58 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:59.001103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1d35d96-f638-4c3b-8c35-d4ef492d78e5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107aae160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:59.028053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:59.036976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:59.046643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:59.047948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f35864e-b19e-4142-af2a-b56e54028e24 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1335 microversion: 2.57 time: 0.163944 Oct 31 14:15:59.048525 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1822/3378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:15:58 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:15:59.070950 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1d35d96-f638-4c3b-8c35-d4ef492d78e5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.074188 Oct 31 14:15:59.072312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1557/3379] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:15:58 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:59.454572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:59.474350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:59.494906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:59.495581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:59.496223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:59.497849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:59.498551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:59.499164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:59.557490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:59.558410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:59.573208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:59.574555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:59.588152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:59.589387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:59.590293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:59.592994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:59.913150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:15:59.923467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b13bd579-a8a2-4625-9c50-66719267d631 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.473037 Oct 31 14:15:59.928763 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1823/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:59 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:15:59.937335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:15:59.947079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:15:59.954074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:59.955496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:59.956422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:59.957333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:15:59.958631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:15:59.959265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:15:59.980417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:00.259728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:00.276809 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ddf88b6-afa5-43b3-9d99-bf104ef61ac5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1538 microversion: 2.1 time: 0.723086 Oct 31 14:16:00.297931 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1558/3381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:59 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1538 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:00.310667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:00.312233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:00.330884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:00.333269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:00.334084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:00.334467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:00.335944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:00.336433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:00.339183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:00.343569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fa383e4-007a-4af3-8f30-4e41e13daa2f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1511 microversion: 2.1 time: 0.413508 Oct 31 14:16:00.347342 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1824/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:15:59 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:00.361362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:00.362118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] [instance: 35803569-c75f-4c91-ae95-e7a540a15274] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:00.406806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:00.407321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:00.407794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:00.408515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:00.408997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:00.409406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:00.446866 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] HTTP exception thrown: Instance 35803569-c75f-4c91-ae95-e7a540a15274 could not be found. Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Request method failure captured: Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 HTTP/1.1 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9iOutNkirgE9nKp70YDyzpJNcEaBA38v6Aayf2wPv6IwbW1FuIU0tMb437-VHxrNa4U6zWK7Ryz7CQKQc8VZ1RogqJXUUiWb1FmyRNtLuRbSbLcPsNIkKJyQn58ScIG1ywhomvUkHilp878wENiEfYrQSqtPOplt0LtJMvHDRbjA5g Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8a35b1405c544fed894f3679acb86961 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAaction247Test-989060475 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a35b1405c544fed894f3679acb86961", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a35b1405c544fed894f3679acb86961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a35b1405c544fed894f3679acb86961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a35b1405c544fed894f3679acb86961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAaction247Test-989060475 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8a35b1405c544fed894f3679acb86961 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAaction247Test-989060475 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAaction247Test-989060475-project Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 590eb752d4dd464ab59675bca445da67 Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAaction247Test-989060475-project Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 35803569-c75f-4c91-ae95-e7a540a15274 could not be found. Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '35803569-c75f-4c91-ae95-e7a540a15274'} Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35803569-c75f-4c91-ae95-e7a540a15274 could not be found. Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35803569-c75f-4c91-ae95-e7a540a15274 could not be found. Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:00.448682 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35803569-c75f-4c91-ae95-e7a540a15274 could not be found. Oct 31 14:16:00.453571 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:00.455953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] Returning 404 to user: Instance 35803569-c75f-4c91-ae95-e7a540a15274 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:16:00.457454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37d0f1da-07ec-4106-84e9-668bd3c218af tempest-ServersAaction247Test-989060475 tempest-ServersAaction247Test-989060475-project] 10.222.0.27 "GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274" status: 404 len: 111 microversion: 2.47 time: 0.109136 Oct 31 14:16:00.458552 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1825/3383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:00 2022] GET /compute/v2.1/servers/35803569-c75f-4c91-ae95-e7a540a15274 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:16:00.464723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:00.466452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:00.473752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:00.474589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:00.475214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:00.476121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:00.476762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:00.477363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:01.462989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:01.475122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:01.482101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:01.506137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d35c5555-0fd2-45b0-b062-e33cf655740a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1335 microversion: 2.57 time: 1.046193 Oct 31 14:16:01.509104 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1826/3384] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:00 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1335 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:01.536923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eaed0c8d-778e-4d16-a94d-c806684a04af tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078265e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:01.589315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:01.607769 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a658b637-5f12-4dda-8c1c-5656c0ff7f89 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1473 microversion: 2.1 time: 1.308715 Oct 31 14:16:01.608632 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1559/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:00 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1473 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:01.630428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:01.631023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:01.633041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:01.658860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:01.671458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:01.672152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:01.674949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:01.679962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:01.680619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:01.757851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eaed0c8d-778e-4d16-a94d-c806684a04af tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.247264 Oct 31 14:16:01.758477 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1827/3386] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:01 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:01.778517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-04298b7c-8056-409f-8ca2-9c85cef5ac1c req-c3a5c79d-68bf-4c83-8dca-fb21ebce11ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1925eb40-8126-4dfb-a83e-41260a763185", "name": "network-vif-plugged", "status": "completed", "tag": "8ee5c5f5-e47c-4164-8101-26618575bed4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:01.830464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-04298b7c-8056-409f-8ca2-9c85cef5ac1c req-c3a5c79d-68bf-4c83-8dca-fb21ebce11ad service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:01.831304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-04298b7c-8056-409f-8ca2-9c85cef5ac1c req-c3a5c79d-68bf-4c83-8dca-fb21ebce11ad service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:01.833287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-04298b7c-8056-409f-8ca2-9c85cef5ac1c req-c3a5c79d-68bf-4c83-8dca-fb21ebce11ad service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:01.857976 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-04298b7c-8056-409f-8ca2-9c85cef5ac1c req-c3a5c79d-68bf-4c83-8dca-fb21ebce11ad service nova] Creating event network-vif-plugged:8ee5c5f5-e47c-4164-8101-26618575bed4 for instance 1925eb40-8126-4dfb-a83e-41260a763185 on n-h1-863052-1 Oct 31 14:16:01.872328 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-04298b7c-8056-409f-8ca2-9c85cef5ac1c req-c3a5c79d-68bf-4c83-8dca-fb21ebce11ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112551 Oct 31 14:16:01.873194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1828/3387] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:01.879716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a8fb9406-1f9d-4c49-8a54-b7ea9679c607 req-c469adb8-9cf4-4157-bb05-b20b7a110d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5f08e7-abcf-4dac-baf3-4b84313cf486", "name": "network-vif-deleted", "tag": "afc66d42-1974-454e-b7b9-5c54e80ec047"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:01.913618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a8fb9406-1f9d-4c49-8a54-b7ea9679c607 req-c469adb8-9cf4-4157-bb05-b20b7a110d36 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:01.914111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a8fb9406-1f9d-4c49-8a54-b7ea9679c607 req-c469adb8-9cf4-4157-bb05-b20b7a110d36 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:01.922899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a8fb9406-1f9d-4c49-8a54-b7ea9679c607 req-c469adb8-9cf4-4157-bb05-b20b7a110d36 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:01.940598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a8fb9406-1f9d-4c49-8a54-b7ea9679c607 req-c469adb8-9cf4-4157-bb05-b20b7a110d36 service nova] Creating event network-vif-deleted:afc66d42-1974-454e-b7b9-5c54e80ec047 for instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 on n-h1-863052-1 Oct 31 14:16:01.959593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a8fb9406-1f9d-4c49-8a54-b7ea9679c607 req-c469adb8-9cf4-4157-bb05-b20b7a110d36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072439 Oct 31 14:16:01.960927 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1829/3388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:01.976530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:01.977738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:01.987055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:01.987971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:01.988764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:01.989712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:01.990807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:01.991969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.142522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:02.157446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2187e9e6-1da5-4db4-83f6-d2ac8dc48bed tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.544652 Oct 31 14:16:02.163408 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1560/3389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:01 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:02.169780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:02.174063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:02.188502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.191452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.193971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.195127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.195603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.196035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.254638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:02.269206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-398caf05-973f-4aae-9419-d165e439ecf0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1538 microversion: 2.1 time: 0.306423 Oct 31 14:16:02.271516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1830/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:01 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1538 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:02.539609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:02.540259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:02.549638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.550139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.555043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.555822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.556411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.557033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.753074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:02.754997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:02.765110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:02.767596 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e31b69c-b5a4-47f5-b231-c963757c77f0 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1511 microversion: 2.1 time: 0.602626 Oct 31 14:16:02.772065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:02.773062 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1561/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:02 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:02.780890 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67c0b849-c31b-412f-bead-d3aef364ee44 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1356 microversion: 2.57 time: 0.245150 Oct 31 14:16:02.781906 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1831/3392] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:02 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:02.795464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9c4d636-eafc-403e-8e41-d48f3fd5f930 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107c08ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:02.805691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:02.807482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:02.831707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.832421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.832863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.833565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.834009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.838452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.935636 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9c4d636-eafc-403e-8e41-d48f3fd5f930 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1412 microversion: 2.1 time: 0.151283 Oct 31 14:16:02.935799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:02.936251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:02.936698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:02.937160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lazy-loading 'fault' on Instance uuid 3a5f08e7-abcf-4dac-baf3-4b84313cf486 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:16:02.945547 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1832/3393] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:02 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:02.961544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:02.979209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:03.029961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:03.031211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:03.031551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:03.035508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:03.046077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:03.046974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:03.085870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f870e154b4a868781aecb8585e6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fadd213d9f34565a0cf36487701aea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:03.103871 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba2bcbf8-ce82-4c92-8955-ae2a3217b8c5 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 200 len: 1307 microversion: 2.1 time: 0.326662 Oct 31 14:16:03.104554 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1562/3394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:02 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:03.181644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:03.182552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:03.192741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:03.193585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:03.194206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:03.195435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:03.196160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:03.197040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:03.734548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:03.753988 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-225c4f45-514c-4242-87af-f71ee4964097 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1315 microversion: 2.1 time: 0.574734 Oct 31 14:16:03.775124 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1563/3395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:03 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:03.784541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:03.786999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:03.834796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:03.838851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:03.841986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:03.844860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:03.847961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:03.849483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:03.872830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:INSERT=6,nova_cell1:SELECT=92,nova_cell1:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:04.320576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:04.333252 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b28c00e-8907-45ff-b072-800a0e602822 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1538 microversion: 2.1 time: 0.556221 Oct 31 14:16:04.333833 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1564/3396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:03 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1538 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:04.347680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:04.348299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:04.372409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:04.377614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:04.379125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:04.380387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:04.382738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:04.383348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:04.487937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:04.488501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:04.488876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:04.489342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lazy-loading 'fault' on Instance uuid 2760d519-a8cd-41b7-9032-a92c4fa7f15e {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:16:04.619119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c986efd4cd4cedaef35c2b9e0de55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b51eed65e464fcdb0706e5d09a5ef05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:04.628607 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b31baa2b-e1db-4a13-acb8-c661f29b0fc3 tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 200 len: 1306 microversion: 2.1 time: 0.287135 Oct 31 14:16:04.629213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1565/3397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:04 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 1306 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:04.649617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62753e7f-323b-4b43-be9f-f17bacc64ba0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107934670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:05.271998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:05.801277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:08.188342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-62753e7f-323b-4b43-be9f-f17bacc64ba0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1421 microversion: 2.1 time: 3.558032 Oct 31 14:16:08.188947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1566/3398] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:04 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1421 bytes in 3559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:08.195350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-64a3f35e-c435-4bf1-9a96-db03e1e0f0c2 req-e739ff96-a427-4d8d-9cef-e3f0837018e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2760d519-a8cd-41b7-9032-a92c4fa7f15e", "name": "network-vif-deleted", "tag": "ef7b6010-bae3-4480-afc9-cebd3341f97f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:08.200482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:16:08.200989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:16:08.201394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:16:08.201802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:16:08.202249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:16:08.210210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64a3f35e-c435-4bf1-9a96-db03e1e0f0c2 req-e739ff96-a427-4d8d-9cef-e3f0837018e6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.211015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64a3f35e-c435-4bf1-9a96-db03e1e0f0c2 req-e739ff96-a427-4d8d-9cef-e3f0837018e6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.211523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64a3f35e-c435-4bf1-9a96-db03e1e0f0c2 req-e739ff96-a427-4d8d-9cef-e3f0837018e6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.224109 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-64a3f35e-c435-4bf1-9a96-db03e1e0f0c2 req-e739ff96-a427-4d8d-9cef-e3f0837018e6 service nova] Creating event network-vif-deleted:ef7b6010-bae3-4480-afc9-cebd3341f97f for instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e on n-h2-863052-1 Oct 31 14:16:08.230918 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-64a3f35e-c435-4bf1-9a96-db03e1e0f0c2 req-e739ff96-a427-4d8d-9cef-e3f0837018e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039203 Oct 31 14:16:08.231835 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1567/3399] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:08.238722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:08.239850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] [instance: 3a5f08e7-abcf-4dac-baf3-4b84313cf486] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.247228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.248180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.248792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.249693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.250364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.250798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.266367 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] HTTP exception thrown: Instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 could not be found. Oct 31 14:16:08.266873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Request method failure captured: Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 HTTP/1.1 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fOEshwlFZ262m0hFA8Mms8W5kubIx6OLZ51qdEDk2pVumYwK5kLsxHpO39i4AHlfkXY6KdthWoFZRENdkf6Ztj-mhArk2NhKxRETQNRyrs4vJfOjxSjACJnfARRQhPZ793gif2LYSBQstNcCN3piiZfHbflJ4OgeqxcqIrloBqv-U Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fadd213d9f34565a0cf36487701aea2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fadd213d9f34565a0cf36487701aea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8fadd213d9f34565a0cf36487701aea2 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-709271185 Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 233f870e154b4a868781aecb8585e6dc Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersOnMultiNodesTest-709271185-project Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 could not be found. Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3a5f08e7-abcf-4dac-baf3-4b84313cf486'} Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 could not be found. Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 could not be found. Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:08.268052 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 could not be found. Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] Returning 404 to user: Instance 3a5f08e7-abcf-4dac-baf3-4b84313cf486 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40f77a5c-9f82-4fef-b05c-e99155b905d2 tempest-ServersOnMultiNodesTest-709271185 tempest-ServersOnMultiNodesTest-709271185-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486" status: 404 len: 111 microversion: 2.1 time: 0.036277 Oct 31 14:16:08.273508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1568/3400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:08 2022] GET /compute/v2.1/servers/3a5f08e7-abcf-4dac-baf3-4b84313cf486 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:16:08.274999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.274999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.274999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.275492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:08.275649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.275649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.275941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.276117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.282117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.282789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.283361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.284762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.285226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.285655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.304601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6167fd8e-d595-4da2-9779-b7cfaef34af4 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "POST /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1/action" status: 202 len: 1137 microversion: 2.57 time: 5.357887 Oct 31 14:16:08.305224 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1833/3401] 10.222.0.27 () {62 vars in 1320 bytes} [Mon Oct 31 14:16:02 2022] POST /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1/action => generated 1137 bytes in 5359 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 14:16:08.483805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:08.496319 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19a61003-891c-439c-a24b-fa122e6a6e75 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1502 microversion: 2.1 time: 0.223938 Oct 31 14:16:08.500618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1569/3402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:08 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:08.505781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:08.506721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.513169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.513998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.515165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.516229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.516908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.517624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.519521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1598354453", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:08.629091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:16:08.629794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:16:08.630305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:16:08.630726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:16:08.633281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:16:08.651873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.655250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.655936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.657139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.657777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.658421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.679723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Getting quotas for project 369bbea55ce84e34b936c80aa4ad2e8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:16:08.686676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Getting quotas for user 6d6ee3a4433c426cb37fb9be425dc5d4 and project 369bbea55ce84e34b936c80aa4ad2e8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:16:08.702448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:16:08.705256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:16:08.780905 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d1f54d2-7078-4df0-bcc5-32b6e58b516e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.474405 Oct 31 14:16:08.787551 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1834/3403] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:16:08.787853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:08.788663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] [instance: 2760d519-a8cd-41b7-9032-a92c4fa7f15e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.795709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.796216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.796662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.797369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.797830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.798283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.800961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:08.812951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3bb490a-378c-4466-8174-b22f4426f86d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.310760 Oct 31 14:16:08.814232 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1570/3404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:08 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:08.814964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] HTTP exception thrown: Instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e could not be found. Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Request method failure captured: Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e HTTP/1.1 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9h-WzQKXwuFT5Ad7Dz4PdxTrua20OAhVe-f4ZtdQTCPvSr4azQQJt46dXjB3qLg415_URC9rJT5J8G1ennjXS0qjlpilJS0_ja5D677_5qsu03cpWApu5o1sy8wvHFClhDhAALpYymVrcZ10gLzDvGyxfYBkpfZl5Gmq9Vl_enJ2i4 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6b51eed65e464fcdb0706e5d09a5ef05 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerPasswordTestJSON-885089990 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b51eed65e464fcdb0706e5d09a5ef05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b51eed65e464fcdb0706e5d09a5ef05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b51eed65e464fcdb0706e5d09a5ef05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b51eed65e464fcdb0706e5d09a5ef05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerPasswordTestJSON-885089990 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6b51eed65e464fcdb0706e5d09a5ef05 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerPasswordTestJSON-885089990 Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerPasswordTestJSON-885089990-project Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 26c986efd4cd4cedaef35c2b9e0de55f Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerPasswordTestJSON-885089990-project Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e could not be found. Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2760d519-a8cd-41b7-9032-a92c4fa7f15e'} Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e could not be found. Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e could not be found. Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:08.816640 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e could not be found. Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] Returning 404 to user: Instance 2760d519-a8cd-41b7-9032-a92c4fa7f15e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:16:08.820873 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d6dc5cf-1aab-48ae-b67d-327a9368475f tempest-ServerPasswordTestJSON-885089990 tempest-ServerPasswordTestJSON-885089990-project] 10.222.0.27 "GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e" status: 404 len: 111 microversion: 2.1 time: 0.034720 Oct 31 14:16:08.829081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40d19fda-ed77-40eb-b4e5-e3a229af3fbf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe107939a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:08.834417 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1835/3405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:08 2022] GET /compute/v2.1/servers/2760d519-a8cd-41b7-9032-a92c4fa7f15e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:16:08.843530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:08.844810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.858334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.859164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.860345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.861075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.861532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.863700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.927931 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40d19fda-ed77-40eb-b4e5-e3a229af3fbf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 200 len: 1421 microversion: 2.1 time: 0.112473 Oct 31 14:16:08.928521 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1571/3406] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:08 2022] GET /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:08.934467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:08.935495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:08.943294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.943995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.945321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:08.946440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:08.947072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:08.947839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:09.061539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.067462 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc6fddc4-fb0e-435d-8a02-26f5f4c7919c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185/action" status: 202 len: 0 microversion: 2.1 time: 0.136927 Oct 31 14:16:09.068933 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1572/3407] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:16:08 2022] POST /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:16:09.080937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.083208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-553cef8b-86b7-4c41-bb78-693d991eb716 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:09.084635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-553cef8b-86b7-4c41-bb78-693d991eb716 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:09.085800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.089346 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b630baab-178b-480f-a9ea-f38e55f1263b tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.252359 Oct 31 14:16:09.092340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1836/3408] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:08 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:09.101072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:09.112966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:09.128446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:09.129203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:09.129912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:09.130887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:09.131889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:09.132555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:09.269490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-553cef8b-86b7-4c41-bb78-693d991eb716 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.288312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-553cef8b-86b7-4c41-bb78-693d991eb716 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.290245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-553cef8b-86b7-4c41-bb78-693d991eb716 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.292553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-553cef8b-86b7-4c41-bb78-693d991eb716 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1278 microversion: 2.54 time: 0.221460 Oct 31 14:16:09.296093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1573/3409] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:09 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:09.303494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1102732528", "imageRef": "2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d", "flavorRef": "452", "networks": [{"uuid": "d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:09.427843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:09.437199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] validate_networks() for [('d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:16:09.450916 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fd68e02-a1e2-4511-8001-a3fc3b367a36 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1507 microversion: 2.1 time: 0.356508 Oct 31 14:16:09.451839 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1837/3410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:09 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:09.842817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:09.843797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:09.853382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:09.853882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:09.854361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:09.857571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:09.858951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:09.860231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.085962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.111287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a870d718-9f62-482d-82cf-1eae337c72bd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.267327 Oct 31 14:16:10.114021 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1838/3411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:09 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:10.121294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:10.123163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:10.134933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.135616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.136155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.137180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.138288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.138927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.232703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.270953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.272891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.274243 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0dc658f-9869-449b-a788-a7030702f311 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.158695 Oct 31 14:16:10.274871 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1839/3412] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:10 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:10.327252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:10.328013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:10.336159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.336911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.337375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.340841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.341337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.342083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.496044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.509336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.514816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.523582 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66f5de63-0420-4201-8faa-0f227a2be55f tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1330 microversion: 2.54 time: 0.198781 Oct 31 14:16:10.525499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1840/3413] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:10 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1330 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:10.525499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:10.539350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:10.561216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.561762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.562474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.564268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.564768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.566556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.588997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:16:10.591243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:16:10.591896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:16:10.592510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:16:10.593225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:16:10.608957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.612525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.612812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.613617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.614085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.614547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.650623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:16:10.661283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for user ec707d34966e44aa93900eebc62a6a93 and project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:16:10.679452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:16:10.682035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:16:10.769605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.772673 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1bfa4370-2d09-419c-93cc-19a12ac6da8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474959 Oct 31 14:16:10.774037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1574/3414] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:16:10.781309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-787b9231-c2f5-4604-88d9-f91d5ea7e020 req-517ae7a6-a50c-4111-937d-683ce0331390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4544a4-f791-409a-9f34-20bdb10acfc3", "name": "network-vif-unplugged", "status": "completed", "tag": "052e069f-ff62-4302-bf3c-acfe4326beea"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:10.785878 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0df0ee1f-16bd-4115-9fbf-fb56a0dbecc1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1487 microversion: 2.1 time: 0.259242 Oct 31 14:16:10.795138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-787b9231-c2f5-4604-88d9-f91d5ea7e020 req-517ae7a6-a50c-4111-937d-683ce0331390 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.795628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-787b9231-c2f5-4604-88d9-f91d5ea7e020 req-517ae7a6-a50c-4111-937d-683ce0331390 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.796631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-787b9231-c2f5-4604-88d9-f91d5ea7e020 req-517ae7a6-a50c-4111-937d-683ce0331390 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.805065 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1841/3415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:10 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1487 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:10.816943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af1ab957-b467-4be5-8cb1-cd2889af996c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:10.818540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af1ab957-b467-4be5-8cb1-cd2889af996c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:10.838976 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-787b9231-c2f5-4604-88d9-f91d5ea7e020 req-517ae7a6-a50c-4111-937d-683ce0331390 service nova] Creating event network-vif-unplugged:052e069f-ff62-4302-bf3c-acfe4326beea for instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 on n-h1-863052-1 Oct 31 14:16:10.845780 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-787b9231-c2f5-4604-88d9-f91d5ea7e020 req-517ae7a6-a50c-4111-937d-683ce0331390 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070209 Oct 31 14:16:10.847395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1575/3416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:10.855172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:10.856313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:10.865190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.866070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.866961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.879225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:10.880026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:10.885271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:10.918042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-af1ab957-b467-4be5-8cb1-cd2889af996c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:10.925720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af1ab957-b467-4be5-8cb1-cd2889af996c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1208 microversion: 2.1 time: 0.119392 Oct 31 14:16:10.926345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1842/3417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:10 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1208 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:10.943657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lazy-loading 'flavor' on Instance uuid 1925eb40-8126-4dfb-a83e-41260a763185 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:16:11.139843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:11.140470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:11.156860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.158560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.160023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.162035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.162768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.166734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.239624 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a52cc28d-c302-4135-a799-a8453c8a5195 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185/action" status: 202 len: 0 microversion: 2.1 time: 0.390431 Oct 31 14:16:11.243491 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1576/3418] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:16:10 2022] POST /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:16:11.252936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:11.255076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:11.265791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.266672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.267356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.268393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.269221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.269902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.508173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.525255 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9559bbe1-4b5f-46cd-9df9-b1c27461d204 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.391858 Oct 31 14:16:11.526909 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1843/3419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:11 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:11.540171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:11.544911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:11.560215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.561384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.562295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.563338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.564217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.564818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.640872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.641559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.649001 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ee780838-559c-48d1-834f-a981111e7830 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1493 microversion: 2.1 time: 0.402436 Oct 31 14:16:11.651610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.653421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.654700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc33802e-6dc3-48bc-a9a9-bee8ffe2a7d8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.125195 Oct 31 14:16:11.655776 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1844/3420] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:11 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:11.666554 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1577/3421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:11 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1493 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:11.671762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:11.672575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:11.681437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.682226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.683306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.685630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.686330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.686924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.735578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:11.817161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.829680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.831442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:11.832695 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-deaf24c5-366f-43f7-b945-6e7cfeca51ea tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1336 microversion: 2.54 time: 0.175799 Oct 31 14:16:11.838218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1845/3422] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:11 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1336 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:11.951616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:11.952359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:11.973540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.974215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.976112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:11.979671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:11.980156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:11.981435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:12.112828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:12.124482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab8766ec-6856-468f-aa26-95a4b0d9c8df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1204 microversion: 2.1 time: 0.176850 Oct 31 14:16:12.125092 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1578/3423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:11 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1204 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:12.550487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:12.551182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:12.568526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:12.568876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:12.569335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:12.570232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:12.571585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:12.572277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:12.681327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:12.681866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:12.690013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:12.698023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:12.712103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:12.713194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:12.713944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:12.714578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.051166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.060552 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e40d382-a0ae-44aa-92e8-d3bc47a968cb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.514334 Oct 31 14:16:13.061148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1846/3424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:12 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:13.070943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:13.070943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:13.079801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:13.080340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:13.080794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.081537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:13.081993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:13.082484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.252932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.263733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.284695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.290156 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-488e522d-fb28-4c48-bfb8-d20356f0a408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.227084 Oct 31 14:16:13.292488 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1847/3425] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:13 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:13.313934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:13.314724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:13.334001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:13.341027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:13.345879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.350220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:13.350965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:13.354782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.567369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.578853 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e8620fb-f3b5-4429-a883-6390a5004fae tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1514 microversion: 2.1 time: 0.899953 Oct 31 14:16:13.580766 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1579/3426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:12 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1514 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:13.613015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:13.615903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:13.638641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:13.642047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:13.642732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.644054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:13.653981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:13.661904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:13.663434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.677746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.683005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.685117 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6ec8823-ff73-4d64-8630-c1ffb1bc6f5b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1336 microversion: 2.54 time: 0.389889 Oct 31 14:16:13.687236 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1848/3427] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:13 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1336 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:13.885169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:13.898412 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6026d049-3b8d-4e15-a118-0c3ad9acc1e7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1266 microversion: 2.1 time: 0.305743 Oct 31 14:16:13.900028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1580/3428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:13 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:14.085413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:14.086492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:14.097327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.098772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.101913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.103028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.112155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.114555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.324413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:14.325880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:14.341110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.342368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.346717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.348052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.348737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.349574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.587731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:14.603493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:14.605509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:14.607931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:14.609768 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e84330d-78aa-4e6f-be42-c7ec9f5e46ad tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.290764 Oct 31 14:16:14.622582 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7387e48a-e5cf-4c02-ae33-43b0fdc17e8a tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.542355 Oct 31 14:16:14.623226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1581/3429] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:14 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:16:14.635951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:14.637470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:14.643053 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1849/3430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:14 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:14.645022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.645908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.646912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.647873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.648556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.649344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.723960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:14.724757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:14.740120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.740616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.741056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:14.750083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:14.750739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:14.751214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.010788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:15.033330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:15.038048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:15.047989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01ef56de-35a4-4f2c-ae25-14054fa264d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1357 microversion: 2.54 time: 0.336401 Oct 31 14:16:15.049704 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1850/3431] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:14 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1357 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:15.064571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:15.068130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:15.084277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:15.086434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:15.087193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.088768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:15.091202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:15.094869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.311088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:15.326368 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5786615b-e021-43a9-8c00-95867e88ff53 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1266 microversion: 2.1 time: 0.274802 Oct 31 14:16:15.326964 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1851/3432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:15 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:15.345039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c37d21a6-78e4-4f8e-9d06-7bebfaf763e2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Action: 'create', calling method: .version_select at 0x7fe106e8ca60>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-316950259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnyfS5DDkgxsGS/jzDJJ+eYb0x2M1KEZeWIINoHHUrZ6LSt6dCvltmAx23ad9IqXlKMyuo9whjw1P5QglweBCDUgJXKJNrqIUH3um+qOXFspsNO4WgHZ3c09S9XrDtJTw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:15.412917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c37d21a6-78e4-4f8e-9d06-7bebfaf763e2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Getting quotas for project 369bbea55ce84e34b936c80aa4ad2e8f. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:16:15.429416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c37d21a6-78e4-4f8e-9d06-7bebfaf763e2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Getting quotas for user 6d6ee3a4433c426cb37fb9be425dc5d4 and project 369bbea55ce84e34b936c80aa4ad2e8f. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:16:15.499617 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c37d21a6-78e4-4f8e-9d06-7bebfaf763e2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.168858 Oct 31 14:16:15.501928 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1852/3433] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:16:15 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:16:15.519796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-316950259", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:15.526733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:15.556545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:15.557036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:15.557471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.558279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:15.558652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:15.559598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.731209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:15.747459 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-deaf695f-613f-4eba-b8fa-49aeedd9eac0 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 1.122839 Oct 31 14:16:15.748070 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1582/3434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:14 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:15.768869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:15.769804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:15.798086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:15.798780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:15.801298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.802920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:15.803545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:15.804129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:15.821237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:16.242414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:16.257972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:16.260923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:16.263326 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1be932d-5d0b-4adb-a485-dd3e1164d4b8 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.514237 Oct 31 14:16:16.264312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1583/3435] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:15 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:16.272883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:16.274818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:16.284596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:16.285197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:16.285802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:16.286692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:16.287406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:16.288051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:17.589435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:17.612429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-574dd6a8-c398-47ed-9ddb-30e56dc64fb6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 1.346647 Oct 31 14:16:17.626022 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1584/3436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:16 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:17.643167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:17.644992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:17.680156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:17.683051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:17.685592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:17.690702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:17.694219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:17.696801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:18.671129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:19.079390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:19.097392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd978112-7c1f-465c-9e8f-6608d25c8150 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 1.463647 Oct 31 14:16:19.111722 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1585/3437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:17 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:19.136003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:19.140401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:19.169704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:19.173244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:19.176079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:19.177098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:19.183084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:19.183867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:20.039117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:20.053214 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e231ddc2-a0dd-47ed-8d12-bcf466a5a7e8 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.938366 Oct 31 14:16:20.068848 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1586/3438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:19 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:20.074428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-56a2fd77-5bdf-4941-8751-acff796af17e req-f4005127-e3db-41cb-8dbf-cd3f7a2f8b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1925eb40-8126-4dfb-a83e-41260a763185", "name": "network-vif-plugged", "status": "completed", "tag": "8ee5c5f5-e47c-4164-8101-26618575bed4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:20.105150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-56a2fd77-5bdf-4941-8751-acff796af17e req-f4005127-e3db-41cb-8dbf-cd3f7a2f8b7c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:20.106448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-56a2fd77-5bdf-4941-8751-acff796af17e req-f4005127-e3db-41cb-8dbf-cd3f7a2f8b7c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:20.106788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-56a2fd77-5bdf-4941-8751-acff796af17e req-f4005127-e3db-41cb-8dbf-cd3f7a2f8b7c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:20.132485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-56a2fd77-5bdf-4941-8751-acff796af17e req-f4005127-e3db-41cb-8dbf-cd3f7a2f8b7c service nova] Creating event network-vif-plugged:8ee5c5f5-e47c-4164-8101-26618575bed4 for instance 1925eb40-8126-4dfb-a83e-41260a763185 on n-h1-863052-1 Oct 31 14:16:20.144487 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-56a2fd77-5bdf-4941-8751-acff796af17e req-f4005127-e3db-41cb-8dbf-cd3f7a2f8b7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073484 Oct 31 14:16:20.145801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1587/3439] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:20.152977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:20.155235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:20.166447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:20.167812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:20.176314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:20.177587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:20.178087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:20.179532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:20.389108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:20.399558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:20.405339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:20.409831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b73a424f-bb0e-4844-98d7-5679ce3255cb tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.262336 Oct 31 14:16:20.410369 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1588/3440] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:20 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:20.420989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:20.421618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:20.439719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:20.440220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:20.440710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:20.441421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:20.441933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:20.442393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:20.626926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:20.686194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:21.046679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:16:21.052672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:16:21.053414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:16:21.054000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:16:21.059829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:16:21.271695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:21.296176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:21.296691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:21.297165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:21.301292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:21.301776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:21.304077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:21.394108 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-865b63b8-2da8-4320-9fdb-6dc392c85c1c tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "POST /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775/action" status: 202 len: 1139 microversion: 2.54 time: 5.884250 Oct 31 14:16:21.402664 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1853/3441] 10.222.0.27 () {62 vars in 1320 bytes} [Mon Oct 31 14:16:15 2022] POST /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775/action => generated 1139 bytes in 5894 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 31 14:16:21.421921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:21.423002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:21.439208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:21.447108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:21.448158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:21.453100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:21.453906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:21.454647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:21.875055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:21.889041 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-931c70c0-d1c4-4ffd-9753-97b1df75f30f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 0.485103 Oct 31 14:16:21.906704 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1854/3442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:21 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:21.919845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:21.922564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:21.941577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:21.942982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:21.943642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:21.944650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:21.945267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:21.947176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:21.997855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.010610 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7fd63fd-b2eb-4b63-9cd0-239854e430c8 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 1.599056 Oct 31 14:16:22.011477 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1589/3443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:20 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:22.022469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:22.023428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:22.037898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.038674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.039295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:22.041190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.043369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.045077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:22.248618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.267214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.268793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.296352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.338105 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-60e77675-6782-4348-85e8-ce1bf72f15cc tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.308388 Oct 31 14:16:22.347327 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1590/3444] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:22 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:22.348248 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2f3f99b-ee7b-42b5-9896-0123f8348bff tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.400771 Oct 31 14:16:22.350526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1855/3445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:21 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:22.372168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:22.372871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:22.412906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.413415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.413858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:22.428214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.428817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.429333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:22.510612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6e642246-f716-42e4-9b46-865972d52987 req-3aeec1d6-8886-453d-89fa-f231ddb32414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad59dc7-a973-4081-865e-d78516739534", "tag": "48cb9f57-d0ac-4800-bd93-316a639464f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:22.553822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:22.562792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6e642246-f716-42e4-9b46-865972d52987 req-3aeec1d6-8886-453d-89fa-f231ddb32414 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.564836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6e642246-f716-42e4-9b46-865972d52987 req-3aeec1d6-8886-453d-89fa-f231ddb32414 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.566269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6e642246-f716-42e4-9b46-865972d52987 req-3aeec1d6-8886-453d-89fa-f231ddb32414 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:22.605068 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6e642246-f716-42e4-9b46-865972d52987 req-3aeec1d6-8886-453d-89fa-f231ddb32414 service nova] Creating event network-changed:48cb9f57-d0ac-4800-bd93-316a639464f8 for instance aad59dc7-a973-4081-865e-d78516739534 on n-h1-863052-1 Oct 31 14:16:22.619198 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6e642246-f716-42e4-9b46-865972d52987 req-3aeec1d6-8886-453d-89fa-f231ddb32414 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114428 Oct 31 14:16:22.629992 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1856/3446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:22.643302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.657357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.671181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:22.676540 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f546695-bee3-4375-9206-d23158c0d24f tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.328542 Oct 31 14:16:22.681454 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1591/3447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:22 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:22.938589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:22.939311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:22.963303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.966067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.972954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:22.975172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:22.977524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:22.978680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:23.038203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:23.039474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:23.062075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:23.062613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:23.063055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:23.063768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:23.064410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:23.065022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:23.666157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:23.681562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4478189e-fbac-4e8c-89a8-7a976a757e9e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 0.753998 Oct 31 14:16:23.688512 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1857/3448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:22 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:23.704271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:23.705680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:23.728732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:23.731269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:23.734070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:23.735017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:23.735715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:23.738195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:23.892888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:23.907618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:23.913949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:23.916568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-432fd8cd-0275-4237-b070-78e7b9e2aa42 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.226623 Oct 31 14:16:23.920342 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1858/3449] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:23 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:23.926857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:23.927705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:23.960853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:23.963664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:23.964394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:23.967302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:23.967974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:23.969334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:24.137511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:24.149364 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4332ac8e-6a59-4a12-9812-a3f421076ccd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 1.115613 Oct 31 14:16:24.152877 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1592/3450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:23 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:24.158511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:24.159712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:24.166645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:24.176210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:24.180416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:24.181384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:24.182805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:24.185045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:24.394446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:24.409731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f33b199-2d06-4e7e-9471-a7b16d84a605 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.487083 Oct 31 14:16:24.411029 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1859/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:23 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:24.442827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:24.455629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:24.461356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:24.466779 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09a04e93-82dc-49a0-9442-32e04da37587 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.310558 Oct 31 14:16:24.467813 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1593/3452] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:24 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:24.713336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:24.714102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:24.733776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:24.735165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:24.735787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:24.736704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:24.737320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:24.738606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:24.950785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:24.951411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:24.959971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:24.960476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:24.960920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:24.961625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:24.966847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:24.967566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.326202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:25.342724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:25.344701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:25.346269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-026a2793-e9fc-49c1-a77f-e805f48c24aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.399807 Oct 31 14:16:25.355279 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1594/3453] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:24 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:16:25.360904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:25.361720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:25.376006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:25.376971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:25.382938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.384011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:25.384649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:25.385270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.415860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:25.436189 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51cf8756-5ec0-49a9-b5e6-bd30d930fb06 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 0.721116 Oct 31 14:16:25.436969 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1860/3454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:24 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:25.451641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:25.461110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:25.464286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:25.484434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:25.484944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:25.485392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.486105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:25.486770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:25.487384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.522415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:25.779652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:25.793595 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69674dc3-ce6e-4135-963f-4e41affd9152 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.350588 Oct 31 14:16:25.794615 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1861/3455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:25 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:25.815744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:25.818916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:25.858576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:25.859081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:25.859525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.862957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:25.867286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:25.867915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:25.872340 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f5e5e17-f365-41cd-9eed-d003a7a19710 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.515196 Oct 31 14:16:25.873535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:25.882197 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1595/3456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:25 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:26.011162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.024139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.026074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.028904 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-422b5196-112d-4236-a8e0-b371bcd3bb6d tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.232518 Oct 31 14:16:26.031843 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1862/3457] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:25 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:26.390817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:26.393104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:26.412633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.413562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.414274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.415232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.415910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.416560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.460931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:26.461936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:26.469429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.474771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.476164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.480893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.484117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.484833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.636127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.646913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.648711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.649984 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7bda6dd0-fe4f-4b5f-a1a3-7247a64197aa tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.264680 Oct 31 14:16:26.670681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1596/3458] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:26 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:26.808138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:26.823359 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef18e543-36f2-48aa-832c-d5937f7e3c55 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 0.362948 Oct 31 14:16:26.825523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:26.826147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:26.839085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.841199 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1863/3459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:26 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:26.841633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.842296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.847442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.848164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.848794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.907410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:26.908025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:26.918214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.919057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.930915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:26.932042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:26.934650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:26.935342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:27.770943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:27.784033 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f831418-124e-4ced-b7a5-1a013026dc01 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1543 microversion: 2.1 time: 0.880393 Oct 31 14:16:27.788677 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1864/3460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:26 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1543 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:27.859618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:28.209975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.225726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.227232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.231742 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6992cdb3-37a2-499a-931e-80f3f48482e6 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.441816 Oct 31 14:16:28.238777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1865/3461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:27 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:28.260713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:28.261344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:28.271913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:28.272415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:28.272860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:28.273577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:28.274100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:28.280962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:28.281267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.298159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84963ca5-6823-41ae-846e-c841dabd91ce tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 1.475711 Oct 31 14:16:28.316093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1597/3462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:26 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:28.329152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:28.335287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:28.348657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:28.349346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:28.349897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:28.352254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:28.355446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:28.356641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:28.480195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.489487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.491409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:28.492744 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b68292da-8141-4dad-ae63-4047b525385e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.252806 Oct 31 14:16:28.493407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1866/3463] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:28 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:28.882218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:28.883850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:28.895019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:28.897909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:28.898684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:28.899675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:28.910357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:28.912250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:29.345771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:29.360889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2e1ab530-5e32-468a-9aa7-dce3d67d9bcf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 1.043450 Oct 31 14:16:29.362856 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1598/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:28 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:29.376709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:29.391921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:29.406159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:29.406801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:29.407243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:29.408032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:29.418485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:29.419506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:29.814745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:29.832386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:29.834592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:29.836417 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20e8a064-174a-4942-8824-2b8f42f55d36 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1365 microversion: 2.57 time: 0.471720 Oct 31 14:16:29.837234 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1599/3465] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:29 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1365 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:29.856223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:29.857897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:29.868409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:29.869282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:29.870227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:29.871726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:29.877217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:29.878005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:29.917524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:30.180934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:30.198264 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e71b0420-c35a-4be6-a281-7da7827c0f2d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1542 microversion: 2.1 time: 1.319661 Oct 31 14:16:30.205368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1867/3466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:28 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1542 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:30.216530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:30.226653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:30.239399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:30.242762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:30.243499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:30.244721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:30.247403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:30.248386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:30.417371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:30.430328 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aaef19ed-916f-4532-a5dd-d61e127fda3a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.590061 Oct 31 14:16:30.430932 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1600/3467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:29 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:30.435200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:30.440804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:30.441421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:30.454001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:30.456415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:30.458795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f999a0be-5fac-4149-9be3-b8c597bbe8f9 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.251537 Oct 31 14:16:30.461388 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1868/3468] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:30 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:30.484816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:30.484816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:30.485523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:30.485992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:30.500772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:30.501322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:30.871311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:30.872212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:30.884633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:30.885432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:30.886043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:30.895483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:30.896234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:30.896878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:31.075902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:31.088701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:31.104344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:31.111958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbcff10b-1d6b-420a-9968-772d386bd4e2 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1371 microversion: 2.57 time: 0.245273 Oct 31 14:16:31.120784 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1869/3469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:30 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:31.139683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "name": "network-vif-unplugged", "status": "completed", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:31.208107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:31.212786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:31.216580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:31.298042 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] Creating event network-vif-unplugged:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h2-863052-1 Oct 31 14:16:31.331285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:16:31.376849 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-96937d36-3075-43a3-9d9e-b145231443fc req-b2cbca7c-319d-48e8-9ec2-3e67e1e4d40b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.251545 Oct 31 14:16:31.383956 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1870/3470] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:31.409282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:31.410185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:31.435486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:31.435991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:31.436433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:31.447239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:31.447751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:31.449640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:31.955012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:31.964335 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c9d3b17-de12-4b69-bdb0-af1ffb37d6c5 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 1.532308 Oct 31 14:16:31.986897 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1601/3471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:30 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:32.003905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:32.006112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:32.020433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:32.028019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:32.028682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:32.030590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:32.031479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:32.033011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:32.033946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:32.417099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.426562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e82dafa8-ccfe-43d9-9570-4628a17846ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1542 microversion: 2.1 time: 1.041243 Oct 31 14:16:32.442321 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1871/3472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:31 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1542 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:32.447287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:32.447910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:32.500627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:32.501508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:32.502137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:32.504105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:32.506065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:32.508772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:32.611429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.625135 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab8e3469-13f7-4411-acd0-2b811932ff4c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.636657 Oct 31 14:16:32.632477 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1602/3473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:31 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:32.644488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:32.647608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:32.664967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:32.666935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:32.668731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:32.670937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:32.673646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:32.674438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:32.715036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.733369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.738758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.744257 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc2e9cf8-72e8-4c98-bb15-988ce0283e93 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.297999 Oct 31 14:16:32.747132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1872/3474] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:32 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:32.857648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.867373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.880637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:32.885380 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e90eb190-d747-4284-936c-3be64b2aa459 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1371 microversion: 2.57 time: 0.250473 Oct 31 14:16:32.895351 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1603/3475] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:32 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:33.000941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:33.001733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:33.017007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:33.019714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:33.020415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:33.022335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:33.025401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:33.026121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:33.455891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:33.457316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:33.501660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:33.503112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:33.503914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:33.504836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:33.514910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:33.522638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:33.572962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:33.596502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c9e16fe-8a2e-4ae8-990f-4638a296aab1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 0.600314 Oct 31 14:16:33.597699 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1873/3476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:32 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:33.659489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:33.660345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:33.669712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:33.672683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:33.673213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:33.674007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:33.677025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:33.677728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.081789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.090870 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc5cc689-42a9-45d3-acbf-4e15bd7bdc65 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.435689 Oct 31 14:16:34.110297 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1874/3477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:33 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:34.122461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:34.141445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:34.192162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.196640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.199385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.200700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.204432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.205155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.361030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.376100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.378097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.379658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b993205c-8443-4f9f-b889-3cfea12aaee2 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.267364 Oct 31 14:16:34.384604 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1875/3478] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:34 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:34.398015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:34.429579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.432955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.436902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.458806 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] Creating event network-changed:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h2-863052-1 Oct 31 14:16:34.481316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:16:34.513508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cf9f92f7-c703-4a9a-8740-01f0d959eccb req-6e36c0cd-6b9d-426f-a64e-fb96defd2224 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114413 Oct 31 14:16:34.514779 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1876/3479] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:34.520286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:34.525756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:34.550729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.555092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.560195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.564392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.568777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.570056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.572747 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ccffa3b-16ab-4f1d-82da-26a436119039 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1542 microversion: 2.1 time: 1.121861 Oct 31 14:16:34.573494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.578811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1604/3480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:33 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1542 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:34.622637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:34.623568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:34.634531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.635333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.635958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.637042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.637684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.638451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.791171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.805724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.810096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:34.812835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cbe8cc5e-d34f-4115-b3f4-c330e7c6a4ce tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1356 microversion: 2.57 time: 0.296673 Oct 31 14:16:34.837878 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1877/3481] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:34 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1356 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:34.851172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:34.855071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:34.871301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.872256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.873045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.874044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:34.874749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:34.875390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:34.951979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:16:34.959517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:35.100422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9e7595c-2e1a-4f1f-9992-9bc0e971d3af tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 204 len: 0 microversion: 2.57 time: 0.254515 Oct 31 14:16:35.101604 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1878/3482] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:16:34 2022] DELETE /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:16:35.487536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-325532619", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:35.568355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] validate_networks() for [('4ba95cfb-590b-49d0-914f-f806450d616c', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:16:35.853752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:35.867136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04e8ec3f-b706-47a3-b036-3f2f0eab3173 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 1.250709 Oct 31 14:16:35.893978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1605/3483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:34 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:35.900089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:35.923338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:35.950411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:35.951388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:35.952104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:35.954900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:35.955709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:35.956550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:36.422050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:36.436924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:36.445492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:36.447522 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-185ba773-189c-4cfc-a696-95d8b3eaa408 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1362 microversion: 2.57 time: 0.551474 Oct 31 14:16:36.453128 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1606/3484] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:35 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:36.469147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:36.485786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:36.502727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:36.503350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:36.504003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:36.507229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:36.509564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:36.510101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:36.872240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:16:36.872892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:16:36.873313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:16:36.873934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:16:36.874555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:16:36.899341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:36.901483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:36.902225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:36.904037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:36.907536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:36.908180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:36.976978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Getting quotas for project c7d422f9bf004e6cb67d83e88cc86792. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:16:36.984284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Getting quotas for user c0e9cce9c3724edabaa98cd00078355d and project c7d422f9bf004e6cb67d83e88cc86792. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:16:37.026800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:16:37.029711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:16:37.173978 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5dbea22-d739-4f12-a624-781f5f16a957 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.070909 Oct 31 14:16:37.175666 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1879/3485] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:16:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:16:37.181526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-eead5b2a-ba40-478b-9416-ee5cdddfba14 req-b6e29fcd-47a8-4ea4-8398-935b257a8884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad59dc7-a973-4081-865e-d78516739534", "name": "network-vif-plugged", "status": "completed", "tag": "48cb9f57-d0ac-4800-bd93-316a639464f8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:37.222416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eead5b2a-ba40-478b-9416-ee5cdddfba14 req-b6e29fcd-47a8-4ea4-8398-935b257a8884 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:37.223256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eead5b2a-ba40-478b-9416-ee5cdddfba14 req-b6e29fcd-47a8-4ea4-8398-935b257a8884 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:37.224178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eead5b2a-ba40-478b-9416-ee5cdddfba14 req-b6e29fcd-47a8-4ea4-8398-935b257a8884 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:37.314782 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-eead5b2a-ba40-478b-9416-ee5cdddfba14 req-b6e29fcd-47a8-4ea4-8398-935b257a8884 service nova] Creating event network-vif-plugged:48cb9f57-d0ac-4800-bd93-316a639464f8 for instance aad59dc7-a973-4081-865e-d78516739534 on n-h1-863052-1 Oct 31 14:16:37.333111 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-eead5b2a-ba40-478b-9416-ee5cdddfba14 req-b6e29fcd-47a8-4ea4-8398-935b257a8884 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154296 Oct 31 14:16:37.334935 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1880/3486] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:37.351001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:37.354937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:37.376983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:37.376983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:37.377360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:37.381033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:37.382820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:37.383976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:37.997629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.007533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.015754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.018987 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bbdb9ee-8777-49c5-a881-609e9bb9abb1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.682384 Oct 31 14:16:38.020279 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1881/3487] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:37 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:38.035236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:38.036107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:38.052741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.053955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.054636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.055627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.059982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.060678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.079227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.091591 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ae82574-93d0-445d-89a7-4208ce6bda7b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 1.635899 Oct 31 14:16:38.095905 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1607/3488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:36 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:38.113868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:38.120406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:38.141413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.150620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.151366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.152937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.157294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.158798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.565813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.575485 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdad174b-bb20-466c-b199-8d3aad629e57 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1474 microversion: 2.1 time: 0.552903 Oct 31 14:16:38.579465 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1882/3489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:38 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1474 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:38.594861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:38.595741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:38.612281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.613188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.613851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.614862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.615584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.616234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.696123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.743440 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad817bf6-c9f0-4b80-8914-fd02f037155f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1308 microversion: 2.1 time: 0.634880 Oct 31 14:16:38.748311 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1608/3490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:38 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:38.768151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:38.769370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:38.778153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.778879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.779537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.780425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.781134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.781738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.883927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:38.885286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:38.895007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:38.900727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:38.906206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lazy-loading 'fault' on Instance uuid 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:16:38.920003 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-958eb757-dd77-4c35-a659-af56d934b4d9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1226 microversion: 2.1 time: 0.335932 Oct 31 14:16:38.922583 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1883/3491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:38 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1226 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:39.052188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:39.053753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:39.066603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.069235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.070531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.071791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.072689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.073400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.177922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.194238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.196119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '829479b263ee49ecb49356967c54a0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3159df582fdb4aa7a2ebf683eed4248b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.197902 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5fce4c73-e0d9-4934-b3b3-33452a7aea90 tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 200 len: 1367 microversion: 2.57 time: 0.441580 Oct 31 14:16:39.199773 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1609/3492] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:38 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:39.205178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:39.206050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:39.213039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.213753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.214954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.215885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.216607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.217362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.328174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.350186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.356119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.364434 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5962d8e-6a99-45f2-aaba-4c4f73f4c467 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.316716 Oct 31 14:16:39.365966 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1884/3493] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:39 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:16:39.609173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:39.613250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:39.642040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.644903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.649515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.653984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.653984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.655956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.818602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:39.837222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17d13519-0088-4a61-90af-eb1c0c3ae95e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.635819 Oct 31 14:16:39.837938 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1610/3494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:39 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:39.855253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:39.856173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:39.869017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.870068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.871301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:39.872306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:39.872946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:39.878149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:40.489880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:40.509139 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93bb1aa5-56c7-477b-a4eb-25023b0bac6a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1488 microversion: 2.1 time: 0.669614 Oct 31 14:16:40.514630 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1611/3495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:39 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1488 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:40.533922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:40.535657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:40.575003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:40.577484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:40.581428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:40.584002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:40.592362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:40.593316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:40.906287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:40.918910 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31b2cb85-04a2-431b-8206-cb4b8b8323d9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1471 microversion: 2.1 time: 1.317849 Oct 31 14:16:40.920365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1885/3496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:39 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1471 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:40.929610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:40.932593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:40.934693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] [instance: 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:40.942155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b259509b-fe22-44f6-86c0-eaf638fbf3c2 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1292 microversion: 2.1 time: 0.422786 Oct 31 14:16:40.947539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:40.948246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:40.951100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1612/3497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:40 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1292 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:40.951723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:40.952647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:40.953279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:40.953858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:40.971420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:40.973384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:40.986998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] HTTP exception thrown: Instance 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 could not be found. Oct 31 14:16:40.987267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Request method failure captured: Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 HTTP/1.1 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9iZ-vHOwYbms0W0jU8c3eJPNBH8Dtmp-NGrQn8ormdSik0rWxyBIkZx9Uk2tHWogstTC7P2YJ3abanqIc6OgtrwjLTe_HYW0nAg8rpqeXJZogLC5IoiZj-Wbm-QwLS6dQhCpISTuTSh0PxugvnkIgAEzNV7ggg-19e1gM-loAM4CEo Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.57 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 3159df582fdb4aa7a2ebf683eed4248b Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerShowV257Test-535315380 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3159df582fdb4aa7a2ebf683eed4248b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3159df582fdb4aa7a2ebf683eed4248b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3159df582fdb4aa7a2ebf683eed4248b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3159df582fdb4aa7a2ebf683eed4248b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerShowV257Test-535315380 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 3159df582fdb4aa7a2ebf683eed4248b Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerShowV257Test-535315380 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerShowV257Test-535315380-project Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 829479b263ee49ecb49356967c54a0d3 Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerShowV257Test-535315380-project Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 could not be found. Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1'} Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 could not be found. Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 could not be found. Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:40.989139 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 could not be found. Oct 31 14:16:40.994324 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:16:40.995341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:40.998198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:40.998585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] Returning 404 to user: Instance 2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:16:41.001171 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8e43849-44dc-4e14-a485-e08964c17f9a tempest-ServerShowV257Test-535315380 tempest-ServerShowV257Test-535315380-project] 10.222.0.27 "GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1" status: 404 len: 111 microversion: 2.57 time: 0.078171 Oct 31 14:16:41.001785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.002910 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1886/3498] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:40 2022] GET /compute/v2.1/servers/2b72fbfd-a740-45d6-b2c5-9a17e90b8bc1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:16:41.006906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.007233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.024093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:41.030547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:41.045632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.054814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.057448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.062140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.064631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.065311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.160247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:16:41.291489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:41.312635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:41.317416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:41.325453 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73445411-304e-4eb7-b83f-ac1296f9fa98 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.373096 Oct 31 14:16:41.326451 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1613/3499] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:40 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:41.347027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:41.348253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:41.389999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.391209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.393587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.394664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.399010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.399856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.453009 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98f5ced6-a331-43b0-8b3a-1713de51e728 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 204 len: 0 microversion: 2.1 time: 0.448650 Oct 31 14:16:41.460131 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1887/3500] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:16:41 2022] DELETE /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:16:41.486271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:41.487015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:41.512433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.513382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.517254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.521092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.523476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.525025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.579907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.580732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.581417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.582601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.583304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.584360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.614457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:16:41.622046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for user 4d15f804765e48e3a279a902cde38dec and project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:16:41.641566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:41.832082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b76a707d-5780-4f82-a1ee-de1135fb4e54 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c/action" status: 202 len: 0 microversion: 2.1 time: 0.370501 Oct 31 14:16:41.836076 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1888/3501] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:16:41 2022] POST /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:16:41.841918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:41.842664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:41.850388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.850854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.851299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:41.852094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:41.852559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:41.852987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.248432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:42.260716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d6ef09b-bb5b-4224-a0cb-64a77a0cc560 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.932365 Oct 31 14:16:42.262866 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1614/3502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:41 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:42.273747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:42.274690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:42.290927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:42.291696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:42.292423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.293347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:42.293996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:42.294642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.407707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:42.418898 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2549d680-c6ea-451e-894b-85e859e6ed8b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1494 microversion: 2.1 time: 0.581526 Oct 31 14:16:42.421873 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1889/3503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:41 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1494 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:42.430648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:42.431666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:42.452302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:42.453753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:42.455642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.457337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:42.457479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:42.460000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.701628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:42.715728 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adb11d4f-e460-4dc8-8c5d-bdbb599c77d7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1280 microversion: 2.1 time: 0.289596 Oct 31 14:16:42.718245 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1890/3504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:42 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1280 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:42.732562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:42.734722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:42.755519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:42.756032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:42.756483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.760410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:42.763887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:42.764745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:42.831860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:43.036858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:43.048818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:43.060855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:43.068956 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dda2efa8-e84f-4b26-96dd-938c37e15924 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1408 microversion: 2.54 time: 0.348395 Oct 31 14:16:43.073111 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1891/3505] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:42 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:43.291832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:43.293253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:43.319687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:43.320193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:43.320641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:43.321354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:43.321816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:43.322298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:43.432411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:43.447845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-61b8f719-e345-41e0-8b31-3c8335f12a8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1470 microversion: 2.1 time: 1.176241 Oct 31 14:16:43.452555 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1615/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:42 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1470 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:43.472284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:43.476675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:43.505064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:43.514379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:43.514942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:43.516015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:43.517165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:43.517622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:44.709815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:44.713644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:44.721889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df62d6c6-cd95-42b6-a562-d71bdc03c26f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1494 microversion: 2.1 time: 1.267542 Oct 31 14:16:44.742785 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1616/3507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:43 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1494 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:44.749856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:44.763428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:44.788814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:44.796171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:44.805458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:44.805995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:44.806784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:44.807252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:44.808426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:44.830732 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-573559e9-cea7-4c2d-ab54-7f66a9e0cf12 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 1.539757 Oct 31 14:16:44.845587 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1892/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:43 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:44.853517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:44.855931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:44.868832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:44.869957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:44.889041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:44.891914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:44.894675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:44.896787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:45.179427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:45.188990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:45.196197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:45.197747 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-289c3a37-d53c-4b53-bbd2-7c0c8e138c18 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1414 microversion: 2.54 time: 0.360425 Oct 31 14:16:45.224727 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1893/3509] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:44 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1414 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:45.237013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:45.239557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:45.264073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:45.264846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:45.265459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:45.266420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:45.274189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:45.274947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:45.614766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:45.626026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-950e3856-2626-4b11-85ea-457a9ffa331b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1470 microversion: 2.1 time: 0.397430 Oct 31 14:16:45.639933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1894/3510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:45 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:45.653876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "name": "network-vif-plugged", "status": "completed", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:45.687027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:45.687894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:45.688591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:45.724461 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] Creating event network-vif-plugged:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h2-863052-1 Oct 31 14:16:45.742837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:16:45.772671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2196e511-debe-4e1b-a87b-4bb282d63225 req-14aded02-7c3d-47a4-b956-9f5f9c47d80c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131270 Oct 31 14:16:45.773556 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1895/3511] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:45.781811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:45.788196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:45.830231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:45.830883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:45.833003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:45.835334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:45.837197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:45.840440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:46.946388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:46.960652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-996a4c59-72fd-492b-93bf-83b6442ff4fd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 2.215917 Oct 31 14:16:46.963744 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1617/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:44 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:46.978545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:46.981049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:46.996710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:46.997495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:46.998138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:47.000058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:47.003143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:47.003855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:47.021798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:47.066586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:47.075224 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2fd742d-0762-48b2-a6c7-b189daafea27 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1494 microversion: 2.1 time: 1.297573 Oct 31 14:16:47.078075 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1896/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:45 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1494 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:47.088526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:47.090983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:47.108536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:47.110266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:47.110911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:47.112077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:47.114409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:47.115347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:47.362358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:47.384395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:47.389312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:47.392529 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3b9535d-c9fe-4039-b4ac-7d7be1232e4d tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1414 microversion: 2.54 time: 0.312703 Oct 31 14:16:47.397722 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1897/3514] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:47 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1414 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:47.410868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:47.411725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:47.433035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:47.434922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:47.438897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:47.440741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:47.442239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:47.444262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:47.952052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:47.961809 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d772e68-aa24-45a5-b056-3088f24babfb tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1470 microversion: 2.1 time: 0.559994 Oct 31 14:16:47.964928 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1898/3515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:47 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1470 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:47.984302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:47.986076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:47.998636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:47.999480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:48.001633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:48.005520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:48.006463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:48.007101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:48.200387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:48.219034 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f83594d5-ceb2-481e-8790-5ccadad8033a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 1.249068 Oct 31 14:16:48.221918 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1618/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:46 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:48.252237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:48.253251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:48.283701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:48.287901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:48.289245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:48.290328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:48.293131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:48.303234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:48.600471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:48.613474 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcb6ca3d-dc48-4151-a8ed-77f7646fd6dc tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 0.633409 Oct 31 14:16:48.626249 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1899/3517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:47 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:48.647516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:48.663465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:48.691815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:48.700126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:48.702077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:48.704402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:48.707798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:48.711288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:49.179001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:49.199784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbc22f46-00c4-4efc-8988-0ddafb3fc38e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 200 len: 1452 microversion: 2.1 time: 0.975900 Oct 31 14:16:49.202516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1619/3518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:48 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 1452 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:49.212995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:49.214428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:49.240654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:49.253384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:49.254111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:49.256715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:49.257445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:49.258065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:49.774491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:49.786936 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bf13f6c-815b-4e54-8390-1cce3d49589e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1470 microversion: 2.1 time: 0.581558 Oct 31 14:16:49.789140 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1620/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:49 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1470 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:49.813603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a024237b-1b89-4d91-8ee8-6eb92cbfc0bc req-7ce85440-3f2f-4719-a599-03ab5c16a121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad59dc7-a973-4081-865e-d78516739534", "name": "network-vif-deleted", "tag": "48cb9f57-d0ac-4800-bd93-316a639464f8"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:49.847778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a024237b-1b89-4d91-8ee8-6eb92cbfc0bc req-7ce85440-3f2f-4719-a599-03ab5c16a121 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:49.849786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a024237b-1b89-4d91-8ee8-6eb92cbfc0bc req-7ce85440-3f2f-4719-a599-03ab5c16a121 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:49.850474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a024237b-1b89-4d91-8ee8-6eb92cbfc0bc req-7ce85440-3f2f-4719-a599-03ab5c16a121 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:49.883045 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a024237b-1b89-4d91-8ee8-6eb92cbfc0bc req-7ce85440-3f2f-4719-a599-03ab5c16a121 service nova] Creating event network-vif-deleted:48cb9f57-d0ac-4800-bd93-316a639464f8 for instance aad59dc7-a973-4081-865e-d78516739534 on n-h1-863052-1 Oct 31 14:16:49.884371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:49.892504 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a024237b-1b89-4d91-8ee8-6eb92cbfc0bc req-7ce85440-3f2f-4719-a599-03ab5c16a121 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101035 Oct 31 14:16:49.893414 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1621/3520] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:49.899082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:49.899908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:49.907814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:49.908115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:49.908770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:49.909282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:49.909616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:49.910516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:49.911138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:49.911722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:49.941140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d79b04cf-8e41-4179-8473-2c54bcf1573b tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1399 microversion: 2.54 time: 1.282523 Oct 31 14:16:49.943870 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1900/3521] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:48 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1399 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:49.978082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:49.988722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:49.997300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.013682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.022017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.023088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.030454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.032701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.540194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:50.549602 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a590eb48-9ebd-4675-9ee5-0bab29b3b389 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.654983 Oct 31 14:16:50.554444 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1622/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:49 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:50.584412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f2a8f33-27b9-41aa-9861-3309aa23b23e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '.version_select at 0x7fe10c5c4310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:50.632976 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f2a8f33-27b9-41aa-9861-3309aa23b23e tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-316950259" status: 204 len: 0 microversion: 2.54 time: 0.065430 Oct 31 14:16:50.634316 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1623/3523] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-316950259 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:16:50.640926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:50.641851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:50.653781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.654385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.655146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.655926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.656753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.657175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.679831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 HTTP/1.1 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'aad59dc7-a973-4081-865e-d78516739534'} Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:50.681959 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:50.687205 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:50.687205 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:50.687205 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:16:50.687205 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:16:50.687205 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:16:50.687205 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:50.688373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:16:50.689426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ea6ad0b-1e0c-47b0-b303-9ecdd7a52aaf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 404 len: 111 microversion: 2.1 time: 0.053683 Oct 31 14:16:50.690542 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1624/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:50 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:16:50.696285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:50.697158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:50.704887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.705387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.705825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.706587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.707224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.708737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.774959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:16:50.915006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:50.921409 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72965d5d-432b-408d-84c1-b55ba11759d1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 204 len: 0 microversion: 2.54 time: 0.229058 Oct 31 14:16:50.926308 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1625/3525] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:16:50 2022] DELETE /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:16:50.926951 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b7321ef-ccc9-42c4-9fda-1ba540abd9a4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 0.976430 Oct 31 14:16:50.927736 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1901/3526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:49 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:50.932905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:50.933521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:50.943550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.944250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.945433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:50.946862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:50.947758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:50.948236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c950ebf6-6edf-4aa2-b32d-9d0d3d2bfadf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10c205c10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:50.950001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.576746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:51.603358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83a1deb8-4594-41d2-b41e-b321d69bfc79 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1470 microversion: 2.1 time: 0.672533 Oct 31 14:16:51.607798 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1902/3527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:50 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1470 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:51.619982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:51.628719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:51.634408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:51.643791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.645441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.646139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.647310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.648156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.648785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.793324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:51.808258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:51.809836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:51.811140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e38abfb1-2535-4e81-908b-a205c10ab8ed tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1405 microversion: 2.54 time: 0.201752 Oct 31 14:16:51.811662 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1903/3528] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:51 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:51.834530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:51.837209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:51.849020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.849519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.853823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.856172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.858856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.859999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.936455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c950ebf6-6edf-4aa2-b32d-9d0d3d2bfadf tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 204 len: 0 microversion: 2.1 time: 1.008316 Oct 31 14:16:51.937204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1626/3529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:50 2022] DELETE /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 0 bytes in 1010 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:16:51.944129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-92b0ac05-6f52-405a-83de-4b97c1fdf304 req-4c99bc5e-c411-4b48-9e0c-ac070488fa99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:51.956115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-92b0ac05-6f52-405a-83de-4b97c1fdf304 req-4c99bc5e-c411-4b48-9e0c-ac070488fa99 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.956766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-92b0ac05-6f52-405a-83de-4b97c1fdf304 req-4c99bc5e-c411-4b48-9e0c-ac070488fa99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.957318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-92b0ac05-6f52-405a-83de-4b97c1fdf304 req-4c99bc5e-c411-4b48-9e0c-ac070488fa99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.972002 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-92b0ac05-6f52-405a-83de-4b97c1fdf304 req-4c99bc5e-c411-4b48-9e0c-ac070488fa99 service nova] Creating event network-changed:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:16:51.977209 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-92b0ac05-6f52-405a-83de-4b97c1fdf304 req-4c99bc5e-c411-4b48-9e0c-ac070488fa99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038654 Oct 31 14:16:51.978276 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1627/3530] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:51.985703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:51.986595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:51.993248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.993985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.994884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:51.996279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:51.996789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:51.997216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:52.023855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:16:52.138809 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-742c2d41-b06b-4fec-b068-9ff8f957b8f1 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 204 len: 0 microversion: 2.1 time: 0.158412 Oct 31 14:16:52.141097 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1628/3531] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:16:51 2022] DELETE /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:16:52.148543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:52.149561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:52.157626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:52.158379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:52.161243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:52.163246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:52.164143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:52.165079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:52.270334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:52.280796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-098c2349-3f78-42d4-ad89-241350bcae1f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.468028 Oct 31 14:16:52.300646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1904/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:51 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:52.367030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-73485249", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:52.435128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] validate_networks() for [('d271b0bf-30f5-4fbc-b0cd-2fd244ac7b6a', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:16:52.580798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:52.596645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cc10296-8471-46f6-b088-9bc07f0c7051 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 0.453572 Oct 31 14:16:52.600790 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1629/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:52 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:52.645899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:52.648740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:52.677336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:52.679201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:52.679680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:52.683267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:52.684136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:52.686204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:53.221341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:53.249787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-252d94dc-aa0a-4818-b217-42c39656e92b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1470 microversion: 2.1 time: 0.616462 Oct 31 14:16:53.255738 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1630/3534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:52 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1470 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:16:53.275598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:53.278141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:53.291837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:53.293407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:53.294634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:53.298205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:53.299688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:53.300382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:53.402588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:53.414530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:53.415305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:53.416615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lazy-loading 'fault' on Instance uuid 4097b54a-daa6-4272-ae01-907e62acd775 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:16:53.497109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:53.522965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:53.527041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d6ee3a4433c426cb37fb9be425dc5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369bbea55ce84e34b936c80aa4ad2e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:53.530386 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8705f5a-23c5-4244-b406-4a3f1f96dbe0 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 200 len: 1410 microversion: 2.54 time: 0.273164 Oct 31 14:16:53.533997 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1631/3535] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:53 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 1410 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:16:53.569899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:53.593660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:53.609739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:53.617630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:53.618241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:53.619234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:53.620352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:53.621011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:54.042451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:16:54.042899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:16:54.043196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:16:54.045289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:16:54.045914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:16:54.065278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:54.067867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:54.069546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:54.070575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:54.074806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:54.075463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:54.137164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:16:54.155241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Getting quotas for user ec707d34966e44aa93900eebc62a6a93 and project d17ea27a1dc44bb3b2c4a9d12913a829. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:16:54.187345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:16:54.193606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:16:54.333475 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc73107e-3158-4097-b37a-8d47334d741f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.970303 Oct 31 14:16:54.336358 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1905/3536] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:16:54.351033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:54.351912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:54.367131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:54.368140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:54.368791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:54.369947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:54.371172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:54.371842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:55.094632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:55.102779 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcdb05ed-1994-4e46-acfe-c93cf29adcc4 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 0.765139 Oct 31 14:16:55.103463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1906/3537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:54 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:55.137009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:55.139492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:55.170490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:55.173119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:55.175945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:55.180401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:55.182464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:55.185626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:55.254621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:55.266631 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f9c21aa5-6003-4eff-a120-ca2efd5b1842 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1506 microversion: 2.1 time: 1.697142 Oct 31 14:16:55.278814 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1632/3538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:53 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1506 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:55.689951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:55.690659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:55.710833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:55.711547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:55.712009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:55.717318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:55.717821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:55.722542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:56.055562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:56.063869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:56.083207 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77803886-eba9-476e-8bd4-36941d1775f3 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1202 microversion: 2.1 time: 0.803169 Oct 31 14:16:56.103133 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1633/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:55 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1202 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:56.115374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:56.126595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] [instance: 4097b54a-daa6-4272-ae01-907e62acd775] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:56.157014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:56.158754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:56.163113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:56.164121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:56.164824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:56.165488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:56.211884 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] HTTP exception thrown: Instance 4097b54a-daa6-4272-ae01-907e62acd775 could not be found. Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Request method failure captured: Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 HTTP/1.1 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ikSEbzexMB8TCUMQjlNRaolWIS9UHqXtlsZmqZHa2fIsUY_lFXs7fEjhdbR1nCcr-b51qhe19YpjKlidpkKz2A3trRM_hD7UXmgho89yso6fPfOJ6kF46yO50RT_KWwYIFAh8q3_B7NkR9el7Au8ruMBmFBM0I8lhIFEplxUjaSGc Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.54 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 369bbea55ce84e34b936c80aa4ad2e8f Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerShowV254Test-1432635208 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_369bbea55ce84e34b936c80aa4ad2e8f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/369bbea55ce84e34b936c80aa4ad2e8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/369bbea55ce84e34b936c80aa4ad2e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/369bbea55ce84e34b936c80aa4ad2e8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerShowV254Test-1432635208 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 369bbea55ce84e34b936c80aa4ad2e8f Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerShowV254Test-1432635208 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerShowV254Test-1432635208-project Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 6d6ee3a4433c426cb37fb9be425dc5d4 Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerShowV254Test-1432635208-project Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 4097b54a-daa6-4272-ae01-907e62acd775 could not be found. Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '4097b54a-daa6-4272-ae01-907e62acd775'} Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4097b54a-daa6-4272-ae01-907e62acd775 could not be found. Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4097b54a-daa6-4272-ae01-907e62acd775 could not be found. Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:16:56.219875 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4097b54a-daa6-4272-ae01-907e62acd775 could not be found. Oct 31 14:16:56.224359 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:16:56.225932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] Returning 404 to user: Instance 4097b54a-daa6-4272-ae01-907e62acd775 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:16:56.227041 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5bc41429-1c34-4774-adf6-80badfaa52e1 tempest-ServerShowV254Test-1432635208 tempest-ServerShowV254Test-1432635208-project] 10.222.0.27 "GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775" status: 404 len: 111 microversion: 2.54 time: 0.122473 Oct 31 14:16:56.231173 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1634/3540] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:16:56 2022] GET /compute/v2.1/servers/4097b54a-daa6-4272-ae01-907e62acd775 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:16:56.244138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:56.245928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:56.253688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:56.257671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:56.265656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:56.268523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:56.272028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:56.274068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:56.437305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:56.450472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1547f77a-2b24-4ca3-ad79-5e0aa3aab71b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1536 microversion: 2.1 time: 1.345975 Oct 31 14:16:56.472877 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1907/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:55 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1536 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:56.501331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:56.510796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:56.532569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:56.533267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:56.533878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:56.535626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:56.537004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:56.538693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:57.292748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:57.300549 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6126f961-502c-4fe2-97ae-50d4851a76ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 1.068039 Oct 31 14:16:57.303975 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1635/3542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:56 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:57.314096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "name": "network-vif-unplugged", "status": "completed", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:57.343660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:57.344143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:57.344563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:57.370702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] Creating event network-vif-unplugged:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h1-863052-1 Oct 31 14:16:57.384087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:16:57.411104 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-19105417-a0d1-4af9-868d-6e97315b744e req-ea8046fe-1b56-4a00-a8d1-486ae0907f1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105598 Oct 31 14:16:57.412336 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1636/3543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:57.418125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:57.431223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:57.438551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:57.439713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:57.439713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:57.440596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:57.450934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:57.451614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:57.460649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:57.468628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:57.474090 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3568f632-9375-412c-ac44-921ac47ed2a2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1506 microversion: 2.1 time: 1.000068 Oct 31 14:16:57.488341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1908/3544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:56 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1506 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:57.509582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:57.511012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:57.524159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:57.529606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:57.530059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:57.530820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:57.531276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:57.531704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:57.669975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:57.678210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33aaa484-ecf2-4991-b3b3-6d7feb8e89cb tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1264 microversion: 2.1 time: 0.264424 Oct 31 14:16:57.691459 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1637/3545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:57 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:58.332475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:58.333942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:58.343966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:58.349143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:58.349949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:58.351227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:58.351900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:58.352545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:58.693699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:58.702644 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f3a3055-6e33-429f-90f5-04578efffac0 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1536 microversion: 2.1 time: 1.212901 Oct 31 14:16:58.707035 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1909/3546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:57 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1536 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:58.723870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:58.724777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:58.741477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:58.747909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:58.748603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:58.749902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:58.751210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:58.751658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:59.412712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:59.429505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07b9fa8f-8ec2-45d4-986a-09c8a53436ac tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1506 microversion: 2.1 time: 0.718566 Oct 31 14:16:59.431956 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1910/3547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:58 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:59.463868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:16:59.466894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:16:59.489750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:59.493403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:59.494706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:59.500089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:59.503891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:59.504898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:59.759001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:16:59.775608 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11563f86-b6d8-4ae3-a0ae-71116004b2f6 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1264 microversion: 2.1 time: 0.331647 Oct 31 14:16:59.776725 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1911/3548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:59 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1264 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:16:59.798502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2223a4dc-8896-445e-b5ef-64df0f7a5c7f req-f0d959ad-abbc-4039-adaa-4919b6e389f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1925eb40-8126-4dfb-a83e-41260a763185", "name": "network-vif-unplugged", "status": "completed", "tag": "8ee5c5f5-e47c-4164-8101-26618575bed4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:59.839608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2223a4dc-8896-445e-b5ef-64df0f7a5c7f req-f0d959ad-abbc-4039-adaa-4919b6e389f3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:59.840118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2223a4dc-8896-445e-b5ef-64df0f7a5c7f req-f0d959ad-abbc-4039-adaa-4919b6e389f3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:59.840768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2223a4dc-8896-445e-b5ef-64df0f7a5c7f req-f0d959ad-abbc-4039-adaa-4919b6e389f3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:59.899934 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2223a4dc-8896-445e-b5ef-64df0f7a5c7f req-f0d959ad-abbc-4039-adaa-4919b6e389f3 service nova] Creating event network-vif-unplugged:8ee5c5f5-e47c-4164-8101-26618575bed4 for instance 1925eb40-8126-4dfb-a83e-41260a763185 on n-h1-863052-1 Oct 31 14:16:59.919392 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2223a4dc-8896-445e-b5ef-64df0f7a5c7f req-f0d959ad-abbc-4039-adaa-4919b6e389f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123409 Oct 31 14:16:59.922999 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1912/3549] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:16:59.934413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:16:59.958501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:16:59.959402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:16:59.960672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:16:59.992990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] Creating event network-changed:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h1-863052-1 Oct 31 14:17:00.005872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:17:00.066065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0b5ef16b-f02b-4c17-a886-b4d0940e714a req-24f8214d-be75-47d3-8ccf-9844d538bc94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141216 Oct 31 14:17:00.069677 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1913/3550] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:00.080482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:00.084663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:00.124575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:00.125346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:00.126034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:00.127959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:00.129409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:00.143439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:00.428418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:00.438553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-844a3949-ca06-41d9-a566-b2ae08ffed31 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 2.110495 Oct 31 14:17:00.448443 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1638/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:16:58 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:00.462324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a630d05a-d9f0-497b-92c2-b3bdabeb3a20 req-e6bde64b-1dec-4ed3-8799-6168fedca05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4544a4-f791-409a-9f34-20bdb10acfc3", "name": "network-vif-deleted", "tag": "052e069f-ff62-4302-bf3c-acfe4326beea"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:00.500307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a630d05a-d9f0-497b-92c2-b3bdabeb3a20 req-e6bde64b-1dec-4ed3-8799-6168fedca05c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:00.502218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a630d05a-d9f0-497b-92c2-b3bdabeb3a20 req-e6bde64b-1dec-4ed3-8799-6168fedca05c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:00.505478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a630d05a-d9f0-497b-92c2-b3bdabeb3a20 req-e6bde64b-1dec-4ed3-8799-6168fedca05c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:00.543604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a630d05a-d9f0-497b-92c2-b3bdabeb3a20 req-e6bde64b-1dec-4ed3-8799-6168fedca05c service nova] Creating event network-vif-deleted:052e069f-ff62-4302-bf3c-acfe4326beea for instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 on n-h1-863052-1 Oct 31 14:17:00.570548 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a630d05a-d9f0-497b-92c2-b3bdabeb3a20 req-e6bde64b-1dec-4ed3-8799-6168fedca05c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118019 Oct 31 14:17:00.573885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1639/3552] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:00.591302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:00.603395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:00.618065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:00.618907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:00.620346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:00.631176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:00.642236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:00.643185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:01.186384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:01.198019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c646bd42-dc9a-4604-bc3b-70f6adab2905 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1536 microversion: 2.1 time: 1.126798 Oct 31 14:17:01.200993 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1914/3553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:00 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1536 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:01.217512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:01.218634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:01.232701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:01.233580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:01.234585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:01.248538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:01.249430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:01.250430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:01.403525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:01.415416 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 200 len: 1509 microversion: 2.1 time: 0.836710 Oct 31 14:17:01.416564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1640/3554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:00 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 1509 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:01.418523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:01.420491 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b32cc38-e00c-4469-b2cd-f127f5cfb1df tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002182 Oct 31 14:17:01.421921 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1641/3555] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 31 14:17:01 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 14:17:01.457614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:01.461347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:01.480203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:01.485018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:01.485739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:01.489363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:01.490927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:01.491548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:02.267200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:02.297313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:02.321685 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f75bbb9-53e5-40d9-b16f-ce49c5e84b4f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.872187 Oct 31 14:17:02.325532 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1642/3556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:01 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:02.337378 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-625c4c7c-04b1-4e4d-98da-b7514fbd8d3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 1.134461 Oct 31 14:17:02.350060 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1915/3557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:01 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:02.365685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:02.370475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:02.379012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:02.380601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:02.381261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:02.381911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:02.386717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:02.387522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:02.388143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:02.398639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:02.399289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:02.465418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:02.466479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:02.468302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:02.469454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:02.471538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:02.478868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:03.373263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:03.382737 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5b67360-44c4-4674-b8a5-720e3ee992dd tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 1.055722 Oct 31 14:17:03.407444 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1643/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:02 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:03.415163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:03.425050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:03.451134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:03.452086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:03.452768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:03.453758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:03.454458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:03.455122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:03.731207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:03.742982 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d77e8c34-806b-42dc-a030-4e6585cf34a3 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1536 microversion: 2.1 time: 1.391481 Oct 31 14:17:03.749134 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1916/3559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:02 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1536 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:03.754696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-12526757-8102-436b-b56f-28df024c757a req-f1d1d28a-9f94-4969-9e58-ce72efee5f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "name": "network-vif-plugged", "status": "completed", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:03.781238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12526757-8102-436b-b56f-28df024c757a req-f1d1d28a-9f94-4969-9e58-ce72efee5f3b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:03.784430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12526757-8102-436b-b56f-28df024c757a req-f1d1d28a-9f94-4969-9e58-ce72efee5f3b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:03.790136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12526757-8102-436b-b56f-28df024c757a req-f1d1d28a-9f94-4969-9e58-ce72efee5f3b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:03.821577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-12526757-8102-436b-b56f-28df024c757a req-f1d1d28a-9f94-4969-9e58-ce72efee5f3b service nova] Creating event network-vif-plugged:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:17:03.837201 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-12526757-8102-436b-b56f-28df024c757a req-f1d1d28a-9f94-4969-9e58-ce72efee5f3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086321 Oct 31 14:17:03.838555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1917/3560] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:03.851351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:03.853212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:03.879790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:03.883000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:03.883652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:03.886478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:03.890783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:03.891451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:04.115061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:04.175629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:04.230930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:04.263017 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa987339-5fd8-4e62-95fb-4556926a4f1e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.853942 Oct 31 14:17:04.299206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1644/3561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:03 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:04.327726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:04.328530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:04.360653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:04.368878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:04.369730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:04.370423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:04.370940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:04.371313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:05.015551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:05.033354 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c696bfb-6986-4b03-8099-5afa45e115db tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.726221 Oct 31 14:17:05.034888 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1645/3562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:04 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:05.059487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:05.061594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:05.075717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:05.076233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:05.076682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:05.077496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:05.077859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:05.078328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:05.577691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:05.599750 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a9c4d73-8ce9-470d-b641-a996b9d97e37 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1322 microversion: 2.1 time: 0.559511 Oct 31 14:17:05.602055 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1646/3563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:05 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:05.609907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:05.615087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:05.625968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:05.630491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:05.631298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:05.635968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:05.636760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:05.637391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.153787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:06.172959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9fd5f076-ea7f-4ead-b0e1-c6aac0ca29ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1529 microversion: 2.1 time: 0.567444 Oct 31 14:17:06.188146 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1647/3564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:05 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1529 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:06.211648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:06.215441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:06.227732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.228244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.231404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.232182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.232655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.236160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.413829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:06.439938 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19b1fd45-6a5a-4c04-9bc2-b2b04d1313d8 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 2.599394 Oct 31 14:17:06.464480 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1918/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:03 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 2625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:06.477501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16b71502-a438-4267-add2-f7cd4e915510 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Action: 'create', calling method: .version_select at 0x7fe106623280>, body: {"keypair": {"name": "tempest-keypair-998249687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEH0aPuc05+3ZYNAUqBwoJfi6xJc2uczeyN6WeQ3KUfhOCQ7k6cOSlFYYJYkJXiumW8FoqYwc+Zx336Dc4PkMK+mo5cVzaQbJYyV3oAXTwtuZrXQMIrEf0T1DfCRe+KiA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:06.540504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-16b71502-a438-4267-add2-f7cd4e915510 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Getting quotas for project da7c5476c60a47c6a49c9b0e556d4fc7. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:06.553814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:06.555928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-16b71502-a438-4267-add2-f7cd4e915510 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Getting quotas for user 906b646261334b8fa6f8dddaace2b8ba and project da7c5476c60a47c6a49c9b0e556d4fc7. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:06.570396 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-59a21d61-e8f3-4051-bbb0-f338f7b3cac9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.380869 Oct 31 14:17:06.571367 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1648/3566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:06.576894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:06.582684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:06.591073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.591859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.592473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.593367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.593989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.594600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.649547 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16b71502-a438-4267-add2-f7cd4e915510 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.182345 Oct 31 14:17:06.651399 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1919/3567] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:17:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:17:06.664686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ca4224b-04df-4718-bb97-34d388d7a3b6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:06.675574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ca4224b-04df-4718-bb97-34d388d7a3b6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.676405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ca4224b-04df-4718-bb97-34d388d7a3b6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.677008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ca4224b-04df-4718-bb97-34d388d7a3b6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.732675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ca4224b-04df-4718-bb97-34d388d7a3b6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Going to try to stop instance {{(pid=120640) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:17:06.847987 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ca4224b-04df-4718-bb97-34d388d7a3b6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.194862 Oct 31 14:17:06.849131 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1920/3568] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:06 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:06.856324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:06.857267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:06.871102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.871805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.872370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.873202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.873759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.874699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.882488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:06.893531 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8f8ee08-ef3c-46ab-b351-54109f56f456 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1529 microversion: 2.1 time: 0.320349 Oct 31 14:17:06.897670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1649/3569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:06 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1529 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:06.908668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:06.915850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:06.926810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.931253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.931921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:06.933089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:06.942744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:06.943283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:07.371712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:07.383302 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebe7d9ed-2fb6-4355-b5d2-579b557bc9c9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.484046 Oct 31 14:17:07.393103 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1650/3570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:07.400647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ef5322c-ff22-4925-9d85-410a14ee08a8 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:07.418831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-8ef5322c-ff22-4925-9d85-410a14ee08a8 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] HTTP exception thrown: Flavor 5407d20c-913a-481b-ba1d-def0218a245c could not be found. Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ef5322c-ff22-4925-9d85-410a14ee08a8 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Request method failure captured: Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/flavors/5407d20c-913a-481b-ba1d-def0218a245c HTTP/1.1 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ffbPMV51uHILMK43pNXnKDCdaF8Ld7CcNZw_1J8Zr9COGVpOpINPEJk3E9FJ8NdWWx4MQ28--41CnNQT18KRE-zmrMaqfR30Jb_94qon5ELw6rZnXPeNtinca8fFBaiiQqdAMSpMRNbkN690qpkCnmDF8m2MLk2CN6ej8PwlXsVro Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 2dcc3f4c72f6453dad21d46f19cabe16 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MigrationsAdminTest-1978107119 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2dcc3f4c72f6453dad21d46f19cabe16", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2dcc3f4c72f6453dad21d46f19cabe16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2dcc3f4c72f6453dad21d46f19cabe16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2dcc3f4c72f6453dad21d46f19cabe16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MigrationsAdminTest-1978107119 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 2dcc3f4c72f6453dad21d46f19cabe16 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MigrationsAdminTest-1978107119 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MigrationsAdminTest-1978107119-project-admin Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 38260ec4f3224dbab9150b268c3e4ad7 Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MigrationsAdminTest-1978107119-project-admin Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: exception: Flavor 5407d20c-913a-481b-ba1d-def0218a245c could not be found. Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '5407d20c-913a-481b-ba1d-def0218a245c'} Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5407d20c-913a-481b-ba1d-def0218a245c could not be found. Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5407d20c-913a-481b-ba1d-def0218a245c could not be found. Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:07.470563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5407d20c-913a-481b-ba1d-def0218a245c could not be found. Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ef5322c-ff22-4925-9d85-410a14ee08a8 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Returning 404 to user: Flavor 5407d20c-913a-481b-ba1d-def0218a245c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ef5322c-ff22-4925-9d85-410a14ee08a8 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/5407d20c-913a-481b-ba1d-def0218a245c" status: 404 len: 109 microversion: 2.1 time: 0.078248 Oct 31 14:17:07.479952 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1651/3571] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:07 2022] DELETE /compute/v2.1/flavors/5407d20c-913a-481b-ba1d-def0218a245c => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:07.481547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:07.482519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:07.495990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:07.503839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:07.504409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:07.505170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:07.509659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:07.510952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:07.901459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:07.909597 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40d9de21-e9bc-4658-9541-44e32d7d3c43 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.431616 Oct 31 14:17:07.910219 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1652/3572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:07 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:07.930044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3190579e-837f-4255-8e07-5d2422970c39 req-aafd931b-c405-4e05-873e-c7db6e4ef013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d17fc9b-f241-4e91-8612-a72e12b7f3da", "tag": "594b9949-8049-4499-b070-fb4e215fdb61"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:07.958884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3190579e-837f-4255-8e07-5d2422970c39 req-aafd931b-c405-4e05-873e-c7db6e4ef013 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:07.960147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3190579e-837f-4255-8e07-5d2422970c39 req-aafd931b-c405-4e05-873e-c7db6e4ef013 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:07.962695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3190579e-837f-4255-8e07-5d2422970c39 req-aafd931b-c405-4e05-873e-c7db6e4ef013 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:08.050587 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3190579e-837f-4255-8e07-5d2422970c39 req-aafd931b-c405-4e05-873e-c7db6e4ef013 service nova] Creating event network-changed:594b9949-8049-4499-b070-fb4e215fdb61 for instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da on n-h2-863052-1 Oct 31 14:17:08.075466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3190579e-837f-4255-8e07-5d2422970c39 req-aafd931b-c405-4e05-873e-c7db6e4ef013 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155520 Oct 31 14:17:08.079206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1653/3573] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:08.090370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1459336698", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:08.221291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:17:08.953941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:17:08.955946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:17:08.958928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:17:08.964298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:17:08.964969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:17:09.003809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.006339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.007019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.009820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.013563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.014145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.055244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:09.065024 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1174021-2a98-4707-8a0a-98ca6f227c5f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1517 microversion: 2.1 time: 2.214252 Oct 31 14:17:09.078347 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1921/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:06 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1517 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:09.084876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:09.088491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:09.092882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:09.098412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.098980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.099426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.100313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.101032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.101553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.108144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Getting quotas for user 4d15f804765e48e3a279a902cde38dec and project c06d65a7e2c9401bbbc2ca5f9999dd4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:09.134763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:17:09.139146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:17:09.198957 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24b4da73-c32a-4f73-bdf0-32f2877c30b5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116400 Oct 31 14:17:09.201224 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1654/3575] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:17:09.207301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:09.208247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:09.216569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.217422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.218131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.219221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.219888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.220523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.254251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.510883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:09.527377 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-268e3eef-4b4a-4b38-9a81-d5c4eba7fd69 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.321557 Oct 31 14:17:09.529854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1655/3576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:09 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:09.549690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:09.560287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:09.586607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:09.593532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.594122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.596749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.602544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.603103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.603465 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-391fba54-8c5b-4412-96fb-c85106dae4d6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.528614 Oct 31 14:17:09.603605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.607088 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1922/3577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:09 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:09.615677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86eedc81-8a46-40e7-9d43-75da2f2fa780 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:09.616377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86eedc81-8a46-40e7-9d43-75da2f2fa780 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:09.639418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.671017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lazy-loading 'flavor' on Instance uuid a46e9c75-491d-4fcf-bb2b-8a48c41c30df {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:17:09.830675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2887241-03ca-4653-bf84-6e6fd0e145e3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action" status: 200 len: 32 microversion: 2.1 time: 0.298608 Oct 31 14:17:09.831481 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1656/3578] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:09 2022] POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:17:09.846353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:09.851117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:09.869994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.872645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.873339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.879317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:09.880080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:09.880728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:09.956879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86eedc81-8a46-40e7-9d43-75da2f2fa780 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:09.966439 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86eedc81-8a46-40e7-9d43-75da2f2fa780 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1213 microversion: 2.1 time: 0.357926 Oct 31 14:17:09.969931 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1923/3579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:09 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1213 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:10.284034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-77f633fe-0794-4b4a-8f79-0089f4415c6c req-01bf96c0-16a5-4b51-b846-542242bbce01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "name": "network-vif-plugged", "status": "completed", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:10.304287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-77f633fe-0794-4b4a-8f79-0089f4415c6c req-01bf96c0-16a5-4b51-b846-542242bbce01 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:10.312033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-77f633fe-0794-4b4a-8f79-0089f4415c6c req-01bf96c0-16a5-4b51-b846-542242bbce01 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:10.312646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-77f633fe-0794-4b4a-8f79-0089f4415c6c req-01bf96c0-16a5-4b51-b846-542242bbce01 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:10.332555 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-77f633fe-0794-4b4a-8f79-0089f4415c6c req-01bf96c0-16a5-4b51-b846-542242bbce01 service nova] Creating event network-vif-plugged:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h1-863052-1 Oct 31 14:17:10.344027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-77f633fe-0794-4b4a-8f79-0089f4415c6c req-01bf96c0-16a5-4b51-b846-542242bbce01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064381 Oct 31 14:17:10.349135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1924/3580] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:17:10.540182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:10.551842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-058867ea-1e9e-4b5b-9b8e-77cd09f24724 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.713182 Oct 31 14:17:10.558119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:10.558870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:10.562425 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1657/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:09 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:10.567680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:10.572396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:10.573702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:10.582540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:10.583299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:10.583934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:10.628000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:10.628807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:10.641666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:10.642179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:10.650213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:10.651002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:10.651473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:10.651894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:11.130969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:11.139992 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c401c59e-e607-4e7b-a31b-ccbf6f74f8dc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.515712 Oct 31 14:17:11.147692 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1658/3582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:10 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:11.167876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:11.172040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:11.186417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:11.189470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:11.190104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:11.194926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:11.195629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:11.196244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:11.398638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:11.410901 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57d04b73-72da-4b2d-a0a5-3b0a7b6f713f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1265 microversion: 2.1 time: 0.260075 Oct 31 14:17:11.422565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1659/3583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:11 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:11.428003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-196946919", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3ff1f5f0-a3fc-4ae8-9cfb-56b07f61655a"}, {"port": "c2c07023-6238-41fb-90f2-bec97e1ade9a", "tag": "port-1"}, {"port": "4a922957-3bba-4585-9ade-2133f2cb8147", "tag": "port-2"}, {"uuid": "5b70f79d-4fe3-4d80-8e68-1e5df28f904e", "tag": "net-1"}, {"uuid": "5b70f79d-4fe3-4d80-8e68-1e5df28f904e"}, {"uuid": "e9ffdb7a-5666-498b-b79f-58ab3823d327", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e9ffdb7a-5666-498b-b79f-58ab3823d327", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6a1f0c04-e628-4db1-a5df-eb4800cb7fe8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9e5b85da-dcfb-4b48-a6d7-b676d81ca140", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "876e0c10-20a9-4f05-b95c-046948a603a6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1724334332"}], "key_name": "tempest-keypair-998249687", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:11.624796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:11.637139 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0aab7b76-744d-4015-895c-142848ff1982 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 1.083518 Oct 31 14:17:11.637973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1925/3584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:10 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:17:11.656189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:11.657180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:11.667582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:11.668454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:11.669317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:11.670091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:11.670650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:11.671141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:11.746117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] validate_networks() for [('3ff1f5f0-a3fc-4ae8-9cfb-56b07f61655a', None, None, None, None, None), (None, None, 'c2c07023-6238-41fb-90f2-bec97e1ade9a', None, None, None), (None, None, '4a922957-3bba-4585-9ade-2133f2cb8147', None, None, None), ('5b70f79d-4fe3-4d80-8e68-1e5df28f904e', None, None, None, None, None), ('5b70f79d-4fe3-4d80-8e68-1e5df28f904e', None, None, None, None, None), ('e9ffdb7a-5666-498b-b79f-58ab3823d327', '10.2.2.100', None, None, None, None), ('e9ffdb7a-5666-498b-b79f-58ab3823d327', '10.2.2.200', None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:17:12.362573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:12.375695 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eaf7b549-31c2-4960-a306-669b4a9e721e tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.735912 Oct 31 14:17:12.383085 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1926/3585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:11 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:12.398015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:12.400444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:12.425497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:12.429385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:12.432760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:12.434569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:12.436357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:12.437062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:12.852381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:12.866815 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.481737 Oct 31 14:17:12.867658 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1927/3586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:12 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:12.869885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:12.871091 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d415b09d-b248-4c5e-ab6b-6600d54de1ec tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001715 Oct 31 14:17:12.879404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1928/3587] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 31 14:17:12 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 14:17:12.888899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:12.894180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:12.912941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:12.913835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:12.914526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:12.915441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:12.916148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:12.917405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:13.081926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:13.084514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:13.104486 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07b3b6f5-b57b-46a1-8a30-f26a2ecdbf26 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1271 microversion: 2.1 time: 0.223351 Oct 31 14:17:13.105987 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1929/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:12 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:13.115337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:13.116877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:13.123456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:13.124308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:13.124963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:13.125882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:13.126580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:13.127216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:13.838516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:13.847408 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-305da4be-4d44-4ad6-b2fd-70e6fa323531 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.739642 Oct 31 14:17:13.849933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1930/3589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:13 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:13.866725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:13.868113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:13.887409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:13.888266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:13.888924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:13.889848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:13.890516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:13.892099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:14.283892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:14.383729 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9cc7b527-1eae-4e8d-aed3-6067f39e07ca tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.529840 Oct 31 14:17:14.388650 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1931/3590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:13 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:14.404339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:14.412045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:14.435191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:14.439518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:14.440024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:14.441103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:14.443045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:14.449487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:14.787944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:14.797210 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c89cbfa-8fe5-4900-b6ef-b867d05c4940 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.397831 Oct 31 14:17:14.800228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1932/3591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:14 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:14.817036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:14.818128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:14.829381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:14.830299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:14.830978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:14.834153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:14.834952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:14.835649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:15.091999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:15.107068 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0efdcb53-300d-41de-a7ec-9c0deb6fbf71 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.301071 Oct 31 14:17:15.112752 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1933/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:14 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:15.132155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:15.134720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:15.152123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:15.155298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:15.156185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:15.157537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:15.160129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:15.162099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:15.663941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:15.676212 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d65f8282-b14b-4c4a-83f6-3e6c9a4663d9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.557908 Oct 31 14:17:15.677105 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1934/3593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:15 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:15.694394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:15.695664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:15.708419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:15.709073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:15.714136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:15.715345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:15.715989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:15.716592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:16.095834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:16.137518 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9c1bbdb-ac4c-47ca-b33b-8edc09c64e84 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.457387 Oct 31 14:17:16.141344 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1935/3594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:15 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:16.162358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:16.163375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:16.177137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:16.180612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:16.184191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:16.186239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:16.189583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:16.190140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:16.428433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:16.439828 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30d31290-3e0f-4c60-8e8e-f518608acbd7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1678 microversion: 2.1 time: 0.294513 Oct 31 14:17:16.442338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1936/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:16 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1678 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:16.450337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:16.457088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:16.468771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:16.472859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:16.473439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:16.474313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:16.478693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:16.479806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:16.837571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:16.853450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63ac610f-f778-4f57-a463-3c91c2b60717 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.409778 Oct 31 14:17:16.856047 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1937/3596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:16 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:16.871296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:16.872047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:16.890160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:16.892211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:16.894418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:16.901755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:16.902922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:16.903607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:17.428648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:17.441066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56f62191-ff9f-4d17-a2e5-ed6c1fda864e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.581935 Oct 31 14:17:17.459685 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1938/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:16 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:17.466087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:17.467046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:17.474741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:17.475506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:17.476227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:17.477112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:17.477719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:17.478455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:17.949266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:17.963955 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7353c13a-9926-4955-924a-dab7b57c12fe tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.502112 Oct 31 14:17:17.964483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1939/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:17 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:17.986113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:17.991664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:17.999491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:18.000254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:18.001019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:18.001888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:18.002525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:18.003715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:18.303820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:18.319028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bea05fde-a5b5-4b3c-9456-c7c7381f70a9 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1655 microversion: 2.1 time: 0.346326 Oct 31 14:17:18.319832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1940/3599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:17 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1655 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:18.337166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:18.339039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:18.364038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:18.365197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:18.366683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:18.368514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:18.370088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:18.372734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:19.065473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:19.095857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:19.113303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66add8ae-1183-4c78-a129-58d7c95e3c0d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.789678 Oct 31 14:17:19.117261 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1941/3600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:18 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:19.127410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:19.141454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91c8e6f4-4919-463d-b918-0af223370471 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:19.164529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c8e6f4-4919-463d-b918-0af223370471 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:19.165030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c8e6f4-4919-463d-b918-0af223370471 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:19.165694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c8e6f4-4919-463d-b918-0af223370471 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:19.223740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91c8e6f4-4919-463d-b918-0af223370471 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 14:17:19.307420 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91c8e6f4-4919-463d-b918-0af223370471 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.179912 Oct 31 14:17:19.308699 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1942/3601] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:19 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:19.330853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:19.342741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:19.384007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:19.386387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:19.386840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:19.387587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:19.388043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:19.388468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:19.966493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:20.082602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:20.092830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a15d3a12-d548-4452-a417-63f584d0afde tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.771962 Oct 31 14:17:20.098194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1943/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:19 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:20.105913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-08d7399e-ed5c-406a-8dd8-2700f0172665 req-14cc3fe3-530e-4a85-98f7-52378822e1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d17fc9b-f241-4e91-8612-a72e12b7f3da", "name": "network-vif-plugged", "status": "completed", "tag": "594b9949-8049-4499-b070-fb4e215fdb61"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:20.149395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-08d7399e-ed5c-406a-8dd8-2700f0172665 req-14cc3fe3-530e-4a85-98f7-52378822e1b4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:20.150062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-08d7399e-ed5c-406a-8dd8-2700f0172665 req-14cc3fe3-530e-4a85-98f7-52378822e1b4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:20.151276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-08d7399e-ed5c-406a-8dd8-2700f0172665 req-14cc3fe3-530e-4a85-98f7-52378822e1b4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:20.176716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-08d7399e-ed5c-406a-8dd8-2700f0172665 req-14cc3fe3-530e-4a85-98f7-52378822e1b4 service nova] Creating event network-vif-plugged:594b9949-8049-4499-b070-fb4e215fdb61 for instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da on n-h2-863052-1 Oct 31 14:17:20.187870 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-08d7399e-ed5c-406a-8dd8-2700f0172665 req-14cc3fe3-530e-4a85-98f7-52378822e1b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085601 Oct 31 14:17:20.189271 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1944/3603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:20.221169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-18017feb-20a0-4806-95e2-1be3113001d3 req-8d3267fc-b40c-4f6c-9495-9111da9f5057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:20.264671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18017feb-20a0-4806-95e2-1be3113001d3 req-8d3267fc-b40c-4f6c-9495-9111da9f5057 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:20.270842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18017feb-20a0-4806-95e2-1be3113001d3 req-8d3267fc-b40c-4f6c-9495-9111da9f5057 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:20.271481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18017feb-20a0-4806-95e2-1be3113001d3 req-8d3267fc-b40c-4f6c-9495-9111da9f5057 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:20.314708 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-18017feb-20a0-4806-95e2-1be3113001d3 req-8d3267fc-b40c-4f6c-9495-9111da9f5057 service nova] Creating event network-changed:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h1-863052-1 Oct 31 14:17:20.328140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-18017feb-20a0-4806-95e2-1be3113001d3 req-8d3267fc-b40c-4f6c-9495-9111da9f5057 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137217 Oct 31 14:17:20.339786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1945/3604] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:20.349638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:20.350657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:20.369175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:20.369175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:20.369175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:20.369175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:20.383012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:20.383512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:20.688530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:20.690841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:20.703162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f262b917-f5a8-4345-af51-759cfbecb059 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.361247 Oct 31 14:17:20.721826 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1946/3605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:20 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:20.732791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:20.733779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:20.742513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:20.743315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:20.743971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:20.745195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:20.745881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:20.746563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:20.996209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:21.008419 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87ed7b9e-1662-431c-af2b-a6fba4fae137 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1664 microversion: 2.1 time: 0.284491 Oct 31 14:17:21.010707 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1947/3606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:20 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1664 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:21.016220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:21.017073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:21.023373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.024216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.024883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.025893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.026606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.027275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.188560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:17:21.190838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:17:21.191618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:17:21.194873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:17:21.195583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:17:21.209379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.209982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.214750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.215912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.216513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.217065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.260186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Getting quotas for project da7c5476c60a47c6a49c9b0e556d4fc7. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:21.263514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:21.270102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Getting quotas for user 906b646261334b8fa6f8dddaace2b8ba and project da7c5476c60a47c6a49c9b0e556d4fc7. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:21.271965 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07f24071-6907-4032-9d22-7c9c7f825011 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.259893 Oct 31 14:17:21.275778 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1948/3607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:21 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:21.286986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:21.287602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:21.300676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.301175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.301749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.303222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.303804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.304227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.499781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:17:21.502624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6a1f0c04-e628-4db1-a5df-eb4800cb7fe8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9e5b85da-dcfb-4b48-a6d7-b676d81ca140',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='876e0c10-20a9-4f05-b95c-046948a603a6',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:17:21.779478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:21.787679 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbc473f8-cb17-48b4-ab80-b5d1eb0b6cd9 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1306 microversion: 2.1 time: 0.510209 Oct 31 14:17:21.792103 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1949/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:21 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1306 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:21.816072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:21.818118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:21.831710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.832633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.833276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:21.835332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:21.838361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:21.839147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:22.170520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:22.182389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0b140d9-702c-4e35-954b-294c9041ff4f tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.387821 Oct 31 14:17:22.195833 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1950/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:21 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:22.224173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:22.225151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:22.242464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:22.243393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:22.244124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:22.245338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:22.247164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:22.247846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:22.313009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ad43328-60ff-41ee-9537-5e7c1777479e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 10.889261 Oct 31 14:17:22.314933 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1660/3610] 10.222.0.27 () {62 vars in 1189 bytes} [Mon Oct 31 14:17:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 10892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:17:22.320979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:22.322046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:22.329516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:22.330671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:22.331373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:22.332356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:22.333049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:22.333717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:22.783440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:22.791969 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0747f2ab-5b9f-4aaf-bcb4-eed80fa96303 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.474986 Oct 31 14:17:22.795075 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1661/3611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:22 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:22.799963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1256331e-62c0-417c-9b2d-360da8ce7ebf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:22.807419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1256331e-62c0-417c-9b2d-360da8ce7ebf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:22.925059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1256331e-62c0-417c-9b2d-360da8ce7ebf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:22.940929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1256331e-62c0-417c-9b2d-360da8ce7ebf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:22.945092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1256331e-62c0-417c-9b2d-360da8ce7ebf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:22.958080 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1256331e-62c0-417c-9b2d-360da8ce7ebf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1284 microversion: 2.32 time: 0.154703 Oct 31 14:17:22.960750 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1662/3612] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:22 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:22.985006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:22.988112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:23.013381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.015558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.018651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.025096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.027247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.028250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.379512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:23.391712 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ca968b4-87a0-408b-9425-e01d936e0ba2 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1487 microversion: 2.1 time: 0.427253 Oct 31 14:17:23.408359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1663/3613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:22 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1487 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:23.430431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:23.430553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:23.441077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:23.446998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.447550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.447997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.450567 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d41c8bda-ccdf-440c-b7ea-3ed327420c82 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 1.253322 Oct 31 14:17:23.454249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.454820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.455275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.455434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1951/3614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:22 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:23.465475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-326346009"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:23.477472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:23.505845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.506375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.506818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.507526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.507978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.512537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.924776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:23.933538 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74e9af74-f9c2-4c0d-b73b-da7132087ba0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.519247 Oct 31 14:17:23.937357 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1664/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:23 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:23.952798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:23.953504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:23.969725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.969725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.970112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:23.971213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:23.972097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:23.972842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.028774 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78488e59-8f70-43b1-a729-0c2b17996d23 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "POST /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da/action" status: 202 len: 0 microversion: 2.1 time: 0.571736 Oct 31 14:17:24.056241 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1952/3616] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:23 2022] POST /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:17:24.075697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:24.076422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:24.111325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:24.112816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:24.112816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.118667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:24.129056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:24.129700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.302323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:24.317751 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de79a7be-6466-4a39-bb50-09c9bfed157b tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.374584 Oct 31 14:17:24.326892 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1665/3617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:23 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:24.345109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:24.345928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:24.357570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:24.364144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:24.366257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.370657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:24.373884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:24.374539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.546159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:24.556088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:24.569504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:24.570145 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-587be94f-b891-48c1-b39c-a3fedf375ee7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1518 microversion: 2.32 time: 0.241745 Oct 31 14:17:24.570776 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1666/3618] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:24 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:24.577551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d456118a-9233-41a1-9a0c-08cc93ac34df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fb86790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:24.651559 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d456118a-9233-41a1-9a0c-08cc93ac34df tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf" status: 200 len: 1411 microversion: 2.1 time: 0.079731 Oct 31 14:17:24.652787 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1667/3619] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:24 2022] GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:24.657727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:24.658387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:24.680450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:24.682698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:24.690750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.692044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:24.692703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:24.693316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:24.696212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:24.707386 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-271a3dae-c18b-4914-9580-889577c0e0ec tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.644304 Oct 31 14:17:24.711747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1953/3620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:24 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:24.718412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-120afd5b-3f7b-4dc9-9d06-f45dc699b035 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe106eab5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:24.828117 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-120afd5b-3f7b-4dc9-9d06-f45dc699b035 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf" status: 200 len: 1411 microversion: 2.1 time: 0.115005 Oct 31 14:17:24.838567 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1954/3621] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:24 2022] GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:24.851260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e2ec4ad-0253-42f1-9fb0-e0e9c01f2437 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1078b8dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:25.024205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:25.032771 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a40ff5a-5057-4e43-91ac-15a73946bdaf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.378650 Oct 31 14:17:25.037395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1668/3622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:24 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:25.059727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:25.063921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:25.082496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:25.085074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:25.088287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:25.089357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:25.091780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:25.093285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:25.162566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e2ec4ad-0253-42f1-9fb0-e0e9c01f2437 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf" status: 204 len: 0 microversion: 2.1 time: 0.321117 Oct 31 14:17:25.166846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1955/3623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:24 2022] DELETE /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:25.168824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:25.169437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:25.183539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:25.184031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:25.202564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:25.203451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:25.203953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:25.204379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:25.343813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:25.390146 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72a1a194-bafa-4c82-84db-13a0e2161fbf tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.348127 Oct 31 14:17:25.394149 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1669/3624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:25 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:25.413501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9016c59e-5800-485e-a2bd-781711bebd22 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fc6d430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:25.467301 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-9016c59e-5800-485e-a2bd-781711bebd22 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Image not found. Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9016c59e-5800-485e-a2bd-781711bebd22 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf HTTP/1.1 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'df87b8a0-49ad-4cb9-abf0-2cd7861906cf'} Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df87b8a0-49ad-4cb9-abf0-2cd7861906cf Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:17:25.496011 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df87b8a0-49ad-4cb9-abf0-2cd7861906cf could not be found. Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:17:25.503193 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:25.514752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9016c59e-5800-485e-a2bd-781711bebd22 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:25.516357 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9016c59e-5800-485e-a2bd-781711bebd22 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf" status: 404 len: 62 microversion: 2.1 time: 0.120575 Oct 31 14:17:25.527086 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1670/3625] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:25 2022] GET /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:17:25.539461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:25.540355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:25.555991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:25.557427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:25.558217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:25.559437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:25.560306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:25.560956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:25.953013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:25.961225 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51eae064-64e2-4482-ace9-d5b624162d47 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.796726 Oct 31 14:17:25.971072 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1956/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:25 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:25.984380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:25.987714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:26.008529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.009268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.011653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.012445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.012836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.013271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.167278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:26.194776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:26.196246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:26.206885 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18177122-4ddf-4f5a-9446-6da9c23601d4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1592 microversion: 2.32 time: 0.234344 Oct 31 14:17:26.213495 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1957/3627] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:25 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1592 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:26.218806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:26.223672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:26.239057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.239819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.240828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.241942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.242602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.247913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.378366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:26.394989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31495856-498d-4107-b6c4-95215f0fb92d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1505 microversion: 2.1 time: 0.865756 Oct 31 14:17:26.398868 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1671/3628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:25 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1505 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:26.408546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:26.413531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:26.425933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.432575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.433079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.439068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.439570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.440022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.506848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:26.515252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.300342 Oct 31 14:17:26.515841 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1958/3629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:26 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:26.534581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:26.535956 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78d0b72e-942d-4e65-9d01-6772551422a5 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001763 Oct 31 14:17:26.544301 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1959/3630] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 31 14:17:26 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 14:17:26.844253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b276cfa2-4a31-431f-b1db-bd27f21b2baa tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: .version_select at 0x7fe1065ef0d0>, body: {"keypair": {"name": "tempest-keypair-1705860644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEsip+DrlfujVNKYNzM3bJYYQygOj3SrT8TytfIeWtqR3BA5cZYxD4+pz/dZLxVMAukTdmaW1IeY4ZI8S8KpNxoFLQkxSNyRGobTDgasQ7jVwyHTTuSKnEO5Yys41Gzig=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:26.874489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b276cfa2-4a31-431f-b1db-bd27f21b2baa tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for project a9c77e61574c4725ac06c32c9f858560. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:26.885151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b276cfa2-4a31-431f-b1db-bd27f21b2baa tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for user 7f2e63e0b7bc4137a40010062e345b8f and project a9c77e61574c4725ac06c32c9f858560. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:26.948952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:26.951829 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b276cfa2-4a31-431f-b1db-bd27f21b2baa tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.406095 Oct 31 14:17:26.952454 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1960/3631] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:17:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:26.957164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:26.957793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:26.967249 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.564367 Oct 31 14:17:26.982041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.982863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.983498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.983972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1672/3632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:26 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:26.984651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:26.985287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:26.986595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:26.986950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:26.997585 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4e7f87f-83a8-4401-aa0b-69c7d7438780 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.010303 Oct 31 14:17:26.998197 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1673/3633] 10.222.0.27 () {54 vars in 1035 bytes} [Mon Oct 31 14:17:26 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 31 14:17:27.004710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:27.005668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:27.021442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.023300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.024061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.025804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.026693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.027376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.098605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lazy-loading 'flavor' on Instance uuid d1d5ebb5-529e-4b8b-9908-39905e0c9a9b {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:17:27.110543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:27.305092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.304940 Oct 31 14:17:27.308258 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1674/3634] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:26 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:27.311013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:27.312438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98b13b1c-122f-4bb6-8979-0cbeb21a2be7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002295 Oct 31 14:17:27.314015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1675/3635] 10.222.0.27 () {54 vars in 1041 bytes} [Mon Oct 31 14:17:27 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:27.320538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f52de889-16dc-4462-896f-f6db0d764c6f req-4cbf93d6-d432-479d-b267-0c8d8442b33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "name": "network-vif-plugged", "status": "completed", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:27.335075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f52de889-16dc-4462-896f-f6db0d764c6f req-4cbf93d6-d432-479d-b267-0c8d8442b33d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.336601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f52de889-16dc-4462-896f-f6db0d764c6f req-4cbf93d6-d432-479d-b267-0c8d8442b33d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.337526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f52de889-16dc-4462-896f-f6db0d764c6f req-4cbf93d6-d432-479d-b267-0c8d8442b33d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.354364 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f52de889-16dc-4462-896f-f6db0d764c6f req-4cbf93d6-d432-479d-b267-0c8d8442b33d service nova] Creating event network-vif-plugged:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h1-863052-1 Oct 31 14:17:27.360720 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f52de889-16dc-4462-896f-f6db0d764c6f req-4cbf93d6-d432-479d-b267-0c8d8442b33d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045140 Oct 31 14:17:27.362947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1676/3636] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:27.370070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:27.371547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:27.379845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.380994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.381712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.382726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.383710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.385309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.415979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:27.458458 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca8c9918-fb1b-4b56-890d-a372d6586b06 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.504146 Oct 31 14:17:27.460945 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1961/3637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:26 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:27.471746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:27.473773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:27.490058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.492045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.492660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.494270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.496722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.497455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.915366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:27.925077 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1676 microversion: 2.1 time: 0.462779 Oct 31 14:17:27.938398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1962/3638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:27 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1676 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:27.938398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:27.938398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29400f09-5983-457b-8492-1f13dafe579c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001153 Oct 31 14:17:27.938398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1963/3639] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 31 14:17:27 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 14:17:27.951415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:27.952042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:27.970276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.970909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.971795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:27.972524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:27.972980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:27.973454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:28.342354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:28.370254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:28.376074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:28.377662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f36380a-8c13-445f-a0eb-2419f79e8e92 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1660 microversion: 2.32 time: 1.012805 Oct 31 14:17:28.384984 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1677/3640] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:27 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1660 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:28.408415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:28.410598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:28.434357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:28.436067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:28.436622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:28.439758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:28.442677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:28.444580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:28.502867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:28.510814 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cbdc620-1605-4989-9abf-862dc2425a67 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1487 microversion: 2.1 time: 0.577256 Oct 31 14:17:28.511412 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1964/3641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:27 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1487 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:28.535288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:28.535912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:28.555169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:28.555671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:28.556116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:28.556879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:28.557339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:28.557762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.006547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:29.024092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-194f1ac6-e0c0-488a-bce1-57662ed16aac tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 0.637043 Oct 31 14:17:29.028226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1678/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:28 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:29.043041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:29.044813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:29.064219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.065978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.069364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.073647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.075011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.076305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.113698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:17:29.263582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:29.271439 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9858f46-ae4b-424d-96f0-ff538b6c3903 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 204 len: 0 microversion: 2.1 time: 0.238458 Oct 31 14:17:29.272658 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1679/3643] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:29 2022] DELETE /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:29.279468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:29.280449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:29.292045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.293947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.310737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.313029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.313709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.314456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.387711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:29.396550 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae60cc80-f497-4e8d-a884-76c0e4f0f282 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1523 microversion: 2.1 time: 0.882486 Oct 31 14:17:29.410206 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1965/3644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:28 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1523 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:29.411282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b15089a7-c734-4013-bc8c-b0bc9e9d8e6b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10662b280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:29.469010 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b15089a7-c734-4013-bc8c-b0bc9e9d8e6b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Image not found. Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b15089a7-c734-4013-bc8c-b0bc9e9d8e6b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf HTTP/1.1 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'df87b8a0-49ad-4cb9-abf0-2cd7861906cf'} Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df87b8a0-49ad-4cb9-abf0-2cd7861906cf to delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df87b8a0-49ad-4cb9-abf0-2cd7861906cf could not be found. Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.471753 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:29.477178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b15089a7-c734-4013-bc8c-b0bc9e9d8e6b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:29.479770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b15089a7-c734-4013-bc8c-b0bc9e9d8e6b tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf" status: 404 len: 62 microversion: 2.1 time: 0.074947 Oct 31 14:17:29.481499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1966/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:29 2022] DELETE /compute/v2.1/images/df87b8a0-49ad-4cb9-abf0-2cd7861906cf => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:17:29.490489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:29.491256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:29.509887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.510701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.511393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.521179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.522009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.522721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.765065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:29.777724 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-23ade9ff-0e7c-4d86-baa9-01baaac2896e tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1659 microversion: 2.1 time: 0.503404 Oct 31 14:17:29.779684 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1680/3646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:29 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1659 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:29.784648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ccc187ed-2b7c-4793-9403-3e43636a8929 req-e8afc735-7e24-4c93-a74a-72d6e106d69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d17fc9b-f241-4e91-8612-a72e12b7f3da", "name": "network-vif-plugged", "status": "completed", "tag": "594b9949-8049-4499-b070-fb4e215fdb61"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:29.823634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ccc187ed-2b7c-4793-9403-3e43636a8929 req-e8afc735-7e24-4c93-a74a-72d6e106d69f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.831116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ccc187ed-2b7c-4793-9403-3e43636a8929 req-e8afc735-7e24-4c93-a74a-72d6e106d69f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.831819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ccc187ed-2b7c-4793-9403-3e43636a8929 req-e8afc735-7e24-4c93-a74a-72d6e106d69f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.873972 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ccc187ed-2b7c-4793-9403-3e43636a8929 req-e8afc735-7e24-4c93-a74a-72d6e106d69f service nova] Creating event network-vif-plugged:594b9949-8049-4499-b070-fb4e215fdb61 for instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da on n-h2-863052-1 Oct 31 14:17:29.889823 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ccc187ed-2b7c-4793-9403-3e43636a8929 req-e8afc735-7e24-4c93-a74a-72d6e106d69f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108500 Oct 31 14:17:29.891948 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1681/3647] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:29.920396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:29.921461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:29.932532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.940763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.943736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:29.946073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:29.956123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:29.956804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:30.036577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:17:30.185073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.compute.api [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Instance is already in deleting state, ignoring this request Oct 31 14:17:30.186252 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2122bf18-7355-4d45-a6cc-7025447cb43e tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 204 len: 0 microversion: 2.1 time: 0.291985 Oct 31 14:17:30.190205 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1682/3648] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:29 2022] DELETE /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:30.204297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:30.205116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:30.214098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:30.217570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:30.218295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:30.219192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:30.222232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:30.223130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:30.269649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:30.303175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:30.308642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:30.312240 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1eb09d9d-a8b4-4f13-84cf-97c04a6da912 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1660 microversion: 2.32 time: 0.830010 Oct 31 14:17:30.315052 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1967/3649] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:29 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1660 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:30.325037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:30.338927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:30.360234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:30.360989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:30.362769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:30.363695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:30.366414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:30.367068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:30.373596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:30.407343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d1eda81-df82-419c-a8b3-412fa2933e9c tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.215651 Oct 31 14:17:30.408252 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1683/3650] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:30 2022] POST /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:30.434968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:30.435333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:30.457201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:30.457700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:30.458145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:30.458894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:30.459349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:30.459781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:31.243143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:31.378592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:31.388210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df584a83-27b1-44ab-9f60-a6bec0684141 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1493 microversion: 2.1 time: 0.978224 Oct 31 14:17:31.388794 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1684/3651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:30 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1493 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:31.417217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:31.420055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:31.433283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:31.436799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:31.437518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:31.438484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:31.439126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:31.439752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:31.628000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:31.636958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35a36bcc-4a20-4d20-8dfd-d1c33858d976 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1313 microversion: 2.1 time: 1.318888 Oct 31 14:17:31.644750 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1968/3652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:30 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1313 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:31.654399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:31.670147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:31.695183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:31.697872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:31.698485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:31.699468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:31.699892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:31.700507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:31.981060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:32.004697 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28a1577f-b2f3-464b-8965-9a69839693ab tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1665 microversion: 2.1 time: 0.593808 Oct 31 14:17:32.008344 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1685/3653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:31 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1665 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:32.021885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:32.023105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:32.034559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:32.035341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:32.035937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:32.036830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:32.037453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:32.038446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:32.716649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:32.739273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:32.741773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:32.743307 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f339c19a-0db3-45e6-8ec1-9b4e1daa8706 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1707 microversion: 2.32 time: 0.733639 Oct 31 14:17:32.756135 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1686/3654] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:32 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1707 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:32.790390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:32.792733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:32.809672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:32.810203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:32.810661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:32.811372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:32.811835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:32.812261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:32.930081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:33.269165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:33.292006 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67a1f904-0480-4700-ae21-f61fe197f359 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1503 microversion: 2.1 time: 1.635279 Oct 31 14:17:33.293082 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1969/3655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:31 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1503 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:33.314675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cc78313e-2e64-400b-9058-af74b47fef3d req-a2862583-fca4-4900-b476-44a6c5ac7243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d17fc9b-f241-4e91-8612-a72e12b7f3da", "name": "network-vif-unplugged", "status": "completed", "tag": "594b9949-8049-4499-b070-fb4e215fdb61"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:33.340502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cc78313e-2e64-400b-9058-af74b47fef3d req-a2862583-fca4-4900-b476-44a6c5ac7243 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:33.341305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cc78313e-2e64-400b-9058-af74b47fef3d req-a2862583-fca4-4900-b476-44a6c5ac7243 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:33.342090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cc78313e-2e64-400b-9058-af74b47fef3d req-a2862583-fca4-4900-b476-44a6c5ac7243 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:33.372585 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cc78313e-2e64-400b-9058-af74b47fef3d req-a2862583-fca4-4900-b476-44a6c5ac7243 service nova] Creating event network-vif-unplugged:594b9949-8049-4499-b070-fb4e215fdb61 for instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da on n-h2-863052-1 Oct 31 14:17:33.384026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cc78313e-2e64-400b-9058-af74b47fef3d req-a2862583-fca4-4900-b476-44a6c5ac7243 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073204 Oct 31 14:17:33.389902 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1970/3656] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:33.401678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:33.406886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:33.431416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:33.431976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:33.432429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:33.436938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:33.437675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:33.439619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:33.723482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec707d34966e44aa93900eebc62a6a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17ea27a1dc44bb3b2c4a9d12913a829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:33.751349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d5cec87-577b-4b38-a7f2-a31c1896316d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 200 len: 1493 microversion: 2.1 time: 0.981443 Oct 31 14:17:33.768594 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1687/3657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:32 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 1493 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:33.796386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:33.800778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:33.824588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:33.830743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:33.832076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:33.835316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:33.838000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:33.838497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:33.857130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:33.984378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:33.996578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6871f30f-aace-4a52-89cc-b5e8465e5bcd tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1463 microversion: 2.1 time: 0.602812 Oct 31 14:17:33.997550 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1971/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:33 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1463 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:34.012866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1355902468", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63bdd4f2-d320-4c7a-bb99-10f607099117"}], "security_groups": [{"name": "tempest-securitygroup--508034202"}], "key_name": "tempest-keypair-1705860644", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:34.271745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] validate_networks() for [('63bdd4f2-d320-4c7a-bb99-10f607099117', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:17:34.895020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:34.910750 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9496f2d4-8571-4a71-a24d-aee1a44c67fc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1665 microversion: 2.1 time: 1.135974 Oct 31 14:17:34.911688 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1688/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:33 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1665 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:34.937819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-614d8418-22f3-49c0-a94c-ad09ff63686b tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'create', calling method: .version_select at 0x7fe10fbd0280>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-17353402", "description": "tempest-description-221433393"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:35.194291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:17:35.195704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:17:35.196399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:17:35.197375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:17:35.197981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:17:35.200545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:35.212048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.213362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.214025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.214455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-614d8418-22f3-49c0-a94c-ad09ff63686b tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.290329 Oct 31 14:17:35.215156 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1689/3660] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:17:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:35.215553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.216359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.217066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.220074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5ec13350-b14c-47b9-969f-77c664e179a6 req-b87c3824-46f3-4137-8d24-ac98dc62adf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d17fc9b-f241-4e91-8612-a72e12b7f3da", "name": "network-vif-deleted", "tag": "594b9949-8049-4499-b070-fb4e215fdb61"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:35.240558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for project a9c77e61574c4725ac06c32c9f858560. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:35.242733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ec13350-b14c-47b9-969f-77c664e179a6 req-b87c3824-46f3-4137-8d24-ac98dc62adf0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.243205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ec13350-b14c-47b9-969f-77c664e179a6 req-b87c3824-46f3-4137-8d24-ac98dc62adf0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.247362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for user 7f2e63e0b7bc4137a40010062e345b8f and project a9c77e61574c4725ac06c32c9f858560. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:35.250434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ec13350-b14c-47b9-969f-77c664e179a6 req-b87c3824-46f3-4137-8d24-ac98dc62adf0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.267163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:17:35.282401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5ec13350-b14c-47b9-969f-77c664e179a6 req-b87c3824-46f3-4137-8d24-ac98dc62adf0 service nova] Creating event network-vif-deleted:594b9949-8049-4499-b070-fb4e215fdb61 for instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da on n-h2-863052-1 Oct 31 14:17:35.283148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:17:35.293851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5ec13350-b14c-47b9-969f-77c664e179a6 req-b87c3824-46f3-4137-8d24-ac98dc62adf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077326 Oct 31 14:17:35.294621 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1690/3661] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:35.300986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:35.302128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:35.324118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.324811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.325958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.327182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.327754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.328752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.372558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a57040d-5a65-4225-b340-58293e33117e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.371855 Oct 31 14:17:35.373923 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1972/3662] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:17:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:17:35.378639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:35.379609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:35.388149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.388977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.389655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.390785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.391622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.392277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.618034 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46be255a-5225-4f45-bc5a-f48d9ccfd535 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1614 microversion: 2.1 time: 0.242748 Oct 31 14:17:35.619100 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1973/3663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:35 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1614 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:35.684596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:35.700795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:35.703585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:35.705282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd9f2412-1909-45ba-8829-4c408adbaffd tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1754 microversion: 2.32 time: 0.409253 Oct 31 14:17:35.719996 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1691/3664] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:35 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1754 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:35.737218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:35.738135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 1d17fc9b-f241-4e91-8612-a72e12b7f3da] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:35.762692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.765530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.766313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.768108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.769170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.771164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.808462 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da could not be found. Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da HTTP/1.1 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da could not be found. Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '1d17fc9b-f241-4e91-8612-a72e12b7f3da'} Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da could not be found. Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da could not be found. Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:35.819464 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da could not be found. Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:35.824261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance 1d17fc9b-f241-4e91-8612-a72e12b7f3da could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:35.825643 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01923c5e-7ca3-42dc-8458-cb7d0227594a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da" status: 404 len: 111 microversion: 2.1 time: 0.102003 Oct 31 14:17:35.829120 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1692/3665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:35 2022] GET /compute/v2.1/servers/1d17fc9b-f241-4e91-8612-a72e12b7f3da => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:35.839525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-17353402"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:35.840176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:35.848477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.849355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.850142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.851663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:35.852403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:35.853157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:35.998497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57184684-992b-4169-bb30-a2d7373b1195 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Action: 'create', calling method: .version_select at 0x7fe1078cfa60>, body: {"keypair": {"name": "tempest-keypair-571964857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOReRucbOhG4VquATjjV7RgBorQKF8VtkbWS+rQ1kZA7h9cabmzv1MKKe1B8/ChmXOce3tIEohfvTr5Bm2NbA3zPTR0lUMIgt7BWRLkHLaPhWL8c2mToL81mjQ3A7eSTyg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:36.036531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-57184684-992b-4169-bb30-a2d7373b1195 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Getting quotas for project 76f3b642a80a4b81913acf2ebc84e453. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:36.042892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-57184684-992b-4169-bb30-a2d7373b1195 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Getting quotas for user d9d6c2a3d22f474a9294d93cd635585b and project 76f3b642a80a4b81913acf2ebc84e453. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:36.097631 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57184684-992b-4169-bb30-a2d7373b1195 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.476959 Oct 31 14:17:36.098269 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1974/3666] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:17:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:36.108922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7678af9b-efb6-4081-b802-dfabe6df792a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:36.109740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7678af9b-efb6-4081-b802-dfabe6df792a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:36.135839 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Adding security group aa5c46d6-ba35-41c8-8777-e3718e29b965 to port f65a0e14-0c19-4b7a-bc6c-df4f911cc959 Oct 31 14:17:36.183614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7678af9b-efb6-4081-b802-dfabe6df792a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:36.194650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7678af9b-efb6-4081-b802-dfabe6df792a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1238 microversion: 2.1 time: 0.088213 Oct 31 14:17:36.195900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1975/3667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:36 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:36.210721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:36.211307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:36.222670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:36.224373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:36.224823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:36.225595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:36.226050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:36.229334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:36.288305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '38260ec4f3224dbab9150b268c3e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcc3f4c72f6453dad21d46f19cabe16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:36.290039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] flavor_id is None. Assuming migration. {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 31 14:17:36.291691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:17:36.482983 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef870d8a-23e1-452d-83fb-253a3e034011 tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.285626 Oct 31 14:17:36.483788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1976/3668] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:36 2022] POST /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:36.503868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:36.504400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:36.524081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:36.525627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:36.526582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:36.528945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:36.529436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:36.530708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:36.576120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 HTTP/1.1 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'aad59dc7-a973-4081-865e-d78516739534'} Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:36.591247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:36.596259 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:36.597149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:36.599634 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1530a5cb-0708-4e56-b416-a039f4e95d59 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 404 len: 111 microversion: 2.1 time: 0.110883 Oct 31 14:17:36.600551 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1977/3669] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:36 2022] DELETE /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:36.607706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:36.609318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:36.628508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:36.628694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:36.629192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:36.631720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:36.632293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:36.632773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:36.908810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:36.919905 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-863cc322-c675-452a-b0ad-0c600c75ec49 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.317542 Oct 31 14:17:36.927069 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1978/3670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:36 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:36.939347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a36e926f-70c6-45f5-b69c-194de2004b94 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe10c59fdc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:37.042934 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a36e926f-70c6-45f5-b69c-194de2004b94 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/42125526-202a-4baa-a4b6-e7a857f61786" status: 200 len: 351 microversion: 2.1 time: 0.113755 Oct 31 14:17:37.044284 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1979/3671] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:17:36 2022] GET /compute/v2.1/os-volumes/42125526-202a-4baa-a4b6-e7a857f61786 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:37.055783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:37.056459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:37.066343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.066875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.067314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.068022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.068477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.068893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.272701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:37.281476 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95549481-b857-484f-946a-fb4d19e0984c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1472 microversion: 2.1 time: 0.236331 Oct 31 14:17:37.284846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1980/3672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:37 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:37.295799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:37.297762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: aad59dc7-a973-4081-865e-d78516739534] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:37.316444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.319865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.320547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.322364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.324307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.324938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.325840 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7ab799b-d003-4273-873e-e225cf57fae0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action" status: 202 len: 0 microversion: 2.1 time: 1.495346 Oct 31 14:17:37.326785 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1693/3673] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:35 2022] POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action => generated 0 bytes in 1497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:37.331774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:37.332420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:37.343744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.344312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.344753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.345599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.345890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.346850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.361604 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 HTTP/1.1 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'aad59dc7-a973-4081-865e-d78516739534'} Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:37.363543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:37.370138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance aad59dc7-a973-4081-865e-d78516739534 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:37.370835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22f73115-1cf9-4e47-b624-27c2633feb3d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534" status: 404 len: 111 microversion: 2.1 time: 0.081053 Oct 31 14:17:37.378371 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1981/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:37 2022] GET /compute/v2.1/servers/aad59dc7-a973-4081-865e-d78516739534 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:37.386277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:37.387961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:37.399487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.402032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.404657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.405762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.406489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.409024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.889584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:37.899675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:37.901309 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62ead935-8099-455e-9698-d8c5f017f2b5 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1668 microversion: 2.1 time: 0.518691 Oct 31 14:17:37.909367 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1982/3675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:37 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1668 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:37.916767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:37.920114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:37.921929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:37.926072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:37.930054 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f7696ff-4adb-4a29-af87-71d95b4b97c8 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1801 microversion: 2.32 time: 0.602052 Oct 31 14:17:37.936027 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1694/3676] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:37 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1801 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:37.942473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-17353402"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:37.945751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:37.952719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.953666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.954418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.955430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.956069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.956661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.960115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.960803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.961392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:37.962388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:37.965353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:37.966008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:38.184847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:38.202367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73c46885-9fc4-4f8b-bf42-1eed81ac9d5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1296 microversion: 2.1 time: 0.291543 Oct 31 14:17:38.202951 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1983/3677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:37 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1296 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:38.222482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b430ba8e-867b-4d83-9778-110a742ff124 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10662bb80>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:38.299142 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b430ba8e-867b-4d83-9778-110a742ff124 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Image not found. Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b430ba8e-867b-4d83-9778-110a742ff124 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d HTTP/1.1 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d'} Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d to delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d could not be found. Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.300955 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:17:38.305628 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:38.310265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b430ba8e-867b-4d83-9778-110a742ff124 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:38.311376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b430ba8e-867b-4d83-9778-110a742ff124 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d" status: 404 len: 62 microversion: 2.1 time: 0.096591 Oct 31 14:17:38.312800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1984/3678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:38 2022] DELETE /compute/v2.1/images/2f94c7ff-c37e-40f2-a03a-b2ccf0896b6d => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:17:38.324061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-90711434-72b6-472e-9cd7-ae4f2ccab7f7 req-1f7fc0cc-0a8a-4c3d-a4f0-821b2152fa0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:38.351023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90711434-72b6-472e-9cd7-ae4f2ccab7f7 req-1f7fc0cc-0a8a-4c3d-a4f0-821b2152fa0f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:38.351772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90711434-72b6-472e-9cd7-ae4f2ccab7f7 req-1f7fc0cc-0a8a-4c3d-a4f0-821b2152fa0f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:38.354310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90711434-72b6-472e-9cd7-ae4f2ccab7f7 req-1f7fc0cc-0a8a-4c3d-a4f0-821b2152fa0f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:38.380845 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-90711434-72b6-472e-9cd7-ae4f2ccab7f7 req-1f7fc0cc-0a8a-4c3d-a4f0-821b2152fa0f service nova] Creating event network-changed:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:17:38.388168 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Removing security group aa5c46d6-ba35-41c8-8777-e3718e29b965 from port f65a0e14-0c19-4b7a-bc6c-df4f911cc959 Oct 31 14:17:38.396693 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-90711434-72b6-472e-9cd7-ae4f2ccab7f7 req-1f7fc0cc-0a8a-4c3d-a4f0-821b2152fa0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082410 Oct 31 14:17:38.400358 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1985/3679] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:38.422807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:38.423424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:38.437025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:38.437534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:38.437988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:38.438925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:38.439544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:38.440135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:38.476717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:17:38.485362 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Working on deleting snapshot e24413bd-b239-4744-94b7-5972dc353bc9 from shelved instance... Oct 31 14:17:39.334249 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b26b389c-703c-48db-9333-df872e917784 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action" status: 202 len: 0 microversion: 2.1 time: 1.395003 Oct 31 14:17:39.335233 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1695/3680] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:37 2022] POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action => generated 0 bytes in 1397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:39.348174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:39.348830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:39.375538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:39.376079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:39.377225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:39.378221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:39.378678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:39.384991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:39.624946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Doing local delete in cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=120640) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 31 14:17:39.626410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:39.627147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:39.627800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:39.628602 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 31 14:17:39.632975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] deallocate_for_instance() {{(pid=120640) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 31 14:17:39.909708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:39.923861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d6ae20fe-d5ae-4086-bc07-f7a34dce3835 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1472 microversion: 2.1 time: 0.582057 Oct 31 14:17:39.925502 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1696/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:39 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1472 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:39.930332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:39.930841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:39.947773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:39.948273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:39.948708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:39.949422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:39.949884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:39.950348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:39.995781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 HTTP/1.1 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '2c4544a4-f791-409a-9f34-20bdb10acfc3'} Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:39.998095 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:40.003099 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c094b1a-3e3d-4c4f-a858-33104445ebd4 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 404 len: 111 microversion: 2.1 time: 0.073928 Oct 31 14:17:40.004893 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1697/3682] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:39 2022] DELETE /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:40.022907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:40.023570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:40.030468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:40.030972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:40.031419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:40.032142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:40.032591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:40.033017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:40.412127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:40.433852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:40.439118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:40.441522 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b1d08487-513a-4c8c-b8a4-fe8c602da701 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1848 microversion: 2.32 time: 0.435594 Oct 31 14:17:40.457031 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1698/3683] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:40 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1848 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:40.459043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:40.459686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:40.472555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:40.473052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:40.473637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:40.474604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:40.479937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:40.479937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:41.055020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:41.067149 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4812dba5-38eb-4875-996f-7ff7061c3b9d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1363 microversion: 2.1 time: 0.616027 Oct 31 14:17:41.083333 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1699/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:40 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1363 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:41.089481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5280dd50-8d56-4a07-af32-0a663eb83ba3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'create', calling method: .version_select at 0x7fe10c2f18b0>, body: {"pool": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:41.275249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Updating instance_info_cache with network_info: [] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:17:41.492043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:41.764945 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-151ddf90-fb3b-4954-8192-a98393d4e4d4 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 204 len: 0 microversion: 2.1 time: 3.362654 Oct 31 14:17:41.765550 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1986/3685] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:38 2022] DELETE /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 0 bytes in 3364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:41.776498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8850a76-84c9-4c74-8a53-7e95bb94cf73 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe106db11f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:41.864932 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8850a76-84c9-4c74-8a53-7e95bb94cf73 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/565b6423-5785-423a-8225-cf2a9be243e3" status: 200 len: 351 microversion: 2.1 time: 0.098016 Oct 31 14:17:41.873892 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1987/3686] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:17:41 2022] GET /compute/v2.1/os-volumes/565b6423-5785-423a-8225-cf2a9be243e3 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:41.881763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:41.885266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 2c4544a4-f791-409a-9f34-20bdb10acfc3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:41.900297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:41.901734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:41.903242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:41.904536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:41.906183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:41.907435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:41.945341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 HTTP/1.1 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2c4544a4-f791-409a-9f34-20bdb10acfc3'} Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:41.948208 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:41.952473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:41.952473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:41.952473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:41.952473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:41.952473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. Oct 31 14:17:41.952473 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:41.958456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance 2c4544a4-f791-409a-9f34-20bdb10acfc3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:41.959620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1588c36e-7dfb-4ca1-aae2-c06e05268a4c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3" status: 404 len: 111 microversion: 2.1 time: 0.093208 Oct 31 14:17:41.965192 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1988/3687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:41 2022] GET /compute/v2.1/servers/2c4544a4-f791-409a-9f34-20bdb10acfc3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:41.972679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5c40e3fd-dcbe-438f-a301-cef1b1eebbb0 req-d92d900f-2b2c-41e6-aee9-5d4a70fe7259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:42.000784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c40e3fd-dcbe-438f-a301-cef1b1eebbb0 req-d92d900f-2b2c-41e6-aee9-5d4a70fe7259 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:42.001557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c40e3fd-dcbe-438f-a301-cef1b1eebbb0 req-d92d900f-2b2c-41e6-aee9-5d4a70fe7259 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:42.003196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c40e3fd-dcbe-438f-a301-cef1b1eebbb0 req-d92d900f-2b2c-41e6-aee9-5d4a70fe7259 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:42.030291 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5c40e3fd-dcbe-438f-a301-cef1b1eebbb0 req-d92d900f-2b2c-41e6-aee9-5d4a70fe7259 service nova] Creating event network-changed:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:17:42.041239 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5c40e3fd-dcbe-438f-a301-cef1b1eebbb0 req-d92d900f-2b2c-41e6-aee9-5d4a70fe7259 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074183 Oct 31 14:17:42.043434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1989/3688] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:42.054191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-140650406", "imageRef": "c19df2c9-2781-4c01-847b-90ad0162fa59", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7a68e503-d023-4fbc-ac57-43a9fb18989c"}], "security_groups": [{"name": "tempest-securitygroup--1742787542"}], "key_name": "tempest-keypair-571964857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:42.352130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] validate_networks() for [('7a68e503-d023-4fbc-ac57-43a9fb18989c', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:17:43.159079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:17:43.159614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:17:43.160083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:17:43.160568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:17:43.160985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:17:43.172450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.173187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.173831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.174878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.175552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.176239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.199036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Getting quotas for project 76f3b642a80a4b81913acf2ebc84e453. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:17:43.206056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Getting quotas for user d9d6c2a3d22f474a9294d93cd635585b and project 76f3b642a80a4b81913acf2ebc84e453. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:17:43.222004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:17:43.225149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c19df2c9-2781-4c01-847b-90ad0162fa59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:17:43.286977 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bee5209-06cf-4ced-b222-5f96670e15fe tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237134 Oct 31 14:17:43.287882 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1990/3689] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:17:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:17:43.294433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:43.295392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:43.303311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.304019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.304797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.307541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.308852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.309854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.594382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:43.605672 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7d3be4c-c7e4-4cfe-b80c-f1ae9b063a82 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.316437 Oct 31 14:17:43.606526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1991/3690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:43 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:43.612498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-56ddb1d0-bf9a-4a08-b387-638ed58a4415 req-a9cd89ac-2376-4f5c-9c74-9c64d0f8d82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1925eb40-8126-4dfb-a83e-41260a763185", "name": "network-vif-deleted", "tag": "8ee5c5f5-e47c-4164-8101-26618575bed4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:43.640708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-56ddb1d0-bf9a-4a08-b387-638ed58a4415 req-a9cd89ac-2376-4f5c-9c74-9c64d0f8d82b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.641401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-56ddb1d0-bf9a-4a08-b387-638ed58a4415 req-a9cd89ac-2376-4f5c-9c74-9c64d0f8d82b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.641967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-56ddb1d0-bf9a-4a08-b387-638ed58a4415 req-a9cd89ac-2376-4f5c-9c74-9c64d0f8d82b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.663251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-56ddb1d0-bf9a-4a08-b387-638ed58a4415 req-a9cd89ac-2376-4f5c-9c74-9c64d0f8d82b service nova] Unable to find a host for instance 1925eb40-8126-4dfb-a83e-41260a763185. Dropping event network-vif-deleted {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 14:17:43.664318 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-56ddb1d0-bf9a-4a08-b387-638ed58a4415 req-a9cd89ac-2376-4f5c-9c74-9c64d0f8d82b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.056652 Oct 31 14:17:43.669740 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1992/3691] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 14:17:43.675094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:43.675907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:43.683896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.684894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.685808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.686672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:43.687541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:43.688357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:43.956246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:43.966476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:43.967934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:43.969105 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef7db36d-64a2-4c1a-a04e-6d097117bfa9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1869 microversion: 2.32 time: 0.298043 Oct 31 14:17:43.986621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1993/3692] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:43 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1869 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:44.251398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:44.252019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 1925eb40-8126-4dfb-a83e-41260a763185] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:44.258088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.258867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.259609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.260306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.260767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.261193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.275750 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] HTTP exception thrown: Instance 1925eb40-8126-4dfb-a83e-41260a763185 could not be found. Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Request method failure captured: Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 HTTP/1.1 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9atnPLnJ7oYvWhon-XMkYD9jenoZFcnReG9sz4J4tIhwlxQqFLppcUKvacmC8VIlUCSeHaQ7i4_1nCrhXlBPmJY7C7hIyq9GxE288Kt-wH2mpf6tl_3IOrIBnznGyy4mj6HhY3jFzHGTkTOiowRHLTDdTGpZ6Tek5OWekLLTptxm9I Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43d946eea72d40e08829491c65b4e750", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43d946eea72d40e08829491c65b4e750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: f6d0e8b2b04b47e69d87f436eb387941 Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 1925eb40-8126-4dfb-a83e-41260a763185 could not be found. Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '1925eb40-8126-4dfb-a83e-41260a763185'} Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1925eb40-8126-4dfb-a83e-41260a763185 could not be found. Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1925eb40-8126-4dfb-a83e-41260a763185 could not be found. Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:44.277638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1925eb40-8126-4dfb-a83e-41260a763185 could not be found. Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Returning 404 to user: Instance 1925eb40-8126-4dfb-a83e-41260a763185 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef679314-18fb-4941-a5c3-2e8adf5fe884 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185" status: 404 len: 111 microversion: 2.1 time: 0.291397 Oct 31 14:17:44.284912 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1994/3693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:43 2022] GET /compute/v2.1/servers/1925eb40-8126-4dfb-a83e-41260a763185 => generated 111 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:44.286491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f20927a1-72d2-4c07-97ba-2202cf5364ca tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe106d9daf0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:44.326539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f20927a1-72d2-4c07-97ba-2202cf5364ca tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Image not found. Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f20927a1-72d2-4c07-97ba-2202cf5364ca tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a HTTP/1.1 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a'} Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a to delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a could not be found. Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.328195 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f20927a1-72d2-4c07-97ba-2202cf5364ca tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f20927a1-72d2-4c07-97ba-2202cf5364ca tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a" status: 404 len: 62 microversion: 2.1 time: 0.048290 Oct 31 14:17:44.333393 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1995/3694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:44 2022] DELETE /compute/v2.1/images/e00fdd5f-b776-4058-b8ff-ecd5d5dcd36a => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:17:44.338329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:44.338955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:44.346327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.346817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.347255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.347949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.348403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.348826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.552022 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5280dd50-8d56-4a07-af32-0a663eb83ba3 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.467509 Oct 31 14:17:44.553510 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1700/3695] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:17:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:44.559947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:44.562206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:44.574902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.575509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.575948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.588699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.590209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.590665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.761792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:44.772889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4b6fde1-0eee-4d6f-872f-a96f004bcba2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1296 microversion: 2.1 time: 0.217680 Oct 31 14:17:44.773795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1701/3696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:44 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1296 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:44.778950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "3a9b4172-f0ff-4584-98cf-3eabc53a8d71"}, {"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "c2c07023-6238-41fb-90f2-bec97e1ade9a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:44.789901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.790746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.791350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.803633 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] Creating event network-changed:3a9b4172-f0ff-4584-98cf-3eabc53a8d71 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:17:44.804438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] Creating event network-changed:c2c07023-6238-41fb-90f2-bec97e1ade9a for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:17:44.811250 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-06aeb7cc-ffa5-46ea-a065-54e90c7371fc req-28d51421-94bf-4ea5-8fd3-878436502b55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035719 Oct 31 14:17:44.812514 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1702/3697] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:44.818109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:44.818945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:44.851520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.853595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.854293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.857003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.857674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.858422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.900811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:17:44.934141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:44.945367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cea086de-9aa0-47cd-93b3-20bec52b29bd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1363 microversion: 2.1 time: 0.608693 Oct 31 14:17:44.950506 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1996/3698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:44 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:44.956883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:44.957398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:44.968764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.969262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.969984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:44.970949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:44.971623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:44.972270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:45.005396 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba HTTP/1.1 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '9e505dec-1e44-49fa-9142-6f61b3c3dcba'} Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:45.015251 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:45.020296 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:45.021792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:45.022923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed8e8bcd-668a-49bb-8177-e9c94da24bdc tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 404 len: 111 microversion: 2.1 time: 0.071413 Oct 31 14:17:45.031022 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1997/3699] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:44 2022] DELETE /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:45.036727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.154"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:45.039583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:45.054405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:45.063112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:45.063486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:45.064252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:45.064725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:45.065129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:45.105678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "refresh_cache-a46e9c75-491d-4fcf-bb2b-8a48c41c30df" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:17:45.106092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquired lock "refresh_cache-a46e9c75-491d-4fcf-bb2b-8a48c41c30df" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:17:45.126159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73591aca-9f40-4201-8aab-cc8462751efd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "DELETE /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 204 len: 0 microversion: 2.1 time: 0.311784 Oct 31 14:17:45.127117 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1703/3700] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:44 2022] DELETE /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:45.135472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cda6bec-a7f7-437e-89fc-853f85a1de04 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe10fc3e670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:45.230333 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cda6bec-a7f7-437e-89fc-853f85a1de04 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/be69086b-dc0d-4c79-85cd-55112a95c0a6" status: 200 len: 351 microversion: 2.1 time: 0.101424 Oct 31 14:17:45.240712 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1704/3701] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:17:45 2022] GET /compute/v2.1/os-volumes/be69086b-dc0d-4c79-85cd-55112a95c0a6 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:45.243043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:45.245045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:45.260563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:45.261357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:45.261958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:45.262896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:45.266968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:45.267626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:45.677768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:45.692587 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a8ef6e7-b9e2-46b7-9459-b1e490c800a6 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.458122 Oct 31 14:17:45.695919 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1705/3702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:45 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:45.714687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:45.718407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:45.731366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:45.733676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:45.734279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:45.735081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:45.743942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:45.745077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:46.582388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:46.597480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:46.603688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:46.623789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-033ebff8-4d6d-4f96-a6e8-520506ed5c7b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1890 microversion: 2.32 time: 0.926282 Oct 31 14:17:46.624723 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1706/3703] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:45 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1890 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:46.629889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:46.632523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: 9e505dec-1e44-49fa-9142-6f61b3c3dcba] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:46.646605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:46.647313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:46.647933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:46.648964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:46.650234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:46.650852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:46.676784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba HTTP/1.1 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9e505dec-1e44-49fa-9142-6f61b3c3dcba'} Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:46.683831 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance 9e505dec-1e44-49fa-9142-6f61b3c3dcba could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:46.690857 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d196469-a81b-4e2e-a595-e63077d7813a tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba" status: 404 len: 111 microversion: 2.1 time: 0.059037 Oct 31 14:17:46.695301 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1707/3704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:46 2022] GET /compute/v2.1/servers/9e505dec-1e44-49fa-9142-6f61b3c3dcba => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:46.707686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:46.708377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:46.720471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:46.721050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:46.721498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:46.726570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:46.727345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:46.728369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:46.961306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:46.975347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2a48a00-3503-48aa-a670-bc9230ff29b2 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 200 len: 1465 microversion: 2.1 time: 0.278941 Oct 31 14:17:46.976395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1708/3705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:46 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 1465 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:46.981481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac2b8f01-64ad-4756-bf40-e57c5a7465c0 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe107821d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:47.187794 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac2b8f01-64ad-4756-bf40-e57c5a7465c0 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.210225 Oct 31 14:17:47.188950 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1709/3706] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 31 14:17:46 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:47.193712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9e7a29be-4231-4d11-9ff3-f2abf8ba3da5 req-9d33f9b9-f474-4839-95a2-32e82283bd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679c6ed9-8d8f-47cb-b1c1-752bf554da3c", "tag": "c47b4013-a988-4e5c-84c0-ed38b18b11f0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:47.207510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e7a29be-4231-4d11-9ff3-f2abf8ba3da5 req-9d33f9b9-f474-4839-95a2-32e82283bd82 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:47.208266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e7a29be-4231-4d11-9ff3-f2abf8ba3da5 req-9d33f9b9-f474-4839-95a2-32e82283bd82 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:47.208883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e7a29be-4231-4d11-9ff3-f2abf8ba3da5 req-9d33f9b9-f474-4839-95a2-32e82283bd82 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:47.237940 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9e7a29be-4231-4d11-9ff3-f2abf8ba3da5 req-9d33f9b9-f474-4839-95a2-32e82283bd82 service nova] Creating event network-changed:c47b4013-a988-4e5c-84c0-ed38b18b11f0 for instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c on n-h2-863052-1 Oct 31 14:17:47.255022 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9e7a29be-4231-4d11-9ff3-f2abf8ba3da5 req-9d33f9b9-f474-4839-95a2-32e82283bd82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064607 Oct 31 14:17:47.262295 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1710/3707] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:47.277061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:47.291959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:47.302087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:47.313766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:47.316140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:47.321189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:47.330927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:47.338913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:47.994996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:47.999741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:48.010764 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78ab7c08-0c64-45bf-8125-968c980b8832 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.746781 Oct 31 14:17:48.026275 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1711/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:47 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:48.041877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:48.071195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:48.095341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:48.101220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:48.101899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:48.105064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:48.107962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:48.108576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:48.396201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:48.407641 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6b23b10-5b48-4ca7-a9e5-0c29f6677f5c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1363 microversion: 2.1 time: 0.378241 Oct 31 14:17:48.428810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1712/3709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:48 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:48.443491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75e394a4-e320-4e4e-80f6-160cb3fbf790 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe10fb860d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:48.547341 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-75e394a4-e320-4e4e-80f6-160cb3fbf790 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Image not found. Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75e394a4-e320-4e4e-80f6-160cb3fbf790 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 HTTP/1.1 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e8fcc945-fbdb-441d-853e-8fafee1c7745'} Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8fcc945-fbdb-441d-853e-8fafee1c7745 to delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8fcc945-fbdb-441d-853e-8fafee1c7745 could not be found. Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.549398 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:17:48.554227 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:48.556510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75e394a4-e320-4e4e-80f6-160cb3fbf790 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:48.557532 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75e394a4-e320-4e4e-80f6-160cb3fbf790 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745" status: 404 len: 62 microversion: 2.1 time: 0.127409 Oct 31 14:17:48.558309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1713/3710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:48 2022] DELETE /compute/v2.1/images/e8fcc945-fbdb-441d-853e-8fafee1c7745 => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:17:48.926178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:48.927923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:48.952017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:48.959142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:48.959674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:48.960435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:48.960906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:48.961334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:49.300929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Building network info cache for instance {{(pid=120640) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:17:49.430204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:49.454388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f4da304-ad0d-4a79-a3d7-2fba9c90665c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.886055 Oct 31 14:17:49.473503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1714/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:48 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:49.490702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-226af2d7-3b1a-4e87-b13d-22ffb2db1c0c req-c4a769a8-b82a-4970-9100-963c05529f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "4a922957-3bba-4585-9ade-2133f2cb8147"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:49.519817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-226af2d7-3b1a-4e87-b13d-22ffb2db1c0c req-c4a769a8-b82a-4970-9100-963c05529f22 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:49.520198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-226af2d7-3b1a-4e87-b13d-22ffb2db1c0c req-c4a769a8-b82a-4970-9100-963c05529f22 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:49.522714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-226af2d7-3b1a-4e87-b13d-22ffb2db1c0c req-c4a769a8-b82a-4970-9100-963c05529f22 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:49.568686 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-226af2d7-3b1a-4e87-b13d-22ffb2db1c0c req-c4a769a8-b82a-4970-9100-963c05529f22 service nova] Creating event network-changed:4a922957-3bba-4585-9ade-2133f2cb8147 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:17:49.591831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-226af2d7-3b1a-4e87-b13d-22ffb2db1c0c req-c4a769a8-b82a-4970-9100-963c05529f22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107641 Oct 31 14:17:49.595943 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1715/3712] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:49.616111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64556dc3-f5bc-4afe-b8f7-9568eeec12cd tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe106bbdc10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:49.878529 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64556dc3-f5bc-4afe-b8f7-9568eeec12cd tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.281244 Oct 31 14:17:49.879379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1716/3713] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:17:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:49.884879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:49.885661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:49.906572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:49.907183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:49.907692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:49.908687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:49.914631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:49.916108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.578773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:50.611812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:50.613775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:50.621860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-038464af-1150-4b78-975d-8d37c9d85273 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1890 microversion: 2.32 time: 0.741479 Oct 31 14:17:50.628881 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1717/3714] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:49 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1890 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:50.642472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:50.646307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 461d8d3d-2f99-4f84-aef3-929c3aec9144] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:50.667313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.668652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.669949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.672427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.677123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.678000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.715787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] HTTP exception thrown: Instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 could not be found. Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Request method failure captured: Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 HTTP/1.1 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9atnPLnJ7oYvWhon-XMkYD9jenoZFcnReG9sz4J4tIhwlxQqFLppcUKvacmC8VIlUCSeHaQ7i4_1nCrhXlBPmJY7C7hIyq9GxE288Kt-wH2mpf6tl_3IOrIBnznGyy4mj6HhY3jFzHGTkTOiowRHLTDdTGpZ6Tek5OWekLLTptxm9I Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43d946eea72d40e08829491c65b4e750", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43d946eea72d40e08829491c65b4e750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f6d0e8b2b04b47e69d87f436eb387941 Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 could not be found. Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '461d8d3d-2f99-4f84-aef3-929c3aec9144'} Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 could not be found. Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 could not be found. Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:50.717769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 could not be found. Oct 31 14:17:50.722461 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.725513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Returning 404 to user: Instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:50.730890 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a07c2aee-b174-4918-8b3f-e5ba2138d528 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144" status: 404 len: 111 microversion: 2.1 time: 0.098497 Oct 31 14:17:50.735257 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1718/3715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:50 2022] GET /compute/v2.1/servers/461d8d3d-2f99-4f84-aef3-929c3aec9144 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:50.744666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:50.746924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:50.760267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.762957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.763671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.764362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.766083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.769198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.795298 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 HTTP/1.1 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e8cd0646-c655-4849-88ee-7314178eebc3'} Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:50.802826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:50.807651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:50.811108 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4291c7b-c5b5-411c-95a0-c004c64ecf8c tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 404 len: 111 microversion: 2.1 time: 0.074647 Oct 31 14:17:50.811763 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1719/3716] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:50 2022] DELETE /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:50.820537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-37077002-d6f8-4845-8a96-74518fa83cc1 req-0bf972a1-7355-4143-a593-f0e04eec7d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679c6ed9-8d8f-47cb-b1c1-752bf554da3c", "name": "network-vif-plugged", "status": "completed", "tag": "c47b4013-a988-4e5c-84c0-ed38b18b11f0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:50.845782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-37077002-d6f8-4845-8a96-74518fa83cc1 req-0bf972a1-7355-4143-a593-f0e04eec7d89 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.846545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-37077002-d6f8-4845-8a96-74518fa83cc1 req-0bf972a1-7355-4143-a593-f0e04eec7d89 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.847042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-37077002-d6f8-4845-8a96-74518fa83cc1 req-0bf972a1-7355-4143-a593-f0e04eec7d89 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.867069 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-37077002-d6f8-4845-8a96-74518fa83cc1 req-0bf972a1-7355-4143-a593-f0e04eec7d89 service nova] Creating event network-vif-plugged:c47b4013-a988-4e5c-84c0-ed38b18b11f0 for instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c on n-h2-863052-1 Oct 31 14:17:50.891215 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-37077002-d6f8-4845-8a96-74518fa83cc1 req-0bf972a1-7355-4143-a593-f0e04eec7d89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077862 Oct 31 14:17:50.892261 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1720/3717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:50.898029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:50.908562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:50.921576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.922268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.924023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:50.926247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:50.926768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:50.927183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:51.643626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:51.660614 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24e52d8f-2c20-4764-9174-2718a3a13062 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.766930 Oct 31 14:17:51.663531 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1721/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:50 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:51.669842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461d8d3d-2f99-4f84-aef3-929c3aec9144", "name": "network-vif-deleted", "tag": "e53d63f0-44c3-423c-aac6-64aa47a30c6c"}, {"name": "network-changed", "server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:51.705222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:51.707985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:51.709625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:51.747768 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] Creating event network-vif-deleted:e53d63f0-44c3-423c-aac6-64aa47a30c6c for instance 461d8d3d-2f99-4f84-aef3-929c3aec9144 on n-h2-863052-1 Oct 31 14:17:51.750568 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] Creating event network-changed:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:17:51.771380 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-024d1c79-dbec-4e31-8456-f0cdfc9bdd78 req-e4e02c82-aaed-49ed-91c5-db8531dbdd1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106114 Oct 31 14:17:51.774086 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1722/3719] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:51.801491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:51.802757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:51.814898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:51.815691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:51.818567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:51.819625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:51.820908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:51.821857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:52.354511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:52.364814 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7866fc3-bf5b-4712-bf26-f9b2d596f33b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1363 microversion: 2.1 time: 0.587216 Oct 31 14:17:52.383547 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1723/3720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:51 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1363 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:52.399230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5210b924-293d-4860-98e4-042622244563 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe10fb7eb80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:52.519849 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5210b924-293d-4860-98e4-042622244563 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.134757 Oct 31 14:17:52.521187 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1724/3721] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 31 14:17:52 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:52.527829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:52.529747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:52.539200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:52.540153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:52.540986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:52.541950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:52.542752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:52.543424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:52.789093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:52.797905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a663ba8c-1077-4241-a00a-c626ae19d157 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.275204 Oct 31 14:17:52.806197 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1725/3722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:52 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:52.816548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:52.817068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:52.835284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:52.837888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:52.838389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:52.839124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:52.839703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:52.840292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:52.875987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:17:53.018661 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69b2ad93-456d-4811-86e8-b5f4187b016a tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 204 len: 0 microversion: 2.1 time: 0.210932 Oct 31 14:17:53.029885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1726/3723] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:52 2022] DELETE /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:53.045124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:53.046004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: e8cd0646-c655-4849-88ee-7314178eebc3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:53.067056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.067554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.067996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.068698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.069147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.069576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.113993 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 HTTP/1.1 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e8cd0646-c655-4849-88ee-7314178eebc3'} Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:53.115674 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance e8cd0646-c655-4849-88ee-7314178eebc3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e45010bc-887f-4aab-81a5-4d1b6198578f tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3" status: 404 len: 111 microversion: 2.1 time: 0.082261 Oct 31 14:17:53.121518 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1727/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:53 2022] GET /compute/v2.1/servers/e8cd0646-c655-4849-88ee-7314178eebc3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:53.134610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:53.135220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:53.141618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.142109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.142566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.143263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.143737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.144135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.189665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:53.215932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=22 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:53.287865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Updating instance_info_cache with network_info: [{"id": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959", "address": "fa:16:3e:7f:19:c1", "network": {"id": "4ba95cfb-590b-49d0-914f-f806450d616c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1929410810-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c7d422f9bf004e6cb67d83e88cc86792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf65a0e14-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:17:53.306311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Releasing lock "refresh_cache-a46e9c75-491d-4fcf-bb2b-8a48c41c30df" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:17:53.307645 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4b06e79-1050-4b60-a05e-5f3ca8090224 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action" status: 202 len: 0 microversion: 2.1 time: 8.275165 Oct 31 14:17:53.310002 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1998/3725] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:45 2022] POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action => generated 0 bytes in 8278 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:17:53.316885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "13d58663-7051-4173-80c9-2fc55f337a36"}, {"name": "network-changed", "server_uuid": "b5908187-cdb3-4eaa-99aa-c37e8c7614a5", "tag": "7401c927-21ce-4667-bca1-cdd3d199e9ad"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:53.346201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.347003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.347780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.368094 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] Creating event network-changed:13d58663-7051-4173-80c9-2fc55f337a36 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:17:53.368914 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] Creating event network-changed:7401c927-21ce-4667-bca1-cdd3d199e9ad for instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 on n-h1-863052-1 Oct 31 14:17:53.379552 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7ec82941-8f79-4c7e-82d9-cd427ad81e62 req-e9d2fe13-543a-414f-9f45-c0685dbab76c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068001 Oct 31 14:17:53.381204 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1999/3726] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:53.387875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82045d57-f392-49db-bc25-cb5ab3157144 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe10655b9d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:53.651882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:53.662348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:53.663779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:53.665593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cca57e6e-68a7-4882-8f34-8acbc4024cdf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1890 microversion: 2.32 time: 0.542423 Oct 31 14:17:53.666027 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1728/3727] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:53 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1890 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:53.692433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:53.693048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:53.713685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:53.733276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.736207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.736668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.737395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.744032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.744855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.777591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82045d57-f392-49db-bc25-cb5ab3157144 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.394561 Oct 31 14:17:53.778460 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2000/3728] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 31 14:17:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:53.789428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:53.792864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:53.813589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.817433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.819026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:53.820401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:53.824079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:53.824820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:54.144186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:54.160122 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd41b414-a1a7-44ed-912f-dcbd23d54d6d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.471420 Oct 31 14:17:54.178843 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1729/3729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:53 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:54.185158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3930b1fb-ce55-46d6-8077-82b1259179d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '.version_select at 0x7fe1075d6a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:54.221857 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3930b1fb-ce55-46d6-8077-82b1259179d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Image not found. Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3930b1fb-ce55-46d6-8077-82b1259179d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 HTTP/1.1 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '125c2551-020b-436e-a046-a30f2ceb09f8'} Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 125c2551-020b-436e-a046-a30f2ceb09f8 to delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 125c2551-020b-436e-a046-a30f2ceb09f8 could not be found. Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.224388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3930b1fb-ce55-46d6-8077-82b1259179d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3930b1fb-ce55-46d6-8077-82b1259179d0 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8" status: 404 len: 62 microversion: 2.1 time: 0.045755 Oct 31 14:17:54.232997 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1730/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:54 2022] DELETE /compute/v2.1/images/125c2551-020b-436e-a046-a30f2ceb09f8 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:17:54.234673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.154"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:54.491740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:54.500610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:54.501424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:54.502793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:54.504057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:54.504762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:54.505566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:54.544368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:54.554347 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31ae0d7e-2380-48bf-baae-8c63c0e1931f tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 200 len: 1506 microversion: 2.1 time: 0.774014 Oct 31 14:17:54.554946 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2001/3731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:53 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:54.578584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:54.579201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:54.581248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:54.609046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:54.609561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:54.609998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:54.610757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:54.611189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:54.621080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:55.134538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "refresh_cache-a46e9c75-491d-4fcf-bb2b-8a48c41c30df" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:17:55.135755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquired lock "refresh_cache-a46e9c75-491d-4fcf-bb2b-8a48c41c30df" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:17:55.568638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:55.581096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa138772-ebd0-407d-90bf-25ab5f774e40 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1549 microversion: 2.1 time: 1.025100 Oct 31 14:17:55.583988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2002/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:54 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1549 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:55.605882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-156e83c8-83bd-4b46-ab2e-ad8097f014be tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe10657adc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:55.824206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-156e83c8-83bd-4b46-ab2e-ad8097f014be tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.227780 Oct 31 14:17:55.824792 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2003/3733] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:17:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:55.830419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:55.831215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:55.851306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:55.852084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:55.855878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:55.856867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:55.857502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:55.858111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:56.580401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Building network info cache for instance {{(pid=120641) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 14:17:56.679760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:56.689492 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42f6dda6-0d42-4e8c-9e5e-ae596b74227f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.863512 Oct 31 14:17:56.690452 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2004/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:55 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:56.714148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:56.714919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:56.723673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:56.724160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:56.725089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:56.725792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:56.726735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:56.727165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:56.742315 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e HTTP/1.1 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c250ffcc-8637-425b-a0c3-7906f0afff8e'} Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:56.745319 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:56.750124 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:17:56.751837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:56.752841 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60eadc7e-49e0-44b8-af2e-824fc743498d tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 404 len: 111 microversion: 2.1 time: 0.045211 Oct 31 14:17:56.756878 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2005/3735] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:56 2022] DELETE /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:56.763644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:56.764475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:56.773412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:56.774144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:56.775319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:56.776197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:56.776809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:56.777389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.035922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:57.048327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:57.050041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:57.051402 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-291357b4-bd05-4474-be85-8c7686b94087 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.293317 Oct 31 14:17:57.052257 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2006/3736] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:56 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:17:57.058853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.059695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:57.071445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.072232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.073145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.073863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.074877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.075262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.098276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Updating instance_info_cache with network_info: [{"id": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959", "address": "fa:16:3e:7f:19:c1", "network": {"id": "4ba95cfb-590b-49d0-914f-f806450d616c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1929410810-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c7d422f9bf004e6cb67d83e88cc86792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf65a0e14-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120641) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:17:57.115949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Releasing lock "refresh_cache-a46e9c75-491d-4fcf-bb2b-8a48c41c30df" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:17:57.117466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95d981aa-139f-4c72-88fe-b67603476520 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action" status: 202 len: 0 microversion: 2.1 time: 2.889201 Oct 31 14:17:57.119169 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1731/3737] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:17:54 2022] POST /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df/action => generated 0 bytes in 2892 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 14:17:57.124706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bf9312a3-f056-4c47-b14d-9eb9ebe9de91 req-37f319eb-9ba4-4312-bf76-38ec1bad2800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "46852d7e-2a8c-4b69-b247-0200900d1218"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:57.136211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf9312a3-f056-4c47-b14d-9eb9ebe9de91 req-37f319eb-9ba4-4312-bf76-38ec1bad2800 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.136794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf9312a3-f056-4c47-b14d-9eb9ebe9de91 req-37f319eb-9ba4-4312-bf76-38ec1bad2800 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.137491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf9312a3-f056-4c47-b14d-9eb9ebe9de91 req-37f319eb-9ba4-4312-bf76-38ec1bad2800 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.151030 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bf9312a3-f056-4c47-b14d-9eb9ebe9de91 req-37f319eb-9ba4-4312-bf76-38ec1bad2800 service nova] Creating event network-changed:46852d7e-2a8c-4b69-b247-0200900d1218 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:17:57.157455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bf9312a3-f056-4c47-b14d-9eb9ebe9de91 req-37f319eb-9ba4-4312-bf76-38ec1bad2800 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036229 Oct 31 14:17:57.158434 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1732/3738] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:57.164684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.166117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 7288e187-fb7b-4904-95fe-e91ba8aea039] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:57.172990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.173805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.174459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.175364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.176149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.176742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.191864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] HTTP exception thrown: Instance 7288e187-fb7b-4904-95fe-e91ba8aea039 could not be found. Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Request method failure captured: Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 HTTP/1.1 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9atnPLnJ7oYvWhon-XMkYD9jenoZFcnReG9sz4J4tIhwlxQqFLppcUKvacmC8VIlUCSeHaQ7i4_1nCrhXlBPmJY7C7hIyq9GxE288Kt-wH2mpf6tl_3IOrIBnznGyy4mj6HhY3jFzHGTkTOiowRHLTDdTGpZ6Tek5OWekLLTptxm9I Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43d946eea72d40e08829491c65b4e750", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43d946eea72d40e08829491c65b4e750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: f6d0e8b2b04b47e69d87f436eb387941 Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 7288e187-fb7b-4904-95fe-e91ba8aea039 could not be found. Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7288e187-fb7b-4904-95fe-e91ba8aea039'} Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7288e187-fb7b-4904-95fe-e91ba8aea039 could not be found. Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7288e187-fb7b-4904-95fe-e91ba8aea039 could not be found. Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:57.193567 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7288e187-fb7b-4904-95fe-e91ba8aea039 could not be found. Oct 31 14:17:57.199131 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.200634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Returning 404 to user: Instance 7288e187-fb7b-4904-95fe-e91ba8aea039 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:57.201695 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d54ce98b-d247-49d1-a1c7-9a521844aab1 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039" status: 404 len: 111 microversion: 2.1 time: 0.041804 Oct 31 14:17:57.202291 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1733/3739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/servers/7288e187-fb7b-4904-95fe-e91ba8aea039 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:57.211442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.212603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:57.219719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.220218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.220657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.221589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.222044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.222503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.314320 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a2f7ada-fda4-4689-8f8a-fabcec426108 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110645 Oct 31 14:17:57.324763 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1734/3740] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:57.330225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29a6587a-f286-4a90-9909-cf8a3cddacf1 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe106b5cee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.429613 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29a6587a-f286-4a90-9909-cf8a3cddacf1 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.103281 Oct 31 14:17:57.430397 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1735/3741] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:57.435692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fc21a61a-f009-4e59-910a-5fdff1fd597c req-f42dbb72-88f6-442c-9a9a-aa4848d675b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:17:57.449182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fc21a61a-f009-4e59-910a-5fdff1fd597c req-f42dbb72-88f6-442c-9a9a-aa4848d675b7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.449825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fc21a61a-f009-4e59-910a-5fdff1fd597c req-f42dbb72-88f6-442c-9a9a-aa4848d675b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.450379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fc21a61a-f009-4e59-910a-5fdff1fd597c req-f42dbb72-88f6-442c-9a9a-aa4848d675b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.461203 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fc21a61a-f009-4e59-910a-5fdff1fd597c req-f42dbb72-88f6-442c-9a9a-aa4848d675b7 service nova] Creating event network-changed:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:17:57.467347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fc21a61a-f009-4e59-910a-5fdff1fd597c req-f42dbb72-88f6-442c-9a9a-aa4848d675b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035451 Oct 31 14:17:57.468064 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1736/3742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:57.476271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.476959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] [instance: c250ffcc-8637-425b-a0c3-7906f0afff8e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:57.483286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.483971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.484534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.485220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.485851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.486298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.500102 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] HTTP exception thrown: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Request method failure captured: Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e HTTP/1.1 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9eoZGANfO_gI-mEsBMMe-ZyX5PcSQzA97emk6w_k5FgftyyWEShIZRq2_kVZFz2b3e9KPVLrseEFGlnnVtH5OH7SfPNUAKGEmBNtRZrwtsu52QJBgbhS0VmKQYzRe__XSDNy3jWOBtJb8ehgPVBLZ4tXkbTlatVLgYjFxR0MtbfQEA Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d17ea27a1dc44bb3b2c4a9d12913a829", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d17ea27a1dc44bb3b2c4a9d12913a829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesTestJSON-249959883 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d17ea27a1dc44bb3b2c4a9d12913a829 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesTestJSON-249959883 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ec707d34966e44aa93900eebc62a6a93 Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesTestJSON-249959883-project Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c250ffcc-8637-425b-a0c3-7906f0afff8e'} Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.501751 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] Returning 404 to user: Instance c250ffcc-8637-425b-a0c3-7906f0afff8e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:17:57.507756 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-739ce915-7ed9-4074-9a55-ff738e92bba7 tempest-ImagesTestJSON-249959883 tempest-ImagesTestJSON-249959883-project] 10.222.0.27 "GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e" status: 404 len: 111 microversion: 2.1 time: 0.030787 Oct 31 14:17:57.513444 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1737/3743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/servers/c250ffcc-8637-425b-a0c3-7906f0afff8e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:57.518599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f682f64-c096-42a3-b2aa-0a63983d9fa1 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '.version_select at 0x7fe106b5cdc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.600227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:57.611998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5096a4f0-396a-4400-aa70-5613410c3dd8 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.558492 Oct 31 14:17:57.614020 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2007/3744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:57.646089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.647364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:57.660296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.660794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.661233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.661949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.662445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.662866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.691523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:17:57.713478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:57.824982 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81261647-b21a-42c2-bd9d-e7b9c0bcdba6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 204 len: 0 microversion: 2.1 time: 0.195299 Oct 31 14:17:57.828185 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2008/3745] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:17:57 2022] DELETE /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:17:57.835308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11e22c0b-8584-491c-92ef-3e8343b91008 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe106504790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.952730 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11e22c0b-8584-491c-92ef-3e8343b91008 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.123222 Oct 31 14:17:57.953578 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2009/3746] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:17:57.963315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:57.964310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:57.979153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.980523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.981080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:57.982017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:57.982677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:57.983547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:58.543393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:58.551669 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-add3381d-c47d-458f-8406-3b004ad74c16 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.596657 Oct 31 14:17:58.566711 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2010/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:57 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:58.573246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:58.573867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:58.580283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:58.580777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:58.581437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:58.582224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:58.582845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:58.583483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:59.018927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:59.029077 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad5eb5d9-d42b-4c6f-b79d-015ed31cfaf7 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1494 microversion: 2.1 time: 0.460964 Oct 31 14:17:59.042903 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2011/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:58 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1494 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:59.050537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2f96e10-2740-44dc-8eb3-c0039645b408 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] Calling method '.version_select at 0x7fe1065045e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:59.150700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2f96e10-2740-44dc-8eb3-c0039645b408 tempest-VolumesTestJSON-469905066 tempest-VolumesTestJSON-469905066-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.106053 Oct 31 14:17:59.151508 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2012/3749] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:17:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:17:59.156374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:59.157100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:59.167318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:59.167797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:59.168351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:59.169743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:59.170358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:59.170893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:59.657886 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f682f64-c096-42a3-b2aa-0a63983d9fa1 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/942dab53-7ae1-4c27-ad80-5195b2e055bb" status: 202 len: 0 microversion: 2.1 time: 2.141985 Oct 31 14:17:59.659974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1738/3750] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:17:57 2022] DELETE /compute/v2.1/os-floating-ips/942dab53-7ae1-4c27-ad80-5195b2e055bb => generated 0 bytes in 2145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:17:59.667431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:17:59.668610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:17:59.678575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:59.679359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:59.679963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:59.681581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:17:59.683113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:17:59.683809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:17:59.713731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:59.948290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:59.963850 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-61028b2a-da17-4084-8890-d72e26306bc3 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.301398 Oct 31 14:17:59.990000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:17:59.999537 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1739/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:17:59 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:00.014009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:00.015535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7288e187-fb7b-4904-95fe-e91ba8aea039", "name": "network-vif-deleted", "tag": "32357038-e558-426c-96f8-b6edda5f50c4"}, {"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "6089802b-32ee-4dc1-aca0-94c27f3a0139"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:00.018635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:00.022306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa7d8f4a-759e-4e67-8047-7fa28225bfa7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.868657 Oct 31 14:18:00.024636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2013/3752] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:17:59 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:00.037891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:00.038955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:00.059000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.061867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.067445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.085569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.087217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.087942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.089995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.091219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.094678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.112833 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] Creating event network-vif-deleted:32357038-e558-426c-96f8-b6edda5f50c4 for instance 7288e187-fb7b-4904-95fe-e91ba8aea039 on n-h2-863052-1 Oct 31 14:18:00.116206 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] Creating event network-changed:6089802b-32ee-4dc1-aca0-94c27f3a0139 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:00.130424 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-235c70c5-828f-4fb1-a131-5fae52f4bb81 req-eed0e53a-9fd1-4c49-b2fe-c9a7840c8ae3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.128958 Oct 31 14:18:00.136445 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1740/3753] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:00.144990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c625b55-7e82-41b9-baf9-77cc522b6f07 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '.version_select at 0x7fe106b5c9d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:00.624675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c625b55-7e82-41b9-baf9-77cc522b6f07 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/aa5c46d6-ba35-41c8-8777-e3718e29b965" status: 202 len: 0 microversion: 2.1 time: 0.486281 Oct 31 14:18:00.628151 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1741/3754] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:18:00 2022] DELETE /compute/v2.1/os-security-groups/aa5c46d6-ba35-41c8-8777-e3718e29b965 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:18:00.630248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:00.631089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:00.643819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.646492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.647062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.652233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.652956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.655047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.750267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.752000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.752462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.754337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lazy-loading 'fault' on Instance uuid 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:18:00.764371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:00.776931 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54e2842e-534f-4d3e-a66e-5c8b476ec4b9 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.749924 Oct 31 14:18:00.779646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2014/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:00 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:00.800520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:00.801031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:00.808190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.808811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.809650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.810643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:00.811374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:00.812052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:00.850063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:00.884954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:00.896131 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-985acf08-3494-416c-b734-dc9817168fbc tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 200 len: 1304 microversion: 2.1 time: 0.269344 Oct 31 14:18:00.896736 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1742/3756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:00 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 1304 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:00.991174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:00.993549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:01.012626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.014733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.015507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.018888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.020787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.022320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.025540 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18314a2d-457e-48c1-8e5f-278e08d78fd9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 204 len: 0 microversion: 2.1 time: 0.244018 Oct 31 14:18:01.027084 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2015/3757] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:00 2022] DELETE /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:01.039250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:01.043106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:01.066774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.069253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.070810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.072088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.073350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.074066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.312387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:01.325221 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfc1f179-4e38-437c-a649-48606d8e71a9 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1509 microversion: 2.1 time: 0.292517 Oct 31 14:18:01.338946 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2016/3758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:01 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1509 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:01.351893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:01.357679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:01.370812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.371316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.371760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.373117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.373585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.374253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.384609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:01.404731 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e2ad720-4336-4bf8-82b0-b38ade4ba378 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.419517 Oct 31 14:18:01.405624 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1743/3759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:00 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:01.815812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:01.821941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:01.822115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:01.840302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:01.846556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.847690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.848861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.850312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.851073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.852234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.862927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:01.864422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-690b4956-6bd9-485a-8ee2-16e83373dc01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.524372 Oct 31 14:18:01.865869 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2017/3760] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:01 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:01.920697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:01.921867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:01.936200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.936724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.937155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.937868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:01.938362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:01.938795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:01.987297 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] HTTP exception thrown: Instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 could not be found. Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Request method failure captured: Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 HTTP/1.1 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9atnPLnJ7oYvWhon-XMkYD9jenoZFcnReG9sz4J4tIhwlxQqFLppcUKvacmC8VIlUCSeHaQ7i4_1nCrhXlBPmJY7C7hIyq9GxE288Kt-wH2mpf6tl_3IOrIBnznGyy4mj6HhY3jFzHGTkTOiowRHLTDdTGpZ6Tek5OWekLLTptxm9I Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43d946eea72d40e08829491c65b4e750", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43d946eea72d40e08829491c65b4e750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: f6d0e8b2b04b47e69d87f436eb387941 Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 could not be found. Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5'} Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 could not be found. Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 could not be found. Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:01.996308 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 could not be found. Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Returning 404 to user: Instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:02.001551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c91cb81-e18c-43e3-b24d-20402c128518 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5" status: 404 len: 111 microversion: 2.1 time: 0.081751 Oct 31 14:18:02.004173 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2018/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:01 2022] GET /compute/v2.1/servers/8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:18:02.009599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:02.012575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:02.033648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.034310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.034626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.035338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.040388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.041060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.110951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:02.232902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71ac28a6-6f33-41c3-9ce5-918e5c539080 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 204 len: 0 microversion: 2.1 time: 0.227235 Oct 31 14:18:02.234875 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2019/3762] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:02 2022] DELETE /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:02.242302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5", "name": "network-vif-deleted", "tag": "4763e0ff-5484-4925-9f3c-283cc524703d"}, {"name": "network-changed", "server_uuid": "679c6ed9-8d8f-47cb-b1c1-752bf554da3c", "tag": "c47b4013-a988-4e5c-84c0-ed38b18b11f0"}, {"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "9e6cbca7-c973-4376-930d-70035fa11e33"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:02.261958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.262747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.263203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.279066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Creating event network-vif-deleted:4763e0ff-5484-4925-9f3c-283cc524703d for instance 8a086a62-f185-4d5b-bb3d-3e5fc1eae4d5 on n-h1-863052-1 Oct 31 14:18:02.280296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Creating event network-changed:c47b4013-a988-4e5c-84c0-ed38b18b11f0 for instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c on n-h2-863052-1 Oct 31 14:18:02.280964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] Creating event network-changed:9e6cbca7-c973-4376-930d-70035fa11e33 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:02.292407 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-528d16ec-1333-490e-a369-5bba8b64e322 req-c612da11-b66a-46f4-af4e-7d741240f01a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.055674 Oct 31 14:18:02.293979 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2020/3763] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:02.301171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:02.301332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:02.302248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:02.313720 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0f57c75-7f6b-4981-b638-b69c13f89027 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.514642 Oct 31 14:18:02.314352 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1744/3764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:01 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:02.333183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.333183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.333183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.333183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.333183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.333183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.355632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:02.356255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:02.369922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.370475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.370920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.371653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.372125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.372547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.701350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:02.702231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:02.714591 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7f21e8d8-7787-4fce-8a65-244d66625983 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1509 microversion: 2.1 time: 0.363128 Oct 31 14:18:02.726371 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2167a0be-3880-4400-90a4-d7a34656fb34 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1674 microversion: 2.1 time: 0.426657 Oct 31 14:18:02.727021 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2021/3765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:02 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1674 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:02.736622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1745/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:02 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:02.757092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:02.766018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:02.790579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.791085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.791732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.792236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.792721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.793106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.896702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:02.897315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:02.919637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.920393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.920843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:02.921584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:02.922046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:02.922501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:03.078824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:03.088370 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bbddafa-a231-4e19-8089-8df52fd5be36 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.345923 Oct 31 14:18:03.089347 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2022/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:02 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:03.341099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:03.341635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:03.349846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:03.350362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:03.350799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:03.351504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:03.351952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:03.352921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:03.555517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:03.565537 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59c7b464-c646-457b-9c40-1501c9c8c9ae tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1477 microversion: 2.1 time: 0.228417 Oct 31 14:18:03.566145 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2023/3768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:03 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:03.743594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:03.744215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:03.759441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:03.760275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:03.761190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:03.761679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:03.764506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:03.764975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:03.779587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:03.836171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:03.851869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:03.853915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:03.866420 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-abffc498-8f92-435d-b166-c5efcb5d34a6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.973429 Oct 31 14:18:03.867015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1746/3769] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:02 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:18:03.903514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:03.904871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:03.925399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:03.927388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:03.928109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:03.929075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:03.929758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:03.930644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:04.323144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:04.334130 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02990024-5651-4ccb-bb16-6d8147875f99 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1674 microversion: 2.1 time: 0.442507 Oct 31 14:18:04.346826 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1747/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:03 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1674 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:04.358416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:04.359731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:04.372763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:04.373506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:04.374130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:04.375700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:04.379599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:04.381241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:04.631665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:04.641703 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c603f00-b929-48f7-9b21-3e1aca0ef175 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1509 microversion: 2.1 time: 0.902010 Oct 31 14:18:04.665599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:04.675039 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2024/3771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:03 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1509 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:04.681833 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8043a699-c4b4-47eb-a546-82911f5f9aa5 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 0.333572 Oct 31 14:18:04.686218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:04.686930 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1748/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:04 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:04.698470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:04.710575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:04.718460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:04.719167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:04.719936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:04.720410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:04.720844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:04.896606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:04.897408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:04.906129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:04.908821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:04.909274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:04.912772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:04.913250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:04.913684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.216602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:05.236672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:05.239107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:05.240636 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a239ca1-f78f-4dd2-9bf7-2d46232c73b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.348711 Oct 31 14:18:05.241752 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1749/3773] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:04 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:05.248301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-00c11292-261c-4e10-884f-38193a17a5c7 req-4c0a94b5-11dc-41c5-aa15-51b553e6e7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5908187-cdb3-4eaa-99aa-c37e8c7614a5", "name": "network-vif-plugged", "status": "completed", "tag": "7401c927-21ce-4667-bca1-cdd3d199e9ad"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:05.262395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-00c11292-261c-4e10-884f-38193a17a5c7 req-4c0a94b5-11dc-41c5-aa15-51b553e6e7c2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.263305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-00c11292-261c-4e10-884f-38193a17a5c7 req-4c0a94b5-11dc-41c5-aa15-51b553e6e7c2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.263968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-00c11292-261c-4e10-884f-38193a17a5c7 req-4c0a94b5-11dc-41c5-aa15-51b553e6e7c2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.280843 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-00c11292-261c-4e10-884f-38193a17a5c7 req-4c0a94b5-11dc-41c5-aa15-51b553e6e7c2 service nova] Creating event network-vif-plugged:7401c927-21ce-4667-bca1-cdd3d199e9ad for instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 on n-h1-863052-1 Oct 31 14:18:05.287047 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-00c11292-261c-4e10-884f-38193a17a5c7 req-4c0a94b5-11dc-41c5-aa15-51b553e6e7c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042940 Oct 31 14:18:05.288402 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1750/3774] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:05.363406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:05.364631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:05.372877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.373343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.374207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.374977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.375742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.376177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.539825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:05.560177 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c5e9c8a-1d0b-4f9d-8566-4c89620db70d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1476 microversion: 2.1 time: 0.883258 Oct 31 14:18:05.561560 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2025/3775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:04 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1476 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:05.667855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "name": "network-vif-unplugged", "status": "completed", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:05.689334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.690841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.691636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.706661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:05.712205 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] Creating event network-vif-unplugged:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h2-863052-1 Oct 31 14:18:05.719452 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9d8528c-f40e-4886-8748-29faa6d93a27 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1674 microversion: 2.1 time: 0.360600 Oct 31 14:18:05.720069 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1751/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:05 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1674 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:05.720351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:18:05.727345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:05.730952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:05.736552 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5598bb94-b8f7-4353-8881-dcf9aa11efca req-53092214-fa54-4f1b-8843-e8f272ee95e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072424 Oct 31 14:18:05.738567 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2026/3777] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:18:05.748478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:05.749635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:05.750192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.750822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.751285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.752039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.752504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.759188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.759702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.760453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.761106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:05.761973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:05.762753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:05.763499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:06.102500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:06.111499 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d5e9eb6-eb23-4215-8acc-fe18f6e6a805 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1509 microversion: 2.1 time: 0.390350 Oct 31 14:18:06.117042 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1752/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:05 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:06.271220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:06.272178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:06.278905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:06.280066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:06.280676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:06.281581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:06.284549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:06.285146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:06.754525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:06.770629 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cfd3464f-cbfc-46f4-a232-e4234aa5cc47 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1370 microversion: 2.1 time: 1.022408 Oct 31 14:18:06.771289 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2027/3779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:05 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1370 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:06.778904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:06.783691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:06.811990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:06.813508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:06.814620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:06.815903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:06.816724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:06.817456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:06.851110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:06.876691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:06.879375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:06.885645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32069b27-1fc4-47fa-8516-40fc465d88a3 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.613352 Oct 31 14:18:06.886350 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1753/3780] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:06 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:06.899436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:06.900063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:06.921453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:06.922005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:06.922475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:06.935240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:06.935971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:06.936580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.163886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:07.191265 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33aa9682-238d-4a7e-83b1-6332b489a1fd tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1674 microversion: 2.1 time: 0.301802 Oct 31 14:18:07.212221 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1754/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:06 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:07.217937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:07.223291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:07.237771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.238628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.239285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.240478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.243813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.244590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.386119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9cce9c3724edabaa98cd00078355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d422f9bf004e6cb67d83e88cc86792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:07.398399 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1431364-08cd-4543-a546-179f091852e7 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 200 len: 1467 microversion: 2.1 time: 0.184818 Oct 31 14:18:07.410915 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1755/3782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:07 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 1467 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:07.486331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-77ab2e6f-679f-4ae6-bce5-6f07dba94c1b req-e375e6a8-3420-42e0-bece-88c7b6801855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46e9c75-491d-4fcf-bb2b-8a48c41c30df", "name": "network-vif-deleted", "tag": "f65a0e14-0c19-4b7a-bc6c-df4f911cc959"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:07.502197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-77ab2e6f-679f-4ae6-bce5-6f07dba94c1b req-e375e6a8-3420-42e0-bece-88c7b6801855 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.503281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-77ab2e6f-679f-4ae6-bce5-6f07dba94c1b req-e375e6a8-3420-42e0-bece-88c7b6801855 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.503999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-77ab2e6f-679f-4ae6-bce5-6f07dba94c1b req-e375e6a8-3420-42e0-bece-88c7b6801855 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.526001 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-77ab2e6f-679f-4ae6-bce5-6f07dba94c1b req-e375e6a8-3420-42e0-bece-88c7b6801855 service nova] Creating event network-vif-deleted:f65a0e14-0c19-4b7a-bc6c-df4f911cc959 for instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df on n-h1-863052-1 Oct 31 14:18:07.532924 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-77ab2e6f-679f-4ae6-bce5-6f07dba94c1b req-e375e6a8-3420-42e0-bece-88c7b6801855 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050375 Oct 31 14:18:07.534088 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1756/3783] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:07.578751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:07.593917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5a55744-b0fe-4d8b-94d4-c86d86689919 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1476 microversion: 2.1 time: 0.820071 Oct 31 14:18:07.599017 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2028/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:06 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1476 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:07.760511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:07.782127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.782980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.783594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.795104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:07.796507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:07.806226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.807916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.815190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.816037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.816569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.817191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.821349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] Creating event network-changed:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h2-863052-1 Oct 31 14:18:07.842110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:18:07.854521 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6878f378-b566-4519-abae-5b11318d03c4 req-2fb3b6a3-cb28-4c87-8a10-90d44397135f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098405 Oct 31 14:18:07.855710 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1757/3785] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:07.918831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:07.919814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:07.927000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.927859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.928542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:07.929481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:07.930721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:07.931455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.006133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:08.028626 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c76e1c68-859c-432d-a047-ffec80e46c21 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1556 microversion: 2.1 time: 0.239248 Oct 31 14:18:08.029944 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2029/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:07 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:08.053858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:08.054761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:08.061138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.061963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.062761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.063698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.064524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.065177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.193259 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da37b5fd-54f9-49b9-8a24-d7b7fecb4734 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143981 Oct 31 14:18:08.193874 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2030/3787] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:18:08 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:08.215721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:08.216355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:08.231348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.232099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.232946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.235650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.236315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.236931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.398970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:08.402222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:08.413357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:08.420036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:08.421539 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e3936c0-673c-4f4f-ac48-af62faed3e96 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.508284 Oct 31 14:18:08.422748 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1758/3788] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:07 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:08.428205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:08.429155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] [instance: a46e9c75-491d-4fcf-bb2b-8a48c41c30df] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:08.436352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.437196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.438094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.439323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.440020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.440660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.467772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] HTTP exception thrown: Instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df could not be found. Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Request method failure captured: Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df HTTP/1.1 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9jCqGsK6bb39mVz7wCq6iE4CNWZWz-fXfKzuI_Sk5G-U25IwuqoKGJ-gLdejTc8W2VT3d0auKEex4978BTqMU1zzGi9XSO8DywILEpz3bvXTtMriuSy-1yhsX1piN2msTMbLNFC7f2EeGxcY7QLA97mH182-aDf9f5zf0NqMP3Nmas Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c7d422f9bf004e6cb67d83e88cc86792 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-94483409 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7d422f9bf004e6cb67d83e88cc86792", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7d422f9bf004e6cb67d83e88cc86792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7d422f9bf004e6cb67d83e88cc86792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7d422f9bf004e6cb67d83e88cc86792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-94483409 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c7d422f9bf004e6cb67d83e88cc86792 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-94483409 Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueTestJSONUnderV235-94483409-project Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: c0e9cce9c3724edabaa98cd00078355d Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-94483409-project Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df could not be found. Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a46e9c75-491d-4fcf-bb2b-8a48c41c30df'} Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df could not be found. Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df could not be found. Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:08.470045 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df could not be found. Oct 31 14:18:08.475473 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:08.477900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] Returning 404 to user: Instance a46e9c75-491d-4fcf-bb2b-8a48c41c30df could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:08.485812 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31c59cec-3167-4527-b7b5-9e18da3df8a0 tempest-ServerRescueTestJSONUnderV235-94483409 tempest-ServerRescueTestJSONUnderV235-94483409-project] 10.222.0.27 "GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df" status: 404 len: 111 microversion: 2.1 time: 0.055045 Oct 31 14:18:08.487139 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1759/3789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:08 2022] GET /compute/v2.1/servers/a46e9c75-491d-4fcf-bb2b-8a48c41c30df => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:08.538731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:08.548884 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af83df5d-7873-4091-a896-52515f6633c6 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1607 microversion: 2.1 time: 0.337525 Oct 31 14:18:08.550149 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2031/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:08 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1607 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:08.622260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:08.623100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:08.640775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.642608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.643220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:08.652147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:08.652863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:08.653495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:09.098616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:09.107077 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e98571df-8dd4-49fa-bdca-7285b51ec24b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1474 microversion: 2.1 time: 0.489816 Oct 31 14:18:09.110801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1760/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:08 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1474 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:09.453466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:09.454654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:09.469324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:09.469823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:09.470514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:09.472185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:09.472642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:09.475701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:09.575007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:09.575704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:09.591014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:09.596253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:09.599999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:09.600779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:09.601253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:09.601687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:09.735448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:09.738848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:09.741352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:09.745470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lazy-loading 'fault' on Instance uuid d1d5ebb5-529e-4b8b-9908-39905e0c9a9b {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:18:09.826559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d0e8b2b04b47e69d87f436eb387941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d946eea72d40e08829491c65b4e750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:09.834924 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7e957a5-fed3-4b3f-9313-c085e6f97874 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 200 len: 1328 microversion: 2.1 time: 0.265818 Oct 31 14:18:09.838066 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1761/3792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:09 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:10.167422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89f28528-b368-4556-a7e3-2892c024cc85 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.328001 Oct 31 14:18:10.168336 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1762/3793] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 31 14:18:09 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:18:10.182519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:10.184336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:10.203275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:10.206322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:10.206954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:10.208547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:10.211530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:10.212156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:10.653000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:10.674797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-986e5d84-92b2-41d4-ba54-ac1f8d39b623 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1471 microversion: 2.1 time: 0.499738 Oct 31 14:18:10.676372 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1763/3794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:10 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1471 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:10.690727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96da2bf5-627d-44e6-8c89-e9c64eb08d89 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Calling method '.version_select at 0x7fe106b18310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:10.735998 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-96da2bf5-627d-44e6-8c89-e9c64eb08d89 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] HTTP exception thrown: Image not found. Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96da2bf5-627d-44e6-8c89-e9c64eb08d89 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Request method failure captured: Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9khbn4iCyRtnSjmJXBRC6AfiY7YZ6PnJzXa-nSz8WnT-pBfpdeCdCUaqb1lCjPr_KG9boviJwu8osj1mjnUpI8cv65eDLi2QaF6sptCWnrdQttjDrh1jzBHRGrv-c3ikKZloxkBZhu_TCwv9w9la7Me2DEw-qDaxpYA4Zmi6pGGYfY Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d383c1c6bdaf4fcb9ee4ab099e932db3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 57a206f2200f46aaab1694ec888de9c7 Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '-1'} Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.737785 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:18:10.742937 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:10.745074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96da2bf5-627d-44e6-8c89-e9c64eb08d89 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:10.745986 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-96da2bf5-627d-44e6-8c89-e9c64eb08d89 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.068463 Oct 31 14:18:10.746470 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1764/3795] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 31 14:18:10 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:18:10.760473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-df6d4c0e-3805-48ab-90a7-0cbe095cf09a req-dc6568dc-df43-4634-90eb-8696b241f71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d5ebb5-529e-4b8b-9908-39905e0c9a9b", "name": "network-vif-deleted", "tag": "5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:10.778012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df6d4c0e-3805-48ab-90a7-0cbe095cf09a req-dc6568dc-df43-4634-90eb-8696b241f71a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:10.778788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df6d4c0e-3805-48ab-90a7-0cbe095cf09a req-dc6568dc-df43-4634-90eb-8696b241f71a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:10.779250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df6d4c0e-3805-48ab-90a7-0cbe095cf09a req-dc6568dc-df43-4634-90eb-8696b241f71a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:10.801683 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-df6d4c0e-3805-48ab-90a7-0cbe095cf09a req-dc6568dc-df43-4634-90eb-8696b241f71a service nova] Creating event network-vif-deleted:5f9d7d17-1ce0-4fd7-8db6-c4b2b045d624 for instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b on n-h2-863052-1 Oct 31 14:18:10.815429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-df6d4c0e-3805-48ab-90a7-0cbe095cf09a req-dc6568dc-df43-4634-90eb-8696b241f71a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059874 Oct 31 14:18:10.818835 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1765/3796] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:10.831881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:10.834829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:10.854962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:10.855515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:10.855963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:10.859597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:10.860306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:10.861152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:10.937879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:10.952855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:10.954621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:10.960345 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c15d389b-f91e-4c89-8b52-9986c7c025b9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 1.511364 Oct 31 14:18:10.974277 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2032/3797] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:09 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:10.979074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ae4a2e5-8eb9-49d5-9cca-690258b9ec10 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Calling method '.version_select at 0x7fe1064ceaf0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.009124 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1ae4a2e5-8eb9-49d5-9cca-690258b9ec10 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] HTTP exception thrown: Image not found. Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ae4a2e5-8eb9-49d5-9cca-690258b9ec10 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Request method failure captured: Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/images/0c50ab7c-c368-4a23-b39e-75b4ded25a1j HTTP/1.1 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9khbn4iCyRtnSjmJXBRC6AfiY7YZ6PnJzXa-nSz8WnT-pBfpdeCdCUaqb1lCjPr_KG9boviJwu8osj1mjnUpI8cv65eDLi2QaF6sptCWnrdQttjDrh1jzBHRGrv-c3ikKZloxkBZhu_TCwv9w9la7Me2DEw-qDaxpYA4Zmi6pGGYfY Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d383c1c6bdaf4fcb9ee4ab099e932db3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 57a206f2200f46aaab1694ec888de9c7 Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: exception: Image not found. Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '0c50ab7c-c368-4a23-b39e-75b4ded25a1j'} Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c50ab7c-c368-4a23-b39e-75b4ded25a1j to delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c50ab7c-c368-4a23-b39e-75b4ded25a1j could not be found. Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.011842 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:18:11.016118 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.022062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ae4a2e5-8eb9-49d5-9cca-690258b9ec10 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Returning 404 to user: Image not found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:11.023290 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ae4a2e5-8eb9-49d5-9cca-690258b9ec10 tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] 10.222.0.27 "DELETE /compute/v2.1/images/0c50ab7c-c368-4a23-b39e-75b4ded25a1j" status: 404 len: 62 microversion: 2.1 time: 0.060813 Oct 31 14:18:11.025008 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2033/3798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:10 2022] DELETE /compute/v2.1/images/0c50ab7c-c368-4a23-b39e-75b4ded25a1j => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:18:11.032547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.034910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] [instance: d1d5ebb5-529e-4b8b-9908-39905e0c9a9b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:11.054612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:11.058879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:11.059621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:11.060608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:11.061334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:11.063793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:11.126255 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] HTTP exception thrown: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b could not be found. Oct 31 14:18:11.128320 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fab3e5f5-0825-4e47-b458-c8cfce4c518c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "POST /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.307565 Oct 31 14:18:11.129222 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1766/3799] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:18:10 2022] POST /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Request method failure captured: Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b HTTP/1.1 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9atnPLnJ7oYvWhon-XMkYD9jenoZFcnReG9sz4J4tIhwlxQqFLppcUKvacmC8VIlUCSeHaQ7i4_1nCrhXlBPmJY7C7hIyq9GxE288Kt-wH2mpf6tl_3IOrIBnznGyy4mj6HhY3jFzHGTkTOiowRHLTDdTGpZ6Tek5OWekLLTptxm9I Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43d946eea72d40e08829491c65b4e750", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43d946eea72d40e08829491c65b4e750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43d946eea72d40e08829491c65b4e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 43d946eea72d40e08829491c65b4e750 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674608452 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: f6d0e8b2b04b47e69d87f436eb387941 Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1674608452-project Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b could not be found. Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'd1d5ebb5-529e-4b8b-9908-39905e0c9a9b'} Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b could not be found. Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b could not be found. Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.133320 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b could not be found. Oct 31 14:18:11.138442 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.141514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Returning 404 to user: Instance d1d5ebb5-529e-4b8b-9908-39905e0c9a9b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:11.142619 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21f72c4a-9b75-4ac2-a08d-b73c91acf0bf tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b" status: 404 len: 111 microversion: 2.1 time: 0.116386 Oct 31 14:18:11.145812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05a4a27d-3940-42eb-a6c5-573e19592fad tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Calling method '.version_select at 0x7fe106bbd1f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.146676 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2034/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:11 2022] GET /compute/v2.1/servers/d1d5ebb5-529e-4b8b-9908-39905e0c9a9b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:11.160457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.162014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:11.171200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:11.172718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:11.173554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:11.174696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:11.175432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:11.176474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:11.192751 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-05a4a27d-3940-42eb-a6c5-573e19592fad tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] HTTP exception thrown: Image not found. Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05a4a27d-3940-42eb-a6c5-573e19592fad tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Request method failure captured: Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/e1e00cce-d3fb-4549-9d45-e4015032f9e51 HTTP/1.1 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9khbn4iCyRtnSjmJXBRC6AfiY7YZ6PnJzXa-nSz8WnT-pBfpdeCdCUaqb1lCjPr_KG9boviJwu8osj1mjnUpI8cv65eDLi2QaF6sptCWnrdQttjDrh1jzBHRGrv-c3ikKZloxkBZhu_TCwv9w9la7Me2DEw-qDaxpYA4Zmi6pGGYfY Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d383c1c6bdaf4fcb9ee4ab099e932db3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 57a206f2200f46aaab1694ec888de9c7 Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e1e00cce-d3fb-4549-9d45-e4015032f9e51'} Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e1e00cce-d3fb-4549-9d45-e4015032f9e51 to delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1e00cce-d3fb-4549-9d45-e4015032f9e51 could not be found. Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.194923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05a4a27d-3940-42eb-a6c5-573e19592fad tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05a4a27d-3940-42eb-a6c5-573e19592fad tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] 10.222.0.27 "DELETE /compute/v2.1/images/e1e00cce-d3fb-4549-9d45-e4015032f9e51" status: 404 len: 62 microversion: 2.1 time: 0.064233 Oct 31 14:18:11.203062 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1767/3801] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:11 2022] DELETE /compute/v2.1/images/e1e00cce-d3fb-4549-9d45-e4015032f9e51 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:18:11.206083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-989cf6b5-06e6-4dc9-8461-d1ea0df22915 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] Calling method '.version_select at 0x7fe106bbd1f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.248728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-989cf6b5-06e6-4dc9-8461-d1ea0df22915 tempest-ServerActionsTestJSON-1674608452 tempest-ServerActionsTestJSON-1674608452-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298726212" status: 202 len: 0 microversion: 2.1 time: 0.048866 Oct 31 14:18:11.253340 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1768/3802] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298726212 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:18:11.264995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05c74196-a8cd-481c-9f83-3e535e0352bb tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Calling method '.version_select at 0x7fe106bb3160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.310535 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-05c74196-a8cd-481c-9f83-3e535e0352bb tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] HTTP exception thrown: Image not found. Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05c74196-a8cd-481c-9f83-3e535e0352bb tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Request method failure captured: Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/tempest-invalid-1816246823 HTTP/1.1 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9khbn4iCyRtnSjmJXBRC6AfiY7YZ6PnJzXa-nSz8WnT-pBfpdeCdCUaqb1lCjPr_KG9boviJwu8osj1mjnUpI8cv65eDLi2QaF6sptCWnrdQttjDrh1jzBHRGrv-c3ikKZloxkBZhu_TCwv9w9la7Me2DEw-qDaxpYA4Zmi6pGGYfY Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d383c1c6bdaf4fcb9ee4ab099e932db3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 57a206f2200f46aaab1694ec888de9c7 Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'tempest-invalid-1816246823'} Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1816246823 to delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1816246823 could not be found. Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.312691 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:18:11.318794 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.322660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05c74196-a8cd-481c-9f83-3e535e0352bb tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:11.324544 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05c74196-a8cd-481c-9f83-3e535e0352bb tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-1816246823" status: 404 len: 62 microversion: 2.1 time: 0.066141 Oct 31 14:18:11.325173 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1769/3803] 10.222.0.27 () {58 vars in 1206 bytes} [Mon Oct 31 14:18:11 2022] DELETE /compute/v2.1/images/tempest-invalid-1816246823 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:18:11.339162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2aa3eb2a-077f-4bca-9dcd-c2eda4768ebf tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Calling method '.version_select at 0x7fe10fc3e310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.365406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2aa3eb2a-077f-4bca-9dcd-c2eda4768ebf tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] HTTP exception thrown: Image not found. Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2aa3eb2a-077f-4bca-9dcd-c2eda4768ebf tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Request method failure captured: Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/images/535dfe68-4970-4605-8332-b5b2e09e3e0a HTTP/1.1 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9khbn4iCyRtnSjmJXBRC6AfiY7YZ6PnJzXa-nSz8WnT-pBfpdeCdCUaqb1lCjPr_KG9boviJwu8osj1mjnUpI8cv65eDLi2QaF6sptCWnrdQttjDrh1jzBHRGrv-c3ikKZloxkBZhu_TCwv9w9la7Me2DEw-qDaxpYA4Zmi6pGGYfY Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d383c1c6bdaf4fcb9ee4ab099e932db3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d383c1c6bdaf4fcb9ee4ab099e932db3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: d383c1c6bdaf4fcb9ee4ab099e932db3 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 57a206f2200f46aaab1694ec888de9c7 Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1165865995-project Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '535dfe68-4970-4605-8332-b5b2e09e3e0a'} Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 535dfe68-4970-4605-8332-b5b2e09e3e0a to delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 535dfe68-4970-4605-8332-b5b2e09e3e0a could not be found. Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.367877 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2aa3eb2a-077f-4bca-9dcd-c2eda4768ebf tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:11.372302 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2aa3eb2a-077f-4bca-9dcd-c2eda4768ebf tempest-ImagesDeleteNegativeTestJSON-1165865995 tempest-ImagesDeleteNegativeTestJSON-1165865995-project] 10.222.0.27 "DELETE /compute/v2.1/images/535dfe68-4970-4605-8332-b5b2e09e3e0a" status: 404 len: 62 microversion: 2.1 time: 0.038099 Oct 31 14:18:11.382907 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1770/3804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:11 2022] DELETE /compute/v2.1/images/535dfe68-4970-4605-8332-b5b2e09e3e0a => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:18:11.837097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:11.851285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e81d8cc-610c-4e50-b136-c44b09cff462 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.698726 Oct 31 14:18:11.857811 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2035/3805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:11 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:11.993330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:11.995202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:12.007746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:12.008858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:12.009301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:12.015188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:12.017829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:12.018366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:12.615554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:12.628355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:12.629814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:12.631006 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e665dfb-bbc0-4af6-a365-e4525655944f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.643581 Oct 31 14:18:12.635406 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1771/3806] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:11 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:12.814948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "name": "network-vif-plugged", "status": "completed", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:12.838950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:12.843365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:12.844039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:12.870710 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] Creating event network-vif-plugged:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h2-863052-1 Oct 31 14:18:12.885246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:12.886382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:12.887761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:18:12.894397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:12.894899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:12.898287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:12.899601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:12.900077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:12.906069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:12.916096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e3ac6c87-ef43-4048-8dad-5435d7033393 req-58ce0e70-1c96-4bd7-b385-3f19611327f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102388 Oct 31 14:18:12.916725 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2036/3807] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:13.242630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:13.257899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20cb0d35-9c8b-4a80-9704-c4ab21ec75ce tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.379908 Oct 31 14:18:13.275308 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1772/3808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:12 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:13.679612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9eae7e10-c84c-4658-8f5d-f76a83cb25be req-176580f6-2bad-4931-9744-15d999b9eb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5908187-cdb3-4eaa-99aa-c37e8c7614a5", "tag": "7401c927-21ce-4667-bca1-cdd3d199e9ad"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:13.681703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:13.685790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:13.700941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:13.701445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:13.701883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:13.708832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:13.709333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:13.709762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:13.716949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9eae7e10-c84c-4658-8f5d-f76a83cb25be req-176580f6-2bad-4931-9744-15d999b9eb4b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:13.720662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9eae7e10-c84c-4658-8f5d-f76a83cb25be req-176580f6-2bad-4931-9744-15d999b9eb4b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:13.721688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9eae7e10-c84c-4658-8f5d-f76a83cb25be req-176580f6-2bad-4931-9744-15d999b9eb4b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:13.764712 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9eae7e10-c84c-4658-8f5d-f76a83cb25be req-176580f6-2bad-4931-9744-15d999b9eb4b service nova] Creating event network-changed:7401c927-21ce-4667-bca1-cdd3d199e9ad for instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 on n-h1-863052-1 Oct 31 14:18:13.777305 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9eae7e10-c84c-4658-8f5d-f76a83cb25be req-176580f6-2bad-4931-9744-15d999b9eb4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108907 Oct 31 14:18:13.778761 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1773/3809] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:14.277026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:14.300484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:14.301208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:14.312023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:14.318921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:14.322427 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c43e6cfc-1871-41fe-8213-ec22b8dd031d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.658957 Oct 31 14:18:14.324928 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2037/3810] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:13 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:14.335092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:14.335596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:14.336046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:14.337286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:14.341006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:14.341684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:14.737084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:14.749340 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c19030cb-19a5-418e-a193-6338945c784b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.454186 Oct 31 14:18:14.750701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1774/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:14 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:15.356471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:15.368458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:15.381675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:15.382461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:15.383108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:15.384589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:15.385228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:15.385825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:15.773083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:15.774315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:15.783796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:15.784289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:15.784780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:15.785515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:15.786010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:15.786681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:15.841623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:15.862911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:15.867257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:15.869122 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a896980-13d1-49e2-ac04-93098ae03574 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.519522 Oct 31 14:18:15.871700 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2038/3812] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:15 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:16.174132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:16.184349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1101338-47f4-4099-9b58-7af51bbf1c58 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.414665 Oct 31 14:18:16.195959 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1775/3813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:15 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:16.896041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:16.897334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:16.906340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:16.906844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:16.907290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:16.908002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:16.908464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:16.909005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:17.215330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:17.216525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:17.228979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:17.229489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:17.229935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:17.231130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:17.231588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:17.232022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:17.444055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:17.460767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:17.467777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:17.469426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fee42a86-91ae-4c4b-9f92-84ecb7b6b55e tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.577459 Oct 31 14:18:17.474862 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2039/3814] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:16 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:17.630316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:17.642782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8423de7-4789-4a41-926f-5bf9b5655335 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.432286 Oct 31 14:18:17.660912 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1776/3815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:17 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:18.501411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:18.502024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:18.514763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:18.516596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:18.517452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:18.518524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:18.521460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:18.522076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:18.740436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ae8fbfa-fd37-4f41-8b3a-0be25cbee8ab tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Action: 'create', calling method: .version_select at 0x7fe106b26820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1235641202", "metadata": {"Type": "work"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:19.262119 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ae8fbfa-fd37-4f41-8b3a-0be25cbee8ab tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.758153 Oct 31 14:18:19.269863 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1777/3816] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 31 14:18:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 767 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 14:18:19.277511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:19.279198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:19.286935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:19.287963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:19.288693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:19.290375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:19.291059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:19.291889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:19.545369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:19.562644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:19.565564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:19.572170 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5886f733-ba1f-4edf-a972-6bb7353b7562 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 1.072052 Oct 31 14:18:19.574569 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2040/3817] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:18 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:19.590752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65c15a5c-8aea-470c-a139-841521eadf88 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe1064eb5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:19.649276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65c15a5c-8aea-470c-a139-841521eadf88 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 353 microversion: 2.1 time: 0.072924 Oct 31 14:18:19.650390 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2041/3818] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:19 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:19.677751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:19.686403 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a071c23e-7da5-478c-8d94-f06380838c67 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.415049 Oct 31 14:18:19.703349 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1778/3819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:19 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:20.042773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "name": "network-vif-unplugged", "status": "completed", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:20.063330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:20.063826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:20.064262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:20.097177 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] Creating event network-vif-unplugged:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h1-863052-1 Oct 31 14:18:20.104588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:18:20.120358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4073627f-275a-4edd-bd18-d6b8d9bf99cb req-d412cc53-3673-4fa5-860e-d6442730578c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083896 Oct 31 14:18:20.121928 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2042/3820] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 31 14:18:20.605573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:20.607519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:20.628051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:20.628600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:20.630338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:20.631107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:20.631555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:20.631991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:20.667981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca3e6b19-c62b-46fa-835d-ec35c762c187 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe10657a700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:20.819190 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca3e6b19-c62b-46fa-835d-ec35c762c187 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 353 microversion: 2.1 time: 0.159164 Oct 31 14:18:20.820109 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2043/3821] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:20 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:18:20.825422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:20.826241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:20.846901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:20.853231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:20.856351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:20.857328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:20.859328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:20.859786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:21.248878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:21.279223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:21.281156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:21.282414 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d18dfba6-46fe-4332-9bb9-da06beb9fb5f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.684971 Oct 31 14:18:21.299230 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1779/3822] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:20 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:21.543285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:21.556758 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a975e82e-275d-45a1-9c4f-7c4da345e7fa tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.735031 Oct 31 14:18:21.558646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2044/3823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:20 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:21.835042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c425f5fc-3c9b-4dbd-b6bb-8320d669dc3d tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe106b26e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:21.928523 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c425f5fc-3c9b-4dbd-b6bb-8320d669dc3d tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 354 microversion: 2.1 time: 0.098549 Oct 31 14:18:21.929095 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1780/3824] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:21 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:21.942452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a766adf-a266-4c40-9326-9f1a20f42366 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe106500670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:22.038466 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a766adf-a266-4c40-9326-9f1a20f42366 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 354 microversion: 2.1 time: 0.099437 Oct 31 14:18:22.038939 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2045/3825] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:21 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:22.054458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf687f69-9b35-4d16-bacb-00bc47f58007 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe106b00d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:22.193760 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf687f69-9b35-4d16-bacb-00bc47f58007 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 202 len: 0 microversion: 2.1 time: 0.144031 Oct 31 14:18:22.195333 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1781/3826] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:18:22 2022] DELETE /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:18:22.197769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:22.207957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0123c513-f958-4e62-9962-5c8c19757271 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe106b32430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:22.243807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:22.244556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:22.244990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:22.275935 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] Creating event network-changed:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h1-863052-1 Oct 31 14:18:22.299385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:18:22.333361 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d5bcbc67-34fa-45ef-b385-c7a2d957869c req-b42fb462-544c-46b4-9848-76736caeb1c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144362 Oct 31 14:18:22.340206 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2046/3827] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:22.345741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:22.348744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:22.364430 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0123c513-f958-4e62-9962-5c8c19757271 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 353 microversion: 2.1 time: 0.164052 Oct 31 14:18:22.371519 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1782/3828] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:22 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:22.371902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:22.371902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:22.371902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:22.371902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:22.371902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:22.374197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:22.386522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:22.583763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:22.585099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:22.601473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:22.616049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:22.621277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:22.627511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:22.629293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:22.632101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:23.169950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:23.186725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:23.191543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:23.197516 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-303565f7-cf17-47c3-9540-848492c5a73b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.855026 Oct 31 14:18:23.224753 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2047/3829] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:22 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:23.351680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:23.364223 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-39b76a43-c9c1-42a8-bf5f-64f57726a99c tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1470 microversion: 2.1 time: 0.785286 Oct 31 14:18:23.365086 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1783/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:22 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1470 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:23.380014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1cb76863-f726-4b8e-9728-b309cac6a071 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe10652aa60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:23.486945 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1cb76863-f726-4b8e-9728-b309cac6a071 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 353 microversion: 2.1 time: 0.111723 Oct 31 14:18:23.488396 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2048/3831] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:23 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:24.234664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:24.235730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:24.240121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:24.258674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:24.267075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:24.268158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:24.269996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:24.275125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:24.275930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:24.393699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:24.394338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:24.408827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:24.409902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:24.411599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:24.413629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:24.415042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:24.416815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:24.801606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:24.813789 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b93e5377-9ea2-45f7-9459-48c2837867f1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1463 microversion: 2.1 time: 0.425026 Oct 31 14:18:24.817301 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2049/3832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:24 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1463 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:24.829192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29549071-6baa-4675-8184-6f3be69ab919 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe10652b670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:24.895348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29549071-6baa-4675-8184-6f3be69ab919 tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 200 len: 353 microversion: 2.1 time: 0.076781 Oct 31 14:18:24.895977 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2050/3833] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:24 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:25.446397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:25.448074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:25.450456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:25.458535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:25.459398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:25.460797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:25.461627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:25.463234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:25.463808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:25.625261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:25.650271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:25.655021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:25.657245 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd272c45-1378-4770-914c-98717a1bc3b5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 1.428903 Oct 31 14:18:25.661168 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1784/3834] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:24 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:25.670110 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-551bba3e-f981-47dc-86cc-a11d8d23ea6b tempest-MigrationsAdminTest-1978107119 tempest-MigrationsAdminTest-1978107119-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1614 microversion: 2.1 time: 0.772767 Oct 31 14:18:25.670786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2051/3835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:24 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1614 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:25.697282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:25.697802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:25.707076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:25.707609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:25.710465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:25.711133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:25.711605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:25.712043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:25.723758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:25.752841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:25.863907 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d4d448e5-b436-4596-89b8-01b67afc26a7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "DELETE /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 204 len: 0 microversion: 2.1 time: 0.170531 Oct 31 14:18:25.864682 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1785/3836] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:25 2022] DELETE /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:25.873596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:25.874377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:25.880752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:25.882993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:25.884495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:25.885245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:25.886567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:25.888154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:25.910895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d684f4e5-cef7-4d0b-bed1-cb72809845fb tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Calling method '.version_select at 0x7fe106b09940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:25.970800 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d684f4e5-cef7-4d0b-bed1-cb72809845fb tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] HTTP exception thrown: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d684f4e5-cef7-4d0b-bed1-cb72809845fb tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Request method failure captured: Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 HTTP/1.1 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9kqD-2jVIaElg6R6C4V1ZJHYDh1GRJu4vg3Rteu03lSaQDiyvRPsNZJnZiAWZPBxQr1ysosfYn-UMXWEjX4_ugmDsa9-X18d4Yrd1r3x_5TR8EvF3-Im9nonApkCCCZIeLueHRidYJoTrMRbLzb7CBCdT90qxMFvhWMu-Lr8TNs8ZM Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 54d872255e864ed18a4d93665cb19b08 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesGetTestJSON-2047253159 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54d872255e864ed18a4d93665cb19b08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54d872255e864ed18a4d93665cb19b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54d872255e864ed18a4d93665cb19b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54d872255e864ed18a4d93665cb19b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesGetTestJSON-2047253159 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 54d872255e864ed18a4d93665cb19b08 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesGetTestJSON-2047253159 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesGetTestJSON-2047253159-project Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 009f2525ce174398b0d74b2ba7d084d1 Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesGetTestJSON-2047253159-project Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: exception: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'fc86d3ca-6300-418c-b300-72b679648d81'} Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. (HTTP 404) (Request-ID: req-e4bb7b5b-dce3-46df-9622-81f4101d5444) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:18:26.016651 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. Oct 31 14:18:26.022563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:26.030014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d684f4e5-cef7-4d0b-bed1-cb72809845fb tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] Returning 404 to user: Volume fc86d3ca-6300-418c-b300-72b679648d81 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:26.030014 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d684f4e5-cef7-4d0b-bed1-cb72809845fb tempest-VolumesGetTestJSON-2047253159 tempest-VolumesGetTestJSON-2047253159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81" status: 404 len: 109 microversion: 2.1 time: 0.123541 Oct 31 14:18:26.030014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1786/3837] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:18:25 2022] GET /compute/v2.1/os-volumes/fc86d3ca-6300-418c-b300-72b679648d81 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:18:26.200074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:26.224877 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64459cdf-7197-434c-858f-9689a164ef8b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1469 microversion: 2.1 time: 0.355453 Oct 31 14:18:26.229428 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2052/3838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:25 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:26.694961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:26.697986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:26.716087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:26.717196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:26.717967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:26.719166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:26.719796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:26.720745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:26.923960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-25351241", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "48084588-989b-40a8-be8d-9d99272d7967"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:27.012638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] validate_networks() for [('48084588-989b-40a8-be8d-9d99272d7967', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:18:27.142415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:27.155248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:27.157266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:27.159083 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a35af167-9cf7-4a35-9f63-e74feaa16c40 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.471487 Oct 31 14:18:27.160639 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2053/3839] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:26 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:27.256006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:27.256979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:27.272054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:27.272770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:27.273955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:27.275043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:27.275687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:27.276296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:27.510483 n-d-863052-1 devstack@n-api.service[120641]: Exception ignored in: . at 0x7fe106bbde50> Oct 31 14:18:27.510483 n-d-863052-1 devstack@n-api.service[120641]: Traceback (most recent call last): Oct 31 14:18:27.510483 n-d-863052-1 devstack@n-api.service[120641]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 31 14:18:27.524674 n-d-863052-1 devstack@n-api.service[120641]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 31 14:18:27.524674 n-d-863052-1 devstack@n-api.service[120641]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 31 14:18:27.525950 n-d-863052-1 devstack@n-api.service[120641]: connection_record.checkin() Oct 31 14:18:27.525950 n-d-863052-1 devstack@n-api.service[120641]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 31 14:18:27.529688 n-d-863052-1 devstack@n-api.service[120641]: pool.dispatch.checkin(connection, self) Oct 31 14:18:27.529688 n-d-863052-1 devstack@n-api.service[120641]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 31 14:18:27.545529 n-d-863052-1 devstack@n-api.service[120641]: fn(*args, **kw) Oct 31 14:18:27.545529 n-d-863052-1 devstack@n-api.service[120641]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 31 14:18:27.553232 n-d-863052-1 devstack@n-api.service[120641]: time.sleep(0) Oct 31 14:18:27.553616 n-d-863052-1 devstack@n-api.service[120641]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 31 14:18:27.555900 n-d-863052-1 devstack@n-api.service[120641]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 31 14:18:27.556211 n-d-863052-1 devstack@n-api.service[120641]: AssertionError: do not call blocking functions from the mainloop Oct 31 14:18:27.745832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:27.756834 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce115d2a-42ca-454d-9319-6c2ddebe223b tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1469 microversion: 2.1 time: 0.504530 Oct 31 14:18:27.757432 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2054/3840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:27 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1469 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:27.851966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:18:27.855056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:18:27.858886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:18:27.860481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:18:27.862403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:18:27.892030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:27.893433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:27.897507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:27.898950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:27.901402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:27.901936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:27.953615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Getting quotas for project 4038443675364039993405eab3223c92. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:18:27.968116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Getting quotas for user 2d14d759747c40f8a8b16ce1b94cb4c5 and project 4038443675364039993405eab3223c92. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:18:28.006782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:18:28.017037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:18:28.124619 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52f4fee9-edba-46fc-8764-668f1d486a90 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621332 Oct 31 14:18:28.132219 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1787/3841] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:18:28.137112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4c22827-9355-4bc3-af3c-8a1d9df0689f tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:28.137783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4c22827-9355-4bc3-af3c-8a1d9df0689f tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:28.188151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:28.188775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:28.201557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:28.212616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:28.215696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:28.218518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:28.219250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:28.221008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:28.340617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4c22827-9355-4bc3-af3c-8a1d9df0689f tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:28.352143 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4c22827-9355-4bc3-af3c-8a1d9df0689f tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1214 microversion: 2.1 time: 0.218644 Oct 31 14:18:28.357194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2055/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:28 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:28.375788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-838662b5-1edb-43ea-ac85-166a850c9afe req-010a7e12-a1ea-4e90-a739-0f78a6620ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81276631-bbb8-4c21-a44c-6d4e82dbd3a1", "name": "network-vif-deleted", "tag": "c212d189-0756-425f-9cdc-ec9df79d692c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:28.406729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-838662b5-1edb-43ea-ac85-166a850c9afe req-010a7e12-a1ea-4e90-a739-0f78a6620ccd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:28.409997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-838662b5-1edb-43ea-ac85-166a850c9afe req-010a7e12-a1ea-4e90-a739-0f78a6620ccd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:28.411346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-838662b5-1edb-43ea-ac85-166a850c9afe req-010a7e12-a1ea-4e90-a739-0f78a6620ccd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:28.428678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-838662b5-1edb-43ea-ac85-166a850c9afe req-010a7e12-a1ea-4e90-a739-0f78a6620ccd service nova] Creating event network-vif-deleted:c212d189-0756-425f-9cdc-ec9df79d692c for instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 on n-h1-863052-1 Oct 31 14:18:28.444521 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-838662b5-1edb-43ea-ac85-166a850c9afe req-010a7e12-a1ea-4e90-a739-0f78a6620ccd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085749 Oct 31 14:18:28.448832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2056/3843] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:28.755301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:28.765373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:28.776110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:28.781608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:28.783797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4dc4030e-0a45-44b1-91d5-4afa1c346f56 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.599464 Oct 31 14:18:28.783945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:28.784925 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1788/3844] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:28 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:28.806102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:28.806613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:28.807057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:28.807769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:28.808229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:28.808672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:28.876349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:28.877082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:28.877695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:28.878602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lazy-loading 'fault' on Instance uuid 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:18:28.938466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:28.949668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf9ccd51-13f7-4a29-b915-fa20cbb1a290 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 200 len: 1303 microversion: 2.1 time: 0.172275 Oct 31 14:18:28.964693 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2057/3845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:28 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:29.384869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1241e21a-34e7-43c2-af73-b3bbf08938f7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:29.385683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1241e21a-34e7-43c2-af73-b3bbf08938f7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:29.499702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1241e21a-34e7-43c2-af73-b3bbf08938f7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:29.508721 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1241e21a-34e7-43c2-af73-b3bbf08938f7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1214 microversion: 2.1 time: 0.129501 Oct 31 14:18:29.510425 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1789/3846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:29 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:29.812506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:29.813159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:29.824691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:29.825197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:29.825626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:29.826365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:29.826822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:29.827259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:29.976799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:29.977413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 81276631-bbb8-4c21-a44c-6d4e82dbd3a1] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:29.999491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.000621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.004437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.006001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.011169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.012760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.051822 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] HTTP exception thrown: Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 could not be found. Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Request method failure captured: Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 HTTP/1.1 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fePxNodA3AlYme85piR0iZl9zCBRyjdTYOwIE-Jm54IFgT4C_QEvaawcr70a2kSpBxeflbWeEvE6K4EnxONQBJLfQaOyuF8YCMpBvtr1PANyxKLFNCSIW3w6OQpA7CQQhVhLP18-fMuJDk4vj7bwQrqmrxKk2ZqCUjp8y6b61dJj8 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c06d65a7e2c9401bbbc2ca5f9999dd4d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4d15f804765e48e3a279a902cde38dec Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 could not be found. Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '81276631-bbb8-4c21-a44c-6d4e82dbd3a1'} Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 could not be found. Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 could not be found. Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:30.053440 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 could not be found. Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Returning 404 to user: Instance 81276631-bbb8-4c21-a44c-6d4e82dbd3a1 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:30.062917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34e9940c-9a49-4ca1-a6bd-7dcfc45ba665 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1" status: 404 len: 111 microversion: 2.1 time: 0.082518 Oct 31 14:18:30.077516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1790/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:29 2022] GET /compute/v2.1/servers/81276631-bbb8-4c21-a44c-6d4e82dbd3a1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:18:30.107632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:30.109531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:30.128817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.133522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.134642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.135707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.141666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.143114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.225912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:30.400405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:30.425664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:30.430127 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-389842c0-3218-4b15-b7dc-9f4422f49de7 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 204 len: 0 microversion: 2.1 time: 0.336597 Oct 31 14:18:30.430881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:30.432018 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1791/3848] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:30 2022] DELETE /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:30.440246 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5416f06e-6608-41fd-a8d5-da3434b71633 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.632847 Oct 31 14:18:30.442914 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2058/3849] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:29 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:30.449994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:30.453391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:30.474796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.475717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.478245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.482271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.483187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.484151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.547901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:30.549178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:30.559447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.560377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.561587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.562937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:30.564073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:30.564897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:30.719049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:30.732818 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67380888-eae3-43f9-ade0-6b6bb4fd87a9 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1266 microversion: 2.1 time: 0.203566 Oct 31 14:18:30.748269 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2059/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:30 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:31.083239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:31.091994 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a13566bf-cce6-4e81-833b-14e1b74a10ab tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1535 microversion: 2.1 time: 0.651356 Oct 31 14:18:31.097447 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1792/3851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:30 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1535 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:31.473954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:31.474662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:31.488304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:31.488804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:31.500155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:31.500825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:31.501275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:31.501991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:31.502481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:31.502913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:31.510586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:31.511097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:31.511541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:31.512261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:31.517571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:31.518254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:31.607770 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5273925-339f-46c8-9cb6-01604c0e9b3c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/ips" status: 200 len: 145 microversion: 2.1 time: 0.123537 Oct 31 14:18:31.633639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1793/3852] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:18:31 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/ips => generated 145 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:31.757141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:31.758015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:31.769433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:31.769954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:31.770515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:31.771220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:31.774512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:31.776807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:32.026406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:32.044340 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25bff87a-acaf-4ecf-af2f-941c8e00cf2a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1274 microversion: 2.1 time: 0.291013 Oct 31 14:18:32.045944 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1794/3853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:31 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:32.128079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:32.128897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:32.137155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:32.138119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:32.139742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:32.141641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:32.146494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:32.147716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:32.160044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:32.181632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:32.184243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:32.188493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-651b1e91-bd8e-4208-bcee-e44c8d362f74 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.715559 Oct 31 14:18:32.191059 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2060/3854] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:31 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:32.510819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:32.536234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-66ef84ab-7a04-4929-b477-f8fa4b789e84 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1535 microversion: 2.1 time: 0.409637 Oct 31 14:18:32.538588 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1795/3855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:32 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1535 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:33.071899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:33.072509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:33.090886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:33.092052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:33.097510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:33.098975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:33.100945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:33.103209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:33.217893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:33.219485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:33.231585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:33.234116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:33.247836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:33.250996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:33.254125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:33.255483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:33.408488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:33.416468 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0ba6106-c2e5-4390-a48b-c8cc5a879b25 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1272 microversion: 2.1 time: 0.349086 Oct 31 14:18:33.420565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2061/3856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:33 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:34.087301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:34.110065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:34.116882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:34.120147 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f84a03cb-4978-4412-a1c7-944f4fdc7f44 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.906888 Oct 31 14:18:34.123830 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1796/3857] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:33 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:18:34.133323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-eed8cd2f-4998-4fae-8c85-fcdefc38212c req-c12b8e12-c1cc-4c6c-a437-d6ee8d9de967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b7c41c-27be-4494-a4e9-0b549d3d486c", "name": "network-vif-deleted", "tag": "9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:34.136237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:34.137588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:34.153291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:34.156563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:34.158240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:34.159266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:34.162665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:34.166017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eed8cd2f-4998-4fae-8c85-fcdefc38212c req-c12b8e12-c1cc-4c6c-a437-d6ee8d9de967 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:34.167745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eed8cd2f-4998-4fae-8c85-fcdefc38212c req-c12b8e12-c1cc-4c6c-a437-d6ee8d9de967 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:34.168405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eed8cd2f-4998-4fae-8c85-fcdefc38212c req-c12b8e12-c1cc-4c6c-a437-d6ee8d9de967 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:34.176151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:34.195406 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-eed8cd2f-4998-4fae-8c85-fcdefc38212c req-c12b8e12-c1cc-4c6c-a437-d6ee8d9de967 service nova] Creating event network-vif-deleted:9bdbd659-14e1-4bb3-9cc6-9e88c46d8d89 for instance 38b7c41c-27be-4494-a4e9-0b549d3d486c on n-h1-863052-1 Oct 31 14:18:34.201620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-eed8cd2f-4998-4fae-8c85-fcdefc38212c req-c12b8e12-c1cc-4c6c-a437-d6ee8d9de967 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.644853 Oct 31 14:18:34.202842 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2062/3858] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:34.250095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:34.251634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:34.252554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:34.253355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lazy-loading 'fault' on Instance uuid 38b7c41c-27be-4494-a4e9-0b549d3d486c {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:18:34.349263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:34.362603 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4830e54-29eb-406b-ad62-55e0951cde06 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 200 len: 1369 microversion: 2.1 time: 0.237235 Oct 31 14:18:34.365969 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1797/3859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:34 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 1369 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:34.450313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:34.451399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:34.473999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:34.477099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:34.478249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:34.480914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:34.482394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:34.484906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:34.916441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:34.938565 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-393c84b1-6394-48d7-8382-2cec9488995c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.495124 Oct 31 14:18:34.956320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2063/3860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:34 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:35.168664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:35.171172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:35.186708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:35.188492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:35.189754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:35.193946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:35.194718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:35.195349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:35.399287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:35.399981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 38b7c41c-27be-4494-a4e9-0b549d3d486c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:35.414459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:35.414880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:35.415323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:35.416027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:35.416480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:35.423514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:35.447475 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] HTTP exception thrown: Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c could not be found. Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Request method failure captured: Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c HTTP/1.1 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fePxNodA3AlYme85piR0iZl9zCBRyjdTYOwIE-Jm54IFgT4C_QEvaawcr70a2kSpBxeflbWeEvE6K4EnxONQBJLfQaOyuF8YCMpBvtr1PANyxKLFNCSIW3w6OQpA7CQQhVhLP18-fMuJDk4vj7bwQrqmrxKk2ZqCUjp8y6b61dJj8 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c06d65a7e2c9401bbbc2ca5f9999dd4d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4d15f804765e48e3a279a902cde38dec Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c could not be found. Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '38b7c41c-27be-4494-a4e9-0b549d3d486c'} Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c could not be found. Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c could not be found. Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:35.450511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c could not be found. Oct 31 14:18:35.454952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:35.457393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Returning 404 to user: Instance 38b7c41c-27be-4494-a4e9-0b549d3d486c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:35.459838 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13d6e556-f97a-4970-b19d-099628b09482 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c" status: 404 len: 111 microversion: 2.1 time: 0.066830 Oct 31 14:18:35.461749 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2064/3861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:35 2022] GET /compute/v2.1/servers/38b7c41c-27be-4494-a4e9-0b549d3d486c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:18:35.473760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34d868e8-c95a-41d2-a6c4-13ea9a64a431 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '.version_select at 0x7fe10657ae50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:35.503983 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34d868e8-c95a-41d2-a6c4-13ea9a64a431 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75315945" status: 202 len: 0 microversion: 2.1 time: 0.037954 Oct 31 14:18:35.505352 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2065/3862] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Oct 31 14:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75315945 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:18:35.971035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:35.973683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:35.985202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:35.987758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:35.988888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:35.991561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:35.995627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:35.996403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:36.493870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:36.505840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5aaca35-fc02-4393-a91d-e6440f5aa39e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.542806 Oct 31 14:18:36.507575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2066/3863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:35 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:36.519272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b88cd2f9-ba0e-453a-9e61-306474f6bcab"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:36.526908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:36.541818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:36.542592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:36.543029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:36.543766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:36.544166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:36.550814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:37.014364 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3cba8bc-867d-4223-829a-6ce7de2dd6d5 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501076 Oct 31 14:18:37.015434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2067/3864] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:18:36 2022] POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:37.067703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:37.090069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:37.095044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:37.098376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af1fb5a4-a821-495a-974d-3a4383a35239 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 1.942092 Oct 31 14:18:37.100981 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1798/3865] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:35 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:37.201197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9fe9cc8c-c155-48e8-9a9d-3aa94e558f44 req-aca435db-9774-4ac3-82e1-9f29e4ff4aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ec682a-a43c-442c-8ee0-80929637f1ed", "tag": "91479282-5828-44ad-baf7-403e6633e420"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:37.224944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9fe9cc8c-c155-48e8-9a9d-3aa94e558f44 req-aca435db-9774-4ac3-82e1-9f29e4ff4aaf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:37.238593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9fe9cc8c-c155-48e8-9a9d-3aa94e558f44 req-aca435db-9774-4ac3-82e1-9f29e4ff4aaf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:37.239044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9fe9cc8c-c155-48e8-9a9d-3aa94e558f44 req-aca435db-9774-4ac3-82e1-9f29e4ff4aaf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:37.243496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:37.269917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9fe9cc8c-c155-48e8-9a9d-3aa94e558f44 req-aca435db-9774-4ac3-82e1-9f29e4ff4aaf service nova] Creating event network-changed:91479282-5828-44ad-baf7-403e6633e420 for instance 82ec682a-a43c-442c-8ee0-80929637f1ed on n-h1-863052-1 Oct 31 14:18:37.278746 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9fe9cc8c-c155-48e8-9a9d-3aa94e558f44 req-aca435db-9774-4ac3-82e1-9f29e4ff4aaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082934 Oct 31 14:18:37.280720 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2068/3866] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:37.533861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:37.534860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:37.545782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:37.552602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:37.553376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:37.554915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:37.555598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:37.563943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:37.929194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:38.117493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:38.129536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efd2c7ec-1299-4bb2-956a-25ee1389cfe3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.600666 Oct 31 14:18:38.130492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1799/3867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:37 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:38.134616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:38.135947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:38.151965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:38.152597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:38.153853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:38.158826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:38.161317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:38.166793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:38.168123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:38.168483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:38.169158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:38.169782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:38.172399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:38.173089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:38.175389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:38.177357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:38.264121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:38.344981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:38.372937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:38.465563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-871ca718-6db7-4cc6-ba01-c7a79cfba7df tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 204 len: 0 microversion: 2.1 time: 0.332834 Oct 31 14:18:38.467597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1800/3868] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:38 2022] DELETE /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:38.478701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:38.479441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:38.492988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:38.500399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:38.501366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:38.502406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:38.503151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:38.503741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:38.605937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:38.622990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:38.625006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:38.626521 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc9b1e8a-ff02-45b2-88f2-393cab688949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.496293 Oct 31 14:18:38.627628 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2069/3869] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:38 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:39.157063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:39.158379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:39.173963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:39.174583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:39.175028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:39.175877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:39.176343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:39.176773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:39.275972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:39.288299 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8f7e128-ef68-4441-8a1a-d2bc26e80506 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1468 microversion: 2.1 time: 0.814825 Oct 31 14:18:39.289923 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1801/3870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:38 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1468 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:39.662856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:39.664258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:39.668636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:39.688422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:39.689347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:39.690052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:39.691076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:39.691757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:39.695322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:39.759234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:39.768199 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-605689fc-9bda-4a9a-88e6-486a81dbe53e tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.619367 Oct 31 14:18:39.771144 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2070/3871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:39 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:40.321183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:40.322922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:40.333068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:40.341463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:40.349664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:40.352564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:40.353172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:40.354624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:40.491052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:40.509373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:40.511089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:40.517757 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acc27967-f9b0-423e-87c4-ff12da038786 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.860201 Oct 31 14:18:40.519280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1802/3872] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:39 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:40.798950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:40.799583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:40.810572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:40.811084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:40.811634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:40.812229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:40.812689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:40.813120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:40.819284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:40.828149 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd3b3701-8822-4e10-b902-ea2366873990 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1468 microversion: 2.1 time: 0.511088 Oct 31 14:18:40.828789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2071/3873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:40 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1468 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:41.446721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9fd8c0bb-5025-4876-80c4-0a135940c2b0 req-95aacf15-96d2-4031-89d1-456ed6d40beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3385c0-7051-44c4-8e83-6b96d554f351", "name": "network-vif-deleted", "tag": "48c46c97-9e28-4345-a0eb-cc9d36b8ce37"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:41.473821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9fd8c0bb-5025-4876-80c4-0a135940c2b0 req-95aacf15-96d2-4031-89d1-456ed6d40beb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:41.478514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9fd8c0bb-5025-4876-80c4-0a135940c2b0 req-95aacf15-96d2-4031-89d1-456ed6d40beb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:41.479245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9fd8c0bb-5025-4876-80c4-0a135940c2b0 req-95aacf15-96d2-4031-89d1-456ed6d40beb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:41.502483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:41.514266 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45777dab-18c9-492e-b48a-1d4d71a81125 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.719020 Oct 31 14:18:41.532425 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1803/3874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:40 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:41.540082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9fd8c0bb-5025-4876-80c4-0a135940c2b0 req-95aacf15-96d2-4031-89d1-456ed6d40beb service nova] Creating event network-vif-deleted:48c46c97-9e28-4345-a0eb-cc9d36b8ce37 for instance 5b3385c0-7051-44c4-8e83-6b96d554f351 on n-h2-863052-1 Oct 31 14:18:41.549706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:41.551192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:41.565681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:41.576642 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9fd8c0bb-5025-4876-80c4-0a135940c2b0 req-95aacf15-96d2-4031-89d1-456ed6d40beb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136346 Oct 31 14:18:41.586273 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2072/3875] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:18:41.586669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:41.587464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:41.588134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:41.588594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:41.589033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:41.853796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:41.854873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:41.869804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:41.874762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:41.876122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:41.881225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:41.881946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:41.882652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:41.992480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:41.993011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:41.993467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:41.993935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lazy-loading 'fault' on Instance uuid 5b3385c0-7051-44c4-8e83-6b96d554f351 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:18:42.093726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:42.101781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:42.102851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ffa29b0-bb58-417e-81c3-309b85332924 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 200 len: 1302 microversion: 2.1 time: 0.253705 Oct 31 14:18:42.103440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2073/3876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:41 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:42.131426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:42.136226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:42.138011 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc8336fd-74ef-4c40-8c71-5866ca99934f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.593059 Oct 31 14:18:42.147606 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1804/3877] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:41 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:18:42.539342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:42.540029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:42.551468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:42.555459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:42.556619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:42.558990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:42.560431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:42.561488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:42.588454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1833974051", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7ee6d5f9-8236-4a4f-ab96-163404112e95"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:42.705646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] validate_networks() for [('7ee6d5f9-8236-4a4f-ab96-163404112e95', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:18:42.796096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:42.806538 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-789b1b22-7815-4acb-bf86-1271ba51694c tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.273404 Oct 31 14:18:42.807673 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1805/3878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:42 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:43.132186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:43.133027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: 5b3385c0-7051-44c4-8e83-6b96d554f351] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:43.151678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.152699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.158187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.159683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.162296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.164525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.205388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] HTTP exception thrown: Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 could not be found. Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Request method failure captured: Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 HTTP/1.1 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9fePxNodA3AlYme85piR0iZl9zCBRyjdTYOwIE-Jm54IFgT4C_QEvaawcr70a2kSpBxeflbWeEvE6K4EnxONQBJLfQaOyuF8YCMpBvtr1PANyxKLFNCSIW3w6OQpA7CQQhVhLP18-fMuJDk4vj7bwQrqmrxKk2ZqCUjp8y6b61dJj8 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c06d65a7e2c9401bbbc2ca5f9999dd4d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4d15f804765e48e3a279a902cde38dec Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 could not be found. Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '5b3385c0-7051-44c4-8e83-6b96d554f351'} Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 could not be found. Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 could not be found. Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:43.214712 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 could not be found. Oct 31 14:18:43.219226 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:43.222488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Returning 404 to user: Instance 5b3385c0-7051-44c4-8e83-6b96d554f351 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:43.226586 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ab139f4-3868-4bd7-825e-bc4e44a326b1 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351" status: 404 len: 111 microversion: 2.1 time: 0.099699 Oct 31 14:18:43.227702 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1806/3879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:43 2022] GET /compute/v2.1/servers/5b3385c0-7051-44c4-8e83-6b96d554f351 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:18:43.235122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:43.241157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:43.258836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.261601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.262688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.263602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:18:43.264275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:18:43.264910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:18:43.265053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.265483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.265791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:18:43.265905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.266481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:18:43.294010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.294756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.295397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.296353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.297001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.297628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.380932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Getting quotas for project 851537efc6704325a41cd84823425704. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:18:43.414714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Getting quotas for user 93bf103641ca49a0a0a405eae6fd55d9 and project 851537efc6704325a41cd84823425704. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:18:43.461280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:18:43.464103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:18:43.572579 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f342a62-4d3d-4452-b02e-74696aca98e0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419618 Oct 31 14:18:43.579835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2074/3880] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:18:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:18:43.614485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:43.615819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:43.624549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.625226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.625841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.627313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:43.627783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:43.628220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:43.684652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:43.878846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-abd8915a-b210-4f5c-86b8-5d796819421e tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 204 len: 0 microversion: 2.1 time: 0.295362 Oct 31 14:18:43.882840 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2075/3881] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:43 2022] DELETE /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:43.902886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05367a85-b128-47eb-9793-1321c8fe146c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:43.904817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05367a85-b128-47eb-9793-1321c8fe146c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:43.919783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:43.943880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:43.950414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:43.953700 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb327304-91bd-4df8-b227-f007fa88f5e4 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.721710 Oct 31 14:18:43.956458 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1807/3882] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:43 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:43.970329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:43.979024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:44.003499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:44.004129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:44.004506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:44.005225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:44.005688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:44.006113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:44.173332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-05367a85-b128-47eb-9793-1321c8fe146c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:44.181089 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05367a85-b128-47eb-9793-1321c8fe146c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1225 microversion: 2.1 time: 0.291905 Oct 31 14:18:44.181682 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2076/3883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:43 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1225 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:44.221682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:44.222755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:44.257353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:44.258416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:44.259184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:44.260330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:44.261058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:44.261752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:44.273787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:44.287836 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d325349-38f2-4187-b160-887d26585f4b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.328175 Oct 31 14:18:44.290595 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1808/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:43 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:44.892690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8c071da5-d744-4927-8b7f-35672ff73a43 req-3562b2c2-5763-44e5-a0f2-4cbc289e3c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "46852d7e-2a8c-4b69-b247-0200900d1218"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:44.908141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:44.919475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8c071da5-d744-4927-8b7f-35672ff73a43 req-3562b2c2-5763-44e5-a0f2-4cbc289e3c6a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:44.920011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8c071da5-d744-4927-8b7f-35672ff73a43 req-3562b2c2-5763-44e5-a0f2-4cbc289e3c6a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:44.921710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8c071da5-d744-4927-8b7f-35672ff73a43 req-3562b2c2-5763-44e5-a0f2-4cbc289e3c6a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:44.924001 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5478c4fd-f137-43d9-8d65-347fcc052f5d tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1468 microversion: 2.1 time: 0.734772 Oct 31 14:18:44.924832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2077/3885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:44 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1468 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:44.965041 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8c071da5-d744-4927-8b7f-35672ff73a43 req-3562b2c2-5763-44e5-a0f2-4cbc289e3c6a service nova] Creating event network-vif-plugged:46852d7e-2a8c-4b69-b247-0200900d1218 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:44.983004 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8c071da5-d744-4927-8b7f-35672ff73a43 req-3562b2c2-5763-44e5-a0f2-4cbc289e3c6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341150 Oct 31 14:18:44.986930 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1809/3886] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:44.987137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:44.987965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:45.000867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:45.004236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:45.004889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:45.018917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:45.031055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:45.037563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:45.205640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:45.206757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:45.224043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:45.228188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:45.229156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:45.229997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:45.230593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:45.231139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:45.414578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:45.434741 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dae241b3-40f8-4e6e-a35c-967acd13d251 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1277 microversion: 2.1 time: 0.221705 Oct 31 14:18:45.435565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1810/3887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:45 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:45.440533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:45.447443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:45.460942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:45.470890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:45.471431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:45.472811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:45.475075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:45.478402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:46.011842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:46.024077 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-197076f4-0947-498c-9cfc-7894a27a6927 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.585150 Oct 31 14:18:46.038675 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1811/3888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:45 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:46.038675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:46.038675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:46.056560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:46.057387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:46.057843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:46.058743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:46.059979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:46.062276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:46.309003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:46.320858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:46.338308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:46.339759 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b97dee53-af39-4463-aa7c-f2e036cbf615 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 1.356475 Oct 31 14:18:46.346722 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2078/3889] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:44 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:46.459276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:46.459894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:46.468793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:46.469280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:46.469714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:46.470461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:46.470912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:46.471335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:47.220701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:47.230042 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22603f81-1bd3-4349-bbc7-7ad8a9fd7e17 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1468 microversion: 2.1 time: 1.202482 Oct 31 14:18:47.240268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1812/3890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:46 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1468 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:47.254014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:47.255305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:47.296462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:47.309774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:47.312598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:47.313523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:47.315017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:47.317224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:47.429745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:47.448914 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29ea0147-1e7c-43dd-a320-e1d39a2c96ec tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1283 microversion: 2.1 time: 0.982555 Oct 31 14:18:47.463493 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2079/3891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:46 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1283 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:47.475543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "6089802b-32ee-4dc1-aca0-94c27f3a0139"}, {"server_uuid": "82ec682a-a43c-442c-8ee0-80929637f1ed", "name": "network-vif-plugged", "status": "completed", "tag": "91479282-5828-44ad-baf7-403e6633e420"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:47.514459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:47.514930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:47.518986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:47.561416 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] Creating event network-vif-plugged:6089802b-32ee-4dc1-aca0-94c27f3a0139 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:47.565615 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] Creating event network-vif-plugged:91479282-5828-44ad-baf7-403e6633e420 for instance 82ec682a-a43c-442c-8ee0-80929637f1ed on n-h1-863052-1 Oct 31 14:18:47.585746 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-61dd9b8b-cc47-43d8-8da1-3b9b8f778f28 req-bd5fcb85-b236-4ea7-aa7e-564e42cd01c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120728 Oct 31 14:18:47.587872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2080/3892] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:47.600166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:47.603058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:47.624068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:47.624831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:47.625671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:47.627434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:47.630319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:47.631241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:48.248856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:48.262073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c334b520-e2f9-4cc7-9370-7d74e490e31b tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 1.016716 Oct 31 14:18:48.264293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1813/3893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:47 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:48.289742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:48.290067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:48.324026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:48.326521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:48.328086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:48.332742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:48.332742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:48.332742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:48.631048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:48.648898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:48.655938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:48.658980 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-caed5a7d-a691-45e5-bd99-7c5a027df579 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 1.067108 Oct 31 14:18:48.661853 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2081/3894] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:47 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:48.703817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:48.705600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:48.730040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:48.734332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:48.736793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:48.737724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:48.738482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:48.745971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:48.851350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d15f804765e48e3a279a902cde38dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d65a7e2c9401bbbc2ca5f9999dd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:48.883162 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a4290c2-b84a-477e-b960-3fa6c9c3558f tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 200 len: 1426 microversion: 2.1 time: 0.610641 Oct 31 14:18:48.894362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1814/3895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:48 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 1426 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:48.914592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-113efeae-1bf0-4eec-9dd4-2e13dd2f5c80 req-5dc46246-d1a8-4f5c-a2a9-48ae814292ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac09d929-a71d-4ae1-8395-99a281a5b3a7", "name": "network-vif-deleted", "tag": "934b105d-4ebe-4255-b58c-a813f5992a2a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:48.945156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-113efeae-1bf0-4eec-9dd4-2e13dd2f5c80 req-5dc46246-d1a8-4f5c-a2a9-48ae814292ee service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:48.945695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-113efeae-1bf0-4eec-9dd4-2e13dd2f5c80 req-5dc46246-d1a8-4f5c-a2a9-48ae814292ee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:48.946243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-113efeae-1bf0-4eec-9dd4-2e13dd2f5c80 req-5dc46246-d1a8-4f5c-a2a9-48ae814292ee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:48.984783 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-113efeae-1bf0-4eec-9dd4-2e13dd2f5c80 req-5dc46246-d1a8-4f5c-a2a9-48ae814292ee service nova] Creating event network-vif-deleted:934b105d-4ebe-4255-b58c-a813f5992a2a for instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 on n-h2-863052-1 Oct 31 14:18:48.997049 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-113efeae-1bf0-4eec-9dd4-2e13dd2f5c80 req-5dc46246-d1a8-4f5c-a2a9-48ae814292ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099941 Oct 31 14:18:48.999452 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1815/3896] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:49.099435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:49.110668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f7a9af2-3b92-4c64-83ae-d138f4dbb067 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.446748 Oct 31 14:18:49.123449 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2082/3897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:48 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:49.297056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:49.298657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:49.316376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:49.331334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:49.331825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:49.332589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:49.341274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:49.343867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:49.429965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "778943c9-e20c-426f-b565-cf9ba6024dd2"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:49.433906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:49.463881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:49.464380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:49.464819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:49.465528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:49.465978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:49.466426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:49.844208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:49.869412 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d6781bf9-0c54-4244-8588-030e30ba59c8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1314 microversion: 2.1 time: 0.576367 Oct 31 14:18:49.871580 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1816/3898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:49 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:49.887571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "3a9b4172-f0ff-4584-98cf-3eabc53a8d71"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "13d58663-7051-4173-80c9-2fc55f337a36"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:49.910626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:49.942065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:49.945332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:49.945784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:49.974356 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] Creating event network-vif-plugged:3a9b4172-f0ff-4584-98cf-3eabc53a8d71 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:49.979234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] Creating event network-vif-plugged:13d58663-7051-4173-80c9-2fc55f337a36 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:49.994112 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fbffaaa0-5be8-4890-b295-daec28b04b38 req-a461e80b-0820-4eee-b3ce-230a6698a1b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116965 Oct 31 14:18:49.995320 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1817/3899] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:50.008862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:50.023292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:50.051547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.067341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.068149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.068664 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07856fda-54a6-4b60-8e8c-8a7a2394ca0e tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "POST /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632077 Oct 31 14:18:50.089060 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2083/3900] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:18:49 2022] POST /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:18:50.093125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.093125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.093125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.100319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:50.105087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] [instance: ac09d929-a71d-4ae1-8395-99a281a5b3a7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:50.120500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.127002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.127775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.128827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.130454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.131141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.178252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] HTTP exception thrown: Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 could not be found. Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Request method failure captured: Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 HTTP/1.1 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9fePxNodA3AlYme85piR0iZl9zCBRyjdTYOwIE-Jm54IFgT4C_QEvaawcr70a2kSpBxeflbWeEvE6K4EnxONQBJLfQaOyuF8YCMpBvtr1PANyxKLFNCSIW3w6OQpA7CQQhVhLP18-fMuJDk4vj7bwQrqmrxKk2ZqCUjp8y6b61dJj8 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c06d65a7e2c9401bbbc2ca5f9999dd4d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c06d65a7e2c9401bbbc2ca5f9999dd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c06d65a7e2c9401bbbc2ca5f9999dd4d Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-MigrationsAdminTest-985829329 Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4d15f804765e48e3a279a902cde38dec Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-MigrationsAdminTest-985829329-project Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 could not be found. Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ac09d929-a71d-4ae1-8395-99a281a5b3a7'} Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 could not be found. Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 could not be found. Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:50.181187 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 could not be found. Oct 31 14:18:50.185993 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:50.189724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] Returning 404 to user: Instance ac09d929-a71d-4ae1-8395-99a281a5b3a7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:50.191307 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0a9a278-1b17-452a-a844-c15417aad278 tempest-MigrationsAdminTest-985829329 tempest-MigrationsAdminTest-985829329-project] 10.222.0.27 "GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7" status: 404 len: 111 microversion: 2.1 time: 0.097230 Oct 31 14:18:50.192503 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2084/3901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:50 2022] GET /compute/v2.1/servers/ac09d929-a71d-4ae1-8395-99a281a5b3a7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:50.198309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:50.199276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:50.217949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.223099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.223811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.224924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.227802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.228461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.521716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:50.527779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:50.538595 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b8c2eef-95d7-4e4e-b8ab-84c6f875b256 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.344302 Oct 31 14:18:50.540446 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2085/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:50 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:50.548880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6c9aab22-fb22-48fb-aa72-15900e100672 req-4d8871e3-a403-40de-bf56-42392081e3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07767af9-b0c1-4fd5-b8ac-a33552cae30c", "tag": "18c95a5e-b435-41a5-895f-c4ee4005d56e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:50.554431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:50.566135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6c9aab22-fb22-48fb-aa72-15900e100672 req-4d8871e3-a403-40de-bf56-42392081e3d5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.566956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6c9aab22-fb22-48fb-aa72-15900e100672 req-4d8871e3-a403-40de-bf56-42392081e3d5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.568598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6c9aab22-fb22-48fb-aa72-15900e100672 req-4d8871e3-a403-40de-bf56-42392081e3d5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.590800 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6c9aab22-fb22-48fb-aa72-15900e100672 req-4d8871e3-a403-40de-bf56-42392081e3d5 service nova] Creating event network-changed:18c95a5e-b435-41a5-895f-c4ee4005d56e for instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c on n-h1-863052-1 Oct 31 14:18:50.602414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6c9aab22-fb22-48fb-aa72-15900e100672 req-4d8871e3-a403-40de-bf56-42392081e3d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059321 Oct 31 14:18:50.603734 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2086/3903] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:50.887143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:50.903518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:50.904766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:50.916577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:50.924650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:50.931674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.932177 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d8bd513-e535-4964-a32f-23f8d9ace312 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.933358 Oct 31 14:18:50.933815 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1818/3904] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:49 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:50.940895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.941675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:50.943483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:50.943949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:50.944418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.322727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:51.335484 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-724ed7e2-6c4a-4db1-93f3-664a77e968d8 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1502 microversion: 2.1 time: 0.441947 Oct 31 14:18:51.336086 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2087/3905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:50 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1502 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:51.363071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:51.363684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:51.373152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.381751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.383514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.386532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.387826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.388278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.469989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:51.495610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:51.566011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:51.566734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:51.577193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.577691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.578130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.578891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.579341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.579770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.667985 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c3e3740-d456-401f-96b2-594b9ac595df tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 204 len: 0 microversion: 2.1 time: 0.308390 Oct 31 14:18:51.672579 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1819/3906] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:51 2022] DELETE /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:51.680803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:51.682374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:51.693096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.694004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.694779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.695916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.698320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.699499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.908297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:51.921092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-786cfa0b-d2a4-402e-9e34-70fe7f8441b3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1508 microversion: 2.1 time: 0.246942 Oct 31 14:18:51.923057 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1820/3907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:51 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:51.949773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:51.969232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:51.971103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:51.982605 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d073c808-a903-49ec-841e-60937b9b967c tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.420812 Oct 31 14:18:51.985474 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2088/3908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:51 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:51.987736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.989407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.990312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:51.993768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:51.995273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:51.995955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:52.018573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "9e6cbca7-c973-4376-930d-70035fa11e33"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "c2c07023-6238-41fb-90f2-bec97e1ade9a"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-plugged", "status": "completed", "tag": "4a922957-3bba-4585-9ade-2133f2cb8147"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:52.043398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:52.043877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:52.044307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:52.068413 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Creating event network-vif-plugged:9e6cbca7-c973-4376-930d-70035fa11e33 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:52.070996 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Creating event network-vif-plugged:c2c07023-6238-41fb-90f2-bec97e1ade9a for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:52.071586 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] Creating event network-vif-plugged:4a922957-3bba-4585-9ade-2133f2cb8147 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:52.090404 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a551e28d-559c-43fc-bc55-de8219f27644 req-d36dad7e-36c0-41b9-95db-71a1e1686049 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.075508 Oct 31 14:18:52.095006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2089/3909] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:18:52.363900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:52.378067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:52.379574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:52.381131 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e34a0fd1-0641-4b79-b62b-c5dc75862a21 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.423182 Oct 31 14:18:52.382118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1821/3910] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:51 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:52.945328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:52.946134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:52.956846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:52.957969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:52.958521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:52.959225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:52.959678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:52.960794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:53.016899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:53.017756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:53.030648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:53.031146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:53.031589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:53.035322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:53.035322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:53.035322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:53.247949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:53.258269 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8e60379-ac37-4d01-80c6-d802d5252f78 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1508 microversion: 2.1 time: 0.318424 Oct 31 14:18:53.267682 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2090/3911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:52 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:53.408993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:53.409606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:53.413415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:53.419773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:53.420531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:53.421193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:53.422301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:53.422982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:53.423631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:53.523498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:53.532146 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b150e5a-d814-4804-aeae-183fb6d83ad6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.523069 Oct 31 14:18:53.536610 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1822/3912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:53 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:53.735201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:53.748332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:53.750218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:53.751778 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf362e90-7800-490c-a2e1-345d9c75593f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1878 microversion: 2.32 time: 0.346695 Oct 31 14:18:53.752343 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2091/3913] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:53 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1878 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:18:54.291387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:54.292632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:54.313464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:54.314299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:54.314980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:54.316028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:54.316768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:54.318147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:54.560416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:54.561747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:54.572326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:54.581038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:54.584374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:54.586948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:54.588015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:54.590088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:54.590920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:54.803280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:54.814454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d144a75-0376-495f-b9fb-4dac1d9fa4ba tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.258512 Oct 31 14:18:54.816116 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2092/3914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:54 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:54.823455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:54.825112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:54.832131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:54.833169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:54.833675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:54.834330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:54.835536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:54.836271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:54.998842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d14d759747c40f8a8b16ce1b94cb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4038443675364039993405eab3223c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:55.008534 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-afe40a9d-7e32-4603-8002-53c5cf7b1bd3 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 200 len: 1466 microversion: 2.1 time: 0.721225 Oct 31 14:18:55.015312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1823/3915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:54 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 1466 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:55.096136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a4368e43-0f16-463d-a383-3efa381a8420 req-106dddc7-894e-409f-a4f4-5affbb069238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ec682a-a43c-442c-8ee0-80929637f1ed", "name": "network-vif-deleted", "tag": "91479282-5828-44ad-baf7-403e6633e420"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:55.127250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a4368e43-0f16-463d-a383-3efa381a8420 req-106dddc7-894e-409f-a4f4-5affbb069238 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.127728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a4368e43-0f16-463d-a383-3efa381a8420 req-106dddc7-894e-409f-a4f4-5affbb069238 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.128154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a4368e43-0f16-463d-a383-3efa381a8420 req-106dddc7-894e-409f-a4f4-5affbb069238 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.157612 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a4368e43-0f16-463d-a383-3efa381a8420 req-106dddc7-894e-409f-a4f4-5affbb069238 service nova] Creating event network-vif-deleted:91479282-5828-44ad-baf7-403e6633e420 for instance 82ec682a-a43c-442c-8ee0-80929637f1ed on n-h1-863052-1 Oct 31 14:18:55.167367 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a4368e43-0f16-463d-a383-3efa381a8420 req-106dddc7-894e-409f-a4f4-5affbb069238 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074316 Oct 31 14:18:55.168756 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1824/3916] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:18:55.342805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:55.354395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:55.356649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:55.358741 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-668eaeb4-bb35-4319-8f02-eaaf637c8fbf tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2829 microversion: 2.32 time: 0.541337 Oct 31 14:18:55.359681 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2093/3917] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:18:54 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2829 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:18:55.388194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-614e3c13-7217-4ac7-b635-de9438594ecc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:55.389201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:55.391168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:55.398639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.399164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.400523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.401832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.402342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.403048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.406646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614e3c13-7217-4ac7-b635-de9438594ecc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.407265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614e3c13-7217-4ac7-b635-de9438594ecc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.409593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614e3c13-7217-4ac7-b635-de9438594ecc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.471484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-614e3c13-7217-4ac7-b635-de9438594ecc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:18:55.556790 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7263cb12-cdf5-4fdc-92c8-a481a5be2bed tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.171478 Oct 31 14:18:55.569309 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2094/3918] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:18:55 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace/os-interface => generated 1829 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:18:55.580549 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-614e3c13-7217-4ac7-b635-de9438594ecc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action" status: 202 len: 0 microversion: 2.1 time: 0.203501 Oct 31 14:18:55.581490 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1825/3919] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:18:55 2022] POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:18:55.594037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:55.595585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:55.605721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.606702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.607360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.608336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.610273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.610922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.842581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:55.843536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:55.858236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.860127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.862747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.864527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:55.866823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:55.869767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:55.889407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:55.902022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26416dda-7daa-4961-b14d-14730bfee256 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.315599 Oct 31 14:18:55.909105 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2095/3920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:55 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:56.042810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:56.046539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:56.059619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.060965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.061771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.062511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.062972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.063395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.103458 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed HTTP/1.1 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '82ec682a-a43c-442c-8ee0-80929637f1ed'} Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.111445 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.116230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.118758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.120127 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f86c18fa-7993-4459-a79c-0fc242ca0c84 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 404 len: 111 microversion: 2.1 time: 0.083207 Oct 31 14:18:56.121598 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2096/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:56 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:56.137614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1917757855", "metadata": {"image_type": "test"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:56.146868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:56.165925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.167535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.168063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.170672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.171842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.172784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.190108 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed/action HTTP/1.1 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 112 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1917757855", "metadata": {"image_type": "test"}}} Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '82ec682a-a43c-442c-8ee0-80929637f1ed', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1917757855', 'metadata': {'image_type': 'test'}}}} Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:18:56.194680 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.199644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.202017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.203313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c34f015d-b21b-47eb-9d15-77548bdae4c7 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "POST /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed/action" status: 404 len: 111 microversion: 2.1 time: 0.077452 Oct 31 14:18:56.204346 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2097/3922] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 31 14:18:56 2022] POST /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:56.215097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6465fa83-f44c-4b03-91e0-06c928ba2524 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-698101065", "metadata": {"image_type": "test"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:56.219702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6465fa83-f44c-4b03-91e0-06c928ba2524 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Failed to fetch instance by id tempest-invalid-1086994472 {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:18:56.220592 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6465fa83-f44c-4b03-91e0-06c928ba2524 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance tempest-invalid-1086994472 could not be found. Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6465fa83-f44c-4b03-91e0-06c928ba2524 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/tempest-invalid-1086994472/action HTTP/1.1 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 111 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-698101065", "metadata": {"image_type": "test"}}} Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance tempest-invalid-1086994472 could not be found. Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'tempest-invalid-1086994472', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-698101065', 'metadata': {'image_type': 'test'}}}} Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1086994472 could not be found. Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.222601 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1086994472 could not be found. Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1086994472 could not be found. Oct 31 14:18:56.227843 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.230287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6465fa83-f44c-4b03-91e0-06c928ba2524 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance tempest-invalid-1086994472 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.231383 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6465fa83-f44c-4b03-91e0-06c928ba2524 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1086994472/action" status: 404 len: 101 microversion: 2.1 time: 0.020739 Oct 31 14:18:56.232564 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2098/3923] 10.222.0.27 () {60 vars in 1249 bytes} [Mon Oct 31 14:18:56 2022] POST /compute/v2.1/servers/tempest-invalid-1086994472/action => generated 101 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:18:56.247111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3faa07c2-6a94-427c-a478-9ff2047ce13a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1427222059"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:56.249767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3faa07c2-6a94-427c-a478-9ff2047ce13a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:18:56.250621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3faa07c2-6a94-427c-a478-9ff2047ce13a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3faa07c2-6a94-427c-a478-9ff2047ce13a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 57 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "tempest-test-snap-1427222059"}} Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1427222059'}}} Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.252292 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.259154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.260584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3faa07c2-6a94-427c-a478-9ff2047ce13a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.261687 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3faa07c2-6a94-427c-a478-9ff2047ce13a tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023450 Oct 31 14:18:56.266032 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2099/3924] 10.222.0.27 () {60 vars in 1275 bytes} [Mon Oct 31 14:18:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:56.276331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-535f724f-ab83-4e73-b24b-551202e114ec tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-454589327"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:56.278976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-535f724f-ab83-4e73-b24b-551202e114ec tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:18:56.279661 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-535f724f-ab83-4e73-b24b-551202e114ec tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-535f724f-ab83-4e73-b24b-551202e114ec tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 56 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: {"createImage": {"name": "tempest-test-snap-454589327"}} Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-454589327'}}} Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.281527 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-535f724f-ab83-4e73-b24b-551202e114ec tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-535f724f-ab83-4e73-b24b-551202e114ec tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011802 Oct 31 14:18:56.286725 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2100/3925] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 31 14:18:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:56.294669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:56.295258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:56.305298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.306150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.306793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.310394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.310394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.310394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.326494 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed HTTP/1.1 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '82ec682a-a43c-442c-8ee0-80929637f1ed'} Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.328330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.332830 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.336529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.337685 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64e13087-3550-47b0-bce9-a9a1389e58cb tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 404 len: 111 microversion: 2.1 time: 0.047172 Oct 31 14:18:56.341580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2101/3926] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:56 2022] DELETE /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:56.348199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:56.348916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] [instance: 82ec682a-a43c-442c-8ee0-80929637f1ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:56.355814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:56.357565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.361583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.362120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.363016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.365198 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57fd8b4e-ae36-4ac6-8617-1b4c5a81e50f tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.531202 Oct 31 14:18:56.366609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.367143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.372230 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1826/3927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:55 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:56.400220 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] HTTP exception thrown: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Request method failure captured: Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed HTTP/1.1 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9kyClq9_c4rXd9C9Eh571atRPLqy-_gNmX7XP0uVWsBPMi1lTq0-NhbI_2Wr50ibpW_1EfNDiz6qWY4Fz1el0RdyVBNbhtb9oMJb2--IN9a2z2ohK9eTfpxEsC6Qc0CqD0byEEgFXeHhWkMxgGcDg5ol1wToR7sr774UQ2do_aB-Ww Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4038443675364039993405eab3223c92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4038443675364039993405eab3223c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4038443675364039993405eab3223c92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4038443675364039993405eab3223c92 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-712991991 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2d14d759747c40f8a8b16ce1b94cb4c5 Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ImagesNegativeTestJSON-712991991-project Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '82ec682a-a43c-442c-8ee0-80929637f1ed'} Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:56.401847 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] Returning 404 to user: Instance 82ec682a-a43c-442c-8ee0-80929637f1ed could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3da1e868-facd-4ff6-86af-6bd1efe20332 tempest-ImagesNegativeTestJSON-712991991 tempest-ImagesNegativeTestJSON-712991991-project] 10.222.0.27 "GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed" status: 404 len: 111 microversion: 2.1 time: 0.061230 Oct 31 14:18:56.407284 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2102/3928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:56 2022] GET /compute/v2.1/servers/82ec682a-a43c-442c-8ee0-80929637f1ed => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:18:56.936655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:56.938006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:56.951084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.958296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.959396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:56.968967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:56.970099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:56.970748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:57.213095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-37deb4c7-f31e-4001-b9a7-da733a1bd3a5 req-4e14f9c9-713c-4c35-b290-c452af84f31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07767af9-b0c1-4fd5-b8ac-a33552cae30c", "name": "network-vif-plugged", "status": "completed", "tag": "18c95a5e-b435-41a5-895f-c4ee4005d56e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:57.228496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37deb4c7-f31e-4001-b9a7-da733a1bd3a5 req-4e14f9c9-713c-4c35-b290-c452af84f31d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:57.229270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37deb4c7-f31e-4001-b9a7-da733a1bd3a5 req-4e14f9c9-713c-4c35-b290-c452af84f31d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:57.230026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37deb4c7-f31e-4001-b9a7-da733a1bd3a5 req-4e14f9c9-713c-4c35-b290-c452af84f31d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:57.247896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-37deb4c7-f31e-4001-b9a7-da733a1bd3a5 req-4e14f9c9-713c-4c35-b290-c452af84f31d service nova] Creating event network-vif-plugged:18c95a5e-b435-41a5-895f-c4ee4005d56e for instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c on n-h1-863052-1 Oct 31 14:18:57.256043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-37deb4c7-f31e-4001-b9a7-da733a1bd3a5 req-4e14f9c9-713c-4c35-b290-c452af84f31d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046267 Oct 31 14:18:57.257453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2103/3929] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:57.352382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:57.361506 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0896fe57-a7e4-453b-b187-32b2ebe3f197 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.428438 Oct 31 14:18:57.362518 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1827/3930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:56 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:57.396486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:57.398081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:57.413130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:57.415857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:57.416493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:57.423162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:57.424165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:57.424786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:57.669766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:57.682574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a51fde51-078c-432c-92ef-4cb67a3625da tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1325 microversion: 2.1 time: 0.290538 Oct 31 14:18:57.716187 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2104/3931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:57 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:57.759311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e542d0c7-a32b-4298-b9bc-6704a8f54325 req-f4040a50-50b7-43c2-bd92-14b4f7f90fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "tag": "3a9b4172-f0ff-4584-98cf-3eabc53a8d71"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:57.772768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e542d0c7-a32b-4298-b9bc-6704a8f54325 req-f4040a50-50b7-43c2-bd92-14b4f7f90fcc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:57.773578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e542d0c7-a32b-4298-b9bc-6704a8f54325 req-f4040a50-50b7-43c2-bd92-14b4f7f90fcc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:57.774228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e542d0c7-a32b-4298-b9bc-6704a8f54325 req-f4040a50-50b7-43c2-bd92-14b4f7f90fcc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:57.789638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e542d0c7-a32b-4298-b9bc-6704a8f54325 req-f4040a50-50b7-43c2-bd92-14b4f7f90fcc service nova] Creating event network-changed:3a9b4172-f0ff-4584-98cf-3eabc53a8d71 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:18:57.800460 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e542d0c7-a32b-4298-b9bc-6704a8f54325 req-f4040a50-50b7-43c2-bd92-14b4f7f90fcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043875 Oct 31 14:18:57.806071 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1828/3932] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:18:58.389499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:58.390288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:58.405452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:58.405968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:58.406510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:58.407250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:58.407700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:58.410276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:58.730007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:58.730930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:58.741903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:58.746562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:58.747095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:58.748035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:58.754897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:58.755343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:58.971918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:58.981497 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-435e6009-f89b-4860-96b3-e92fa4a03889 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.597151 Oct 31 14:18:58.987063 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2105/3933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:58 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:18:59.039207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:59.056865 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-290b29de-9866-4175-9036-775a0907f472 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1522 microversion: 2.1 time: 0.332931 Oct 31 14:18:59.057453 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1829/3934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:58 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:18:59.087804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:59.088505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:59.096871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:59.106293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:59.107390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:59.108878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:59.111852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:59.112502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:59.174529 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] HTTP exception thrown: Instance is not a member of specified network Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Request method failure captured: Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c/ips/invalid HTTP/1.1 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9lBwQXr-IOPfqbA0RAXo-RkKPJJ94b9kAA9SIhoMCZ7H9LEdOXU5lartAOZbCMDKKqlGrYauRoqXwczhv5DPEV9uhKX7FiiEdwNJ8W_VhjntBU7qac1JTbfMjfzvSx0rip_0kH56AlsswMOpAG8VzZT7BFgiazf8Wia5_zMXv0uPvs Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 851537efc6704325a41cd84823425704 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_851537efc6704325a41cd84823425704", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/851537efc6704325a41cd84823425704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/851537efc6704325a41cd84823425704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/851537efc6704325a41cd84823425704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 851537efc6704325a41cd84823425704 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerAddressesNegativeTestJSON-2063791927-project Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 93bf103641ca49a0a0a405eae6fd55d9 Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2063791927-project Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance is not a member of specified network Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '07767af9-b0c1-4fd5-b8ac-a33552cae30c', 'id': 'invalid'} Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 31 14:18:59.191026 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.198567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:59.201937 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c76d104-89b6-4e4b-a83c-565b939a08e6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.118259 Oct 31 14:18:59.204563 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1830/3935] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:18:59 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c/ips/invalid => generated 91 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:18:59.246373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54b99971-ff6b-45cd-bd18-d320ce2e2c28 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:59.248079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-54b99971-ff6b-45cd-bd18-d320ce2e2c28 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Failed to fetch instance by id 999 {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:18:59.250455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-54b99971-ff6b-45cd-bd18-d320ce2e2c28 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] HTTP exception thrown: Instance 999 could not be found. Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54b99971-ff6b-45cd-bd18-d320ce2e2c28 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Request method failure captured: Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9lBwQXr-IOPfqbA0RAXo-RkKPJJ94b9kAA9SIhoMCZ7H9LEdOXU5lartAOZbCMDKKqlGrYauRoqXwczhv5DPEV9uhKX7FiiEdwNJ8W_VhjntBU7qac1JTbfMjfzvSx0rip_0kH56AlsswMOpAG8VzZT7BFgiazf8Wia5_zMXv0uPvs Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 851537efc6704325a41cd84823425704 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_851537efc6704325a41cd84823425704", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/851537efc6704325a41cd84823425704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/851537efc6704325a41cd84823425704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/851537efc6704325a41cd84823425704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 851537efc6704325a41cd84823425704 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerAddressesNegativeTestJSON-2063791927-project Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 93bf103641ca49a0a0a405eae6fd55d9 Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2063791927-project Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 999 could not be found. Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '999'} Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 31 14:18:59.253716 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:18:59.265543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-54b99971-ff6b-45cd-bd18-d320ce2e2c28 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:18:59.268927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-54b99971-ff6b-45cd-bd18-d320ce2e2c28 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.057396 Oct 31 14:18:59.269988 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1831/3936] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:18:59 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:18:59.280599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:59.282527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:59.313139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:59.313965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:59.315658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:59.316691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:59.318329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:59.319749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:59.418975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:18:59.585342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e33acf17-dd97-4167-a255-124ee754fc06 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 204 len: 0 microversion: 2.1 time: 0.308880 Oct 31 14:18:59.586259 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1832/3937] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:18:59 2022] DELETE /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:18:59.596638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:18:59.597583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:18:59.605167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:59.605973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:59.606598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:59.607595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:18:59.608201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:18:59.608884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:18:59.658425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-927425141", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:18:59.733426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:18:59.936427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:18:59.948983 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e59c1a28-6506-4cf3-89d4-64811c814d72 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1528 microversion: 2.1 time: 0.358062 Oct 31 14:18:59.953818 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1833/3938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:18:59 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1528 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:00.012530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:00.013151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:00.024935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:00.028216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:00.028792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:00.029467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:00.037381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:00.040251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:00.088225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:00.164049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:19:00.164747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:19:00.165521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:19:00.166821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:19:00.167504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:19:00.188693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:00.189455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:00.190301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:00.193610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:00.197806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:00.198639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:00.250064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Getting quotas for project 7b00f88189464c49b179a4ee59cec69c. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:19:00.257217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Getting quotas for user ea40fd7288c14d17a56f5f5b60145211 and project 7b00f88189464c49b179a4ee59cec69c. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:19:00.275089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:19:00.277955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:19:00.361117 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15fb278d-f9e3-489f-98f9-f2708ae2dbe5 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.370683 Oct 31 14:19:00.367807 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2106/3939] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:19:00.374547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ef36cf8-91f6-4752-acc8-9bdabfb0c05e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:00.377330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ef36cf8-91f6-4752-acc8-9bdabfb0c05e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:00.527637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ef36cf8-91f6-4752-acc8-9bdabfb0c05e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:00.537666 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ef36cf8-91f6-4752-acc8-9bdabfb0c05e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1222 microversion: 2.1 time: 0.168421 Oct 31 14:19:00.544435 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2107/3940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:00 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:00.568591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:00.578869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c893bf3e-ecd1-4351-9862-ea02c78ab6e3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.570246 Oct 31 14:19:00.581921 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1834/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:00 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:00.977600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:00.982306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:00.995907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:00.996341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:01.000160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:01.000957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:01.001488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:01.001907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:01.232522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:01.246007 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-640009e8-52f3-4f45-9f7f-428893e980f6 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1528 microversion: 2.1 time: 0.271430 Oct 31 14:19:01.248380 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2108/3942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:00 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1528 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:01.563907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:01.565340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:01.582326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:01.582867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:01.585548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:01.586556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:01.594950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:01.595838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:01.603756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:01.604551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:01.624989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:01.628672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:01.630558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:01.632677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:01.633328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:01.636435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:01.776583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:01.790921 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-451b5411-34ea-40a9-9656-19824d57f096 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1274 microversion: 2.1 time: 0.227352 Oct 31 14:19:01.791851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1835/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:01 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:01.954572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:01.978459 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d62188f7-e8b6-41f8-81bd-ac18f44e84e8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.378607 Oct 31 14:19:01.980107 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2109/3944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:01 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:02.271276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:02.272688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:02.282441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:02.283024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:02.283532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:02.293337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:02.293921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:02.298874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:02.321538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-bbee70cb-4785-4df7-8c65-dba67ea49d46 req-7bbb04bd-e994-4dc8-b9f6-4b3ed911b23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07767af9-b0c1-4fd5-b8ac-a33552cae30c", "name": "network-vif-deleted", "tag": "18c95a5e-b435-41a5-895f-c4ee4005d56e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:02.341488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bbee70cb-4785-4df7-8c65-dba67ea49d46 req-7bbb04bd-e994-4dc8-b9f6-4b3ed911b23d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:02.342403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bbee70cb-4785-4df7-8c65-dba67ea49d46 req-7bbb04bd-e994-4dc8-b9f6-4b3ed911b23d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:02.343039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bbee70cb-4785-4df7-8c65-dba67ea49d46 req-7bbb04bd-e994-4dc8-b9f6-4b3ed911b23d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:02.372593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-bbee70cb-4785-4df7-8c65-dba67ea49d46 req-7bbb04bd-e994-4dc8-b9f6-4b3ed911b23d service nova] Creating event network-vif-deleted:18c95a5e-b435-41a5-895f-c4ee4005d56e for instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c on n-h1-863052-1 Oct 31 14:19:02.386476 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-bbee70cb-4785-4df7-8c65-dba67ea49d46 req-7bbb04bd-e994-4dc8-b9f6-4b3ed911b23d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064516 Oct 31 14:19:02.387747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2110/3945] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:19:02.579014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bf103641ca49a0a0a405eae6fd55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851537efc6704325a41cd84823425704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:02.592453 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8de62dd6-d6a3-45c7-a98b-c3a1c7d62025 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 200 len: 1486 microversion: 2.1 time: 0.325244 Oct 31 14:19:02.594223 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1836/3946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:02 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 1486 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:02.824754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:02.826094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:02.838745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:02.840321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:02.842607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:02.843718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:02.845227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:02.845911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:03.004087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:03.005046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:03.012737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:03.015254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:03.017354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:03.026133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:03.026805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:03.027378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:03.036121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:03.048319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-537c66ee-a764-41b5-af74-b8194d54bb76 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1280 microversion: 2.1 time: 0.234340 Oct 31 14:19:03.076368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2111/3947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:02 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:03.622518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:03.622518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] [instance: 07767af9-b0c1-4fd5-b8ac-a33552cae30c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:03.623084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:03.631048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:03.631581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:03.632068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:03.633057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:03.636668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:03.637360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:03.667518 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0479b14-49c5-4dea-93ac-bf3ef5d700b8 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.665126 Oct 31 14:19:03.674741 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1837/3948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:02 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:03.682338 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] HTTP exception thrown: Instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c could not be found. Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Request method failure captured: Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c HTTP/1.1 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9lBwQXr-IOPfqbA0RAXo-RkKPJJ94b9kAA9SIhoMCZ7H9LEdOXU5lartAOZbCMDKKqlGrYauRoqXwczhv5DPEV9uhKX7FiiEdwNJ8W_VhjntBU7qac1JTbfMjfzvSx0rip_0kH56AlsswMOpAG8VzZT7BFgiazf8Wia5_zMXv0uPvs Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 851537efc6704325a41cd84823425704 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_851537efc6704325a41cd84823425704", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/851537efc6704325a41cd84823425704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/851537efc6704325a41cd84823425704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/851537efc6704325a41cd84823425704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 851537efc6704325a41cd84823425704 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2063791927 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerAddressesNegativeTestJSON-2063791927-project Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 93bf103641ca49a0a0a405eae6fd55d9 Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2063791927-project Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c could not be found. Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '07767af9-b0c1-4fd5-b8ac-a33552cae30c'} Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c could not be found. Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c could not be found. Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:03.684612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c could not be found. Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:03.690575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] Returning 404 to user: Instance 07767af9-b0c1-4fd5-b8ac-a33552cae30c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:03.697958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-558f9cfc-6aab-4c28-a52b-c85492633cd0 tempest-ServerAddressesNegativeTestJSON-2063791927 tempest-ServerAddressesNegativeTestJSON-2063791927-project] 10.222.0.27 "GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c" status: 404 len: 111 microversion: 2.1 time: 0.071232 Oct 31 14:19:03.697958 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2112/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:03 2022] GET /compute/v2.1/servers/07767af9-b0c1-4fd5-b8ac-a33552cae30c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:04.087349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:04.088287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:04.096314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:04.096812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:04.097260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:04.097981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:04.098472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:04.098904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:04.211155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:04.219878 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72c4dd83-0b02-4527-bc39-97630e42805a tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1280 microversion: 2.1 time: 0.139768 Oct 31 14:19:04.228263 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1838/3950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:04 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:04.715059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:04.715873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:04.734901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:04.735447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:04.735932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:04.736642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:04.737097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:04.737577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:04.774399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:04.964965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:04.968411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:04.977826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:04.978990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:04.979684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:04.981394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:04.982116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:04.983521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:05.025655 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19b2c415-6273-415e-8ad4-db13ebea3540 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065284 Oct 31 14:19:05.033191 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1839/3951] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:19:04 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:05.052418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:05.053976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:05.072188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:05.078534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:05.078534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:05.078534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:05.078534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:05.078534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:05.282361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lazy-loading 'services' on Instance uuid b5908187-cdb3-4eaa-99aa-c37e8c7614a5 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:19:05.326746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:05.338317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1624e697-a70c-4903-9e58-0ff43f98a7b1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.637529 Oct 31 14:19:05.339780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2113/3952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:04 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:05.346086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:05.347322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:05.354333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:05.355111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:05.355815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:05.357961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:05.358737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:05.359594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:05.470456 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05e06b8a-d42c-4005-98aa-1f2f8a6e8184 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments/778943c9-e20c-426f-b565-cf9ba6024dd2" status: 202 len: 0 microversion: 2.1 time: 0.434542 Oct 31 14:19:05.476689 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1840/3953] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:19:05 2022] DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments/778943c9-e20c-426f-b565-cf9ba6024dd2 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:19:05.848313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:05.860249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1424352-87ed-44b1-bf10-b00370dd5334 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.518608 Oct 31 14:19:05.871153 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2114/3954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:05 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:06.368889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:06.369976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:06.378427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:06.380378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:06.380834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:06.382107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:06.382579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:06.384028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:06.527362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27995bdf-74dd-465d-b52b-7a20a70cca53 tempest-ListImageFiltersNegativeTestJSON-1858326812 tempest-ListImageFiltersNegativeTestJSON-1858326812-project] Calling method '.version_select at 0x7fe106bb3160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:06.572580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-27995bdf-74dd-465d-b52b-7a20a70cca53 tempest-ListImageFiltersNegativeTestJSON-1858326812 tempest-ListImageFiltersNegativeTestJSON-1858326812-project] HTTP exception thrown: Image not found. Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27995bdf-74dd-465d-b52b-7a20a70cca53 tempest-ListImageFiltersNegativeTestJSON-1858326812 tempest-ListImageFiltersNegativeTestJSON-1858326812-project] Request method failure captured: Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/images/d891eea1-b42e-413b-bbf1-bf14a86dbf28 HTTP/1.1 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9lZfgH7tEIbXV77NpT-xsbQuBExO7wSyftDIEYskJCuaWUyxiUw_BjJRow2l_W1n20qDw-tizMAXq_PzOXtAmjQPuWR_wLCMWJnjxAgVy9BGy1HsuPq3kPviyZxVZyPkmW4mSxaF52W-c7Sv1LUpkd7kta1mfj1JlJKxI9kMVT-mlA Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: f70a834454fe4607bbb2ea0368a6a92c Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1858326812 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f70a834454fe4607bbb2ea0368a6a92c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f70a834454fe4607bbb2ea0368a6a92c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f70a834454fe4607bbb2ea0368a6a92c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f70a834454fe4607bbb2ea0368a6a92c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1858326812 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: f70a834454fe4607bbb2ea0368a6a92c Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1858326812 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ListImageFiltersNegativeTestJSON-1858326812-project Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 515fedc34ce44c5696163547d669a668 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1858326812-project Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: exception: Image not found. Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd891eea1-b42e-413b-bbf1-bf14a86dbf28'} Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d891eea1-b42e-413b-bbf1-bf14a86dbf28 Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 14:19:06.578317 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d891eea1-b42e-413b-bbf1-bf14a86dbf28 could not be found. Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 14:19:06.583780 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:06.601919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27995bdf-74dd-465d-b52b-7a20a70cca53 tempest-ListImageFiltersNegativeTestJSON-1858326812 tempest-ListImageFiltersNegativeTestJSON-1858326812-project] Returning 404 to user: Image not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:06.603036 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27995bdf-74dd-465d-b52b-7a20a70cca53 tempest-ListImageFiltersNegativeTestJSON-1858326812 tempest-ListImageFiltersNegativeTestJSON-1858326812-project] 10.222.0.27 "GET /compute/v2.1/images/d891eea1-b42e-413b-bbf1-bf14a86dbf28" status: 404 len: 62 microversion: 2.1 time: 0.574089 Oct 31 14:19:06.604680 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1841/3955] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:06 2022] GET /compute/v2.1/images/d891eea1-b42e-413b-bbf1-bf14a86dbf28 => generated 62 bytes in 580 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:19:06.870682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:06.885395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48777bbc-9b7b-483a-94f1-e5ca92f64aee tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.520378 Oct 31 14:19:06.888625 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2115/3956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:06 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:06.897304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:06.899097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:06.927907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8b4290d7-40f2-4ed3-ba28-7624eb0ea013 req-ee420054-1419-43a7-b428-ea5631329aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e404204-0e87-485f-8c6b-069a1f3e8cb9", "tag": "ad0df109-d283-4d34-8c21-6271136c024e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:06.943643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:06.948425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:06.952089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:06.956613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:06.957366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:06.963073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:06.964398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8b4290d7-40f2-4ed3-ba28-7624eb0ea013 req-ee420054-1419-43a7-b428-ea5631329aa0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:06.972973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8b4290d7-40f2-4ed3-ba28-7624eb0ea013 req-ee420054-1419-43a7-b428-ea5631329aa0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:06.978766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8b4290d7-40f2-4ed3-ba28-7624eb0ea013 req-ee420054-1419-43a7-b428-ea5631329aa0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:07.021376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8b4290d7-40f2-4ed3-ba28-7624eb0ea013 req-ee420054-1419-43a7-b428-ea5631329aa0 service nova] Creating event network-changed:ad0df109-d283-4d34-8c21-6271136c024e for instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 on n-h2-863052-1 Oct 31 14:19:07.031831 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8b4290d7-40f2-4ed3-ba28-7624eb0ea013 req-ee420054-1419-43a7-b428-ea5631329aa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109775 Oct 31 14:19:07.032457 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2116/3957] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:19:07.285374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:07.298849 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58445368-d7d1-4b9b-894f-7216893c8d18 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.413618 Oct 31 14:19:07.317527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1842/3958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:06 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:07.918660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:07.919385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:07.943258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:07.946387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:07.948225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:07.949594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:07.952990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:07.955326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:08.322830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:08.324028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:08.336942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:08.337639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:08.338291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:08.339194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:08.341977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:08.342766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:08.363503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:08.375808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50257509-16c0-4957-82ea-f9de5661d860 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.463847 Oct 31 14:19:08.377319 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2117/3959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:07 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:08.904786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:08.919567 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84b8672c-45fd-4d1e-abd7-6e94eb6e6899 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.600003 Oct 31 14:19:08.922978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1843/3960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:08 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:09.400849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:09.401657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:09.417884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:09.418613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:09.419232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:09.420292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:09.422823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:09.423490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:09.849735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:09.869964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d1ca764-d6bd-4035-8e46-5fe7015914dc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.470705 Oct 31 14:19:09.885799 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2118/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:09 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:09.950769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:09.952846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:09.968540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:09.972885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:09.975379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:09.978846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:09.981214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:09.982124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:10.239797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:10.251676 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c539c9cf-503f-43cf-9d97-85d0e6c5da7e tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.305992 Oct 31 14:19:10.252265 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1844/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:09 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:10.497721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:10.532951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:10.903538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:10.904313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:10.929510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:10.936381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:10.937270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:10.938658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:10.942774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:10.944046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:11.102050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61c0e4e7-571f-499b-9bc0-4e62d12530c3 tempest-ListImagesTestJSON-145995141 tempest-ListImagesTestJSON-145995141-project] Calling method '.version_select at 0x7fe106465160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:11.183202 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61c0e4e7-571f-499b-9bc0-4e62d12530c3 tempest-ListImagesTestJSON-145995141 tempest-ListImagesTestJSON-145995141-project] 10.222.0.27 "GET /compute/v2.1/images/cf380c16-a362-46be-bffa-e45fdf8f7e66" status: 200 len: 784 microversion: 2.1 time: 0.689696 Oct 31 14:19:11.183958 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2119/3963] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:10 2022] GET /compute/v2.1/images/cf380c16-a362-46be-bffa-e45fdf8f7e66 => generated 784 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:11.199322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c67d7d9-ddab-4774-ae8e-ddf53e11adf8 tempest-ListImagesTestJSON-145995141 tempest-ListImagesTestJSON-145995141-project] Calling method '.version_select at 0x7fe1064b9f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:11.277872 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c67d7d9-ddab-4774-ae8e-ddf53e11adf8 tempest-ListImagesTestJSON-145995141 tempest-ListImagesTestJSON-145995141-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.082233 Oct 31 14:19:11.282909 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2120/3964] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:11 2022] GET /compute/v2.1/images => generated 871 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:11.289865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:11.295243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:11.315069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:11.315679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:11.316761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:11.317600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:11.318191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:11.318693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:11.439782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:11.455889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec5491ec-be34-4185-a508-0f44374278b9 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.558775 Oct 31 14:19:11.457995 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1845/3965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:10 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:11.463065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75fa07e3-5f9f-4985-9e93-0f2bac3797c5 tempest-ListImagesTestJSON-145995141 tempest-ListImagesTestJSON-145995141-project] Calling method '.version_select at 0x7fe106aafe50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:11.597832 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75fa07e3-5f9f-4985-9e93-0f2bac3797c5 tempest-ListImagesTestJSON-145995141 tempest-ListImagesTestJSON-145995141-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.138350 Oct 31 14:19:11.610961 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1846/3966] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:19:11 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:11.629308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:11.648925 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d9f779b-d065-476e-832c-7eb356b33d17 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.364598 Oct 31 14:19:11.649521 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2121/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:11 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:12.486311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:12.487091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:12.500525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:12.502349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:12.503632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:12.504819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:12.507962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:12.509605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:12.676533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:12.677118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:12.705650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:12.706161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:12.706638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:12.707362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:12.707794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:12.708216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:12.833260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:12.842035 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92544423-c4b5-4044-af14-7aac45ab9b22 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.360956 Oct 31 14:19:12.843035 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1847/3968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:12 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:13.071555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:13.082811 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a46c656-c612-4328-bd04-c5d7b2fdccf1 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.410069 Oct 31 14:19:13.086683 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2122/3969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:12 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:13.374773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:13.377286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:13.383977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.384683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.385496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.386479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.387199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.387782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.432306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b18fc67b-f3be-4260-be7a-0027d31265d7 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061387 Oct 31 14:19:13.432886 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1848/3970] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:19:13 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:19:13.516370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:13.519353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:13.526384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.526872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.527490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.528370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.529008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.529599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.565281 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33aa2932-f592-47ec-bf58-d78181efec2f tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052797 Oct 31 14:19:13.573157 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2123/3971] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:19:13 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:19:13.646472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ca0dec6e-760c-4da3-b282-f837b82bdc0b req-1f0a846d-013f-479f-8c21-095c03fc95d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e404204-0e87-485f-8c6b-069a1f3e8cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ad0df109-d283-4d34-8c21-6271136c024e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:13.648934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:13.650032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:13.658821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.660118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.660836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.661702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.661893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ca0dec6e-760c-4da3-b282-f837b82bdc0b req-1f0a846d-013f-479f-8c21-095c03fc95d3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.663028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ca0dec6e-760c-4da3-b282-f837b82bdc0b req-1f0a846d-013f-479f-8c21-095c03fc95d3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.663513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.663643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ca0dec6e-760c-4da3-b282-f837b82bdc0b req-1f0a846d-013f-479f-8c21-095c03fc95d3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.664213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.683016 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ca0dec6e-760c-4da3-b282-f837b82bdc0b req-1f0a846d-013f-479f-8c21-095c03fc95d3 service nova] Creating event network-vif-plugged:ad0df109-d283-4d34-8c21-6271136c024e for instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 on n-h2-863052-1 Oct 31 14:19:13.689329 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ca0dec6e-760c-4da3-b282-f837b82bdc0b req-1f0a846d-013f-479f-8c21-095c03fc95d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047087 Oct 31 14:19:13.690329 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2124/3972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:13.722145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:19:13.833842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba4dba09-5d2a-495d-98ad-db7dad39e8c2 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 204 len: 0 microversion: 2.1 time: 0.192343 Oct 31 14:19:13.837390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1849/3973] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:19:13 2022] DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:19:13.847132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:13.848742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:13.858216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.859092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.859811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.860522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.860980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.861408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.869784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:13.870661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:13.883605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.885067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.885626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:13.886483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:13.887031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:13.887903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:14.026582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:14.036203 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a21969b4-397f-4497-a63f-9247bee01ce4 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1680 microversion: 2.1 time: 0.194197 Oct 31 14:19:14.042082 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2125/3974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:13 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:14.077766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:14.081670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:14.088108 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64a81a10-fb56-4640-b54d-7aa40e2a3511 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.223728 Oct 31 14:19:14.088686 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1850/3975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:13 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:14.109753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:14.110588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:14.118489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:14.118987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:14.119720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:14.120883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:14.121336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:14.122053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:14.269915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:14.281927 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32e0fe01-68e7-44b1-aa23-7435803c7cd9 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1322 microversion: 2.1 time: 0.174913 Oct 31 14:19:14.282049 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2126/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:14 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:15.061546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:15.062233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:15.072285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.073622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.074298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.075012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.076233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.076859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.112580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:15.113329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:15.124127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.124840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.125451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.126360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.126982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.127596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.321842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:15.333401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70a189ee-7cbf-4f1a-9607-42e11f6c3148 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1680 microversion: 2.1 time: 0.276970 Oct 31 14:19:15.346479 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1851/3977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:15 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:15.357843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:15.358846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:15.366580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.367272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.367912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.368780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.369653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.370263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.394744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:15.408808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19b3abd8-f2c1-42cb-ad97-a580a9785ea6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.299524 Oct 31 14:19:15.409445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2127/3978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:15 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:15.818364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:15.826671 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16c61ec0-e29d-4bcc-8d3e-c2c41e1305db tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1472 microversion: 2.1 time: 0.478762 Oct 31 14:19:15.842885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1852/3979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:15 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:15.856295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:15.856965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:15.870695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.874127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.875143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.876176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.878805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.879262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.918403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Request method failure captured: Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9/diagnostics HTTP/1.1 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9lQRrawM3oIyimB8caO8qiW8WoVGyb1QuCOTcJTwDv7KLs-GMs4MNQinFx65r-s8dAus0XXoYGkYtpyDPj0alUqzw-pVcFre5rz7nRKUQbQk5H1aENBHpPR-npprJAZNMwOs884_0KelJttOJQV52m7jxBpn_2SHh4W_Hb10pUeBc4 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7b00f88189464c49b179a4ee59cec69c Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-982623111 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b00f88189464c49b179a4ee59cec69c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b00f88189464c49b179a4ee59cec69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b00f88189464c49b179a4ee59cec69c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b00f88189464c49b179a4ee59cec69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-982623111 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7b00f88189464c49b179a4ee59cec69c Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-982623111 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerDiagnosticsNegativeTest-982623111-project Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea40fd7288c14d17a56f5f5b60145211 Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-982623111-project Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': '0e404204-0e87-485f-8c6b-069a1f3e8cb9'} Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:15.942792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:15.949115 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:15.949115 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:15.949115 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 14:19:15.949115 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 14:19:15.949115 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 14:19:15.949115 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:15.952257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:15.953921 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9272bbfd-41e0-4ce4-8866-7698fa287742 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.102347 Oct 31 14:19:15.954654 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2128/3980] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:15 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9/diagnostics => generated 117 bytes in 105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:15.971178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:15.971682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:15.978472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.978472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.978918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:15.980131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:15.980131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:15.980486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:16.367882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:16.369668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:16.387606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:16.388557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:16.393006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:16.395109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:16.399039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:16.402012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:16.418787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:19:16.610839 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d5fdc4eb-d227-4055-8200-7c3c7ac432ae tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 204 len: 0 microversion: 2.1 time: 0.645650 Oct 31 14:19:16.611415 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1853/3981] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:19:15 2022] DELETE /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:19:16.626319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:16.627313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:16.651765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:16.660907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:16.663700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:16.666359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:16.667494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:16.669225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:16.672741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:16.681648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a54f591-093a-44e6-a630-ea384f4ebb46 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1612 microversion: 2.1 time: 0.319740 Oct 31 14:19:16.692638 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2129/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:16 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1612 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:16.704204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:16.704824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:16.735320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:16.735817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:16.736257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:16.736967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:16.737421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:16.737887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:17.056882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:17.071877 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41db8393-3d6b-4db1-9072-9ab432aa85ef tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.456438 Oct 31 14:19:17.078341 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1854/3983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:16 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:17.210054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:17.226233 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9720dcc7-a5ec-4a6f-ae10-d835417b8f47 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1478 microversion: 2.1 time: 0.531675 Oct 31 14:19:17.238604 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2130/3984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:16 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1478 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:17.716740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:17.718073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:17.727970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:17.728848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:17.734953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:17.737412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:17.739267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:17.739873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:17.842575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b0b1e422-7c44-400b-ae99-10c774ea13f1 req-ed52de2f-51ed-4153-a321-de11450dc17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5908187-cdb3-4eaa-99aa-c37e8c7614a5", "name": "network-vif-deleted", "tag": "7401c927-21ce-4667-bca1-cdd3d199e9ad"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:17.854349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b0b1e422-7c44-400b-ae99-10c774ea13f1 req-ed52de2f-51ed-4153-a321-de11450dc17c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:17.855190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b0b1e422-7c44-400b-ae99-10c774ea13f1 req-ed52de2f-51ed-4153-a321-de11450dc17c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:17.857448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b0b1e422-7c44-400b-ae99-10c774ea13f1 req-ed52de2f-51ed-4153-a321-de11450dc17c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:17.872851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b0b1e422-7c44-400b-ae99-10c774ea13f1 req-ed52de2f-51ed-4153-a321-de11450dc17c service nova] Creating event network-vif-deleted:7401c927-21ce-4667-bca1-cdd3d199e9ad for instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 on n-h1-863052-1 Oct 31 14:19:17.878792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b0b1e422-7c44-400b-ae99-10c774ea13f1 req-ed52de2f-51ed-4153-a321-de11450dc17c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040336 Oct 31 14:19:17.880051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2131/3985] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:19:17.966417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d6c2a3d22f474a9294d93cd635585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f3b642a80a4b81913acf2ebc84e453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:17.984115 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-016ed32e-5aa5-477d-944f-29ac62ff8895 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 200 len: 1612 microversion: 2.1 time: 0.271475 Oct 31 14:19:17.986678 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1855/3986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:17 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 1612 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:18.098759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:18.099756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:18.117853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:18.122914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:18.123689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:18.125800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:18.131566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:18.133825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:18.250963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:18.251635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:18.265626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:18.268624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:18.269183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:18.270065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:18.270555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:18.270986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:18.862609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:18.876572 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a58ebe14-7b29-40ee-9305-87822eef751b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1478 microversion: 2.1 time: 0.629484 Oct 31 14:19:18.879720 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1856/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:18 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1478 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:19.013068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:19.014061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:19.032080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:19.032624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:19.033193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:19.033921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:19.039577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:19.040383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:19.069897 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] HTTP exception thrown: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:19.083347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Request method failure captured: Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 HTTP/1.1 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9jA_ll8PxVSkKr3ntRflE4F9P2a81_8CQgQNVtGz59IMA_zxZqWQLtp9vqYq9Wgf9RgITFdTLlx11EaBHwXLXIoqJj5CE52_TJEIyXUh_1vSpcu4YVfVidlkn7CNlRn-fGfuy6XAmiWwmi0hmmZ0xZPJEmqyC08D09_HZmNt8UPv_U Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 76f3b642a80a4b81913acf2ebc84e453 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76f3b642a80a4b81913acf2ebc84e453", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 76f3b642a80a4b81913acf2ebc84e453 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachSCSIVolumeTestJSON-943930413-project Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: d9d6c2a3d22f474a9294d93cd635585b Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-943930413-project Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b5908187-cdb3-4eaa-99aa-c37e8c7614a5'} Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:19.083987 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Returning 404 to user: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c455543e-d36a-4e4b-91fc-72c25b99930d tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 404 len: 111 microversion: 2.1 time: 0.076827 Oct 31 14:19:19.090072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1857/3988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:19 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:19:19.094250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93cf48c5-1d8e-4c0e-83c8-c6822606ae63 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '.version_select at 0x7fe106b26550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:19.113453 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0682ba2d-24b2-4ead-9e38-8a774d24083d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 1.018735 Oct 31 14:19:19.116080 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2132/3989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:18 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:19.122624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:19.140571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93cf48c5-1d8e-4c0e-83c8-c6822606ae63 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571964857" status: 202 len: 0 microversion: 2.1 time: 0.050355 Oct 31 14:19:19.142493 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1858/3990] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571964857 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:19:19.908138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:19.909526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:19.914635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:19.929651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:19.930560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:19.931251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:19.932692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:19.935558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:19.936254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:20.146042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:20.147543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:20.167936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:20.168535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:20.170482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:20.171670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:20.172744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:20.174375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:20.626680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:20.647226 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ddd679c8-e186-4850-911f-b329f04d6c5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1723 microversion: 2.1 time: 0.505575 Oct 31 14:19:20.653031 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1859/3991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:20 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1723 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:20.791856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:20.807863 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce78f5d9-cfa1-4c19-a892-7befc259ae1b tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1478 microversion: 2.1 time: 0.904111 Oct 31 14:19:20.808696 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2133/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:19 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1478 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:21.682289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:21.684575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:21.701721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:21.702802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:21.706125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:21.707574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:21.708694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:21.710794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:21.718344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-072fd981-cf6f-480c-95b4-f8e979157b17 req-f8455935-5519-478f-a57a-7064dd859f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e404204-0e87-485f-8c6b-069a1f3e8cb9", "name": "network-vif-deleted", "tag": "ad0df109-d283-4d34-8c21-6271136c024e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:21.748497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-072fd981-cf6f-480c-95b4-f8e979157b17 req-f8455935-5519-478f-a57a-7064dd859f9b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:21.751022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-072fd981-cf6f-480c-95b4-f8e979157b17 req-f8455935-5519-478f-a57a-7064dd859f9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:21.752018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-072fd981-cf6f-480c-95b4-f8e979157b17 req-f8455935-5519-478f-a57a-7064dd859f9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:21.789266 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-072fd981-cf6f-480c-95b4-f8e979157b17 req-f8455935-5519-478f-a57a-7064dd859f9b service nova] Creating event network-vif-deleted:ad0df109-d283-4d34-8c21-6271136c024e for instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 on n-h2-863052-1 Oct 31 14:19:21.802868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-072fd981-cf6f-480c-95b4-f8e979157b17 req-f8455935-5519-478f-a57a-7064dd859f9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089235 Oct 31 14:19:21.813525 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2134/3993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:21.839083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:21.841153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:21.860456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:21.864268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:21.865121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:21.869916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:21.871513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:21.872616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:21.925057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:21.940299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:21.941141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:21.941951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:21.942687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lazy-loading 'fault' on Instance uuid 0e404204-0e87-485f-8c6b-069a1f3e8cb9 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:19:22.096742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea40fd7288c14d17a56f5f5b60145211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00f88189464c49b179a4ee59cec69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:22.107302 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa9dc832-d065-4429-a4f1-b636e3c6bedc tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 200 len: 1312 microversion: 2.1 time: 0.276190 Oct 31 14:19:22.108080 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2135/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:21 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:22.203592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:22.218089 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9bd86755-a4a5-4872-b49b-a0162e115344 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1700 microversion: 2.1 time: 0.542513 Oct 31 14:19:22.235218 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1860/3995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:21 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1700 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:22.247387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ed03c36-746d-4746-8fb4-1c46e3fe16d3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:22.262385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ed03c36-746d-4746-8fb4-1c46e3fe16d3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:22.263050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ed03c36-746d-4746-8fb4-1c46e3fe16d3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:22.263626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ed03c36-746d-4746-8fb4-1c46e3fe16d3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:22.348443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ed03c36-746d-4746-8fb4-1c46e3fe16d3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 14:19:22.454731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ed03c36-746d-4746-8fb4-1c46e3fe16d3 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action" status: 202 len: 0 microversion: 2.1 time: 0.213963 Oct 31 14:19:22.466349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2136/3996] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:19:22 2022] POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:19:22.476615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:22.477731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:22.495164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:22.498828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:22.504229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:22.505235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:22.507825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:22.510870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:23.134884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:23.136259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] [instance: 0e404204-0e87-485f-8c6b-069a1f3e8cb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:23.148992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:23.157059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:23.157698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:23.158887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:23.159738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:23.160340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:23.197350 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] HTTP exception thrown: Instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 could not be found. Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Request method failure captured: Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 HTTP/1.1 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9lQRrawM3oIyimB8caO8qiW8WoVGyb1QuCOTcJTwDv7KLs-GMs4MNQinFx65r-s8dAus0XXoYGkYtpyDPj0alUqzw-pVcFre5rz7nRKUQbQk5H1aENBHpPR-npprJAZNMwOs884_0KelJttOJQV52m7jxBpn_2SHh4W_Hb10pUeBc4 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7b00f88189464c49b179a4ee59cec69c Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-982623111 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b00f88189464c49b179a4ee59cec69c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b00f88189464c49b179a4ee59cec69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b00f88189464c49b179a4ee59cec69c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b00f88189464c49b179a4ee59cec69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-982623111 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7b00f88189464c49b179a4ee59cec69c Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-982623111 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerDiagnosticsNegativeTest-982623111-project Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: ea40fd7288c14d17a56f5f5b60145211 Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-982623111-project Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 could not be found. Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '0e404204-0e87-485f-8c6b-069a1f3e8cb9'} Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 could not be found. Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 could not be found. Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:23.199365 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 could not be found. Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:23.207044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] Returning 404 to user: Instance 0e404204-0e87-485f-8c6b-069a1f3e8cb9 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:23.208276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74303319-9766-4ace-878a-06b95f9b2644 tempest-ServerDiagnosticsNegativeTest-982623111 tempest-ServerDiagnosticsNegativeTest-982623111-project] 10.222.0.27 "GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9" status: 404 len: 111 microversion: 2.1 time: 0.075240 Oct 31 14:19:23.209515 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2137/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:23 2022] GET /compute/v2.1/servers/0e404204-0e87-485f-8c6b-069a1f3e8cb9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:19:23.296087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:23.311037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a5fd27e-3a72-4e14-9bb0-6873bbac69db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1709 microversion: 2.1 time: 0.839534 Oct 31 14:19:23.315345 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1861/3998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:22 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1709 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:24.337542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:24.338129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:24.352000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:24.356720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:24.359494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:24.405237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:24.405833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:24.406332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:24.964091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:24.977200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a34e771d-031e-4388-b61c-90ba4dd0b19a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1709 microversion: 2.1 time: 0.644121 Oct 31 14:19:24.982444 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2138/3999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:24 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1709 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:19:25.251888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Calling method '.version_select at 0x7fe107476790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:25.426031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:19:25.426787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Neutron security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:19:25.427454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] HTTP exception thrown: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.427454 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Request method failure captured: Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-security-groups/cca24b12-3f6b-49e1-8fed-6c68cee01e3f HTTP/1.1 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9lscm0luA8IFYzTlxLiFYe2x-Gv2gbTrNtUzv8p3sRN9apYLUsC61ya025JIDr2CmoPguhwGJn8IaAsHlUyUF33_J2g3dFqNYe7QwemYl4Cf45u3fw2UyNWdFpC4FJNvhRiZJ4FtKnW7x-KtnbdCiRy-WX8D3CdwgVEIqD7zpSvTCc Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c0688eab7848ecaf7e20b272210b7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8119fb3ba4204c059b0047368703689b Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'cca24b12-3f6b-49e1-8fed-6c68cee01e3f'} Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:19:25.447995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Returning 404 to user: Security group cca24b12-3f6b-49e1-8fed-6c68cee01e3f does not exist Oct 31 14:19:25.454485 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-a1d98adb-271c-4f7b-9d83-8e5c3eadf498'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:25.457826 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5692c568-10b3-42fe-b6f2-dcadf26c17bd tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/cca24b12-3f6b-49e1-8fed-6c68cee01e3f" status: 404 len: 194 microversion: 2.1 time: 0.537270 Oct 31 14:19:25.463489 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1862/4000] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:24 2022] DELETE /compute/v2.1/os-security-groups/cca24b12-3f6b-49e1-8fed-6c68cee01e3f => generated 194 bytes in 544 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:25.474807 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-573bc01d-d2f7-4782-85fc-a84dedf7c36a tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009576 Oct 31 14:19:25.475975 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2139/4001] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 31 14:19:25 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:19:25.485514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9811711-f02c-47a3-9b86-6baf68a4fcae tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Calling method '.version_select at 0x7fe106a9b550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:25.967492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9811711-f02c-47a3-9b86-6baf68a4fcae tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.485698 Oct 31 14:19:25.968076 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1863/4002] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:19:25 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:19:25.985535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcc974cc-30e2-4f48-ab20-6e9b800f2672 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Calling method '.version_select at 0x7fe106456820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:26.016187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:26.017062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:26.025949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:26.026863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:26.027586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:26.028632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:26.029453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:26.030119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:26.627558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-bcc974cc-30e2-4f48-ab20-6e9b800f2672 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:19:26.630243 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bcc974cc-30e2-4f48-ab20-6e9b800f2672 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 31 14:19:26.630243 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcc974cc-30e2-4f48-ab20-6e9b800f2672 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Request method failure captured: Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-security-groups/82d9fd13-f83f-44ad-b61c-c86b678b9fd7 HTTP/1.1 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9lscm0luA8IFYzTlxLiFYe2x-Gv2gbTrNtUzv8p3sRN9apYLUsC61ya025JIDr2CmoPguhwGJn8IaAsHlUyUF33_J2g3dFqNYe7QwemYl4Cf45u3fw2UyNWdFpC4FJNvhRiZJ4FtKnW7x-KtnbdCiRy-WX8D3CdwgVEIqD7zpSvTCc Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c0688eab7848ecaf7e20b272210b7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8119fb3ba4204c059b0047368703689b Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: exception: Insufficient rights for removing default security group. Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '82d9fd13-f83f-44ad-b61c-c86b678b9fd7'} Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:19:26.656832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] Oct 31 14:19:26.662013 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:26.668038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcc974cc-30e2-4f48-ab20-6e9b800f2672 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 31 14:19:26.668038 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-92cfda9c-577a-48a9-8a85-4cd7393b5439'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:26.669246 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcc974cc-30e2-4f48-ab20-6e9b800f2672 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/82d9fd13-f83f-44ad-b61c-c86b678b9fd7" status: 400 len: 182 microversion: 2.1 time: 0.690974 Oct 31 14:19:26.669991 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2140/4003] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:25 2022] DELETE /compute/v2.1/os-security-groups/82d9fd13-f83f-44ad-b61c-c86b678b9fd7 => generated 182 bytes in 692 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:19:26.691188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Calling method '.version_select at 0x7fe1063b2790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:27.029006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:27.041390 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2370f16d-cbf1-4cc3-adaa-201b5f63559c tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1713 microversion: 2.1 time: 1.030722 Oct 31 14:19:27.046642 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1864/4004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:26 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1713 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:19:27.248887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:19:27.249510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Neutron security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f not found {{(pid=120640) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:19:27.250251 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] HTTP exception thrown: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.250251 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Request method failure captured: Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-security-groups/c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f HTTP/1.1 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9lscm0luA8IFYzTlxLiFYe2x-Gv2gbTrNtUzv8p3sRN9apYLUsC61ya025JIDr2CmoPguhwGJn8IaAsHlUyUF33_J2g3dFqNYe7QwemYl4Cf45u3fw2UyNWdFpC4FJNvhRiZJ4FtKnW7x-KtnbdCiRy-WX8D3CdwgVEIqD7zpSvTCc Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c0688eab7848ecaf7e20b272210b7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8119fb3ba4204c059b0047368703689b Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f'} Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:19:27.252411 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] Oct 31 14:19:27.257793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.261834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Returning 404 to user: Security group c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f does not exist Oct 31 14:19:27.261834 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-ab593a6d-b6f3-4964-b056-a542e283c66d'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:27.263053 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79e7d084-86b4-4119-b81d-237d5dcadd18 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f" status: 404 len: 194 microversion: 2.1 time: 0.585152 Oct 31 14:19:27.263810 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2141/4005] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:19:26 2022] GET /compute/v2.1/os-security-groups/c5c163b2-7f9d-438c-9fe9-c2ff855e3d9f => generated 194 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:19:27.274325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Action: 'update', calling method: .version_select at 0x7fe106a50790>, body: {"security_group": {"name": "tempest-sg-168003808", "description": "tempest-description-889143258"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:27.311090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:19:27.311815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Neutron security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:19:27.312460 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] HTTP exception thrown: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.312460 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Request method failure captured: Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: request: PUT /compute/v2.1/os-security-groups/8d11eeff-b25a-42be-8bd8-11ce6cf66067 HTTP/1.1 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 100 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9lscm0luA8IFYzTlxLiFYe2x-Gv2gbTrNtUzv8p3sRN9apYLUsC61ya025JIDr2CmoPguhwGJn8IaAsHlUyUF33_J2g3dFqNYe7QwemYl4Cf45u3fw2UyNWdFpC4FJNvhRiZJ4FtKnW7x-KtnbdCiRy-WX8D3CdwgVEIqD7zpSvTCc Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6c0688eab7848ecaf7e20b272210b7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6c0688eab7848ecaf7e20b272210b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a6c0688eab7848ecaf7e20b272210b7b Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324 Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8119fb3ba4204c059b0047368703689b Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1371047324-project Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: {"security_group": {"name": "tempest-sg-168003808", "description": "tempest-description-889143258"}} Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '8d11eeff-b25a-42be-8bd8-11ce6cf66067', 'body': {'security_group': {'name': 'tempest-sg-168003808', 'description': 'tempest-description-889143258'}}} Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:19:27.314563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] Returning 404 to user: Security group 8d11eeff-b25a-42be-8bd8-11ce6cf66067 does not exist Oct 31 14:19:27.320444 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-fdfdfc1c-589a-4486-a1c0-255f1846734e'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:27.325965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fccb29be-9723-4484-9be9-b980b84c7597 tempest-SecurityGroupsNegativeTestJSON-1371047324 tempest-SecurityGroupsNegativeTestJSON-1371047324-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/8d11eeff-b25a-42be-8bd8-11ce6cf66067" status: 404 len: 194 microversion: 2.1 time: 0.054467 Oct 31 14:19:27.325965 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1865/4006] 10.222.0.27 () {60 vars in 1290 bytes} [Mon Oct 31 14:19:27 2022] PUT /compute/v2.1/os-security-groups/8d11eeff-b25a-42be-8bd8-11ce6cf66067 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:19:28.279835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79f4a822-11a0-43ef-8deb-7f19697f2de6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Action: 'create', calling method: .version_select at 0x7fe1063404c0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:28.329855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-79f4a822-11a0-43ef-8deb-7f19697f2de6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Getting quotas for project 74d0e7b6bc254021a2db4fa25a5bffb2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:19:28.337267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-79f4a822-11a0-43ef-8deb-7f19697f2de6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Getting quotas for user b4f99961cfa6426eace8afb4b96b75c3 and project 74d0e7b6bc254021a2db4fa25a5bffb2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:19:28.406003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-79f4a822-11a0-43ef-8deb-7f19697f2de6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Getting quotas for project 74d0e7b6bc254021a2db4fa25a5bffb2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:19:28.415731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-79f4a822-11a0-43ef-8deb-7f19697f2de6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Getting quotas for user b4f99961cfa6426eace8afb4b96b75c3 and project 74d0e7b6bc254021a2db4fa25a5bffb2. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:19:28.475202 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79f4a822-11a0-43ef-8deb-7f19697f2de6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.536900 Oct 31 14:19:28.489347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9b1ac5d-c346-405c-8518-19a2c4b799a7 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:28.494646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2142/4007] 10.222.0.27 () {62 vars in 1214 bytes} [Mon Oct 31 14:19:27 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:19:28.527173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9b1ac5d-c346-405c-8518-19a2c4b799a7 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.042247 Oct 31 14:19:28.543349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3775913-c892-49fc-9bda-cd22230d2d41 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:28.562914 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1866/4008] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 31 14:19:28 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:19:28.569481 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3775913-c892-49fc-9bda-cd22230d2d41 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba" status: 200 len: 235 microversion: 2.64 time: 0.030333 Oct 31 14:19:28.570061 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2143/4009] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 31 14:19:28 2022] GET /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba => generated 235 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:19:28.582054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92d82a72-b5df-44af-b052-bb056cff5225 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:28.686822 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92d82a72-b5df-44af-b052-bb056cff5225 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba" status: 204 len: 0 microversion: 2.64 time: 0.103740 Oct 31 14:19:28.701194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee6594e1-bdce-42d5-b273-1a1342c710f6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:28.707952 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1867/4010] 10.222.0.27 () {60 vars in 1307 bytes} [Mon Oct 31 14:19:28 2022] DELETE /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:19:28.714033 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ee6594e1-bdce-42d5-b273-1a1342c710f6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] HTTP exception thrown: Instance group 356f55ab-f997-4e7a-8b33-76613c9ae9ba could not be found. Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee6594e1-bdce-42d5-b273-1a1342c710f6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Request method failure captured: Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba HTTP/1.1 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9lv3jEgNoNzOODD10Wk7jR9M9NHe0FAyvpib336Ban31gcrtsSa8RyGHziiBdxlNZX_NGSFao8bsigAzbDediGlG92GepnVpXFTmA-G_t12vonLrJ3y0dvhIR2zr4aMwWp1db9HIxOKiCNPOcoJBr5FscN_claUvtgE7oukqH4UnUU Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.64 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 74d0e7b6bc254021a2db4fa25a5bffb2 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerGroup264TestJSON-1937408882 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74d0e7b6bc254021a2db4fa25a5bffb2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74d0e7b6bc254021a2db4fa25a5bffb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74d0e7b6bc254021a2db4fa25a5bffb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74d0e7b6bc254021a2db4fa25a5bffb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerGroup264TestJSON-1937408882 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 74d0e7b6bc254021a2db4fa25a5bffb2 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1937408882 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerGroup264TestJSON-1937408882-project Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b4f99961cfa6426eace8afb4b96b75c3 Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerGroup264TestJSON-1937408882-project Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance group 356f55ab-f997-4e7a-8b33-76613c9ae9ba could not be found. Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '356f55ab-f997-4e7a-8b33-76613c9ae9ba'} Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 356f55ab-f997-4e7a-8b33-76613c9ae9ba could not be found. Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 356f55ab-f997-4e7a-8b33-76613c9ae9ba could not be found. Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:28.734707 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:28.743679 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:28.743679 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:28.743679 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:28.743679 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:28.743679 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 356f55ab-f997-4e7a-8b33-76613c9ae9ba could not be found. Oct 31 14:19:28.743679 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:28.746916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee6594e1-bdce-42d5-b273-1a1342c710f6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] Returning 404 to user: Instance group 356f55ab-f997-4e7a-8b33-76613c9ae9ba could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:28.750512 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee6594e1-bdce-42d5-b273-1a1342c710f6 tempest-ServerGroup264TestJSON-1937408882 tempest-ServerGroup264TestJSON-1937408882-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba" status: 404 len: 117 microversion: 2.64 time: 0.053838 Oct 31 14:19:28.752380 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2144/4011] 10.222.0.27 () {60 vars in 1307 bytes} [Mon Oct 31 14:19:28 2022] DELETE /compute/v2.1/os-server-groups/356f55ab-f997-4e7a-8b33-76613c9ae9ba => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:19:31.995368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:31.998077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:32.013548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:32.014369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:32.017885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:32.019000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:32.019644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:32.020261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:32.079989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] HTTP exception thrown: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Request method failure captured: Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 HTTP/1.1 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9jA_ll8PxVSkKr3ntRflE4F9P2a81_8CQgQNVtGz59IMA_zxZqWQLtp9vqYq9Wgf9RgITFdTLlx11EaBHwXLXIoqJj5CE52_TJEIyXUh_1vSpcu4YVfVidlkn7CNlRn-fGfuy6XAmiWwmi0hmmZ0xZPJEmqyC08D09_HZmNt8UPv_U Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 76f3b642a80a4b81913acf2ebc84e453 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76f3b642a80a4b81913acf2ebc84e453", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 76f3b642a80a4b81913acf2ebc84e453 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachSCSIVolumeTestJSON-943930413-project Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: d9d6c2a3d22f474a9294d93cd635585b Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-943930413-project Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b5908187-cdb3-4eaa-99aa-c37e8c7614a5'} Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:19:32.090890 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Returning 404 to user: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:32.096686 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b55b5eb7-dc57-4c94-8aaa-b778d25e0f57 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 404 len: 111 microversion: 2.1 time: 0.108311 Oct 31 14:19:32.104690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:32.105403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] [instance: b5908187-cdb3-4eaa-99aa-c37e8c7614a5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:32.109541 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1868/4012] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:19:31 2022] DELETE /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:32.138828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:32.140042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:32.142333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:32.144806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:32.147117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:32.147807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:32.182772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] HTTP exception thrown: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Request method failure captured: Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 HTTP/1.1 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9jA_ll8PxVSkKr3ntRflE4F9P2a81_8CQgQNVtGz59IMA_zxZqWQLtp9vqYq9Wgf9RgITFdTLlx11EaBHwXLXIoqJj5CE52_TJEIyXUh_1vSpcu4YVfVidlkn7CNlRn-fGfuy6XAmiWwmi0hmmZ0xZPJEmqyC08D09_HZmNt8UPv_U Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 76f3b642a80a4b81913acf2ebc84e453 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76f3b642a80a4b81913acf2ebc84e453", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76f3b642a80a4b81913acf2ebc84e453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 76f3b642a80a4b81913acf2ebc84e453 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-943930413 Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachSCSIVolumeTestJSON-943930413-project Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: d9d6c2a3d22f474a9294d93cd635585b Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-943930413-project Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b5908187-cdb3-4eaa-99aa-c37e8c7614a5'} Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:32.188692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. Oct 31 14:19:32.194031 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:19:32.196731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] Returning 404 to user: Instance b5908187-cdb3-4eaa-99aa-c37e8c7614a5 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:32.198633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e895fd14-d21b-4c30-b126-7a01de402be1 tempest-AttachSCSIVolumeTestJSON-943930413 tempest-AttachSCSIVolumeTestJSON-943930413-project] 10.222.0.27 "GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5" status: 404 len: 111 microversion: 2.1 time: 0.100717 Oct 31 14:19:32.201541 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2145/4013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:19:32 2022] GET /compute/v2.1/servers/b5908187-cdb3-4eaa-99aa-c37e8c7614a5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:39.496400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2096099799", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:39.614913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:19:39.615603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:19:39.616274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:19:39.616999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:19:39.617627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:19:39.643117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:39.646371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:39.648451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:39.649482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:39.652119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:39.655815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:39.714464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Getting quotas for project 340299294686458087f5f4baa72f4897. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:19:39.728995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Getting quotas for user c6658ae441fc449abdfe5b3c3e5baad3 and project 340299294686458087f5f4baa72f4897. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:19:39.758082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:19:39.760792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:19:39.834402 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15387039-0af9-4ff5-9ff1-d1e919f6d5e4 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.596512 Oct 31 14:19:39.835484 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1869/4014] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:19:39.848451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99e8380a-605d-42b6-aead-a956c0c247f3 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:39.849055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99e8380a-605d-42b6-aead-a956c0c247f3 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:39.859649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:40.086118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99e8380a-605d-42b6-aead-a956c0c247f3 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:40.115914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99e8380a-605d-42b6-aead-a956c0c247f3 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:40.137482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99e8380a-605d-42b6-aead-a956c0c247f3 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:40.144878 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99e8380a-605d-42b6-aead-a956c0c247f3 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4" status: 200 len: 1278 microversion: 2.47 time: 0.295179 Oct 31 14:19:40.160691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2146/4015] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:39 2022] GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:40.678850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-616877547", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": "none"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:40.843217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:19:40.843771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:19:40.844264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:19:40.844712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:19:40.845144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:19:40.870710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:40.872822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:40.874003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:40.875505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:40.879050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:40.880434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:40.931590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Getting quotas for project 340299294686458087f5f4baa72f4897. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:19:40.947586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Getting quotas for user c6658ae441fc449abdfe5b3c3e5baad3 and project 340299294686458087f5f4baa72f4897. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:19:40.976082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:19:40.985738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:19:41.074101 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e8db76a-d97d-4bca-88d6-af796f7b460b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.402083 Oct 31 14:19:41.075713 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1870/4016] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:19:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:19:41.089376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b96a1277-60b6-4a40-80c8-05df545611da tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:41.093359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b96a1277-60b6-4a40-80c8-05df545611da tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:41.244351 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b96a1277-60b6-4a40-80c8-05df545611da tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "PUT /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 991 microversion: 2.47 time: 0.160656 Oct 31 14:19:41.245855 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2147/4017] 10.222.0.27 () {62 vars in 1297 bytes} [Mon Oct 31 14:19:41 2022] PUT /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 991 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:19:41.268730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9156fca2-7f5a-4b46-949b-62f416a0bdf7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:41.269622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9156fca2-7f5a-4b46-949b-62f416a0bdf7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:41.498349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9156fca2-7f5a-4b46-949b-62f416a0bdf7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:41.519051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9156fca2-7f5a-4b46-949b-62f416a0bdf7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:41.523606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9156fca2-7f5a-4b46-949b-62f416a0bdf7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:41.527310 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9156fca2-7f5a-4b46-949b-62f416a0bdf7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1277 microversion: 2.47 time: 0.263686 Oct 31 14:19:41.529543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1871/4018] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:41 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:41.868813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:41.869691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:41.943729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:41.944241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:41.944690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:41.952567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:41.953074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:41.953524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:42.570390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:42.572888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:42.613018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:42.615897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:42.616632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:42.618312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:42.620207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:42.620752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:42.737057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:42.750741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:42.754080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:42.757890 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3bf92ab-7d7f-423d-901c-5f2c8670fd6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1281 microversion: 2.47 time: 0.195073 Oct 31 14:19:42.759819 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1872/4019] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:42 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:42.974037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:42.991446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:42.993333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:42.995983 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f90a55be-9635-46a8-9cec-578581fcf555 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2948 microversion: 2.32 time: 1.140579 Oct 31 14:19:42.998582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2148/4020] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:41 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2948 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:19:43.036427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:43.036932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:43.049099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:43.049625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:43.053964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:43.055009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:43.082768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:43.088328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:43.350260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bbb99d21-e095-463b-8a3d-5df11c8a0878 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.318825 Oct 31 14:19:43.351081 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1873/4021] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:19:43 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace/os-interface => generated 1829 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:43.369981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58da5021-e735-41dc-a2f0-f54b6f438b56 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106343e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-387018396", "description": "tempest-description-200788505"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:43.793594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:43.795218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:43.816116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:43.816619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:43.817062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:43.818346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:43.818791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:43.819283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:43.996702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:44.017819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:44.022792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:44.026107 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c04090b4-2c43-4523-b695-ecd62e8f1c6d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1329 microversion: 2.47 time: 0.237028 Oct 31 14:19:44.030680 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1874/4022] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:43 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1329 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:44.195028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58da5021-e735-41dc-a2f0-f54b6f438b56 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.047231 Oct 31 14:19:44.202365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2149/4023] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:43 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:44.218076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f9e107e-e12f-4498-b4b7-80bb76c580e4 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106b098b0>, body: {"security_group_rule": {"parent_group_id": "f8597628-8071-4e43-a5b1-5b83e4790362", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:45.066049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:45.072171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:45.088069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:45.092761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:45.093730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:45.095187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:45.095886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:45.097866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:45.251883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:45.270691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:45.272312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:45.273740 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53ccb474-6077-487e-84d5-9cb5f677965a tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1335 microversion: 2.47 time: 0.216868 Oct 31 14:19:45.274652 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2150/4024] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:45 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1335 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:19:45.533695 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f9e107e-e12f-4498-b4b7-80bb76c580e4 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.320756 Oct 31 14:19:45.535337 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1875/4025] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:19:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:45.551836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da21d721-28d8-44e0-92cb-3c61db3adde5 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe1063b2b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-419666333", "description": "tempest-description-1309464979"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:46.314063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:46.314719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:46.317137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da21d721-28d8-44e0-92cb-3c61db3adde5 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.771649 Oct 31 14:19:46.317825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2151/4026] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:46.338906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:46.339102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:46.339473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:46.340197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:46.348409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2df4cdc-6217-43cf-84a3-870283142f74 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106343430>, body: {"security_group_rule": {"parent_group_id": "e6e22231-7ea0-42de-95be-c846535b66a6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:46.349402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:46.349988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:46.398526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:47.296121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:47.305916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:47.311027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:47.317121 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40880fca-769e-4f9c-9b60-76308949a789 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1335 microversion: 2.47 time: 1.005684 Oct 31 14:19:47.321848 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1876/4027] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:46 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1335 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:19:48.352949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:48.353747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:48.373586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:48.374202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:48.375911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:48.378069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:48.379196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:48.382644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:48.556052 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2df4cdc-6217-43cf-84a3-870283142f74 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.228780 Oct 31 14:19:48.557046 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2152/4028] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:19:46 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:48.572307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e770223-427f-411f-b4f2-9ff9877c0806 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106343700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-895499692", "description": "tempest-description-2090080205"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:48.650443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:48.662365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:48.664320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:48.665530 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97c09dca-2c9e-4f62-b864-c119c1814247 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1356 microversion: 2.47 time: 0.319792 Oct 31 14:19:48.666071 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1877/4029] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:48 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1356 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:48.700175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:48.716563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:48.730790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:48.732344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:48.732986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:48.733918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:48.735447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:48.737625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:48.911866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:19:48.915559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:19:48.917530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:19:48.918229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:19:48.919423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:19:49.041815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:49.055960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:49.056673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:49.058123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:49.061856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:49.062651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:49.064435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:49.141895 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cbbcc36c-7a7f-4575-9c73-07d7246a1604 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "POST /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e/action" status: 202 len: 1078 microversion: 2.47 time: 0.448784 Oct 31 14:19:49.163014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1878/4030] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:19:48 2022] POST /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e/action => generated 1078 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 14:19:49.180793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:49.181431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:49.202605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:49.208723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:49.213339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:49.215376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:49.215770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:49.216209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:49.483846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:49.497236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:49.499751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:49.504821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9248969-08a4-4b73-9f77-77c873f43a9d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.334459 Oct 31 14:19:49.522207 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1879/4031] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:49 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:50.104311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:50.340779 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e770223-427f-411f-b4f2-9ff9877c0806 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.774219 Oct 31 14:19:50.341942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2153/4032] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:50.355145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa1cf65f-354b-4057-88d5-32ab9f0d2f9a tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106a81160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-75615771", "description": "tempest-description-442235198"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:50.536053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:50.536877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:50.545489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:50.547008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:50.547509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:50.548271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:50.548967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:50.549115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:50.549525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:50.904905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:50.905810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:50.939283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:50.958943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:50.960195 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3df1da3c-88cb-44e1-9508-16a873f4334b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.428400 Oct 31 14:19:50.985952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2154/4033] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:50 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:19:51.076024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa1cf65f-354b-4057-88d5-32ab9f0d2f9a tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.724399 Oct 31 14:19:51.076847 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1880/4034] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:50 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:51.091057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62d99a7a-6652-4e84-ae93-f69fa61bfcc6 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe1063b2c10>, body: {"security_group_rule": {"parent_group_id": "58601822-7a6e-4111-83c7-f0391f0af530", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2d8150da-75b1-4d9a-a60a-47ded0797fdb"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:51.991903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.998825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:51.999770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:52.004451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:52.023996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:52.026099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:52.027381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:52.030742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:52.031974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:52.032674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:52.201108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:52.215802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:52.217096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:52.224033 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2dcb327-af7d-4584-a966-553715b17ffa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.234024 Oct 31 14:19:52.239580 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1881/4035] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:51 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:52.605240 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62d99a7a-6652-4e84-ae93-f69fa61bfcc6 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 1.518495 Oct 31 14:19:52.606885 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2155/4036] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:19:51 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:52.626267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-754262fe-2084-45dc-98ac-52c124bad3e8 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106bb34c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-781190068", "description": "tempest-description-1851711489"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:53.029022 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-754262fe-2084-45dc-98ac-52c124bad3e8 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.411828 Oct 31 14:19:53.030413 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1882/4037] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:53.045867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e347c1c5-6599-4605-98f3-15f60e5fe4c7 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106367b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1901120229", "description": "tempest-description-1048711580"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:53.251365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:53.252215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:53.277840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:53.295155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:53.295813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:53.302409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:53.312200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:53.312661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:53.570004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:53.594812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:53.608434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:53.616802 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7fc76bfc-fb79-4dce-9cdd-cf1ed0883b70 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.369447 Oct 31 14:19:53.618198 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1883/4038] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:53 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:19:54.534767 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e347c1c5-6599-4605-98f3-15f60e5fe4c7 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.494234 Oct 31 14:19:54.538652 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2156/4039] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:53 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:54.549323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd5f7eab-edfc-477c-a4e4-6bd1bf77f2fb tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106a50940>, body: {"security_group_rule": {"parent_group_id": "5dfe5f37-8546-4700-a738-9db3883ce657", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3db9fea8-a483-41d4-98a3-b14965cedb4c"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:54.654046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:54.656090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:54.670363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:54.672408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:54.673108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:54.676131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:54.677162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:54.677787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:54.682464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:54.822107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:54.836292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:54.845067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:54.846379 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bf15b25-8873-46a2-bf7e-e5b9bd141532 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.199636 Oct 31 14:19:54.850974 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2157/4040] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:54 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:54.927191 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd5f7eab-edfc-477c-a4e4-6bd1bf77f2fb tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.382034 Oct 31 14:19:54.928149 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1884/4041] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:19:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:54.945187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f0b9e91-57aa-4db8-8656-91d0981b7e6f tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe106340dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:55.878334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:55.879335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:55.899665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:55.905833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:55.906742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:55.912565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:55.915481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:55.916575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:55.959487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f0b9e91-57aa-4db8-8656-91d0981b7e6f tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3db9fea8-a483-41d4-98a3-b14965cedb4c" status: 202 len: 0 microversion: 2.1 time: 1.023408 Oct 31 14:19:55.963228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2158/4042] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:54 2022] DELETE /compute/v2.1/os-security-groups/3db9fea8-a483-41d4-98a3-b14965cedb4c => generated 0 bytes in 1025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:19:55.968147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81b22d42-32fa-40da-913d-4574a072ab6a tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe1063b2430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:56.119336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:56.136429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:56.142800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:56.149451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c644d74-2820-4318-b700-9890fd0f39dd tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.275730 Oct 31 14:19:56.151574 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1885/4043] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:55 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:56.212353 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81b22d42-32fa-40da-913d-4574a072ab6a tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/5dfe5f37-8546-4700-a738-9db3883ce657" status: 200 len: 247 microversion: 2.1 time: 0.248008 Oct 31 14:19:56.213298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2159/4044] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:19:55 2022] GET /compute/v2.1/os-security-groups/5dfe5f37-8546-4700-a738-9db3883ce657 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:19:56.232990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d3eda71-6b8b-4d93-9510-464cbae6493a tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe10fb7eb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-339492758", "description": "tempest-description-686918430"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:56.618075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d3eda71-6b8b-4d93-9510-464cbae6493a tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.390697 Oct 31 14:19:56.619669 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1886/4045] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:19:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:56.634414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05def46f-239b-4a6b-b506-92d07df039bd tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe10636e3a0>, body: {"security_group_rule": {"parent_group_id": "73f0748a-029c-4ce0-ad4e-2224f5834eb7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:56.969797 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05def46f-239b-4a6b-b506-92d07df039bd tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.339976 Oct 31 14:19:56.971184 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2160/4046] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:19:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:56.983061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c312b261-5d19-418f-acf4-f6cd3c5d3b9d tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Action: 'create', calling method: .version_select at 0x7fe106a81310>, body: {"security_group_rule": {"parent_group_id": "73f0748a-029c-4ce0-ad4e-2224f5834eb7", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:57.412790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1454275623", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:19:57.486474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] validate_networks() for [('67c1bc0f-cc41-413e-b0f6-e228063bab2e', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:19:57.773111 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c312b261-5d19-418f-acf4-f6cd3c5d3b9d tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.793861 Oct 31 14:19:57.774240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1887/4047] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:19:56 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:57.784975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:57.786028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:57.798666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:57.799433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:57.800120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:57.801115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:57.802511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:57.803170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:57.909043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:57.926745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:57.928331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:57.930011 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b93e5356-e57c-44e3-837e-a7ec80285009 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.154637 Oct 31 14:19:57.930768 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1888/4048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:57 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:57.955455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd013b4f-25fd-411a-bac5-fea777f6a3ca tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe10c383dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:58.053860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd013b4f-25fd-411a-bac5-fea777f6a3ca tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/73f0748a-029c-4ce0-ad4e-2224f5834eb7" status: 200 len: 663 microversion: 2.1 time: 0.109212 Oct 31 14:19:58.055404 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1889/4049] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:19:57 2022] GET /compute/v2.1/os-security-groups/73f0748a-029c-4ce0-ad4e-2224f5834eb7 => generated 663 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:19:58.070872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b6d5e79-bdcb-47c4-b647-1ac59304078e tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe106bbd5e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:58.582674 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b6d5e79-bdcb-47c4-b647-1ac59304078e tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/e0295d97-ed42-4b41-b0f8-946e9321493f" status: 202 len: 0 microversion: 2.1 time: 0.515581 Oct 31 14:19:58.587462 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1890/4050] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 31 14:19:58 2022] DELETE /compute/v2.1/os-security-group-rules/e0295d97-ed42-4b41-b0f8-946e9321493f => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:19:58.593623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8efbb1e-258b-4b57-b73b-6bf84e3a719b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe10785aca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:59.101482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8efbb1e-258b-4b57-b73b-6bf84e3a719b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/73f0748a-029c-4ce0-ad4e-2224f5834eb7" status: 202 len: 0 microversion: 2.1 time: 0.512604 Oct 31 14:19:59.102204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1891/4051] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:58 2022] DELETE /compute/v2.1/os-security-groups/73f0748a-029c-4ce0-ad4e-2224f5834eb7 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:19:59.107713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:59.108618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:59.119249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:59.120057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:59.120757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:59.121803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:59.122525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:59.123366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:59.690480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:59.704166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:59.708370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:19:59.709618 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-094d5da9-d824-433e-99ce-56b21315f9a7 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.606299 Oct 31 14:19:59.728210 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1892/4052] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:19:59 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:19:59.734435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe1069804c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:59.762911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:19:59.764612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:19:59.765297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:19:59.765835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:19:59.766526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:19:59.791489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:19:59.792095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Neutron security group 3db9fea8-a483-41d4-98a3-b14965cedb4c not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:19:59.792312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:59.792624 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] HTTP exception thrown: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.792624 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Request method failure captured: Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-security-groups/3db9fea8-a483-41d4-98a3-b14965cedb4c HTTP/1.1 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9l_I2oS8SoW34jqBg6BA3PPXocMBQS8WJrpbyaIpu-1RLp3UJxWJj2NORAjX5P6fFve9cPq03hfb82tpWp2IrbDY7i8-KjJxYmW_ANs6Rfa5le6LBTYQKjTp3jJv6mulsH7PIvlzUie63dNjY_ZUq0ApunO4td0JuM6xVHd9O-YPuc Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a1df9b92ab80495c960c43384af14013 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2145284358 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1df9b92ab80495c960c43384af14013", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1df9b92ab80495c960c43384af14013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1df9b92ab80495c960c43384af14013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1df9b92ab80495c960c43384af14013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2145284358 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a1df9b92ab80495c960c43384af14013 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2145284358 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupRulesTestJSON-2145284358-project Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7be5f74fbdc24ca3bddf65f911dc38cd Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2145284358-project Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3db9fea8-a483-41d4-98a3-b14965cedb4c'} Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:19:59.794517 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Returning 404 to user: Security group 3db9fea8-a483-41d4-98a3-b14965cedb4c does not exist Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-ff8db810-764b-4883-99c6-0136aeb3dd1a'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00df06b8-5b5d-4e93-b261-267b02808625 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3db9fea8-a483-41d4-98a3-b14965cedb4c" status: 404 len: 194 microversion: 2.1 time: 0.066402 Oct 31 14:19:59.799901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1893/4053] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:59 2022] DELETE /compute/v2.1/os-security-groups/3db9fea8-a483-41d4-98a3-b14965cedb4c => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:59.804520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1f47e1e-50d2-47c9-8790-71af1df63e1b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe106a9b0d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:59.804954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:59.805470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:59.810347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:59.810991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:59.811441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:59.836337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Getting quotas for project 1c2802504e2c457aad1f0a46a1e905fd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:19:59.858519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Getting quotas for user 3c6495becc67460d999a48831eda71e1 and project 1c2802504e2c457aad1f0a46a1e905fd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:19:59.878828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:19:59.881487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:19:59.977075 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-932c590a-bd56-42fe-bddd-256c10fad330 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.823849 Oct 31 14:19:59.977937 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2161/4054] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:19:59.984027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:19:59.985021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:19:59.991904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:59.992748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:59.993416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:19:59.994705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:19:59.995385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:19:59.996037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:00.158694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lazy-loading 'services' on Instance uuid 679c6ed9-8d8f-47cb-b1c1-752bf554da3c {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:20:00.275216 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f050d7f1-416f-4f04-b56c-318f93ec2607 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-volume_attachments/b88cd2f9-ba0e-453a-9e61-306474f6bcab" status: 202 len: 0 microversion: 2.1 time: 0.294701 Oct 31 14:20:00.277688 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2162/4055] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:19:59 2022] DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-volume_attachments/b88cd2f9-ba0e-453a-9e61-306474f6bcab => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:00.299404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da0dccda-be16-409d-876d-37f05edce192 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:00.300117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da0dccda-be16-409d-876d-37f05edce192 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:00.470479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da0dccda-be16-409d-876d-37f05edce192 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:00.482453 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da0dccda-be16-409d-876d-37f05edce192 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1224 microversion: 2.1 time: 0.203294 Oct 31 14:20:00.485890 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2163/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:00 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1224 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:00.683220 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1f47e1e-50d2-47c9-8790-71af1df63e1b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5dfe5f37-8546-4700-a738-9db3883ce657" status: 202 len: 0 microversion: 2.1 time: 0.882263 Oct 31 14:20:00.688067 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1894/4057] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:19:59 2022] DELETE /compute/v2.1/os-security-groups/5dfe5f37-8546-4700-a738-9db3883ce657 => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:00.694091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4d745f6-ee42-421a-9517-7e591d611b75 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe106465ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:00.740514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:00.741440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:00.761560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:00.762279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:00.762840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:00.763738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:00.764479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:00.767403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:01.063189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:01.094111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:01.096142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:01.112630 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b0c6692-2535-43d5-a340-6648ddc7ac84 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.372958 Oct 31 14:20:01.116076 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1895/4058] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:00 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:20:01.512860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:01.513495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:01.527097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:01.527596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:01.528046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:01.528761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:01.529215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:01.529641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:01.713584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:01.732639 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e77b4f0a-d645-4e5d-b44c-5c5985247b7d tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1276 microversion: 2.1 time: 0.223672 Oct 31 14:20:01.738806 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1896/4059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:01 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:02.145688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:02.146567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:02.162130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:02.162849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:02.163533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:02.164427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:02.165812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:02.170892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:02.436618 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4d745f6-ee42-421a-9517-7e591d611b75 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2d8150da-75b1-4d9a-a60a-47ded0797fdb" status: 202 len: 0 microversion: 2.1 time: 1.746643 Oct 31 14:20:02.438360 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2164/4060] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:00 2022] DELETE /compute/v2.1/os-security-groups/2d8150da-75b1-4d9a-a60a-47ded0797fdb => generated 0 bytes in 1749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:02.451124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:02.456487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d74fcd2-7df4-41a1-8dee-6d1257b21f4b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe1064654c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:02.467521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:02.468962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:02.475025 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-699702fe-568c-4ed6-b9e2-f2ef2465e8d8 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.334118 Oct 31 14:20:02.492613 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1897/4061] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:02 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:20:02.769189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:02.773511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:02.791225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:02.792162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:02.793046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:02.808678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:02.809476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:02.810685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:02.983659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:03.008230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba920ea7-5306-4abb-96e4-6df5c7add1d2 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1282 microversion: 2.1 time: 0.245137 Oct 31 14:20:03.009142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1898/4062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:02 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1282 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:03.331999 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3d74fcd2-7df4-41a1-8dee-6d1257b21f4b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/58601822-7a6e-4111-83c7-f0391f0af530" status: 202 len: 0 microversion: 2.1 time: 0.889164 Oct 31 14:20:03.333653 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2165/4063] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:02 2022] DELETE /compute/v2.1/os-security-groups/58601822-7a6e-4111-83c7-f0391f0af530 => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:03.343396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-12c0228e-6e46-466a-8544-eeabb2871cc2 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe106aaf9d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:03.515633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:03.516259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:03.541882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:03.543154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:03.545150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:03.549818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:03.552975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:03.553744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:03.851087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:03.880154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:03.882343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:03.883763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-990fddfc-bd98-4dc0-ad3d-bbccd0dac69d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.381640 Oct 31 14:20:03.890515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-12c0228e-6e46-466a-8544-eeabb2871cc2 tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e6e22231-7ea0-42de-95be-c846535b66a6" status: 202 len: 0 microversion: 2.1 time: 0.551872 Oct 31 14:20:03.892900 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1899/4064] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:03 2022] DELETE /compute/v2.1/os-security-groups/e6e22231-7ea0-42de-95be-c846535b66a6 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:03.898335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2166/4065] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:03 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:03.903904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3290140a-0a51-419a-8cbc-3bf9beb1133b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] Calling method '.version_select at 0x7fe10fb7ec10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:04.034852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:04.035498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:04.044446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:04.044943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:04.050936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:04.051834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:04.052314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:04.052749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:04.532973 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3290140a-0a51-419a-8cbc-3bf9beb1133b tempest-SecurityGroupRulesTestJSON-2145284358 tempest-SecurityGroupRulesTestJSON-2145284358-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f8597628-8071-4e43-a5b1-5b83e4790362" status: 202 len: 0 microversion: 2.1 time: 0.635610 Oct 31 14:20:04.533874 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1900/4066] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:03 2022] DELETE /compute/v2.1/os-security-groups/f8597628-8071-4e43-a5b1-5b83e4790362 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:20:04.709908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:04.721140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db6861a6-ffd0-41c2-95a4-7749aedf47e6 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 0.690214 Oct 31 14:20:04.724319 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2167/4067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:04 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:04.930977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:04.933241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:04.954137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:04.955503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:04.957976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:04.960311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:04.962877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:04.968476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:05.384654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:05.396019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:05.397736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:05.401635 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c30a1735-818b-4922-b9e6-762abd8796e5 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.477619 Oct 31 14:20:05.403881 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1901/4068] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:04 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:05.749643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:05.750863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:05.778848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:05.781035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:05.783962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:05.784748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:05.785522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:05.791151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:06.222694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:06.231696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5ce1971-811b-4410-9b30-89f8fefa6dbb tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 0.486731 Oct 31 14:20:06.235451 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2168/4069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:05 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:06.434470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:06.435094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:06.446321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:06.446819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:06.447260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:06.452209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:06.457897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:06.458644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:06.741979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:06.759037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:06.778932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:06.781057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:06.782581 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7beb46d3-712a-4633-94c6-b8a618ede5ff tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.353891 Oct 31 14:20:06.783347 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1902/4070] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:06 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:07.260530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:07.261894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:07.283439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:07.298657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:07.299303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:07.300167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:07.313955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:07.314653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:07.783857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3c3a4708-c4a1-4aca-8602-d3cef769ba77 req-db75579f-5dcd-4010-ad8f-59053c71bbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51c85cc-9eb3-4cca-bd7a-bf24035e56e3", "tag": "eeebce51-4d82-48eb-bf05-60ec63f28ce0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:07.824520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3c3a4708-c4a1-4aca-8602-d3cef769ba77 req-db75579f-5dcd-4010-ad8f-59053c71bbb1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:07.825321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3c3a4708-c4a1-4aca-8602-d3cef769ba77 req-db75579f-5dcd-4010-ad8f-59053c71bbb1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:07.825764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3c3a4708-c4a1-4aca-8602-d3cef769ba77 req-db75579f-5dcd-4010-ad8f-59053c71bbb1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:07.868629 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3c3a4708-c4a1-4aca-8602-d3cef769ba77 req-db75579f-5dcd-4010-ad8f-59053c71bbb1 service nova] Creating event network-changed:eeebce51-4d82-48eb-bf05-60ec63f28ce0 for instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 on n-h2-863052-1 Oct 31 14:20:07.880791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:07.890095 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3c3a4708-c4a1-4aca-8602-d3cef769ba77 req-db75579f-5dcd-4010-ad8f-59053c71bbb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.578844 Oct 31 14:20:07.891698 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1903/4071] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:07.895415 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00eb71c2-bc35-46b4-aa96-ec220f823884 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 0.635937 Oct 31 14:20:07.896522 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2169/4072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:07 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:07.926872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:07.928059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:07.945202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:07.948803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:07.949799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:07.951411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:07.955534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:07.956166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:08.178619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:08.193485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:08.196063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:08.205435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e4b6d18b-2396-49ec-81f8-5be7c8d2566c tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Action: 'create', calling method: .version_select at 0x7fe1063b2940>, body: {"pool": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:08.221940 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6bd7efe8-2433-4027-b7e0-c182bb346bab tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.304465 Oct 31 14:20:08.222866 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1904/4073] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:07 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:08.923825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:08.925251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:08.940385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:08.941582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:08.942715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:08.945937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:08.947619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:08.950550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:09.824753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:10.074625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:10.091796 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e39d313-ab33-4dcb-a1ae-07ca8282770a tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 1.172822 Oct 31 14:20:10.097960 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1905/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:08 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:10.114085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:10.116526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:10.128379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.129681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.130390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.131577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.132230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.132846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.326322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:10.343582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:10.346185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:10.348438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c929cc47-07c0-4489-a646-5d6f5df82486 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.248859 Oct 31 14:20:10.350279 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1906/4075] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:10 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:10.357276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4fd1337e-c7e7-450a-8d9b-9142f4474d8d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:10.377162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fd1337e-c7e7-450a-8d9b-9142f4474d8d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.377987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fd1337e-c7e7-450a-8d9b-9142f4474d8d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.378670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fd1337e-c7e7-450a-8d9b-9142f4474d8d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.418008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4fd1337e-c7e7-450a-8d9b-9142f4474d8d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:20:10.476219 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4fd1337e-c7e7-450a-8d9b-9142f4474d8d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action" status: 202 len: 0 microversion: 2.1 time: 0.124219 Oct 31 14:20:10.481346 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1907/4076] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:20:10 2022] POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:10.482073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:10.787538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Calling method '.version_select at 0x7fe1075d6dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:10.789285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.789786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.790335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.837399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.840001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.840332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.866217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.866792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.867509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.874584 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1383686f-ff8f-46b3-a5d6-c13e9255525d tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480 tempest-PortsAdminExtendedAttrsIpV6TestJSON-714312480-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.391265 Oct 31 14:20:10.880048 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1908/4077] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:20:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:10.891793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:10.893903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:10.901343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.901952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.902301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:10.903018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:10.903475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:10.903904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:11.224235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:11.232879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-409c9f77-2812-4d80-be31-be6dac14389b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.351290 Oct 31 14:20:11.233470 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1909/4078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:10 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:11.258600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:11.259978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:11.279961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:11.280823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:11.282702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:11.283515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:11.290766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:11.291494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:11.326829 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e4b6d18b-2396-49ec-81f8-5be7c8d2566c tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.334529 Oct 31 14:20:11.327442 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2170/4079] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:20:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:11.342343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6953cff-a0a8-4d87-9d4c-660844263cb8 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Calling method '.version_select at 0x7fe1064ebee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:11.802453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:11.810982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04eb389a-98c2-48e1-ac90-fa02646e5df0 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 0.563387 Oct 31 14:20:11.811892 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1910/4080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:11 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:11.817613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:11.823249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:11.841780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:11.842613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:11.843311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:11.844443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:11.845136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:11.845777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:11.977660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:11.991670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:11.993280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:12.004397 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5017aae3-ac9e-43bb-bd0e-5734e5fd6109 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.190804 Oct 31 14:20:12.006013 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1911/4081] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:11 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:12.091057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6953cff-a0a8-4d87-9d4c-660844263cb8 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/2cdbdf77-9475-4395-a79c-5dcf2df955ea" status: 200 len: 141 microversion: 2.1 time: 0.753684 Oct 31 14:20:12.092458 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2171/4082] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:20:11 2022] GET /compute/v2.1/os-floating-ips/2cdbdf77-9475-4395-a79c-5dcf2df955ea => generated 141 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:20:12.105232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80513572-6a35-4bce-865e-52e4a3503056 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Calling method '.version_select at 0x7fe10fb86940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:12.259006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:12.260021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:12.273447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:12.274108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:12.274672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:12.275816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:12.276084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:12.276624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:12.542232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:12.553683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb530102-8895-4ffe-82ee-d0e93dd9d36e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.299478 Oct 31 14:20:12.554830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2172/4083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:12 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:12.593260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80513572-6a35-4bce-865e-52e4a3503056 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.492256 Oct 31 14:20:12.594382 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1912/4084] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:20:12 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:12.606515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a07c036-ea30-45fe-960f-731c832257b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Calling method '.version_select at 0x7fe10c47b790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:12.838784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:12.839765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:12.846198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:12.846997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:12.847686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:12.848613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:12.849268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:12.850150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:13.234735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:13.255033 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e41fd567-afb6-4ad6-af46-225fe69d233f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 0.418196 Oct 31 14:20:13.273818 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1913/4085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:12 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:13.279783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:13.280615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:13.290472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:13.291255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:13.291880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:13.292772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:13.293424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:13.294028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:13.419640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:13.431714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:13.434059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:13.435368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b76bb1a-2b4a-4e31-8069-e764c397a0d1 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.160124 Oct 31 14:20:13.435969 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1914/4086] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:13 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:13.465080 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a07c036-ea30-45fe-960f-731c832257b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/2cdbdf77-9475-4395-a79c-5dcf2df955ea" status: 202 len: 0 microversion: 2.1 time: 0.862467 Oct 31 14:20:13.465687 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2173/4087] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:20:12 2022] DELETE /compute/v2.1/os-floating-ips/2cdbdf77-9475-4395-a79c-5dcf2df955ea => generated 0 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:20:13.477693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efdb1765-98be-435a-98d0-79e73dedb5fe tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Action: 'create', calling method: .version_select at 0x7fe106b79dc0>, body: {"pool": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:13.580546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:13.583666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:13.592892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:13.593827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:13.595193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:13.596098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:13.597335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:13.598046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:13.945327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:13.953837 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b0d074c-6b1d-48c5-aca8-58d6e9ccd7f2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.378154 Oct 31 14:20:13.957545 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2174/4088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:13 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:14.000214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8c4306b3-e903-4dc3-8422-4fe2d5967446 req-c43731b9-c79e-4f5a-af4a-5cbf89da1664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51c85cc-9eb3-4cca-bd7a-bf24035e56e3", "name": "network-vif-plugged", "status": "completed", "tag": "eeebce51-4d82-48eb-bf05-60ec63f28ce0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:14.010125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c4306b3-e903-4dc3-8422-4fe2d5967446 req-c43731b9-c79e-4f5a-af4a-5cbf89da1664 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.010922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c4306b3-e903-4dc3-8422-4fe2d5967446 req-c43731b9-c79e-4f5a-af4a-5cbf89da1664 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.011502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c4306b3-e903-4dc3-8422-4fe2d5967446 req-c43731b9-c79e-4f5a-af4a-5cbf89da1664 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:14.026551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8c4306b3-e903-4dc3-8422-4fe2d5967446 req-c43731b9-c79e-4f5a-af4a-5cbf89da1664 service nova] Creating event network-vif-plugged:eeebce51-4d82-48eb-bf05-60ec63f28ce0 for instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 on n-h2-863052-1 Oct 31 14:20:14.034225 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8c4306b3-e903-4dc3-8422-4fe2d5967446 req-c43731b9-c79e-4f5a-af4a-5cbf89da1664 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037589 Oct 31 14:20:14.036061 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2175/4089] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:20:14.283292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:14.288253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:14.293553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.294301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.294926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:14.296009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.296651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.297143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:14.531396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:14.546373 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d455dfd5-094e-4210-8bf6-2efafd4480bd tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1324 microversion: 2.1 time: 0.268425 Oct 31 14:20:14.548915 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2176/4090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:14 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:14.555024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:14.556218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:14.566979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.568424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.570303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:14.571987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.572823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.573680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:14.679090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:14.691634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:14.693298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:14.694893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb121743-6ff4-4f4d-8377-b33f850df7aa tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.144807 Oct 31 14:20:14.695787 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2177/4091] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:14 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:14.981446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:14.982405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:14.990575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.991337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.991976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:14.992758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:14.993436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:14.994290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:15.245029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:15.256840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-733e1bbd-adea-4087-aebf-ce1f97fd053a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.280294 Oct 31 14:20:15.262218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2178/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:14 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:15.572293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:15.573959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:15.583706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:15.585068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:15.585708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:15.586594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:15.587209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:15.588465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:15.856715 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efdb1765-98be-435a-98d0-79e73dedb5fe tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.384902 Oct 31 14:20:15.858381 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1915/4093] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:20:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:20:15.884137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:15.885923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:15.894221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:15.895466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:15.896160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:15.897250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:15.898693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:15.899338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:15.950411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:15.963685 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-611b0727-3f38-4825-b8da-db6a2f652c64 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1521 microversion: 2.1 time: 0.395382 Oct 31 14:20:15.977738 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2179/4094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:15 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:15.993796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19eb3729-b12e-472b-97c8-95656ac7b5a0 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Calling method '.version_select at 0x7fe1063b2f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:16.022701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:16.037947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:16.039583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:16.040840 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48dc91e0-7460-4a71-9add-4c8376298cde tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.180490 Oct 31 14:20:16.041529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1916/4095] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:15 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:16.103786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-937124a9-5312-432d-8c56-e76769928874 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-977562334", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-937124a9-5312-432d-8c56-e76769928874 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 242 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-977562334", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-977562334', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '67c1bc0f-cc41-413e-b0f6-e228063bab2e'}]}}} Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:20:16.112163 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.116562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-937124a9-5312-432d-8c56-e76769928874 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:16.118424 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-937124a9-5312-432d-8c56-e76769928874 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018854 Oct 31 14:20:16.128156 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1917/4096] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:20:16 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:20:16.135574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79611663-a6a3-4620-8b6c-07cc9092bb1b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:16.136074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79611663-a6a3-4620-8b6c-07cc9092bb1b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f1bb015a-edb2-47a2-8f94-b74ea962d837] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:16.164435 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-79611663-a6a3-4620-8b6c-07cc9092bb1b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] HTTP exception thrown: Instance f1bb015a-edb2-47a2-8f94-b74ea962d837 could not be found. Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79611663-a6a3-4620-8b6c-07cc9092bb1b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/f1bb015a-edb2-47a2-8f94-b74ea962d837/metadata HTTP/1.1 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f1bb015a-edb2-47a2-8f94-b74ea962d837 could not be found. Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': 'f1bb015a-edb2-47a2-8f94-b74ea962d837'} Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1bb015a-edb2-47a2-8f94-b74ea962d837 could not be found. Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1bb015a-edb2-47a2-8f94-b74ea962d837 could not be found. Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.173878 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.179104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:16.179104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:16.179104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1bb015a-edb2-47a2-8f94-b74ea962d837 could not be found. Oct 31 14:20:16.179104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.179104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79611663-a6a3-4620-8b6c-07cc9092bb1b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 404 to user: Instance f1bb015a-edb2-47a2-8f94-b74ea962d837 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:16.182094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79611663-a6a3-4620-8b6c-07cc9092bb1b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f1bb015a-edb2-47a2-8f94-b74ea962d837/metadata" status: 404 len: 111 microversion: 2.1 time: 0.048410 Oct 31 14:20:16.202822 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1918/4097] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:20:16 2022] GET /compute/v2.1/servers/f1bb015a-edb2-47a2-8f94-b74ea962d837/metadata => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:20:16.254358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a94853b7-5ebb-4cf1-baa6-7a8015ef3464 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1298723636", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a94853b7-5ebb-4cf1-baa6-7a8015ef3464 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 499 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1298723636", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1298723636', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '67c1bc0f-cc41-413e-b0f6-e228063bab2e'}]}}} Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:20:16.261471 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a94853b7-5ebb-4cf1-baa6-7a8015ef3464 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:16.264465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a94853b7-5ebb-4cf1-baa6-7a8015ef3464 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.015102 Oct 31 14:20:16.278576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1919/4098] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:20:16 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:20:16.289814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:16.290476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:16.306125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:16.307823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:16.308279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:16.311853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:16.312325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:16.312755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:16.969229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:16.978768 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c4e77bf-62ec-4c25-b239-4b18651174c0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.699051 Oct 31 14:20:16.979502 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1920/4099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:16 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:16.984520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-710d7396-7e4a-483e-b3d1-f83333472b0b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-820030258", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-710d7396-7e4a-483e-b3d1-f83333472b0b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 499 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-820030258", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-820030258', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '67c1bc0f-cc41-413e-b0f6-e228063bab2e'}]}}} Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:20:16.989474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-710d7396-7e4a-483e-b3d1-f83333472b0b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-710d7396-7e4a-483e-b3d1-f83333472b0b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010270 Oct 31 14:20:16.991809 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1921/4100] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:20:16 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:20:17.046514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed39603b-5733-4e71-96cf-3de6d96ccb73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1912685077", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed39603b-5733-4e71-96cf-3de6d96ccb73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 754 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1912685077", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1912685077', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '67c1bc0f-cc41-413e-b0f6-e228063bab2e'}]}}} Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:20:17.054779 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:20:17.056762 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:20:17.058565 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.058565 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.060532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed39603b-5733-4e71-96cf-3de6d96ccb73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:17.061675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed39603b-5733-4e71-96cf-3de6d96ccb73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.019417 Oct 31 14:20:17.065788 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1922/4101] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:20:17 2022] POST /compute/v2.1/servers => generated 1197 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 31 14:20:17.078695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:17.079647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:17.087667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:17.088315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:17.088938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:17.089969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:17.110911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:17.112981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:17.195542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:17.204964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:17.206445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:17.208180 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75e18c8e-9967-4e39-b12f-d7c04573c188 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.140893 Oct 31 14:20:17.213138 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1923/4102] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:17 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:17.213841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a023a89f-62e1-4e2d-b5e0-07b3d018a0d7 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1657423235", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a023a89f-62e1-4e2d-b5e0-07b3d018a0d7 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 1266 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1657423235", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "67c1bc0f-cc41-413e-b0f6-e228063bab2e"}]}} Oct 31 14:20:17.218692 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1657423235', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '67c1bc0f-cc41-413e-b0f6-e228063bab2e'}]}}} Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.220722 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:20:17.221895 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:20:17.223322 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 14:20:17.223322 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.224633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a023a89f-62e1-4e2d-b5e0-07b3d018a0d7 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:17.225811 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a023a89f-62e1-4e2d-b5e0-07b3d018a0d7 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.015906 Oct 31 14:20:17.226974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1924/4103] 10.222.0.27 () {60 vars in 1148 bytes} [Mon Oct 31 14:20:17 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 31 14:20:17.242302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b003c036-198f-48aa-8f8a-05e6b37bed2f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:17.243129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b003c036-198f-48aa-8f8a-05e6b37bed2f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: a4197372-dc9c-4c06-bd67-41bbbdab8299] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:17.251391 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b003c036-198f-48aa-8f8a-05e6b37bed2f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] HTTP exception thrown: Instance a4197372-dc9c-4c06-bd67-41bbbdab8299 could not be found. Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b003c036-198f-48aa-8f8a-05e6b37bed2f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/a4197372-dc9c-4c06-bd67-41bbbdab8299/metadata/test2 HTTP/1.1 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a4197372-dc9c-4c06-bd67-41bbbdab8299 could not be found. Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': 'a4197372-dc9c-4c06-bd67-41bbbdab8299', 'id': 'test2'} Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4197372-dc9c-4c06-bd67-41bbbdab8299 could not be found. Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4197372-dc9c-4c06-bd67-41bbbdab8299 could not be found. Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.253161 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.257266 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:17.257266 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:17.257266 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4197372-dc9c-4c06-bd67-41bbbdab8299 could not be found. Oct 31 14:20:17.257266 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.257266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b003c036-198f-48aa-8f8a-05e6b37bed2f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 404 to user: Instance a4197372-dc9c-4c06-bd67-41bbbdab8299 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:17.257266 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b003c036-198f-48aa-8f8a-05e6b37bed2f tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/a4197372-dc9c-4c06-bd67-41bbbdab8299/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.018099 Oct 31 14:20:17.267479 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1925/4104] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 14:20:17 2022] GET /compute/v2.1/servers/a4197372-dc9c-4c06-bd67-41bbbdab8299/metadata/test2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:17.270043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:17.270566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:17.296668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:17.297174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:17.298047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:17.298827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:17.299293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:17.299721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:17.367914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:20:17.488934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:17.565097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-453ee223-b5d6-46dd-8e61-4541d0077ec5 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 204 len: 0 microversion: 2.1 time: 0.291578 Oct 31 14:20:17.566132 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1926/4105] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:20:17 2022] DELETE /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:20:17.576461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:17.577542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:17.587058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:17.587944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:17.588624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:17.589655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:17.590582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:17.591321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:17.823920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19eb3729-b12e-472b-97c8-95656ac7b5a0 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e" status: 202 len: 0 microversion: 2.1 time: 1.839385 Oct 31 14:20:17.824701 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2180/4106] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:20:15 2022] DELETE /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e => generated 0 bytes in 1846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:17.833645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a343e576-453b-4320-a943-0029990cde48 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Calling method '.version_select at 0x7fe106378ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:17.929973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-a343e576-453b-4320-a943-0029990cde48 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 861e686d-7059-42d7-8a89-92a18b30e05e could not be found", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:20:17.932236 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a343e576-453b-4320-a943-0029990cde48 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] HTTP exception thrown: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a343e576-453b-4320-a943-0029990cde48 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Request method failure captured: Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e HTTP/1.1 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mX3fvv-_qw130u-U6tb63if3WPfNG0WiqyI5PAZzeEsXzNDrGIhSf9IdIzfPfK_0kyuxUDd2BX__o1ZnMdFjGWeVzhzSlrIMnhDn8UR1hYONFmN4TPEYHtIR3QVSNmh5-BCJqdexQOKtgpVvRdEjn72sPYJxXnPR2kmnqTrnIBnBk Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a32f3b1444414c78b6b5da71d16840b9 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FloatingIPsTestJSON-682893097 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a32f3b1444414c78b6b5da71d16840b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a32f3b1444414c78b6b5da71d16840b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a32f3b1444414c78b6b5da71d16840b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a32f3b1444414c78b6b5da71d16840b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FloatingIPsTestJSON-682893097 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a32f3b1444414c78b6b5da71d16840b9 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FloatingIPsTestJSON-682893097 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FloatingIPsTestJSON-682893097-project Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 44f5d00754f447f8aa08024e1f2f5e7a Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FloatingIPsTestJSON-682893097-project Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: exception: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '861e686d-7059-42d7-8a89-92a18b30e05e'} Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 861e686d-7059-42d7-8a89-92a18b30e05e could not be found Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65c17b5b-130f-4401-a813-8e5727aaec22'] Oct 31 14:20:17.935477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e. Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:17.938533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a343e576-453b-4320-a943-0029990cde48 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Returning 404 to user: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:17.940106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a343e576-453b-4320-a943-0029990cde48 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e" status: 404 len: 111 microversion: 2.1 time: 0.109837 Oct 31 14:20:17.941741 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2181/4107] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:20:17 2022] GET /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:20:17.950455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-606d053e-0ee8-4d24-b41a-6b9befebe3b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Calling method '.version_select at 0x7fe106365f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:18.016956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:18.033376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bac60f60-0b6e-48c2-a42a-6f5bd94c7891 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1527 microversion: 2.1 time: 0.459957 Oct 31 14:20:18.046817 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1927/4108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:17 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1527 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:18.046817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:18.046817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:18.070461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:18.071665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:18.072316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:18.073300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:18.075505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:18.076195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:18.408229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-606d053e-0ee8-4d24-b41a-6b9befebe3b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 861e686d-7059-42d7-8a89-92a18b30e05e could not be found", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:20:18.409016 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-606d053e-0ee8-4d24-b41a-6b9befebe3b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] HTTP exception thrown: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-606d053e-0ee8-4d24-b41a-6b9befebe3b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Request method failure captured: Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e HTTP/1.1 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mX3fvv-_qw130u-U6tb63if3WPfNG0WiqyI5PAZzeEsXzNDrGIhSf9IdIzfPfK_0kyuxUDd2BX__o1ZnMdFjGWeVzhzSlrIMnhDn8UR1hYONFmN4TPEYHtIR3QVSNmh5-BCJqdexQOKtgpVvRdEjn72sPYJxXnPR2kmnqTrnIBnBk Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a32f3b1444414c78b6b5da71d16840b9 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-FloatingIPsTestJSON-682893097 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a32f3b1444414c78b6b5da71d16840b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a32f3b1444414c78b6b5da71d16840b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a32f3b1444414c78b6b5da71d16840b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a32f3b1444414c78b6b5da71d16840b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-FloatingIPsTestJSON-682893097 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a32f3b1444414c78b6b5da71d16840b9 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-FloatingIPsTestJSON-682893097 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-FloatingIPsTestJSON-682893097-project Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 44f5d00754f447f8aa08024e1f2f5e7a Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-FloatingIPsTestJSON-682893097-project Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: exception: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '861e686d-7059-42d7-8a89-92a18b30e05e'} Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 861e686d-7059-42d7-8a89-92a18b30e05e could not be found Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7c0a840-e0f2-4d84-ac45-455ce33073cd'] Oct 31 14:20:18.412101 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e. Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-606d053e-0ee8-4d24-b41a-6b9befebe3b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] Returning 404 to user: Floating IP not found for ID 861e686d-7059-42d7-8a89-92a18b30e05e {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:18.415090 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-606d053e-0ee8-4d24-b41a-6b9befebe3b6 tempest-FloatingIPsTestJSON-682893097 tempest-FloatingIPsTestJSON-682893097-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e" status: 404 len: 111 microversion: 2.1 time: 0.470194 Oct 31 14:20:18.423046 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2182/4109] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:20:17 2022] DELETE /compute/v2.1/os-floating-ips/861e686d-7059-42d7-8a89-92a18b30e05e => generated 111 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:20:18.428955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:18.430442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:18.439037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:18.439870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:18.440553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:18.442522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:18.443511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:18.443982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:18.444434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:18.455115 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e160ac14-24b7-4be8-903c-b0bf411fa7f7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.415603 Oct 31 14:20:18.456273 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1928/4110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:18 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:18.568016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:18.576645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:18.581241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:18.583236 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c875f58a-56e5-47e2-b276-5e734475fb66 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.159069 Oct 31 14:20:18.590678 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2183/4111] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:18 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:19.060377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:19.061404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:19.068637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:19.069412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:19.069908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:19.071064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:19.071706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:19.072129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:19.232079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:19.243332 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c03f548-727b-490d-a638-96f6e2cb3d5b tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1527 microversion: 2.1 time: 0.186749 Oct 31 14:20:19.244913 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1929/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:19 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1527 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:19.482925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:19.484223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:19.501626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:19.502256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:19.502906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:19.504336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:19.504998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:19.505998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:19.617804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:19.620729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:19.629550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:19.630427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:19.630943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:19.631733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:19.632257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:19.632932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:19.720076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:19.731232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:19.732860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:19.734072 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2270ac16-37ff-4958-8104-4ad4ceebb7cc tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.121304 Oct 31 14:20:19.734670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1930/4113] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:19 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:20.203104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:20.212062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2aa35a8-797f-494c-88a4-6334af256800 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1677 microversion: 2.1 time: 0.734284 Oct 31 14:20:20.212845 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2184/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:19 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1677 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:20.268538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:20.269428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:20.276928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:20.277716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:20.278465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:20.279251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:20.280555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:20.281058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:20.498136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6495becc67460d999a48831eda71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2802504e2c457aad1f0a46a1e905fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:20.512579 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-431fb2db-99e1-421e-98c1-c04cbc47d06e tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 200 len: 1527 microversion: 2.1 time: 0.248542 Oct 31 14:20:20.519137 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1931/4115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:20 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 1527 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:20.709524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a573551b-1f7f-4735-a6a0-17d1da96f840 req-2971ea2c-1cc8-4a2d-913e-bef714407bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51c85cc-9eb3-4cca-bd7a-bf24035e56e3", "name": "network-vif-deleted", "tag": "eeebce51-4d82-48eb-bf05-60ec63f28ce0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:20.715614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:20.728055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a573551b-1f7f-4735-a6a0-17d1da96f840 req-2971ea2c-1cc8-4a2d-913e-bef714407bb4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:20.728533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a573551b-1f7f-4735-a6a0-17d1da96f840 req-2971ea2c-1cc8-4a2d-913e-bef714407bb4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:20.734126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a573551b-1f7f-4735-a6a0-17d1da96f840 req-2971ea2c-1cc8-4a2d-913e-bef714407bb4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:20.762101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:20.763094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:20.774328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:20.784451 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a573551b-1f7f-4735-a6a0-17d1da96f840 req-2971ea2c-1cc8-4a2d-913e-bef714407bb4 service nova] Creating event network-vif-deleted:eeebce51-4d82-48eb-bf05-60ec63f28ce0 for instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 on n-h2-863052-1 Oct 31 14:20:20.785361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:20.789296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:20.790350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:20.790999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:20.791598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:20.796278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a573551b-1f7f-4735-a6a0-17d1da96f840 req-2971ea2c-1cc8-4a2d-913e-bef714407bb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090288 Oct 31 14:20:20.807079 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2185/4116] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:21.164792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:21.173945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:21.175503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:21.177255 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1c92d8b-0b3c-4204-9756-dd1dc482f585 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1365 microversion: 2.47 time: 0.419018 Oct 31 14:20:21.178282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1932/4117] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:20 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:21.240797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:21.241431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:21.257035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.261117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.261581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:21.262349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.263538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.263538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:21.544964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:21.546240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] [instance: f51c85cc-9eb3-4cca-bd7a-bf24035e56e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:21.562942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.564562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.566859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:21.566988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:21.569631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.571286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.572220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:21.579331 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bcfa328-9194-425a-ab31-84adc0439029 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1654 microversion: 2.1 time: 0.344626 Oct 31 14:20:21.580749 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2186/4118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:21 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1654 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:21.608222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] HTTP exception thrown: Instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 could not be found. Oct 31 14:20:21.608644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf1bd86-38e1-4de9-a22a-449bbab32190 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:21.615457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1bd86-38e1-4de9-a22a-449bbab32190 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.615947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1bd86-38e1-4de9-a22a-449bbab32190 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.616379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf1bd86-38e1-4de9-a22a-449bbab32190 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Request method failure captured: Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 HTTP/1.1 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mMMmu5K_vCSchynxM1oy38eKDfDoNVhKhLP_MaESpJwUz1RKtdMg4Ilnr9Ni6b6_Alckx1MMXfMsNG2ayxxfan8ohY9EclCz8sPjhwFj_3qKoQq08L9MPZYj_EA_YHo7zKBDzuqg6FAPTAI2y5m9Rfxh9ofs5YWQABimgCqzgUSi0 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c2802504e2c457aad1f0a46a1e905fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c2802504e2c457aad1f0a46a1e905fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 1c2802504e2c457aad1f0a46a1e905fd Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-459840532 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c6495becc67460d999a48831eda71e1 Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-459840532-project Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 could not be found. Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f51c85cc-9eb3-4cca-bd7a-bf24035e56e3'} Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 could not be found. Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 could not be found. Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:21.616594 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 could not be found. Oct 31 14:20:21.620962 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:21.621715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:21.623816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] Returning 404 to user: Instance f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:21.625047 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58f48d2d-d13f-4522-a2b8-946ef60eba73 tempest-ServerMetadataNegativeTestJSON-459840532 tempest-ServerMetadataNegativeTestJSON-459840532-project] 10.222.0.27 "GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3" status: 404 len: 111 microversion: 2.1 time: 0.089790 Oct 31 14:20:21.626095 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1933/4119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:21 2022] GET /compute/v2.1/servers/f51c85cc-9eb3-4cca-bd7a-bf24035e56e3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:21.657557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bf1bd86-38e1-4de9-a22a-449bbab32190 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 14:20:21.738467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bf1bd86-38e1-4de9-a22a-449bbab32190 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action" status: 202 len: 0 microversion: 2.1 time: 0.133518 Oct 31 14:20:21.740897 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2187/4120] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:20:21 2022] POST /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:20:21.748963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:21.750121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:21.760638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.761408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.762118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:21.765339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:21.766006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:21.776203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:22.207710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:22.208419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:22.237447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:22.242759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:22.243231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:22.244772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:22.245253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:22.245676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:22.270825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:22.284360 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6ffa20e-8919-4876-917f-0c1d1237fb13 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1663 microversion: 2.1 time: 0.539102 Oct 31 14:20:22.285782 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1934/4121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:21 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1663 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:22.618300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:22.632224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:22.640144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:22.641409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef7529fa-a7b0-4eb1-8cbe-53b9408d1972 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1371 microversion: 2.47 time: 0.438029 Oct 31 14:20:22.641921 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2188/4122] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:22 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:23.313064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:23.314296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:23.319031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:23.329442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:23.330131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:23.331036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:23.332462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:23.333080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:23.333659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:23.668775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:23.676344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:23.684433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:23.685175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:23.695509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:23.696529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:23.697158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:23.697733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:23.833695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:23.844708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:23.846530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:23.848120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-016c6977-52c9-4500-b307-b46126599543 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1356 microversion: 2.47 time: 0.183398 Oct 31 14:20:23.849659 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2189/4123] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:23 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:23.883188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:23.894919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:23.898311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Searching by: {'deleted': False, 'project_id': '340299294686458087f5f4baa72f4897'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:20:23.908221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:23.909002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:23.909869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:23.911580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:23.913601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:23.914516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:24.153499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:20:24.259126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:24.266588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:24.267310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:24.267751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:24.279567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:24.281238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:24.422889 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd4d5bce-5804-4247-bbb5-6ebb6eeb9d0d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.549275 Oct 31 14:20:24.424069 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2190/4124] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 31 14:20:23 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:24.462220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:24.463089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:24.474632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:24.476374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:24.477586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:24.478648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:24.479460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:24.480072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:24.536481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:24.550613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:20:24.552310 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f740f448-77a4-4677-86bc-9f00a4fead47 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1663 microversion: 2.1 time: 1.244148 Oct 31 14:20:24.553395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1935/4125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:23 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1663 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:24.678127 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4019e2ca-fc8a-46aa-a4fc-f6772a5b3e7b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "DELETE /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 204 len: 0 microversion: 2.47 time: 0.220736 Oct 31 14:20:24.679011 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2191/4126] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:20:24 2022] DELETE /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 14:20:24.688239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:24.688874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:24.696431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:24.697646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:24.698296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:24.699961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:24.700632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:24.701275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:25.018511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:25.045632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:25.053949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:25.055454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e01e8aad-8922-4aa3-a6b4-d947d578929b tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1362 microversion: 2.47 time: 0.372295 Oct 31 14:20:25.056206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1936/4127] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:24 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:25.580077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:25.580926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:25.600476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:25.601140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:25.602928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:25.605087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:25.605676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:25.609095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:26.077697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:26.081340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:26.082307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:26.095009 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e48957fd-ad52-4c03-be15-8dd5ad747e5e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1667 microversion: 2.1 time: 0.520322 Oct 31 14:20:26.096218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2192/4128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:25 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1667 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:26.105540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:26.108923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:26.109629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:26.110770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:26.111707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:26.112599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:26.424218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:26.446733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:26.453916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:26.458417 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad549f13-3917-4503-a8eb-2b7b96fc934f tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 200 len: 1362 microversion: 2.47 time: 0.381122 Oct 31 14:20:26.462180 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1937/4129] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:26 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:20:26.496300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c449ca8-75d8-4905-bfcf-fee21d4b71f6 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe1063435e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1162666012", "description": "tempest-description-502242457"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:27.109047 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c449ca8-75d8-4905-bfcf-fee21d4b71f6 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.945959 Oct 31 14:20:27.111196 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2193/4130] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:20:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:27.124922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad03396a-aad0-48dc-aa3f-c091c6e0edef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10fc42670>, body: {"security_group_rule": {"parent_group_id": "8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:27.487070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:27.487694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: baf75f57-b193-499b-a118-6601f9dc593e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:27.498966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:27.506924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:27.509810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:27.510608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:27.511087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:27.518820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:27.572272 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] HTTP exception thrown: Instance baf75f57-b193-499b-a118-6601f9dc593e could not be found. Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Request method failure captured: Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e HTTP/1.1 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9l62ZZxsw_ncrGFOprQoUzm6E19t3lPd0aUJJI10StUFQpaLXzu4vUVXjUD2pROF7Vub3ZdwTwafPKwODKsAIOut7trzsP0J6KoHCqZlc6W9w7gJvOp9VsH69MbBrL2aaJe4ZTz14RyEzOCFvljXd4U-xh2fkEIuQ7QLf7-fJk6Nb0 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 340299294686458087f5f4baa72f4897 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerShowV247Test-844156237 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_340299294686458087f5f4baa72f4897", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/340299294686458087f5f4baa72f4897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/340299294686458087f5f4baa72f4897"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/340299294686458087f5f4baa72f4897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerShowV247Test-844156237 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 340299294686458087f5f4baa72f4897 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerShowV247Test-844156237 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerShowV247Test-844156237-project Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: c6658ae441fc449abdfe5b3c3e5baad3 Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerShowV247Test-844156237-project Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance baf75f57-b193-499b-a118-6601f9dc593e could not be found. Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'baf75f57-b193-499b-a118-6601f9dc593e'} Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf75f57-b193-499b-a118-6601f9dc593e could not be found. Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf75f57-b193-499b-a118-6601f9dc593e could not be found. Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:27.575775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf75f57-b193-499b-a118-6601f9dc593e could not be found. Oct 31 14:20:27.580045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:27.591101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Returning 404 to user: Instance baf75f57-b193-499b-a118-6601f9dc593e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:27.592279 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03ac836e-6c85-4ad9-adf8-af469acb991d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e" status: 404 len: 111 microversion: 2.47 time: 0.109925 Oct 31 14:20:27.593176 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2194/4131] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:27 2022] GET /compute/v2.1/servers/baf75f57-b193-499b-a118-6601f9dc593e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:20:27.613779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:27.616673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:27.634001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:27.636936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:27.637611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:27.638557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:27.640906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:27.642190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:27.715440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:20:27.911027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-896f78bd-460f-49d8-b36f-f5cfa434e25d tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4" status: 204 len: 0 microversion: 2.47 time: 0.311417 Oct 31 14:20:27.912368 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2195/4132] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:20:27 2022] DELETE /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:20:27.928749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:27.929327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:27.944417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:27.944924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:27.946472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:27.948987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:27.949619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:27.952137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:28.072943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:28.088991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:28.090468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:28.091665 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cdb3b63-b2fd-4930-9dad-9ecb005339b0 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4" status: 200 len: 1363 microversion: 2.47 time: 0.174665 Oct 31 14:20:28.092232 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2196/4133] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:27 2022] GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:28.754771 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad03396a-aad0-48dc-aa3f-c091c6e0edef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.631330 Oct 31 14:20:28.765829 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1938/4134] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:28.768568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b59ea75d-ef6e-4596-b189-5eaa869050ed tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe106301940>, body: {"security_group_rule": {"parent_group_id": "8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:28.898316 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b59ea75d-ef6e-4596-b189-5eaa869050ed tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: This rule already exists in group 8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b59ea75d-ef6e-4596-b189-5eaa869050ed tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 138 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: {"security_group_rule": {"parent_group_id": "8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: exception: This rule already exists in group 8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:28.900439 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:28.904060 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:28.904060 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:28.904060 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 Oct 31 14:20:28.904060 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:28.905422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b59ea75d-ef6e-4596-b189-5eaa869050ed tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 400 to user: This rule already exists in group 8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:28.906490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b59ea75d-ef6e-4596-b189-5eaa869050ed tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.141918 Oct 31 14:20:28.907547 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2197/4135] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:28 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:20:28.919465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09d9072a-810b-4360-8038-3185d35d08f1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe10fb86f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:29.127816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:29.129643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:29.147611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:29.148877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:29.149554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:29.150997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:29.152242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:29.156782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:29.400129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:29.429276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:29.437269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:29.440549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cd9de5d-9ad6-4250-9df3-f33c995c8280 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4" status: 200 len: 1363 microversion: 2.47 time: 0.317758 Oct 31 14:20:29.441641 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2198/4136] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:29 2022] GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:20:29.475278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09d9072a-810b-4360-8038-3185d35d08f1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/a2d1d435-7dfc-4643-a200-330cfae84206" status: 202 len: 0 microversion: 2.1 time: 0.562411 Oct 31 14:20:29.476849 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1939/4137] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 31 14:20:28 2022] DELETE /compute/v2.1/os-security-group-rules/a2d1d435-7dfc-4643-a200-330cfae84206 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:29.489193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74e948fa-ed92-47c9-8750-cda687a9649f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe1063014c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1372761824", "description": "tempest-description-1412568472"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:30.366380 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74e948fa-ed92-47c9-8750-cda687a9649f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.881037 Oct 31 14:20:30.376588 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2199/4138] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:20:29 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:30.391343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa64208d-b193-4bd5-b4dc-bdbd0b701043 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe106a9b4c0>, body: {"security_group_rule": {"parent_group_id": "e1dd1674-d54f-45a4-afd4-bcab7bb56c9e", "ip_protocol": "tcp", "from_port": 186486717, "to_port": 22}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:30.467315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:30.468049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:30.483043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:30.483547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:30.483993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:30.485238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:30.485238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:30.485555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:30.583308 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-fa64208d-b193-4bd5-b4dc-bdbd0b701043 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Invalid port range 186486717:22. Former value cannot be greater than the later Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa64208d-b193-4bd5-b4dc-bdbd0b701043 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 145 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: {"security_group_rule": {"parent_group_id": "e1dd1674-d54f-45a4-afd4-bcab7bb56c9e", "ip_protocol": "tcp", "from_port": 186486717, "to_port": 22}} Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid port range 186486717:22. Former value cannot be greater than the later Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e1dd1674-d54f-45a4-afd4-bcab7bb56c9e', 'ip_protocol': 'tcp', 'from_port': 186486717, 'to_port': 22}}} Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 186486717:22. Former value cannot be greater than the later Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 186486717:22. Former value cannot be greater than the later Oct 31 14:20:30.595275 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 186486717:22. Former value cannot be greater than the later Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa64208d-b193-4bd5-b4dc-bdbd0b701043 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 400 to user: Invalid port range 186486717:22. Former value cannot be greater than the later {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:30.599636 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa64208d-b193-4bd5-b4dc-bdbd0b701043 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.219843 Oct 31 14:20:30.601703 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1940/4139] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:30 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:20:30.624987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e62e1bb3-85d3-4664-8644-01b8c97775c1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10c311670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1748883654", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:30.627462 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e62e1bb3-85d3-4664-8644-01b8c97775c1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Security group id should be uuid Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e62e1bb3-85d3-4664-8644-01b8c97775c1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 131 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1748883654", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group id should be uuid Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1748883654', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:30.629737 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:30.633277 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 31 14:20:30.633277 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:30.633277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e62e1bb3-85d3-4664-8644-01b8c97775c1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 400 to user: Security group id should be uuid {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:30.633277 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e62e1bb3-85d3-4664-8644-01b8c97775c1 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018553 Oct 31 14:20:30.633947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1941/4140] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:30 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:30.659384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0c55fae-1acf-4370-a5c0-68222b51d20a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10c3114c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-968839850", "description": "tempest-description-535696578"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:30.676594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:30.677172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:30.677624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:30.678089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lazy-loading 'fault' on Instance uuid 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:20:30.825134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:30.834553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:30.836029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6658ae441fc449abdfe5b3c3e5baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340299294686458087f5f4baa72f4897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:30.837278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-849a3725-e055-4132-89e8-768cdcc7044e tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4" status: 200 len: 1368 microversion: 2.47 time: 0.374435 Oct 31 14:20:30.849612 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2200/4141] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:30 2022] GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 => generated 1368 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:20:31.787844 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0c55fae-1acf-4370-a5c0-68222b51d20a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.144460 Oct 31 14:20:31.788649 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1942/4142] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:20:30 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:31.803989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ad6188f-ed3d-4bd2-a1bc-3a7843df15ef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe106465430>, body: {"security_group_rule": {"parent_group_id": "0aa5582a-ab51-4186-a65d-81705a728386", "ip_protocol": "tempest-999-1337632470", "from_port": 22, "to_port": 22}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:31.866508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:31.867245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] [instance: 31b5d85e-65d7-4a5c-9fcc-226da85a1db4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:31.879334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:31.886222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:31.890378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:31.896226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:31.896881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:31.897432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:31.920623 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] HTTP exception thrown: Instance 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 could not be found. Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Request method failure captured: Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 HTTP/1.1 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9l62ZZxsw_ncrGFOprQoUzm6E19t3lPd0aUJJI10StUFQpaLXzu4vUVXjUD2pROF7Vub3ZdwTwafPKwODKsAIOut7trzsP0J6KoHCqZlc6W9w7gJvOp9VsH69MbBrL2aaJe4ZTz14RyEzOCFvljXd4U-xh2fkEIuQ7QLf7-fJk6Nb0 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 340299294686458087f5f4baa72f4897 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerShowV247Test-844156237 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_340299294686458087f5f4baa72f4897", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/340299294686458087f5f4baa72f4897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/340299294686458087f5f4baa72f4897"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/340299294686458087f5f4baa72f4897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerShowV247Test-844156237 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 340299294686458087f5f4baa72f4897 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerShowV247Test-844156237 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerShowV247Test-844156237-project Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: c6658ae441fc449abdfe5b3c3e5baad3 Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerShowV247Test-844156237-project Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 could not be found. Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '31b5d85e-65d7-4a5c-9fcc-226da85a1db4'} Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 could not be found. Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 could not be found. Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:31.931885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 could not be found. Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:31.937642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] Returning 404 to user: Instance 31b5d85e-65d7-4a5c-9fcc-226da85a1db4 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:31.939507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d237db4-0ecf-4d97-ad7e-f408d9835334 tempest-ServerShowV247Test-844156237 tempest-ServerShowV247Test-844156237-project] 10.222.0.27 "GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4" status: 404 len: 111 microversion: 2.47 time: 0.078333 Oct 31 14:20:31.946288 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1943/4143] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:20:31 2022] GET /compute/v2.1/servers/31b5d85e-65d7-4a5c-9fcc-226da85a1db4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:20:32.249199 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8ad6188f-ed3d-4bd2-a1bc-3a7843df15ef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Invalid IP protocol tempest-999-1337632470. Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ad6188f-ed3d-4bd2-a1bc-3a7843df15ef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 157 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: {"security_group_rule": {"parent_group_id": "0aa5582a-ab51-4186-a65d-81705a728386", "ip_protocol": "tempest-999-1337632470", "from_port": 22, "to_port": 22}} Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid IP protocol tempest-999-1337632470. Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0aa5582a-ab51-4186-a65d-81705a728386', 'ip_protocol': 'tempest-999-1337632470', 'from_port': 22, 'to_port': 22}}} Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1337632470. Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1337632470. Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.256223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1337632470. Oct 31 14:20:32.260227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.261633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ad6188f-ed3d-4bd2-a1bc-3a7843df15ef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 400 to user: Invalid IP protocol tempest-999-1337632470. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:32.264316 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ad6188f-ed3d-4bd2-a1bc-3a7843df15ef tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.465279 Oct 31 14:20:32.265090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2201/4144] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:31 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 468 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:32.276567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb4196c0-6da7-4b7e-8486-6cca6c01024e tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10fc2a790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1802247857", "description": "tempest-description-538121540"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:32.814939 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb4196c0-6da7-4b7e-8486-6cca6c01024e tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.542593 Oct 31 14:20:32.816901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1944/4145] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:20:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:32.833365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-723c1a68-518c-4fca-856a-d572ff6d6a1a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10636eee0>, body: {"security_group_rule": {"parent_group_id": "9a987708-04b3-4069-9678-a9d049e51bab", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:32.982064 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-723c1a68-518c-4fca-856a-d572ff6d6a1a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-723c1a68-518c-4fca-856a-d572ff6d6a1a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 138 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: {"security_group_rule": {"parent_group_id": "9a987708-04b3-4069-9678-a9d049e51bab", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9a987708-04b3-4069-9678-a9d049e51bab', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 14:20:32.984244 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:32.987474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-723c1a68-518c-4fca-856a-d572ff6d6a1a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:32.988540 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-723c1a68-518c-4fca-856a-d572ff6d6a1a tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.161194 Oct 31 14:20:32.998100 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2202/4146] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:32 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:20:33.002927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-978786c4-f497-4096-a071-d51415dae509 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10fc40430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1841613813", "description": "tempest-description-61627520"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:33.567020 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-978786c4-f497-4096-a071-d51415dae509 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.568763 Oct 31 14:20:33.569293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1945/4147] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:20:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:20:33.582591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfce75fc-660f-4c9e-8853-a1ba002aaa5f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe10657aaf0>, body: {"security_group_rule": {"parent_group_id": "4be03355-926d-4583-8b26-08df68dcfd55", "ip_protocol": "tcp", "from_port": 22, "to_port": 408838302}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:33.780879 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-cfce75fc-660f-4c9e-8853-a1ba002aaa5f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Invalid port range 22:408838302. Valid TCP ports should be between 1-65535 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfce75fc-660f-4c9e-8853-a1ba002aaa5f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 145 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: {"security_group_rule": {"parent_group_id": "4be03355-926d-4583-8b26-08df68dcfd55", "ip_protocol": "tcp", "from_port": 22, "to_port": 408838302}} Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid port range 22:408838302. Valid TCP ports should be between 1-65535 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4be03355-926d-4583-8b26-08df68dcfd55', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 408838302}}} Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:408838302. Valid TCP ports should be between 1-65535 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:408838302. Valid TCP ports should be between 1-65535 Oct 31 14:20:33.782443 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:408838302. Valid TCP ports should be between 1-65535 Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfce75fc-660f-4c9e-8853-a1ba002aaa5f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 400 to user: Invalid port range 22:408838302. Valid TCP ports should be between 1-65535 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cfce75fc-660f-4c9e-8853-a1ba002aaa5f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.205906 Oct 31 14:20:33.786626 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2203/4148] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:33 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:20:33.796247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Action: 'create', calling method: .version_select at 0x7fe106b18c10>, body: {"security_group_rule": {"parent_group_id": "034dc35e-d04c-49b3-953c-cfead4daf931", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:33.836516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:20:33.836516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Neutron security group 034dc35e-d04c-49b3-953c-cfead4daf931 not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:20:33.837173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.837173 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 138 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: {"security_group_rule": {"parent_group_id": "034dc35e-d04c-49b3-953c-cfead4daf931", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'security_group_rule': {'parent_group_id': '034dc35e-d04c-49b3-953c-cfead4daf931', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:20:33.839189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 404 to user: Security group 034dc35e-d04c-49b3-953c-cfead4daf931 does not exist Oct 31 14:20:33.843074 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-36e63639-d889-44db-90b9-352dcc736962'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:33.845176 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c5f0fc09-c37a-4742-85b4-1affc67fe46c tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.051499 Oct 31 14:20:33.851070 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1946/4149] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 31 14:20:33 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:33.858846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe106301ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:33.970884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:20:33.972009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Neutron security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 not found {{(pid=120640) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 31 14:20:33.972544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] HTTP exception thrown: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.972544 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Request method failure captured: Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-security-group-rules/00943319-ca2d-454d-a4af-a1f88bde2a11 HTTP/1.1 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9mpZP_02V7jY6BosQQv33QbREa0cyhSzP26Hrekuqbw5D2CRWny8OsNWPcbiJW5q7ute0eEg6Tv9lGsaSSHY36Tpay_XijTHONuZyX1npyh6EFbsVGEiDVDLG-ctXpIasimpQO6koNk1vx-pTQTe3pKz59tazpG0_uKInL7KfIeUJk Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fa5110c3c1b4cc1a40c4d2fbd93c7d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fa5110c3c1b4cc1a40c4d2fbd93c7d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 0fa5110c3c1b4cc1a40c4d2fbd93c7d9 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bf6b6dcc7fe74bf2b1f5dea27b487eff Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-78749476-project Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '00943319-ca2d-454d-a4af-a1f88bde2a11'} Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:20:33.974968 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Returning 404 to user: Security group rule 00943319-ca2d-454d-a4af-a1f88bde2a11 does not exist Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-b09447eb-b1d3-4f41-a95f-fbd1361493c9'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-616a15d2-f10b-47d7-8074-83c2be78e62f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/00943319-ca2d-454d-a4af-a1f88bde2a11" status: 404 len: 199 microversion: 2.1 time: 0.125595 Oct 31 14:20:33.978029 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2204/4150] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 31 14:20:33 2022] DELETE /compute/v2.1/os-security-group-rules/00943319-ca2d-454d-a4af-a1f88bde2a11 => generated 199 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:20:34.005469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74421a2c-854e-46c6-9b38-b3e0d314978e tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe10fc40ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:34.688382 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74421a2c-854e-46c6-9b38-b3e0d314978e tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4be03355-926d-4583-8b26-08df68dcfd55" status: 202 len: 0 microversion: 2.1 time: 0.698063 Oct 31 14:20:34.689307 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1947/4151] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:33 2022] DELETE /compute/v2.1/os-security-groups/4be03355-926d-4583-8b26-08df68dcfd55 => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:34.699260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd24470c-c30d-4751-aa16-35d70d37ced3 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe10636e4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:34.708458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:34.711886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:35.931088 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd24470c-c30d-4751-aa16-35d70d37ced3 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9a987708-04b3-4069-9678-a9d049e51bab" status: 202 len: 0 microversion: 2.1 time: 1.236152 Oct 31 14:20:35.934653 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2205/4152] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:34 2022] DELETE /compute/v2.1/os-security-groups/9a987708-04b3-4069-9678-a9d049e51bab => generated 0 bytes in 1241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:35.939648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ced27c37-8538-49a7-9d9e-50baef4e2c3f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe10636e5e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:36.087284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e65be9a8-cd6f-44bc-9e9a-c58711f012f3 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Action: 'create', calling method: .version_select at 0x7fe10fc2f820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1425745750"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:36.495612 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e65be9a8-cd6f-44bc-9e9a-c58711f012f3 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.813181 Oct 31 14:20:36.496683 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1948/4153] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Oct 31 14:20:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 816 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 14:20:36.510994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4a5fcb0-d337-4de6-b772-a96d36846345 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107db1940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:36.542593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ced27c37-8538-49a7-9d9e-50baef4e2c3f tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0aa5582a-ab51-4186-a65d-81705a728386" status: 202 len: 0 microversion: 2.1 time: 0.606560 Oct 31 14:20:36.543161 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2206/4154] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:35 2022] DELETE /compute/v2.1/os-security-groups/0aa5582a-ab51-4186-a65d-81705a728386 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:20:36.551689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b13a3d06-fa03-4550-a3d7-953168cd9c35 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe106301ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:36.646834 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4a5fcb0-d337-4de6-b772-a96d36846345 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 200 len: 345 microversion: 2.1 time: 0.139452 Oct 31 14:20:36.653656 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1949/4155] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:36 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:37.144290 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b13a3d06-fa03-4550-a3d7-953168cd9c35 tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e1dd1674-d54f-45a4-afd4-bcab7bb56c9e" status: 202 len: 0 microversion: 2.1 time: 0.596682 Oct 31 14:20:37.145314 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2207/4156] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:36 2022] DELETE /compute/v2.1/os-security-groups/e1dd1674-d54f-45a4-afd4-bcab7bb56c9e => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:20:37.154845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-469fbf46-597c-4ec1-88b2-2f0387aceadc tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] Calling method '.version_select at 0x7fe10fc2f820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:37.661437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20fa9b99-b461-432b-ac87-8055598d9929 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe106489f70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:37.735255 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20fa9b99-b461-432b-ac87-8055598d9929 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 200 len: 346 microversion: 2.1 time: 0.078225 Oct 31 14:20:37.736005 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2208/4157] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:37 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:37.751926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4acd0bb-e15f-467a-819c-07d9a64e0e08 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Action: 'create', calling method: .version_select at 0x7fe1062540d0>, body: {"snapshot": {"volume_id": "9f9201ca-11f6-48c1-be47-231c47339adc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-554471685"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:37.978085 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4acd0bb-e15f-467a-819c-07d9a64e0e08 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.229882 Oct 31 14:20:37.978706 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2209/4158] 10.222.0.27 () {60 vars in 1162 bytes} [Mon Oct 31 14:20:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:37.990815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96e30793-f931-456a-a8a2-9b9ea0a0470b tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe106254790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:38.057389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96e30793-f931-456a-a8a2-9b9ea0a0470b tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.071340 Oct 31 14:20:38.058337 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2210/4159] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:37 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:38.068885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0dd249b4-492d-4487-8832-f53ae81b224e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe106254e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:38.119808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0dd249b4-492d-4487-8832-f53ae81b224e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.054566 Oct 31 14:20:38.120713 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2211/4160] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 31 14:20:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:20:38.134705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffbda958-c3b9-4ac7-b847-6d5619bbed2a tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe106254c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:38.172290 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ffbda958-c3b9-4ac7-b847-6d5619bbed2a tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.041156 Oct 31 14:20:38.173680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2212/4161] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:38 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:38.281176 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-469fbf46-597c-4ec1-88b2-2f0387aceadc tempest-SecurityGroupRulesNegativeTestJSON-78749476 tempest-SecurityGroupRulesNegativeTestJSON-78749476-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13" status: 202 len: 0 microversion: 2.1 time: 1.130825 Oct 31 14:20:38.281738 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1950/4162] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:20:37 2022] DELETE /compute/v2.1/os-security-groups/8df3fa0b-c6ce-42ac-9c3a-98b152c3fe13 => generated 0 bytes in 1132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:39.187243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-102283e2-50f4-45c4-b491-dec6581dd83e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe106301430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:39.247692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-102283e2-50f4-45c4-b491-dec6581dd83e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.065155 Oct 31 14:20:39.248782 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2213/4163] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:39 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:40.260990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7f9b942e-19ba-4586-a84d-d5e01e89cc2e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107db14c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:40.319322 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7f9b942e-19ba-4586-a84d-d5e01e89cc2e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.058785 Oct 31 14:20:40.319322 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1951/4164] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:40 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:41.330956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5559193-3585-4cf2-a0cc-d3abb4368da0 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe10626d160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:41.353792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:41.355380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:41.396381 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5559193-3585-4cf2-a0cc-d3abb4368da0 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 287 microversion: 2.1 time: 0.069463 Oct 31 14:20:41.410568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3a62e38-332e-4c5f-bdf6-6533d7e0decd tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107479310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:41.414322 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2214/4165] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:41 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:41.492259 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3a62e38-332e-4c5f-bdf6-6533d7e0decd tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 202 len: 0 microversion: 2.1 time: 0.087691 Oct 31 14:20:41.493623 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1952/4166] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 31 14:20:41 2022] DELETE /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:41.504843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5be96d8-9fca-4580-a1ca-bff8698dc161 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe10626d280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:41.566120 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5be96d8-9fca-4580-a1ca-bff8698dc161 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.066673 Oct 31 14:20:41.571851 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2215/4167] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:41 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:42.595830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f30d874b-f01d-410c-ada3-8a6ac1ed01ef tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107479550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:42.610903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:42.613798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:42.684789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f30d874b-f01d-410c-ada3-8a6ac1ed01ef tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.109570 Oct 31 14:20:42.686698 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1953/4168] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:42 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:43.702095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13c14003-4908-4cf3-9755-5a05b99ab1e7 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe1061ff670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:43.807860 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13c14003-4908-4cf3-9755-5a05b99ab1e7 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 200 len: 286 microversion: 2.1 time: 0.113584 Oct 31 14:20:43.808810 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2216/4169] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:43 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:44.822754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a59820c-ff31-455d-8975-a139b5e2cc3e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe10fc2f5e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:44.869677 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7a59820c-ff31-455d-8975-a139b5e2cc3e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] HTTP exception thrown: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a59820c-ff31-455d-8975-a139b5e2cc3e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Request method failure captured: Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 HTTP/1.1 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mz8UTRRem486DS1EKzmvB_M_-XtSm_LskiKFym4c_zfugsS9HjHRugtsitz6TCRonv2cz-FL6iguhPe9vyTOODoc8x7zA6rxzAaCBbwZHiERMKSsYuXHppQfWPAsjkgTieP3pXLXm5P0eeoF0PJunay0Df90iVC2URxOFOC5uaLEw Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fda78cd94f594543ae41ce062706dd04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e5aa4b4de4fe47539e2b137ffe4394b5 Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: exception: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f5f2d9c6-b410-4709-bf78-24e4e83c6ed6'} Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. (HTTP 404) (Request-ID: req-a6002080-b1a8-48ff-925f-389c699f780b) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:20:44.879863 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. Oct 31 14:20:44.884828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:44.891301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a59820c-ff31-455d-8975-a139b5e2cc3e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Returning 404 to user: Snapshot f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:44.892548 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a59820c-ff31-455d-8975-a139b5e2cc3e tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6" status: 404 len: 111 microversion: 2.1 time: 0.075356 Oct 31 14:20:44.894846 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1954/4170] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:20:44 2022] GET /compute/v2.1/os-snapshots/f5f2d9c6-b410-4709-bf78-24e4e83c6ed6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:44.905877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f936911-b5c6-44c7-8907-70dd4be03e24 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe10626d1f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:45.033388 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f936911-b5c6-44c7-8907-70dd4be03e24 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 202 len: 0 microversion: 2.1 time: 0.133528 Oct 31 14:20:45.037749 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2217/4171] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:20:44 2022] DELETE /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:20:45.050073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adc5c09c-3e79-4fd6-9eb1-a7de4beaf527 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107479430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:45.187431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-adc5c09c-3e79-4fd6-9eb1-a7de4beaf527 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 200 len: 345 microversion: 2.1 time: 0.146852 Oct 31 14:20:45.189477 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1955/4172] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:45 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:20:46.204611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88e16b8f-f721-4344-b8d9-c1a23e7b0a80 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe106268550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:46.350493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88e16b8f-f721-4344-b8d9-c1a23e7b0a80 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 200 len: 345 microversion: 2.1 time: 0.149598 Oct 31 14:20:46.352376 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2218/4173] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:46 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:47.368453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9178b9ae-5b47-453d-8463-ff36b0a37724 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107447e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:47.520930 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9178b9ae-5b47-453d-8463-ff36b0a37724 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 200 len: 345 microversion: 2.1 time: 0.156769 Oct 31 14:20:47.521721 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1956/4174] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:47 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:20:48.009612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1764454809", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:48.096328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] validate_networks() for [('9f8924a5-c038-416a-9512-8369ddd99493', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:20:48.537373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb7fe7a6-2789-4849-855e-7ba7830b4d7d tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe10fbd0160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:48.587713 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-cb7fe7a6-2789-4849-855e-7ba7830b4d7d tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] HTTP exception thrown: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb7fe7a6-2789-4849-855e-7ba7830b4d7d tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Request method failure captured: Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc HTTP/1.1 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mz8UTRRem486DS1EKzmvB_M_-XtSm_LskiKFym4c_zfugsS9HjHRugtsitz6TCRonv2cz-FL6iguhPe9vyTOODoc8x7zA6rxzAaCBbwZHiERMKSsYuXHppQfWPAsjkgTieP3pXLXm5P0eeoF0PJunay0Df90iVC2URxOFOC5uaLEw Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fda78cd94f594543ae41ce062706dd04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e5aa4b4de4fe47539e2b137ffe4394b5 Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: exception: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9f9201ca-11f6-48c1-be47-231c47339adc'} Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. (HTTP 404) (Request-ID: req-dfdabf34-c02a-460f-b964-54933e78282e) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:20:48.592377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.597212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.601876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb7fe7a6-2789-4849-855e-7ba7830b4d7d tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Returning 404 to user: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:48.603129 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb7fe7a6-2789-4849-855e-7ba7830b4d7d tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 404 len: 109 microversion: 2.1 time: 0.071391 Oct 31 14:20:48.603899 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1957/4175] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:48 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:20:48.617768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-671897cd-fd69-477f-921c-d54c9b99edf5 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107447ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:48.658634 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-671897cd-fd69-477f-921c-d54c9b99edf5 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] HTTP exception thrown: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-671897cd-fd69-477f-921c-d54c9b99edf5 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Request method failure captured: Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc HTTP/1.1 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mz8UTRRem486DS1EKzmvB_M_-XtSm_LskiKFym4c_zfugsS9HjHRugtsitz6TCRonv2cz-FL6iguhPe9vyTOODoc8x7zA6rxzAaCBbwZHiERMKSsYuXHppQfWPAsjkgTieP3pXLXm5P0eeoF0PJunay0Df90iVC2URxOFOC5uaLEw Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fda78cd94f594543ae41ce062706dd04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e5aa4b4de4fe47539e2b137ffe4394b5 Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: exception: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9f9201ca-11f6-48c1-be47-231c47339adc'} Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. (HTTP 404) (Request-ID: req-88f9ee30-9ba4-46ae-b207-aea76e80a8ed) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:20:48.661223 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-671897cd-fd69-477f-921c-d54c9b99edf5 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Returning 404 to user: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-671897cd-fd69-477f-921c-d54c9b99edf5 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 404 len: 109 microversion: 2.1 time: 0.048861 Oct 31 14:20:48.665293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1958/4176] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:20:48 2022] DELETE /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:48.674542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9413090-d12c-45a6-8343-45a354051086 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Calling method '.version_select at 0x7fe107479dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:48.735431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c9413090-d12c-45a6-8343-45a354051086 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] HTTP exception thrown: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9413090-d12c-45a6-8343-45a354051086 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Request method failure captured: Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc HTTP/1.1 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9mz8UTRRem486DS1EKzmvB_M_-XtSm_LskiKFym4c_zfugsS9HjHRugtsitz6TCRonv2cz-FL6iguhPe9vyTOODoc8x7zA6rxzAaCBbwZHiERMKSsYuXHppQfWPAsjkgTieP3pXLXm5P0eeoF0PJunay0Df90iVC2URxOFOC5uaLEw Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fda78cd94f594543ae41ce062706dd04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fda78cd94f594543ae41ce062706dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: fda78cd94f594543ae41ce062706dd04 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1488208122 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e5aa4b4de4fe47539e2b137ffe4394b5 Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1488208122-project Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: exception: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9f9201ca-11f6-48c1-be47-231c47339adc'} Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. (HTTP 404) (Request-ID: req-2fda4d30-0ca7-44bd-9472-b5ce097aac4e) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:20:48.737645 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. Oct 31 14:20:48.740972 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:48.745124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9413090-d12c-45a6-8343-45a354051086 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] Returning 404 to user: Volume 9f9201ca-11f6-48c1-be47-231c47339adc could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:48.746197 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9413090-d12c-45a6-8343-45a354051086 tempest-VolumesSnapshotsTestJSON-1488208122 tempest-VolumesSnapshotsTestJSON-1488208122-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc" status: 404 len: 109 microversion: 2.1 time: 0.076407 Oct 31 14:20:48.747231 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1959/4177] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:20:48 2022] GET /compute/v2.1/os-volumes/9f9201ca-11f6-48c1-be47-231c47339adc => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:49.962957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cddd107-c542-4287-aa11-c1e1362ee29e tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Calling method '.version_select at 0x7fe107479d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:50.049224 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cddd107-c542-4287-aa11-c1e1362ee29e tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.280333 Oct 31 14:20:50.050357 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1960/4178] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 31 14:20:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 14:20:50.071065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9519e9a8-dbcc-4a36-b628-f0f956a58607 tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Action: 'create', calling method: .version_select at 0x7fe10fbd00d0>, body: {"pool": "non_exist_pool"} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:20:50.125422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-9519e9a8-dbcc-4a36-b628-f0f956a58607 tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] HTTP exception thrown: Floating IP pool not found. Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9519e9a8-dbcc-4a36-b628-f0f956a58607 tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Request method failure captured: Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 26 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9nBQ1FrIX1Jp-9jqCJUb1nFCyDoTj9kKT9seCuGYEXgqGr208BuX05XDQ13alqVGO_-kslcWgodKQG7Ayps93zvvACOceoUZVO3-DDSYBrZ5bspaB7Qw72YMUj-CiUBs42tx3ChgYWHsjEKykCak1GU1Jc12OKMzfQk8-h32W_75zs Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8bcf9f5779be437891b523b5a3a9fea1 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1630355683 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bcf9f5779be437891b523b5a3a9fea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bcf9f5779be437891b523b5a3a9fea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bcf9f5779be437891b523b5a3a9fea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bcf9f5779be437891b523b5a3a9fea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1630355683 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8bcf9f5779be437891b523b5a3a9fea1 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1630355683 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsNegativeTestJSON-1630355683-project Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: c58cea453f3a426881b9ec75d18d3959 Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1630355683-project Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: {"pool": "non_exist_pool"} Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: exception: Floating IP pool not found. Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:50.131070 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:50.135769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 31 14:20:50.135769 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.137763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9519e9a8-dbcc-4a36-b628-f0f956a58607 tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Returning 404 to user: Floating IP pool not found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:50.141230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9519e9a8-dbcc-4a36-b628-f0f956a58607 tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.082042 Oct 31 14:20:50.144023 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1961/4179] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 31 14:20:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:20:50.162346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67b1f3ca-4d30-4357-a613-378185c4cd7b tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Calling method '.version_select at 0x7fe10fbd0790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:50.217080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:20:50.217570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:20:50.218522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:20:50.219126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:20:50.219705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:20:50.236747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:50.237871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:50.238571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:50.244637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:50.245359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:50.246002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:50.284119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-67b1f3ca-4d30-4357-a613-378185c4cd7b tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 930ac063-fba6-42f1-a047-bfeae11ef952 could not be found", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:20:50.299192 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-67b1f3ca-4d30-4357-a613-378185c4cd7b tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] HTTP exception thrown: Floating IP not found for ID 930ac063-fba6-42f1-a047-bfeae11ef952 Oct 31 14:20:50.301216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Getting quotas for project 51dc0b8f573048159de0a59092c3e547. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67b1f3ca-4d30-4357-a613-378185c4cd7b tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Request method failure captured: Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-floating-ips/930ac063-fba6-42f1-a047-bfeae11ef952 HTTP/1.1 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9nBQ1FrIX1Jp-9jqCJUb1nFCyDoTj9kKT9seCuGYEXgqGr208BuX05XDQ13alqVGO_-kslcWgodKQG7Ayps93zvvACOceoUZVO3-DDSYBrZ5bspaB7Qw72YMUj-CiUBs42tx3ChgYWHsjEKykCak1GU1Jc12OKMzfQk8-h32W_75zs Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8bcf9f5779be437891b523b5a3a9fea1 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1630355683 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bcf9f5779be437891b523b5a3a9fea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bcf9f5779be437891b523b5a3a9fea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bcf9f5779be437891b523b5a3a9fea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bcf9f5779be437891b523b5a3a9fea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1630355683 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8bcf9f5779be437891b523b5a3a9fea1 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1630355683 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-FloatingIPsNegativeTestJSON-1630355683-project Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: c58cea453f3a426881b9ec75d18d3959 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1630355683-project Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: exception: Floating IP not found for ID 930ac063-fba6-42f1-a047-bfeae11ef952 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '930ac063-fba6-42f1-a047-bfeae11ef952'} Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 930ac063-fba6-42f1-a047-bfeae11ef952 could not be found Oct 31 14:20:50.301584 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf3c0ee8-190d-49fd-9b41-690708981209'] Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 930ac063-fba6-42f1-a047-bfeae11ef952. Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 930ac063-fba6-42f1-a047-bfeae11ef952 Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 930ac063-fba6-42f1-a047-bfeae11ef952 Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67b1f3ca-4d30-4357-a613-378185c4cd7b tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] Returning 404 to user: Floating IP not found for ID 930ac063-fba6-42f1-a047-bfeae11ef952 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67b1f3ca-4d30-4357-a613-378185c4cd7b tempest-FloatingIPsNegativeTestJSON-1630355683 tempest-FloatingIPsNegativeTestJSON-1630355683-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/930ac063-fba6-42f1-a047-bfeae11ef952" status: 404 len: 111 microversion: 2.1 time: 0.153474 Oct 31 14:20:50.309510 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1962/4180] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:20:50 2022] DELETE /compute/v2.1/os-floating-ips/930ac063-fba6-42f1-a047-bfeae11ef952 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:50.338391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Getting quotas for user 09698dbdb79d475aba0d84611879f2e3 and project 51dc0b8f573048159de0a59092c3e547. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:20:50.376153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:20:50.378938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:20:50.467601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e14b69ef-72b0-4722-b3c5-4b3184afc06d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.733545 Oct 31 14:20:50.468982 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2219/4181] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:20:50.480272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f367cfd-a03a-4bf8-9afd-dc6fb44e5f41 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:50.480895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f367cfd-a03a-4bf8-9afd-dc6fb44e5f41 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:51.185203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f367cfd-a03a-4bf8-9afd-dc6fb44e5f41 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:51.196227 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f367cfd-a03a-4bf8-9afd-dc6fb44e5f41 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1217 microversion: 2.1 time: 0.719780 Oct 31 14:20:51.197920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1963/4182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:50 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1217 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:52.223153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:52.224278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:52.237770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:52.238684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:52.242746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:52.243951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:52.244698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:52.245293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:52.420911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:52.431233 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7f0423f-3f06-487c-9207-a89891d1318c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1269 microversion: 2.1 time: 0.213874 Oct 31 14:20:52.450779 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2220/4183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:52 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1269 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:53.474758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:53.476057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:53.500699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:53.501441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:53.502225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:53.503925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:53.505148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:53.505734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:54.213593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:54.239498 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0fada85f-68ca-4918-baa2-88260da4a5f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1275 microversion: 2.1 time: 0.779095 Oct 31 14:20:54.240116 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1964/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:53 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1275 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:55.168306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:55.171359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:55.186157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.192105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.192731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.193643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.194291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.194875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.269948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:55.271389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:55.294074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.295558 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f414bad7-409e-4e39-9762-75a9694a10fd tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133345 Oct 31 14:20:55.304141 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2221/4185] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:20:55 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:20:55.316540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.320828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.328721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.329380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.330975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.506374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:55.507385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:55.515784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.516749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.517898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.519331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.520018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.521754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.565189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:20:55.750740 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bbcfc993-0fd7-4d5a-b3ba-3c722f3c7764 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 204 len: 0 microversion: 2.1 time: 0.245735 Oct 31 14:20:55.753765 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2222/4186] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:20:55 2022] DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:20:55.762703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:55.763808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:55.771060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.771880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.772543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:55.773503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:55.774211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:55.774868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:56.173397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:56.198213 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e8335a9-20ab-487f-bb1d-57be1c2eaec4 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1673 microversion: 2.1 time: 0.439342 Oct 31 14:20:56.201841 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2223/4187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:55 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1673 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:20:56.688473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:56.700540 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1653a6ab-8889-4a9c-82d2-b02e82875ffc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 1.436937 Oct 31 14:20:56.702072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1965/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:55 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:57.228682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:57.229497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:57.244889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:57.250825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:57.251848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:57.256062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:57.258659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:57.259375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:57.727718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:57.729551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:57.749432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:57.750113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:57.750692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:57.751517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:57.752083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:57.752660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:58.232372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:58.241716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a652526-4dd8-470a-9f34-2dfa53fe2dd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 0.517927 Oct 31 14:20:58.255093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1966/4189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:57 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:58.423780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:58.432398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cf93fb8-9a41-4e1e-a05a-cab6de8fdb18 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1673 microversion: 2.1 time: 1.207804 Oct 31 14:20:58.438345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2224/4190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:57 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1673 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:20:59.282217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:59.283027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:59.295343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:59.298217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:59.298688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:59.301454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:59.302849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:59.304081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:59.468549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:20:59.469749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:20:59.494904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:59.495410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:59.495857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:59.499141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:20:59.499899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:20:59.501541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:20:59.743034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:20:59.759979 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30fcde82-08b8-4a9e-9b1f-971b054bfabb tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1606 microversion: 2.1 time: 0.294348 Oct 31 14:20:59.763198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2225/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:59 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1606 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:00.230008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:00.245037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b804fd07-b1ae-4a42-a05c-b37acd10a113 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 0.968676 Oct 31 14:21:00.249777 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1967/4192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:20:59 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:00.403674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3f85a95c-d07f-4f47-bf53-daf3b8f98dee req-2a7eba51-9807-42af-a798-7427c2ba53bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c2c342-ac89-4ca5-98f0-5cad14e05ad6", "tag": "782d392a-a5cb-401c-b1cc-ac4fb1e65d41"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:00.425396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:00.434381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:00.436911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3f85a95c-d07f-4f47-bf53-daf3b8f98dee req-2a7eba51-9807-42af-a798-7427c2ba53bd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:00.438870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3f85a95c-d07f-4f47-bf53-daf3b8f98dee req-2a7eba51-9807-42af-a798-7427c2ba53bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:00.442431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3f85a95c-d07f-4f47-bf53-daf3b8f98dee req-2a7eba51-9807-42af-a798-7427c2ba53bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:00.495484 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3f85a95c-d07f-4f47-bf53-daf3b8f98dee req-2a7eba51-9807-42af-a798-7427c2ba53bd service nova] Creating event network-changed:782d392a-a5cb-401c-b1cc-ac4fb1e65d41 for instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 on n-h1-863052-1 Oct 31 14:21:00.508127 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3f85a95c-d07f-4f47-bf53-daf3b8f98dee req-2a7eba51-9807-42af-a798-7427c2ba53bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108260 Oct 31 14:21:00.514891 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2226/4193] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:00.786578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:00.787356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:00.796548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:00.803012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:00.808624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:00.811894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:00.813316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:00.814103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:01.125139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:01.142068 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e811040f-9c43-4460-8a8c-ecdf7b8f344f tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 200 len: 1606 microversion: 2.1 time: 0.360805 Oct 31 14:21:01.150334 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1968/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:00 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 1606 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:01.160832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-629c27fb-dde9-4066-bddc-d2ac2c1491f9 req-f95ae0d3-58bc-4eb2-8aa4-e79f31093e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679c6ed9-8d8f-47cb-b1c1-752bf554da3c", "name": "network-vif-deleted", "tag": "c47b4013-a988-4e5c-84c0-ed38b18b11f0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:01.180557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-629c27fb-dde9-4066-bddc-d2ac2c1491f9 req-f95ae0d3-58bc-4eb2-8aa4-e79f31093e99 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:01.182489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-629c27fb-dde9-4066-bddc-d2ac2c1491f9 req-f95ae0d3-58bc-4eb2-8aa4-e79f31093e99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:01.183038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-629c27fb-dde9-4066-bddc-d2ac2c1491f9 req-f95ae0d3-58bc-4eb2-8aa4-e79f31093e99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:01.224088 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-629c27fb-dde9-4066-bddc-d2ac2c1491f9 req-f95ae0d3-58bc-4eb2-8aa4-e79f31093e99 service nova] Creating event network-vif-deleted:c47b4013-a988-4e5c-84c0-ed38b18b11f0 for instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c on n-h2-863052-1 Oct 31 14:21:01.248826 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-629c27fb-dde9-4066-bddc-d2ac2c1491f9 req-f95ae0d3-58bc-4eb2-8aa4-e79f31093e99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086321 Oct 31 14:21:01.253243 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2227/4195] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:01.275269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:01.276597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:01.284304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:01.289609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:01.292393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:01.293173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:01.295821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:01.296592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:01.297646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:02.157118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:02.173070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:02.173903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:02.178888 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-11bd7a98-2638-4111-a8d7-171f5d7a54cc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 0.907325 Oct 31 14:21:02.193338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:02.193338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:02.193338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:02.193338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:02.193338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:02.193338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:02.201802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1969/4196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:01 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:02.212711 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] HTTP exception thrown: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Request method failure captured: Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c HTTP/1.1 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9j2L2-4sGnoB4mjLiKFJ61t0bbN8Bd7H_xti7uiJYO_5qbPbf5qNrvkUZVxJlFl46y6q6bMtJ7IdbRZuCRzkNwnU-sdLlz3bCsNxbiIfVXVOhhdGx8klvVZpPg2Ok9w1Sqdh_OwHGbzJJgOfiiu9es75fXp-J2-iDFcWSRH6y5tAFo Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a9c77e61574c4725ac06c32c9f858560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 7f2e63e0b7bc4137a40010062e345b8f Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '679c6ed9-8d8f-47cb-b1c1-752bf554da3c'} Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:02.214426 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Returning 404 to user: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:02.218765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25f5460e-15dc-4442-a043-7bda208fc520 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 404 len: 111 microversion: 2.1 time: 0.048135 Oct 31 14:21:02.220156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2228/4197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:02 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:21:02.227629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1b0f749f-2772-472d-aaae-47f6e09b6157 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '.version_select at 0x7fe10fb86b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:02.276457 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1b0f749f-2772-472d-aaae-47f6e09b6157 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705860644" status: 202 len: 0 microversion: 2.1 time: 0.054011 Oct 31 14:21:02.279274 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1970/4198] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:21:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705860644 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:21:03.208169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:03.209080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:03.224141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:03.229988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:03.230598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:03.231402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:03.231939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:03.232435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:03.967886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70194594-a049-4e8a-bd97-e1ad8528c7fc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: .version_select at 0x7fe106b095e0>, body: {"keypair": {"name": "tempest-keypair-1747739063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5i+sLlZsPi2SPcSOZo5w7B7AvidKsr5q4Vt+DkmMhgmaoQQ6TxYnZrI5+teRL7uZkbuEdMwBPPD4mpYGtgmxsmA1ReWANEgo0W4xRBjv+Y+fb4EsQdbYfO5F6wxx9M2g=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:04.002852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-70194594-a049-4e8a-bd97-e1ad8528c7fc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for project a9c77e61574c4725ac06c32c9f858560. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:21:04.027774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-70194594-a049-4e8a-bd97-e1ad8528c7fc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for user 7f2e63e0b7bc4137a40010062e345b8f and project a9c77e61574c4725ac06c32c9f858560. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:21:04.066662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70194594-a049-4e8a-bd97-e1ad8528c7fc tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103577 Oct 31 14:21:04.074134 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1971/4199] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:21:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:21:04.297459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:04.306313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60af191d-e673-41cd-8e05-eadc8d0e9b75 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 1.103235 Oct 31 14:21:04.309788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2229/4200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:03 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:05.333381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:05.334013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:05.345988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:05.346582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:05.347035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:05.347753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:05.352440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:05.352963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:05.816342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:05.833168 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95b5639b-e6d3-48cc-bd44-a79fd1aaec7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 0.503783 Oct 31 14:21:05.847425 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1972/4201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:05 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:06.871201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:06.871829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:06.893284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:06.894092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:06.894727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:06.899138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:06.899774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:06.900399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:07.197401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:07.210954 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd9d1702-ea3f-47e6-8857-97d75371f710 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 0.355145 Oct 31 14:21:07.227203 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2230/4202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:06 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:07.821900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Calling method '.version_select at 0x7fe10fbddaf0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:07.849793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:07.851830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:07.852559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:07.854313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:07.856143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:07.856779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:07.895637 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ceb03f3-5c26-437e-82d2-9e3f4bc364d9 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.286978 Oct 31 14:21:07.897363 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1973/4203] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:07.957792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-833478785", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:08.000970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4f1c5527-b80b-4cbd-ad8f-c3f2c27b4ac3 req-b71df70b-1863-49df-8c9b-fae76aea7318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c2c342-ac89-4ca5-98f0-5cad14e05ad6", "name": "network-vif-plugged", "status": "completed", "tag": "782d392a-a5cb-401c-b1cc-ac4fb1e65d41"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:08.017373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4f1c5527-b80b-4cbd-ad8f-c3f2c27b4ac3 req-b71df70b-1863-49df-8c9b-fae76aea7318 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:08.020606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4f1c5527-b80b-4cbd-ad8f-c3f2c27b4ac3 req-b71df70b-1863-49df-8c9b-fae76aea7318 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:08.021312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4f1c5527-b80b-4cbd-ad8f-c3f2c27b4ac3 req-b71df70b-1863-49df-8c9b-fae76aea7318 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:08.039020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:21:08.053067 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4f1c5527-b80b-4cbd-ad8f-c3f2c27b4ac3 req-b71df70b-1863-49df-8c9b-fae76aea7318 service nova] Creating event network-vif-plugged:782d392a-a5cb-401c-b1cc-ac4fb1e65d41 for instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 on n-h1-863052-1 Oct 31 14:21:08.058574 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4f1c5527-b80b-4cbd-ad8f-c3f2c27b4ac3 req-b71df70b-1863-49df-8c9b-fae76aea7318 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062640 Oct 31 14:21:08.059575 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1974/4204] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:08.239121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:08.240202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:08.248819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:08.249391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:08.250047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:08.250878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:08.251556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:08.252756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:08.504075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:08.512505 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9fd961f2-e32a-4058-b074-afe766610f17 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1317 microversion: 2.1 time: 0.279741 Oct 31 14:21:08.513268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1975/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:08 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:08.519648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-288615554", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63bdd4f2-d320-4c7a-bb99-10f607099117"}], "security_groups": [{"name": "tempest-securitygroup--1282471567"}], "key_name": "tempest-keypair-1747739063", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:08.678912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] validate_networks() for [('63bdd4f2-d320-4c7a-bb99-10f607099117', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:21:08.981284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Getting quotas for project c537efada5b54b05a018fc2ae8677a62. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:21:08.992207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Getting quotas for user 97881d66788a4c70a35b93e6dc716440 and project c537efada5b54b05a018fc2ae8677a62. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:21:09.009601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Request method failure captured: Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 1751 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9nT9H1fbRt7EZeuXLK_KX8Ov2BLokJ_zI1TAwA8wYmSzjj_-_3zZJwTEAfJdqx-9rNMCFN-bcdRDo_dZH2d6b3ZsuTyMuIZ8dip7DWDFxLkJqghObsejwnUtlMjpUVCSFPA2IOCZHyNT-BSH0v2SnWHt0xoa5OjXeYvluYdXXKAbMk Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c537efada5b54b05a018fc2ae8677a62 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-694050898 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c537efada5b54b05a018fc2ae8677a62", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c537efada5b54b05a018fc2ae8677a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c537efada5b54b05a018fc2ae8677a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c537efada5b54b05a018fc2ae8677a62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-694050898 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c537efada5b54b05a018fc2ae8677a62 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-694050898 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-694050898-project Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 97881d66788a4c70a35b93e6dc716440 Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-694050898-project Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-833478785", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:21:09.012417 n-d-863052-1 devstack@n-api.service[120640]: exception: Maximum number of metadata items exceeds 128 Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-833478785', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:09.014793 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 31 14:21:09.017662 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:09.019707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:09.020722 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82f1b6c8-fc95-4e8e-9d7a-6152902d4fb1 tempest-AbsoluteLimitsNegativeTestJSON-694050898 tempest-AbsoluteLimitsNegativeTestJSON-694050898-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.067491 Oct 31 14:21:09.026392 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2231/4206] 10.222.0.27 () {60 vars in 1148 bytes} [Mon Oct 31 14:21:07 2022] POST /compute/v2.1/servers => generated 87 bytes in 1074 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:21:09.538850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:09.539806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:09.560768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:09.562957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:09.566060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:09.569169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:09.571574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:09.572367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:09.958922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:09.993508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc5c5a8c-8822-4da7-9b1b-7e00c85da642 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.459190 Oct 31 14:21:10.026656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2232/4207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:09 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:10.143519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:21:10.144567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:21:10.145835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:21:10.146864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:21:10.148034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:21:10.173289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:10.176646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:10.179111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:10.180631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:10.183513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:10.184438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:10.211103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981075497", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:10.248089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for project a9c77e61574c4725ac06c32c9f858560. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:21:10.260680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Getting quotas for user 7f2e63e0b7bc4137a40010062e345b8f and project a9c77e61574c4725ac06c32c9f858560. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:21:10.276316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:21:10.278613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:21:10.319600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] validate_networks() for [('9f8924a5-c038-416a-9512-8369ddd99493', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:21:10.374126 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f66d7e0a-78ca-466c-8a53-531422a3b917 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.857718 Oct 31 14:21:10.375901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1976/4208] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:21:10.406501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-334c1f1b-bcea-4943-b618-0e5cf95916ad tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:10.407154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-334c1f1b-bcea-4943-b618-0e5cf95916ad tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:10.577143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-334c1f1b-bcea-4943-b618-0e5cf95916ad tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:10.606742 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-334c1f1b-bcea-4943-b618-0e5cf95916ad tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1237 microversion: 2.1 time: 0.216138 Oct 31 14:21:10.610452 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1977/4209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:10 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1237 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:11.636707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:11.639016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:11.652167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:11.652934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:11.654370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:11.655557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:11.656174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:11.656944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:11.821307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:11.839852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cde791e8-0f04-464c-b3c3-ec7efee2f7b0 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1233 microversion: 2.1 time: 0.208257 Oct 31 14:21:11.840696 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1978/4210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:11 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1233 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:12.247257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:21:12.249569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:21:12.250412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:21:12.251597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:21:12.253629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:21:12.257400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:12.284307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:12.285062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:12.285863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:12.288627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:12.289249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:12.290750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:12.317014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:12.393679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Getting quotas for project 51dc0b8f573048159de0a59092c3e547. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:21:12.412145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Getting quotas for user 09698dbdb79d475aba0d84611879f2e3 and project 51dc0b8f573048159de0a59092c3e547. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:21:12.431644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:21:12.442646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:21:12.543028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b46631a-a05b-493a-86cf-c253e879c4f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.337121 Oct 31 14:21:12.544271 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2233/4211] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:21:12.555805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63a702b0-ba87-425c-9b11-d35cec6a2ed3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:12.556428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63a702b0-ba87-425c-9b11-d35cec6a2ed3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:12.685135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63a702b0-ba87-425c-9b11-d35cec6a2ed3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:12.694062 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63a702b0-ba87-425c-9b11-d35cec6a2ed3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1216 microversion: 2.1 time: 0.142158 Oct 31 14:21:12.695765 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1979/4212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:12 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:12.865022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:12.865966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:12.874282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:12.874829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:12.885977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:12.891133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:12.894153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:12.904942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:13.280305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:13.301857 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72228812-8210-4621-bf1e-efe414f17b0b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1307 microversion: 2.1 time: 0.440113 Oct 31 14:21:13.304467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2234/4213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:12 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1307 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:13.718136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:13.719468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:13.724907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:13.755569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:13.756537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:13.758269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:13.759255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:13.759920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:13.760355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:14.025960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:14.036215 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a91e66f-defa-40e2-ad6f-2272d06e5634 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1212 microversion: 2.1 time: 0.321894 Oct 31 14:21:14.042631 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1980/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:13 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1212 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:14.328964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:14.330244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:14.341765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:14.342287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:14.342722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:14.343416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:14.346872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:14.347317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:14.546483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:14.565440 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36cae790-3640-4f09-97cc-c68e64a9ba56 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1295 microversion: 2.1 time: 0.238349 Oct 31 14:21:14.586586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2235/4215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:14 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1295 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:15.068864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:15.070304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:15.081067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:15.082442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:15.083127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:15.084229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:15.085048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:15.085801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:15.321624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:15.334357 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca8ad3c0-7191-4528-aee8-e210574efd2c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1274 microversion: 2.1 time: 0.269852 Oct 31 14:21:15.351063 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1981/4216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:15 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:15.590996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:15.592310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:15.600433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:15.605408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:15.607001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:15.607974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:15.610575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:15.612318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:16.011203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:16.031268 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05ada251-eab5-4d04-b3ca-208b4f77b9cf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.433023 Oct 31 14:21:16.032189 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2236/4217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:15 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:16.362294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:16.363239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:16.382462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:16.383746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:16.385005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:16.389550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:16.390833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:16.393608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:16.596004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:16.613435 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-388496c2-af6a-4e5e-a838-ddc1de918fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1274 microversion: 2.1 time: 0.253275 Oct 31 14:21:16.615335 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1982/4218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:16 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:17.057922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:17.058601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:17.079567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:17.080622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:17.081181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:17.081898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:17.083313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:17.083759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:17.640835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:17.641513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:17.658897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:17.659686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:17.660330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:17.661281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:17.661944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:17.662629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:17.938393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:17.951616 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24961720-1bbe-426e-9743-895efda07705 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.897577 Oct 31 14:21:17.967932 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2237/4219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:17 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:18.367343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-58774128-8efc-4caa-8dea-8948a6f54054 req-d8e3e890-2c42-44cd-b929-ba758c57c1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992e8f7b-3c0f-4675-b126-64a54baef38e", "tag": "2ca06734-78d6-49a9-bf3e-7bc77c30f8e0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:18.398669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58774128-8efc-4caa-8dea-8948a6f54054 req-d8e3e890-2c42-44cd-b929-ba758c57c1b5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:18.401170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58774128-8efc-4caa-8dea-8948a6f54054 req-d8e3e890-2c42-44cd-b929-ba758c57c1b5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:18.402589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58774128-8efc-4caa-8dea-8948a6f54054 req-d8e3e890-2c42-44cd-b929-ba758c57c1b5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:18.434958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-58774128-8efc-4caa-8dea-8948a6f54054 req-d8e3e890-2c42-44cd-b929-ba758c57c1b5 service nova] Creating event network-changed:2ca06734-78d6-49a9-bf3e-7bc77c30f8e0 for instance 992e8f7b-3c0f-4675-b126-64a54baef38e on n-h2-863052-1 Oct 31 14:21:18.441367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-58774128-8efc-4caa-8dea-8948a6f54054 req-d8e3e890-2c42-44cd-b929-ba758c57c1b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080067 Oct 31 14:21:18.442914 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2238/4220] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:18.977644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:18.978636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:18.985435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:18.986054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:18.986578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:18.987367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:18.987892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:18.988532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:19.308329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:19.323073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db7b1a28-624a-4cae-880b-00eaef93cefc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 1.686124 Oct 31 14:21:19.330090 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1983/4221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:17 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:19.867584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:19.880894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-551ccc3e-8077-4f14-9625-ae0e4806adfe tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.907409 Oct 31 14:21:19.881727 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2239/4222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:18 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:20.352462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:20.353083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:20.359911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:20.365093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:20.365862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:20.367661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:20.370696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:20.373934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:20.374697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:20.911260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:20.912038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:20.926474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:20.931075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:20.931795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:20.932759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:20.933443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:20.934091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:21.039058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:21.050417 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-53ca8c20-971b-4614-a037-c69c6f98372e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.701896 Oct 31 14:21:21.055327 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1984/4223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:20 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:21.337432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:21.368183 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cabb57b3-63f8-43ac-9d85-b847d4cfe7f1 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.461986 Oct 31 14:21:21.369234 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2240/4224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:20 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:21.836824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c6a77adc-3124-4c2b-b631-81b166ae807d req-ac6cafb2-5d32-4fa9-9d88-b26a2006b110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c1698c-2f83-4f1f-a7ab-8f6c9d0be948", "tag": "dc54d880-f29b-46a3-a58a-8d8307a07f9e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:21.860508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c6a77adc-3124-4c2b-b631-81b166ae807d req-ac6cafb2-5d32-4fa9-9d88-b26a2006b110 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:21.861780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c6a77adc-3124-4c2b-b631-81b166ae807d req-ac6cafb2-5d32-4fa9-9d88-b26a2006b110 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:21.863336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c6a77adc-3124-4c2b-b631-81b166ae807d req-ac6cafb2-5d32-4fa9-9d88-b26a2006b110 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:21.877551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c6a77adc-3124-4c2b-b631-81b166ae807d req-ac6cafb2-5d32-4fa9-9d88-b26a2006b110 service nova] Creating event network-changed:dc54d880-f29b-46a3-a58a-8d8307a07f9e for instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 on n-h1-863052-1 Oct 31 14:21:21.883298 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c6a77adc-3124-4c2b-b631-81b166ae807d req-ac6cafb2-5d32-4fa9-9d88-b26a2006b110 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062921 Oct 31 14:21:21.884608 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1985/4225] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:22.075130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:22.076278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:22.088570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:22.089060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:22.089496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:22.090269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:22.090674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:22.091089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:22.400851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:22.401574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:22.415646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:22.416161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:22.416887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:22.417674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:22.418097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:22.418562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:22.556499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:22.557313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:22.712431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:22.965006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:22.977749 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26e5a259-652b-4b05-abed-4f1b61fd6bcd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.907480 Oct 31 14:21:22.981205 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2241/4226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:22 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:23.064123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:23.073223 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe3fef40-2490-46d5-b329-4e4d6098bf2d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.681571 Oct 31 14:21:23.079286 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1986/4227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:22 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:24.003682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:24.009026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:24.029052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:24.030009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:24.030448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:24.031274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:24.031761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:24.032184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:24.110450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:24.111688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:24.126391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:24.131973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:24.132717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:24.134499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:24.135144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:24.136977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:24.198206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:24.525738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:24.534551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da180b6b-22c0-4aba-a0ed-e4ca8d145abe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.534787 Oct 31 14:21:24.535814 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2242/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:23 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:24.660027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:24.674546 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63030cab-7f62-48e4-a755-d9342eeb6e6b tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.564765 Oct 31 14:21:24.692429 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1987/4229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:24 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:25.559605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:25.560869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:25.568480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:25.568974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:25.569412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:25.570117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:25.577246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:25.578879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:25.701453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:25.703859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:25.720619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:25.730990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:25.732382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:25.735445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:25.736545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:25.742724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:26.189531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:26.200623 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0741dde9-b791-428a-871d-55f500123f18 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.644898 Oct 31 14:21:26.204006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2243/4230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:25 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:26.672197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:26.694671 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34193cf3-fbc3-4006-9a1d-b8ae6b502a53 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 0.992758 Oct 31 14:21:26.700390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1988/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:25 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:27.231519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:27.232207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:27.242350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:27.249847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:27.255191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:27.255950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:27.266295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:27.266970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:27.631304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-444475a3-a8da-4fff-a479-9a30d31190b8 req-20cd3359-4e4d-4ef5-bda3-c28f533e4296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992e8f7b-3c0f-4675-b126-64a54baef38e", "name": "network-vif-plugged", "status": "completed", "tag": "2ca06734-78d6-49a9-bf3e-7bc77c30f8e0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:27.712470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-444475a3-a8da-4fff-a479-9a30d31190b8 req-20cd3359-4e4d-4ef5-bda3-c28f533e4296 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:27.713052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-444475a3-a8da-4fff-a479-9a30d31190b8 req-20cd3359-4e4d-4ef5-bda3-c28f533e4296 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:27.713502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-444475a3-a8da-4fff-a479-9a30d31190b8 req-20cd3359-4e4d-4ef5-bda3-c28f533e4296 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:27.760855 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-444475a3-a8da-4fff-a479-9a30d31190b8 req-20cd3359-4e4d-4ef5-bda3-c28f533e4296 service nova] Creating event network-vif-plugged:2ca06734-78d6-49a9-bf3e-7bc77c30f8e0 for instance 992e8f7b-3c0f-4675-b126-64a54baef38e on n-h2-863052-1 Oct 31 14:21:27.778879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-444475a3-a8da-4fff-a479-9a30d31190b8 req-20cd3359-4e4d-4ef5-bda3-c28f533e4296 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161174 Oct 31 14:21:27.787173 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1989/4232] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:27.797067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:27.797785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:27.827389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:27.827896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:27.828347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:27.829069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:27.830059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:27.830565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:27.864487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:27.881817 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6fd4c08-9c81-47d8-bfcf-52dc68486f89 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.652145 Oct 31 14:21:27.882467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2244/4233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:27 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:28.908853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:28.909525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:28.925943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:28.926511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:28.927154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:28.928616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:28.929293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:28.929744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:28.956920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:28.969071 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86c711b7-35d0-43c4-b8a7-5415242e8c03 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1363 microversion: 2.1 time: 1.180502 Oct 31 14:21:28.970907 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1990/4234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:27 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1363 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:29.613947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:29.629268 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b621135c-1e88-4ec3-b693-f3c47037192b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.724701 Oct 31 14:21:29.630436 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2245/4235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:28 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:29.999311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:30.000248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:30.013918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:30.017321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:30.017871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:30.021263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:30.021837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:30.022697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:30.496248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:30.509728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6952908f-d2a8-42f5-aea0-4a35bb12f137 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1548 microversion: 2.1 time: 0.514170 Oct 31 14:21:30.514147 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1991/4236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:29 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1548 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:30.539549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:30.540079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:30.555123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:30.555628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:30.556080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:30.556802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:30.557442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:30.558032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:30.657292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:30.659657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:30.671918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:30.674301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:30.690135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:30.696134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:30.697119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:30.700267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:31.049623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:31.059775 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fe45497-9bb4-45aa-aefd-2f549ad6dffb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.406995 Oct 31 14:21:31.069020 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1992/4237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:30 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:31.453036 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3463d5c-fd07-4adb-b6db-42140a01e76e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.917478 Oct 31 14:21:31.453659 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2246/4238] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:21:30 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-interface => generated 284 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:31.946322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c07c93f8-48a5-492f-8b58-3f639a62cb46 req-64b7d8d6-7d37-431a-82d2-215a94c281c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c1698c-2f83-4f1f-a7ab-8f6c9d0be948", "name": "network-vif-plugged", "status": "completed", "tag": "dc54d880-f29b-46a3-a58a-8d8307a07f9e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:31.973748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c07c93f8-48a5-492f-8b58-3f639a62cb46 req-64b7d8d6-7d37-431a-82d2-215a94c281c3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:31.974931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c07c93f8-48a5-492f-8b58-3f639a62cb46 req-64b7d8d6-7d37-431a-82d2-215a94c281c3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:31.975553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c07c93f8-48a5-492f-8b58-3f639a62cb46 req-64b7d8d6-7d37-431a-82d2-215a94c281c3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:32.018557 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c07c93f8-48a5-492f-8b58-3f639a62cb46 req-64b7d8d6-7d37-431a-82d2-215a94c281c3 service nova] Creating event network-vif-plugged:dc54d880-f29b-46a3-a58a-8d8307a07f9e for instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 on n-h1-863052-1 Oct 31 14:21:32.029224 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c07c93f8-48a5-492f-8b58-3f639a62cb46 req-64b7d8d6-7d37-431a-82d2-215a94c281c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087268 Oct 31 14:21:32.032063 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1993/4239] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:32.095760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:32.096584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:32.110961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:32.114092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:32.118372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:32.119973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:32.120469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:32.122678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:32.821295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:32.837225 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-400c12b2-3233-4ecf-93cd-a4ba986644bc tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1316 microversion: 2.1 time: 0.747831 Oct 31 14:21:32.838872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2247/4240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:32 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:33.862656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:33.864530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:33.898215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:33.901207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:33.902319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:33.911999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:33.916766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:33.921890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:34.155761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a7ec6dd-03be-41f5-9c23-5e588cd76915 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe107f2bf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1679061898", "description": "tempest-description-919697664"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:34.593605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:34.605316 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc3696fe-ab79-48e1-a37d-a0955fcbeba6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1506 microversion: 2.1 time: 0.747506 Oct 31 14:21:34.627131 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2248/4241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:33 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:34.644260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:34.646310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:34.663555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:34.669236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:34.669977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:34.671253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:34.672395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:34.673412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:34.746410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:21:34.867940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:34.951428 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3e16073-0ba1-4b1a-aa12-f93e8bb4006f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 204 len: 0 microversion: 2.1 time: 0.321231 Oct 31 14:21:34.952043 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2249/4242] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:21:34 2022] DELETE /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:21:34.963694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:34.966875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:34.983708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:34.984525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:34.985160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:34.987076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:34.988671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:34.989267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:35.321419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:35.333007 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99055762-6667-47cd-8601-ebf15a511922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1512 microversion: 2.1 time: 0.375870 Oct 31 14:21:35.334839 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2250/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:34 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:35.560489 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a7ec6dd-03be-41f5-9c23-5e588cd76915 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.749361 Oct 31 14:21:35.561333 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1994/4244] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:21:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:35.574759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf852d9c-8f8a-4a71-b35d-dbf06ba3a338 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe106440160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-870123608", "description": "tempest-description-1756164832"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:35.794120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d4f8ab75-970e-4fda-84bf-108244602eba req-148473b7-c2a2-4032-9ffd-ad321c58bc8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992e8f7b-3c0f-4675-b126-64a54baef38e", "tag": "2ca06734-78d6-49a9-bf3e-7bc77c30f8e0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:35.830103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d4f8ab75-970e-4fda-84bf-108244602eba req-148473b7-c2a2-4032-9ffd-ad321c58bc8f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:35.835494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d4f8ab75-970e-4fda-84bf-108244602eba req-148473b7-c2a2-4032-9ffd-ad321c58bc8f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:35.837572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d4f8ab75-970e-4fda-84bf-108244602eba req-148473b7-c2a2-4032-9ffd-ad321c58bc8f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:35.875208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d4f8ab75-970e-4fda-84bf-108244602eba req-148473b7-c2a2-4032-9ffd-ad321c58bc8f service nova] Creating event network-changed:2ca06734-78d6-49a9-bf3e-7bc77c30f8e0 for instance 992e8f7b-3c0f-4675-b126-64a54baef38e on n-h2-863052-1 Oct 31 14:21:35.891048 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d4f8ab75-970e-4fda-84bf-108244602eba req-148473b7-c2a2-4032-9ffd-ad321c58bc8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104320 Oct 31 14:21:35.901918 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1995/4245] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:21:36.120234 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf852d9c-8f8a-4a71-b35d-dbf06ba3a338 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.549719 Oct 31 14:21:36.126962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2251/4246] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:21:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:36.362745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:36.364770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:36.404861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-667039835", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "84a39bcc-6a8e-4ec2-9898-abb1247f91c2"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:36.411080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:36.413915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:36.415263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:36.419396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:36.420074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:36.423785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:36.884620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] validate_networks() for [('84a39bcc-6a8e-4ec2-9898-abb1247f91c2', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:21:37.928117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:21:37.928607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:21:37.929010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:21:37.929428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:21:37.929846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:21:37.945017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:37.945517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:37.945963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:37.948181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:37.950584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:37.951848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:38.007088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Getting quotas for project 6a0c3a55e468402da1424750fc0ddd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:21:38.026425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Getting quotas for user 8117f4d2a50f416d92466798b7c2d5fc and project 6a0c3a55e468402da1424750fc0ddd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:21:38.055741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:21:38.058621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:21:38.149816 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cbfd261-36f3-4c35-a1db-6f35fdee0239 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.752714 Oct 31 14:21:38.157786 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2252/4247] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:21:38.163507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ecd3afd-ff6a-4c4d-aafa-1eb2ef502534 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:38.164391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ecd3afd-ff6a-4c4d-aafa-1eb2ef502534 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:38.296210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ecd3afd-ff6a-4c4d-aafa-1eb2ef502534 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:38.318700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:38.320315 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ecd3afd-ff6a-4c4d-aafa-1eb2ef502534 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1215 microversion: 2.1 time: 0.160938 Oct 31 14:21:38.332042 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01e7a790-57c0-4f2e-98d4-c4ec1000ac77 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1512 microversion: 2.1 time: 1.976412 Oct 31 14:21:38.338789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2253/4248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:38 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:38.352127 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1996/4249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:36 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1512 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:39.347942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:39.348757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:39.360327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:39.361516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:39.370555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:39.371396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:39.372417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:39.373953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:39.374386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:39.375699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:39.376335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:39.376990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:39.377797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:39.378659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:39.380759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:39.381985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:39.690497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:39.710842 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81595f60-adcd-4f66-b2c6-9cbb140213e0 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1219 microversion: 2.1 time: 0.366493 Oct 31 14:21:39.711620 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2254/4250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:39 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1219 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:39.744542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2eaea4ac-bde3-4cfb-bb3c-b7c2b27b4f48 req-a729a806-19aa-4fa4-a485-3964c2bd3910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c1698c-2f83-4f1f-a7ab-8f6c9d0be948", "name": "network-vif-deleted", "tag": "dc54d880-f29b-46a3-a58a-8d8307a07f9e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:39.762982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:39.788300 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e7cfd7e-b10a-4684-ac01-4c1f28cdc140 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 200 len: 1470 microversion: 2.1 time: 0.431603 Oct 31 14:21:39.789816 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1997/4251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:39 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 1470 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:39.792294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2eaea4ac-bde3-4cfb-bb3c-b7c2b27b4f48 req-a729a806-19aa-4fa4-a485-3964c2bd3910 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:39.801394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2eaea4ac-bde3-4cfb-bb3c-b7c2b27b4f48 req-a729a806-19aa-4fa4-a485-3964c2bd3910 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:39.802134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2eaea4ac-bde3-4cfb-bb3c-b7c2b27b4f48 req-a729a806-19aa-4fa4-a485-3964c2bd3910 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:39.867838 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2eaea4ac-bde3-4cfb-bb3c-b7c2b27b4f48 req-a729a806-19aa-4fa4-a485-3964c2bd3910 service nova] Creating event network-vif-deleted:dc54d880-f29b-46a3-a58a-8d8307a07f9e for instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 on n-h1-863052-1 Oct 31 14:21:39.890949 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2eaea4ac-bde3-4cfb-bb3c-b7c2b27b4f48 req-a729a806-19aa-4fa4-a485-3964c2bd3910 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175853 Oct 31 14:21:39.895026 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2255/4252] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:40.738618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:40.739263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:40.753487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:40.756765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:40.757323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:40.759423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:40.761104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:40.761574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:40.817484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:40.818969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:40.831000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:40.834603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:40.835609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:40.840051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:40.841010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:40.841697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:40.877431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 HTTP/1.1 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '44c1698c-2f83-4f1f-a7ab-8f6c9d0be948'} Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:40.883952 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:21:40.887974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:40.891256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:40.901824 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ead9f670-47d9-4b85-b964-8a18cde197e8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 404 len: 111 microversion: 2.1 time: 0.090783 Oct 31 14:21:40.907477 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2256/4253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:40 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:21:40.913601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:40.914626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:40.929167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:40.931702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:40.937415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:40.938647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:40.939352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:40.940020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:41.014217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:41.024650 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e344115-1779-4609-ac29-5ac3db147576 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1275 microversion: 2.1 time: 0.292947 Oct 31 14:21:41.030703 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1998/4254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:40 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:41.388368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:41.410854 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44bc9511-3217-4f2d-b61c-52f8944fad03 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.500920 Oct 31 14:21:41.413151 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2257/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:40 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:41.666812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30218c99-ba86-4c6f-8cc5-0914771959b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30218c99-ba86-4c6f-8cc5-0914771959b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 163 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": 12345, "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 12345 Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:21:41.672144 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 14:21:41.676604 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:41.682751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30218c99-ba86-4c6f-8cc5-0914771959b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:41.683876 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30218c99-ba86-4c6f-8cc5-0914771959b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.021964 Oct 31 14:21:41.690368 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1999/4256] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:41 2022] POST /compute/v2.1/servers => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:21:41.697958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:41.698767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:41.715917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:41.716455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:41.726362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:41.728331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:41.729831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:41.730869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:42.057606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:42.059267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:42.075598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:42.076494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:42.078328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:42.082041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:42.083511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:42.085140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:42.356355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:42.371672 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a1ed997-19c6-4d01-9e1b-8a73787041f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1273 microversion: 2.1 time: 0.319072 Oct 31 14:21:42.372486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2000/4257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:42 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:42.481056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:42.492805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbfd87e1-cfd9-4c0a-9cb8-fb2b16fc4542 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.798880 Oct 31 14:21:42.508224 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2258/4258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:41 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:42.521990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:42.522910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:42.534429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:42.534933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:42.535378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:42.536092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:42.539197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:42.539880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:43.109676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:43.121867 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-030cdb70-386a-4cb3-b6d0-9ca301660ca5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.605204 Oct 31 14:21:43.122754 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2001/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:42 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:43.398980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:43.400512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:43.422216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:43.426428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:43.428998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:43.429711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:43.432863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:43.434646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:43.437670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:44.116110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:44.157501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fcb1640-e720-4bdc-9c70-8ad7583d17ca tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1315 microversion: 2.1 time: 0.762282 Oct 31 14:21:44.158947 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2259/4260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:43 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:45.182476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:45.183349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:45.197402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=40 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:45.199595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:45.200499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:45.202078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:45.203807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:45.205038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:45.206008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:45.643125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:45.667210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0473cd15-57c4-40ab-85ac-07fb223edf50 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1315 microversion: 2.1 time: 0.478338 Oct 31 14:21:45.667868 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2002/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:45 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:45.673667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1a6515e6-bb9a-4f70-8d1b-f1f811cdd33b req-99aa7d09-2836-4626-9963-54faf097da52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230412fe-c163-48f5-90ab-4edcf0ad57b2", "tag": "412833dd-d9f4-495d-a3a6-5dede3ed7ff5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:45.693143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a6515e6-bb9a-4f70-8d1b-f1f811cdd33b req-99aa7d09-2836-4626-9963-54faf097da52 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:45.693622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a6515e6-bb9a-4f70-8d1b-f1f811cdd33b req-99aa7d09-2836-4626-9963-54faf097da52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:45.694053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a6515e6-bb9a-4f70-8d1b-f1f811cdd33b req-99aa7d09-2836-4626-9963-54faf097da52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:45.725051 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1a6515e6-bb9a-4f70-8d1b-f1f811cdd33b req-99aa7d09-2836-4626-9963-54faf097da52 service nova] Creating event network-changed:412833dd-d9f4-495d-a3a6-5dede3ed7ff5 for instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 on n-h2-863052-1 Oct 31 14:21:45.741254 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1a6515e6-bb9a-4f70-8d1b-f1f811cdd33b req-99aa7d09-2836-4626-9963-54faf097da52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072551 Oct 31 14:21:45.743141 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2260/4262] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:46.512944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2178b6a1-ae9a-43d8-9812-80e640a69daf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063638581", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b7b4291d-dfb7-4b6f-8ac5-061e473162ed", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:46.649203 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2178b6a1-ae9a-43d8-9812-80e640a69daf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Block Device b7b4291d-dfb7-4b6f-8ac5-061e473162ed is not bootable. Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2178b6a1-ae9a-43d8-9812-80e640a69daf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 358 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063638581", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b7b4291d-dfb7-4b6f-8ac5-061e473162ed", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: exception: Block Device b7b4291d-dfb7-4b6f-8ac5-061e473162ed is not bootable. Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2063638581', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b7b4291d-dfb7-4b6f-8ac5-061e473162ed'}], 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b7b4291d-dfb7-4b6f-8ac5-061e473162ed is not bootable. Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:46.658683 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b7b4291d-dfb7-4b6f-8ac5-061e473162ed is not bootable. Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b7b4291d-dfb7-4b6f-8ac5-061e473162ed is not bootable. Oct 31 14:21:46.662103 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:46.664847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2178b6a1-ae9a-43d8-9812-80e640a69daf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Block Device b7b4291d-dfb7-4b6f-8ac5-061e473162ed is not bootable. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:46.665812 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2178b6a1-ae9a-43d8-9812-80e640a69daf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.157218 Oct 31 14:21:46.666455 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2003/4263] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:21:46.681980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:46.683157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:46.692811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:46.693024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:46.693427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:46.693960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:46.694355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:46.695302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:46.696173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:46.697757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:46.708200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:46.709809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:46.713133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:46.714840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:46.716548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:46.718619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:46.917943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:46.928303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d40d7cbf-534f-4c5c-bbea-0a8cd50213d2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.256661 Oct 31 14:21:46.928900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2261/4264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:46 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:46.958890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:46.960955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:46.969728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:46.972739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:46.973699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:46.974480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:46.975410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:46.976119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:47.151801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:47.165104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7e19b31-ee35-4e25-9960-41e8fbb93508 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.210660 Oct 31 14:21:47.166884 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2262/4265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:46 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:47.269121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:47.281679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6761e1f1-beaa-4d93-b40c-8cd3124df9f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1315 microversion: 2.1 time: 0.592237 Oct 31 14:21:47.297296 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2004/4266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:46 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:48.305824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:48.307121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:48.325099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:48.330222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:48.335837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:48.339159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:48.342987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:48.345038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:48.346822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:48.347683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:48.753510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:48.754029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:48.763542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:48.766648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:48.767100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:48.770766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:48.771249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:48.774335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:48.833086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:21:49.003704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f56b855-f5e0-45f0-8cc1-3a9ae5ba5691 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 204 len: 0 microversion: 2.32 time: 0.694533 Oct 31 14:21:49.005659 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2005/4267] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:21:48 2022] DELETE /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 14:21:49.016110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:49.017130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:49.035030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:49.035925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:49.038606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:49.040056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:49.040736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:49.044011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:49.104615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:49.118776 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f663987b-f3ba-46e0-a889-84df35e15745 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1315 microversion: 2.1 time: 0.814177 Oct 31 14:21:49.121987 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2263/4268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:48 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:49.460173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:49.503847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:49.507847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:49.510393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2731b94a-f023-4b5d-83ad-4cd4c80cadda tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2954 microversion: 2.32 time: 0.499993 Oct 31 14:21:49.514964 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2006/4269] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:21:49 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2954 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:21:50.025931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3b0adca-9cc0-4055-bddb-8d02480136be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089304920", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "destination_type": "local"}, {"source_type": "volume", "uuid": "951146d7-c611-483c-b4c0-58a05d60b00a", "destination_type": "invalid"}], "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3b0adca-9cc0-4055-bddb-8d02480136be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 495 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089304920", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "destination_type": "local"}, {"source_type": "volume", "uuid": "951146d7-c611-483c-b4c0-58a05d60b00a", "destination_type": "invalid"}], "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2089304920', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '951146d7-c611-483c-b4c0-58a05d60b00a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:50.034656 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 14:21:50.038638 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:50.049749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3b0adca-9cc0-4055-bddb-8d02480136be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:50.051111 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3b0adca-9cc0-4055-bddb-8d02480136be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030301 Oct 31 14:21:50.052497 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2264/4270] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:50 2022] POST /compute/v2.1/servers => generated 155 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:21:50.061122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:50.061729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:50.071138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.072484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.073366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.074329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.075495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.076109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.082180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:50.150601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:50.151365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:50.171614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.172137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.174867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.177931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.179757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.180203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.508219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:50.522860 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2487ad7-7f86-4886-91f9-c6689b2431b8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1315 microversion: 2.1 time: 0.377084 Oct 31 14:21:50.524483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2265/4271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:50 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:50.599272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Calling method '.version_select at 0x7fe106225820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:50.601425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.602187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.602893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.632967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.633475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.633930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.655609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.657127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.657787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.667406 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4ec1aea-9fe4-4d86-8de3-c118e05777f3 tempest-PortsAdminExtendedAttrsTestJSON-1345972318 tempest-PortsAdminExtendedAttrsTestJSON-1345972318-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.140700 Oct 31 14:21:50.668580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2266/4272] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:21:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:50.675257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:50.676331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:50.687531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.688465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.689120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.690862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.691546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.692557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.783234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:50.792164 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec11aa87-f216-44fc-ae38-38928739b2d1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.735133 Oct 31 14:21:50.792755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2007/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:50 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:50.797539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-80195bd2-5cc1-45ee-a3b8-b5aacbee9252 req-a76a062e-33fc-4ad7-b3aa-d83eacdbc666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230412fe-c163-48f5-90ab-4edcf0ad57b2", "name": "network-vif-plugged", "status": "completed", "tag": "412833dd-d9f4-495d-a3a6-5dede3ed7ff5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:50.807007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-80195bd2-5cc1-45ee-a3b8-b5aacbee9252 req-a76a062e-33fc-4ad7-b3aa-d83eacdbc666 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.807751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-80195bd2-5cc1-45ee-a3b8-b5aacbee9252 req-a76a062e-33fc-4ad7-b3aa-d83eacdbc666 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.810766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-80195bd2-5cc1-45ee-a3b8-b5aacbee9252 req-a76a062e-33fc-4ad7-b3aa-d83eacdbc666 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.824650 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-80195bd2-5cc1-45ee-a3b8-b5aacbee9252 req-a76a062e-33fc-4ad7-b3aa-d83eacdbc666 service nova] Creating event network-vif-plugged:412833dd-d9f4-495d-a3a6-5dede3ed7ff5 for instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 on n-h2-863052-1 Oct 31 14:21:50.830844 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-80195bd2-5cc1-45ee-a3b8-b5aacbee9252 req-a76a062e-33fc-4ad7-b3aa-d83eacdbc666 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036742 Oct 31 14:21:50.832564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2008/4274] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:50.838287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:50.839168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:50.846933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.847663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.848260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:50.849123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:50.849725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:50.850392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.136668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:51.154716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bef02c30-9e91-45d2-b48a-32dbae63dc72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.320154 Oct 31 14:21:51.166523 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2009/4275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:50 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:51.224626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7e06621-4bee-4ded-9f67-9c7bafa131d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1286124706", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7e06621-4bee-4ded-9f67-9c7bafa131d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 492 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1286124706", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1286124706', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.229706 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 14:21:51.232983 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:51.235905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7e06621-4bee-4ded-9f67-9c7bafa131d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:51.236766 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7e06621-4bee-4ded-9f67-9c7bafa131d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016130 Oct 31 14:21:51.237555 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2010/4276] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:51 2022] POST /compute/v2.1/servers => generated 624 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:21:51.245758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:51.246671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:51.254346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:51.255055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:51.255670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.256556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:51.257182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:51.257770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.380087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:51.392078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:51.394032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:51.395423 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30ea4f3d-3094-4e92-800a-2944f210e09f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2954 microversion: 2.32 time: 0.725448 Oct 31 14:21:51.415830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2267/4277] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:21:50 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2954 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:21:51.494833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:51.510617 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d120dd4-c8d1-4a18-974b-1c3149acd0b7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.268335 Oct 31 14:21:51.512356 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2011/4278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:51 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:51.536552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:51.537538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:51.549027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:51.549932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:51.553016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:51.553313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:51.553753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.555239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:51.555650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:51.556079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.557239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:51.557909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:51.558543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.559420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:51.560029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:51.560605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:51.907139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:51.953134 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f1387cb9-e9b7-42c9-af98-6afe061d7d5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1315 microversion: 2.1 time: 0.408418 Oct 31 14:21:51.954047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2012/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:51 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:52.011877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:52.051464 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f10a18b7-296a-40b0-b94e-5af33477fd72 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.519351 Oct 31 14:21:52.052562 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2268/4280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:51 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:52.149685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e193c07-e25d-495b-a24b-ea7552f46ba8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e193c07-e25d-495b-a24b-ea7552f46ba8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 416 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.153664 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:21:52.157669 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:52.164821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e193c07-e25d-495b-a24b-ea7552f46ba8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:52.166782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e193c07-e25d-495b-a24b-ea7552f46ba8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.021136 Oct 31 14:21:52.179131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:52.180154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:52.182357 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2013/4281] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:52 2022] POST /compute/v2.1/servers => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:21:52.189312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:52.191215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:52.192017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:52.192766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:52.194097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:52.196858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:52.427538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:52.429122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:52.438968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:52.439904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:52.440574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:52.441508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:52.442202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:52.442866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:52.613938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:52.643359 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4223890-6747-4b91-9653-05e4c6b4d31a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.468014 Oct 31 14:21:52.645504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2269/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:52 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:52.685700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:52.688011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:52.703954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:52.704777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:52.714943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:52.715731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:52.716188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:52.716786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.081480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:53.094009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:53.100210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:53.103453 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67c695d8-7a5b-4e88-86e6-0abc66c481d1 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2954 microversion: 2.32 time: 0.682219 Oct 31 14:21:53.104037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2014/4283] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:21:52 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2954 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:21:53.133997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:53.134645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:53.135629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:53.144346 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2738789-4632-407f-906c-bbf49aab2f8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.472897 Oct 31 14:21:53.151669 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2270/4284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:52 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:53.176309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.177307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.179386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.181266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.186913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.187632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.268801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd02da8f-49b4-4316-8968-a7d289d4a5f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-746190285", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": -1, "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:53.294097 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bd02da8f-49b4-4316-8968-a7d289d4a5f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Flavor -1 could not be found. Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd02da8f-49b4-4316-8968-a7d289d4a5f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 205 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-746190285", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": -1, "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor -1 could not be found. Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-746190285', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': -1, 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:53.296803 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd02da8f-49b4-4316-8968-a7d289d4a5f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd02da8f-49b4-4316-8968-a7d289d4a5f7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.033980 Oct 31 14:21:53.300833 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2271/4285] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:53.310193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:53.319157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:53.331642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.332219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.332559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.333271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.333724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.334148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.537202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:53.548968 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f32f4b4a-68a6-471c-b613-dffff7e2110b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1501 microversion: 2.1 time: 0.418587 Oct 31 14:21:53.552259 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2015/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:53 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1501 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:53.583355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1679061898"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:53.584041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:53.594062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.600912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.601654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.602601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.603177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.603784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.766262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:53.781324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-493f12b2-d4bf-4af3-ad5f-43f4568991a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.473740 Oct 31 14:21:53.784620 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2272/4287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:53 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:53.818159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:53.819287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:53.829496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.829987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.831341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.832455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:53.833121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:53.834097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:53.842960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:54.101698 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Adding security group b084a636-e318-4adf-921d-1166c7a256f1 to port 412833dd-d9f4-495d-a3a6-5dede3ed7ff5 Oct 31 14:21:54.534072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:54.548447 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cfe42286-6b23-4d90-a243-f901e7806b1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.738674 Oct 31 14:21:54.549194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2273/4288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:53 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:54.560718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:54.561638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:54.581466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:54.582213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:54.582872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:54.584043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:54.584696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:54.585328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:55.374298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:55.410529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:55.412715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:55.415113 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3d5aea7a-be63-4f71-adfa-0ab6597e5985 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2933 microversion: 2.32 time: 0.864674 Oct 31 14:21:55.416110 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2274/4289] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:21:54 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2933 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:21:55.424173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd2683ed-e20f-4f45-bdbd-c25800b88d31 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1037317185", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd2683ed-e20f-4f45-bdbd-c25800b88d31 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 173 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1037317185", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1037317185', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi -1 Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:21:55.433045 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 14:21:55.438349 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:21:55.441621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd2683ed-e20f-4f45-bdbd-c25800b88d31 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:55.442993 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd2683ed-e20f-4f45-bdbd-c25800b88d31 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.025691 Oct 31 14:21:55.443759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2275/4290] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:55 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:21:55.451779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:55.452949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:55.462959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:55.463692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:55.464288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:55.465143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:55.465745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:55.466347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:55.685600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc985b1e-123d-4c18-bfe2-9b51b07ca6f7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2/action" status: 202 len: 0 microversion: 2.1 time: 2.107723 Oct 31 14:21:55.686790 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2016/4291] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:21:53 2022] POST /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2/action => generated 0 bytes in 2110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:21:55.696097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-870123608"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:55.696839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:55.710743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:55.714066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:55.714836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:55.715780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:55.718772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:55.719992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:56.084803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:56.097200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff4c2f00-5da0-4046-af74-154655ac9812 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.649083 Oct 31 14:21:56.101171 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2276/4292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:55 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:21:56.114564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7e82ff1f-8bda-4b47-8899-9fe6a76ed836 req-cb66ada2-6d2a-42a5-a3ca-289995d0e224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230412fe-c163-48f5-90ab-4edcf0ad57b2", "tag": "412833dd-d9f4-495d-a3a6-5dede3ed7ff5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:56.136247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e82ff1f-8bda-4b47-8899-9fe6a76ed836 req-cb66ada2-6d2a-42a5-a3ca-289995d0e224 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:56.139914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e82ff1f-8bda-4b47-8899-9fe6a76ed836 req-cb66ada2-6d2a-42a5-a3ca-289995d0e224 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:56.140643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e82ff1f-8bda-4b47-8899-9fe6a76ed836 req-cb66ada2-6d2a-42a5-a3ca-289995d0e224 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:56.162982 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7e82ff1f-8bda-4b47-8899-9fe6a76ed836 req-cb66ada2-6d2a-42a5-a3ca-289995d0e224 service nova] Creating event network-changed:412833dd-d9f4-495d-a3a6-5dede3ed7ff5 for instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 on n-h2-863052-1 Oct 31 14:21:56.178764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7e82ff1f-8bda-4b47-8899-9fe6a76ed836 req-cb66ada2-6d2a-42a5-a3ca-289995d0e224 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074663 Oct 31 14:21:56.179835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2277/4293] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:56.192875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:56.193852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:56.207438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:56.213474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:56.214085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:56.214977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:56.215560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:56.216098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:56.351564 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Adding security group 238b26aa-9a95-4a56-a6d8-ca8c0281b967 to port 412833dd-d9f4-495d-a3a6-5dede3ed7ff5 Oct 31 14:21:56.944173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:56.964886 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a59cf60-eeb6-47c2-a4e3-e5176feb7753 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.783209 Oct 31 14:21:56.965783 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2278/4294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:56 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:56.975146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:56.976170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:56.987895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:56.988702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:56.989316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:56.990289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:56.990942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:56.991633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:57.427131 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aecfed0a-90c1-406d-903c-02d8d3733e62 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2/action" status: 202 len: 0 microversion: 2.1 time: 1.735434 Oct 31 14:21:57.430980 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2017/4295] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:21:55 2022] POST /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2/action => generated 0 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:21:57.434795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-dea21499-d6ae-445c-b76a-d19bb47eaefb req-655ca65c-06f3-41d8-adce-4176dd5d2b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-unplugged", "status": "completed", "tag": "9e6cbca7-c973-4376-930d-70035fa11e33"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:57.461251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dea21499-d6ae-445c-b76a-d19bb47eaefb req-655ca65c-06f3-41d8-adce-4176dd5d2b1d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:57.461882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dea21499-d6ae-445c-b76a-d19bb47eaefb req-655ca65c-06f3-41d8-adce-4176dd5d2b1d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:57.462450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dea21499-d6ae-445c-b76a-d19bb47eaefb req-655ca65c-06f3-41d8-adce-4176dd5d2b1d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:57.506622 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-dea21499-d6ae-445c-b76a-d19bb47eaefb req-655ca65c-06f3-41d8-adce-4176dd5d2b1d service nova] Creating event network-vif-unplugged:9e6cbca7-c973-4376-930d-70035fa11e33 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:21:57.523515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-dea21499-d6ae-445c-b76a-d19bb47eaefb req-655ca65c-06f3-41d8-adce-4176dd5d2b1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094090 Oct 31 14:21:57.526961 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2018/4296] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:57.543969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79b3c762-7645-4454-b1f8-ed82c8c47b95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-736586393", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:57.567313 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-79b3c762-7645-4454-b1f8-ed82c8c47b95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79b3c762-7645-4454-b1f8-ed82c8c47b95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 215 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-736586393", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-736586393', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:21:57.569383 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 14:21:57.573761 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:21:57.575926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79b3c762-7645-4454-b1f8-ed82c8c47b95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:21:57.577149 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79b3c762-7645-4454-b1f8-ed82c8c47b95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.048751 Oct 31 14:21:57.584998 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2019/4297] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:21:57 2022] POST /compute/v2.1/servers => generated 123 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:21:57.606571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:57.607223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:57.631301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:57.633656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:57.634385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:57.635268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:57.637534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:57.639322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:58.248535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:58.265172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:58.269866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:58.273571 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e6156a7-f4d8-4593-8a13-4bbcb6a2aa95 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2912 microversion: 2.32 time: 1.305087 Oct 31 14:21:58.275135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2279/4298] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:21:56 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2912 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:21:58.310481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:58.311289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:58.327631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:58.329560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:58.330859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:58.331738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:58.333672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:58.339637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:58.824270 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1bd8fc87-04e9-47bf-a83e-20a8aaa3d298 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.240863 Oct 31 14:21:58.825380 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2020/4299] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 31 14:21:57 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2/os-security-groups => generated 1157 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:58.842797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230412fe-c163-48f5-90ab-4edcf0ad57b2", "tag": "412833dd-d9f4-495d-a3a6-5dede3ed7ff5"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-deleted", "tag": "9e6cbca7-c973-4376-930d-70035fa11e33"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:58.867623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:58.870521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:58.870992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:58.911046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] Creating event network-changed:412833dd-d9f4-495d-a3a6-5dede3ed7ff5 for instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 on n-h2-863052-1 Oct 31 14:21:58.912472 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] Creating event network-vif-deleted:9e6cbca7-c973-4376-930d-70035fa11e33 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:21:58.930082 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-481e3ed1-f659-4c21-b957-e87820b477bd req-8118b989-d82d-4143-bb98-dd63e27a153f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.097862 Oct 31 14:21:58.934225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2021/4300] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:21:58.950468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6fc7cd0-24c6-440d-8657-e934d6ac8e47 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe106b095e0>, body: {"security_group": {"name": " tempest-securitygroup -913612679 ", "description": "tempest-description-1498447022"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:21:59.098558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:21:59.107738 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25372d62-ee99-4903-ad1d-b49cf8265539 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.813826 Oct 31 14:21:59.108339 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2280/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:58 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:21:59.145833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:21:59.146879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:21:59.160570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:59.162066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:59.162705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:21:59.164791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:21:59.165644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:21:59.166430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:00.022505 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6fc7cd0-24c6-440d-8657-e934d6ac8e47 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.086780 Oct 31 14:22:00.023985 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2022/4302] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:21:58 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:00.041584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:00.042517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:00.057491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:00.059753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:00.060385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:00.066654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:00.067366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:00.068010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:00.190426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:00.208075 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46644797-f8f9-4502-a571-e45f19152747 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.068750 Oct 31 14:22:00.209194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2281/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:21:59 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:00.228376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-unplugged", "status": "completed", "tag": "13d58663-7051-4173-80c9-2fc55f337a36"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-unplugged", "status": "completed", "tag": "6089802b-32ee-4dc1-aca0-94c27f3a0139"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-unplugged", "status": "completed", "tag": "3a9b4172-f0ff-4584-98cf-3eabc53a8d71"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-unplugged", "status": "completed", "tag": "46852d7e-2a8c-4b69-b247-0200900d1218"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:00.260482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:00.261243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:00.261836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:00.290106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Creating event network-vif-unplugged:13d58663-7051-4173-80c9-2fc55f337a36 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:00.294737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Creating event network-vif-unplugged:6089802b-32ee-4dc1-aca0-94c27f3a0139 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:00.296004 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Creating event network-vif-unplugged:3a9b4172-f0ff-4584-98cf-3eabc53a8d71 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:00.297908 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] Creating event network-vif-unplugged:46852d7e-2a8c-4b69-b247-0200900d1218 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:00.309773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-26239956-1801-4d0f-b9dd-da3af939bea2 req-1aaa379b-2368-48aa-b027-fae8fc717ca4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.099179 Oct 31 14:22:00.315584 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2282/4304] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:00.329624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-abb5102b-f886-4085-be77-129fb91b0129 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10652b4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:00.834950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:00.858209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:00.862374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:00.872908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e27702fb-2025-4cdd-b157-18bfec40eb88 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2818 microversion: 2.32 time: 0.846848 Oct 31 14:22:00.873520 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2023/4305] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:00 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2818 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:00.908108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68298b40-8301-42ad-ada3-0a75b8dca176 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-821839678", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-key-962076473", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:01.010813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-68298b40-8301-42ad-ada3-0a75b8dca176 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] validate_networks() for [('9f8924a5-c038-416a-9512-8369ddd99493', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:22:01.119380 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-abb5102b-f886-4085-be77-129fb91b0129 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11" status: 200 len: 223 microversion: 2.1 time: 0.802139 Oct 31 14:22:01.119952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2283/4306] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:22:00 2022] GET /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11 => generated 223 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:01.125530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0791c4aa-80ab-4987-80d2-9ab2133f8d79 req-d976a9ce-5fc9-4ea1-8c94-ece22c623153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-deleted", "tag": "3a9b4172-f0ff-4584-98cf-3eabc53a8d71"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:01.145919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0791c4aa-80ab-4987-80d2-9ab2133f8d79 req-d976a9ce-5fc9-4ea1-8c94-ece22c623153 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:01.150971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0791c4aa-80ab-4987-80d2-9ab2133f8d79 req-d976a9ce-5fc9-4ea1-8c94-ece22c623153 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:01.151879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0791c4aa-80ab-4987-80d2-9ab2133f8d79 req-d976a9ce-5fc9-4ea1-8c94-ece22c623153 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:01.189784 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0791c4aa-80ab-4987-80d2-9ab2133f8d79 req-d976a9ce-5fc9-4ea1-8c94-ece22c623153 service nova] Creating event network-vif-deleted:3a9b4172-f0ff-4584-98cf-3eabc53a8d71 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:01.221205 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0791c4aa-80ab-4987-80d2-9ab2133f8d79 req-d976a9ce-5fc9-4ea1-8c94-ece22c623153 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095763 Oct 31 14:22:01.262949 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2284/4307] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:01.282308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45b66b22-17d9-4514-9113-91cb706c5eab tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10636f790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:02.161534 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-68298b40-8301-42ad-ada3-0a75b8dca176 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Invalid key_name provided. Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68298b40-8301-42ad-ada3-0a75b8dca176 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 245 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-821839678", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-key-962076473", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid key_name provided. Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-821839678', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'key_name': 'tempest-key-962076473', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-962076473 not found for user 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:02.168667 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 31 14:22:02.173789 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:02.178924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68298b40-8301-42ad-ada3-0a75b8dca176 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid key_name provided. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:02.180070 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68298b40-8301-42ad-ada3-0a75b8dca176 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.283975 Oct 31 14:22:02.181024 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2024/4308] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:22:00 2022] POST /compute/v2.1/servers => generated 70 bytes in 1307 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:02.204710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:02.205516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:02.215586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:02.216273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:02.216990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:02.219519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:02.220543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:02.221893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:02.744425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:02.759335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:02.760824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:02.762132 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa7e4b9c-3104-41b2-9c32-689e3995ecb9 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2485 microversion: 2.32 time: 0.579988 Oct 31 14:22:02.762749 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2025/4309] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:02 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2485 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:02.779723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:02.780555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:02.789549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:02.790436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:02.791053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:02.791954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:02.792582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:02.793384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:02.943721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45b66b22-17d9-4514-9113-91cb706c5eab tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11" status: 202 len: 0 microversion: 2.1 time: 1.677165 Oct 31 14:22:02.944792 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2285/4310] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:01 2022] DELETE /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11 => generated 0 bytes in 1681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:02.960764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106456430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:03.173256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:03.174549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 7328f35b-753e-431e-bb03-912ee3294a11 not found {{(pid=120640) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:03.177312 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.177312 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11 HTTP/1.1 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '7328f35b-753e-431e-bb03-912ee3294a11'} Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:03.183076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] Oct 31 14:22:03.188180 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:03.195264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:03.195264 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-15753d5a-4073-45e8-ad89-4205ccaa64df'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:03.198546 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46976469-d81c-40b8-bc1d-c940c84445e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11" status: 404 len: 194 microversion: 2.1 time: 0.246354 Oct 31 14:22:03.205403 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2286/4311] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:22:02 2022] GET /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11 => generated 194 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:03.226943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9904e200-63d7-47f9-9393-55b4d64790a2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe106456ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2048880129", "description": "tempest-description-1193903188"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:03.444772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:03.454054 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-993c8123-abaa-4f2c-9ace-4864e8ab9c4a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.683084 Oct 31 14:22:03.454599 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2026/4312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:02 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:03.478977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-deleted", "tag": "46852d7e-2a8c-4b69-b247-0200900d1218"}, {"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-deleted", "tag": "6089802b-32ee-4dc1-aca0-94c27f3a0139"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:03.510106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:03.512547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:03.513063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:03.539198 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] Creating event network-vif-deleted:46852d7e-2a8c-4b69-b247-0200900d1218 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:03.539929 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] Creating event network-vif-deleted:6089802b-32ee-4dc1-aca0-94c27f3a0139 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:03.550984 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-aa657742-ee58-4ba9-84c6-d1d425d89a3c req-829f3803-2a17-4f21-9196-c6af663ff82b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078030 Oct 31 14:22:03.552306 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2027/4313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:03.560729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:03.561845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:03.574678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:03.577097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:03.577744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:03.580596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:03.582601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:03.583204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:03.867907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:03.873621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9904e200-63d7-47f9-9393-55b4d64790a2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.664711 Oct 31 14:22:03.874245 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2287/4314] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:22:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:03.879494 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4fb9397-0ebf-4fb9-afdb-4bc7bb2aa64b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.323049 Oct 31 14:22:03.880079 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2028/4315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:03 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:03.886857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:03.887769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:03.903864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:03.907338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:03.908054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:03.909648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:03.914392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-350c7b05-57d0-4afa-aeb5-8ac10dfe116f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe107e943a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1400323362", "description": "tempest-description-629249201"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:03.915195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:03.915974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:04.060646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:04.080488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:04.082801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:04.085001 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2d36135-0998-4ba1-9209-1425f68cd39a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 2270 microversion: 2.32 time: 0.209536 Oct 31 14:22:04.086181 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2288/4316] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:03 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 2270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:04.112420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b72ad43f-067c-4ab2-894a-542b8df791f5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118235970", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:04.414505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-b72ad43f-067c-4ab2-894a-542b8df791f5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Neutron security group does_not_exist not found {{(pid=120640) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 31 14:22:04.415391 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b72ad43f-067c-4ab2-894a-542b8df791f5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b72ad43f-067c-4ab2-894a-542b8df791f5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 258 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118235970", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1118235970', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 31 14:22:04.424432 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 31 14:22:04.428504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:04.433362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b72ad43f-067c-4ab2-894a-542b8df791f5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:04.434471 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b72ad43f-067c-4ab2-894a-542b8df791f5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.346870 Oct 31 14:22:04.435089 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2289/4317] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:22:04 2022] POST /compute/v2.1/servers => generated 106 bytes in 348 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:04.444942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:04.445847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:04.463599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:04.465143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:04.466625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:04.475561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:04.476346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:04.477011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:04.687999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:04.702347 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-275a616b-40f8-4a40-b9a9-2999f8d25e0e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.258141 Oct 31 14:22:04.703335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2290/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:04 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:04.737328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:04.738745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:04.746052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:04.750623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:04.753385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:04.754366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:04.754999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:04.755618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:05.111090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:05.119512 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fadc1567-6e25-4224-98d7-2e18aef3a83f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.386171 Oct 31 14:22:05.126944 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2291/4319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:04 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:05.136190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:05.136814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:05.160191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:05.169956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:05.170689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:05.171610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:05.172780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:05.173374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:05.307964 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-350c7b05-57d0-4afa-aeb5-8ac10dfe116f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.411275 Oct 31 14:22:05.309274 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2029/4320] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:22:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:05.315046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ec2c961-9cde-436b-a51c-2782d165f8f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:05.315790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ec2c961-9cde-436b-a51c-2782d165f8f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: df892dfa-f27f-4ef9-b0d4-295cff72cfc9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:05.322858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-9ec2c961-9cde-436b-a51c-2782d165f8f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance df892dfa-f27f-4ef9-b0d4-295cff72cfc9 could not be found. Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ec2c961-9cde-436b-a51c-2782d165f8f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/df892dfa-f27f-4ef9-b0d4-295cff72cfc9 HTTP/1.1 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance df892dfa-f27f-4ef9-b0d4-295cff72cfc9 could not be found. Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'df892dfa-f27f-4ef9-b0d4-295cff72cfc9'} Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df892dfa-f27f-4ef9-b0d4-295cff72cfc9 could not be found. Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df892dfa-f27f-4ef9-b0d4-295cff72cfc9 could not be found. Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:05.324854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df892dfa-f27f-4ef9-b0d4-295cff72cfc9 could not be found. Oct 31 14:22:05.329137 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:05.333218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ec2c961-9cde-436b-a51c-2782d165f8f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance df892dfa-f27f-4ef9-b0d4-295cff72cfc9 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:05.334363 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ec2c961-9cde-436b-a51c-2782d165f8f8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df892dfa-f27f-4ef9-b0d4-295cff72cfc9" status: 404 len: 111 microversion: 2.1 time: 0.023751 Oct 31 14:22:05.335505 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2030/4321] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:22:05 2022] DELETE /compute/v2.1/servers/df892dfa-f27f-4ef9-b0d4-295cff72cfc9 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:05.348376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22c9e9b0-142e-49cf-9ad4-94c4104822c3 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe107f78940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1139185578", "description": "tempest-description-1770609277"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:05.357699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:05.369111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:05.380099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:05.381601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b7ff036-8037-4f42-bb84-1e23dd49702c tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.252145 Oct 31 14:22:05.391299 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2292/4322] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:05 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:05.396918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:05.397733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:05.407757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:05.410356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:05.419364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:05.420327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:05.420965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:05.421570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:05.928460 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22c9e9b0-142e-49cf-9ad4-94c4104822c3 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.591574 Oct 31 14:22:05.929493 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2031/4323] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:22:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:05.934737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e85e46b2-1be6-4bc7-9476-0f7dde10d60e req-fc19b194-a9c3-4446-8d8c-ac84dedd67af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb98a6f-ffa6-454e-9973-2e6b21a64ace", "name": "network-vif-deleted", "tag": "13d58663-7051-4173-80c9-2fc55f337a36"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:05.967273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e85e46b2-1be6-4bc7-9476-0f7dde10d60e req-fc19b194-a9c3-4446-8d8c-ac84dedd67af service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:05.969354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e85e46b2-1be6-4bc7-9476-0f7dde10d60e req-fc19b194-a9c3-4446-8d8c-ac84dedd67af service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:05.970125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e85e46b2-1be6-4bc7-9476-0f7dde10d60e req-fc19b194-a9c3-4446-8d8c-ac84dedd67af service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:05.988455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:05.995174 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e85e46b2-1be6-4bc7-9476-0f7dde10d60e req-fc19b194-a9c3-4446-8d8c-ac84dedd67af service nova] Creating event network-vif-deleted:13d58663-7051-4173-80c9-2fc55f337a36 for instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace on n-h2-863052-1 Oct 31 14:22:05.998450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1301bce4-54e3-436b-acd4-f65129040ff1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.605752 Oct 31 14:22:05.999663 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2293/4324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:05 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:06.002239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e85e46b2-1be6-4bc7-9476-0f7dde10d60e req-fc19b194-a9c3-4446-8d8c-ac84dedd67af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071262 Oct 31 14:22:06.005139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2103dffb-bc55-4493-a5c8-3b962a9f6e10 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106343430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.005529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2032/4325] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:06.033892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.033892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:06.045043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:06.046197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:06.062764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:06.063679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:06.064165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:06.064615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:06.387994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:06.407494 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7999c1c-17b8-4820-8a7a-048f0be4192e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.376870 Oct 31 14:22:06.407494 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2033/4326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:06 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:06.423732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.424273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:06.449038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:06.449544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:06.450000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:06.450748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:06.451213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:06.451649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:06.510477 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2103dffb-bc55-4493-a5c8-3b962a9f6e10 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.509353 Oct 31 14:22:06.511153 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2294/4327] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:22:05 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:06.520355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45e1ecb0-0e9a-407a-b920-66076030d717 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.520355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45e1ecb0-0e9a-407a-b920-66076030d717 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:22:06.520355 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-45e1ecb0-0e9a-407a-b920-66076030d717 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45e1ecb0-0e9a-407a-b920-66076030d717 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 9223372036854775808 could not be found. Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '9223372036854775808'} Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:06.522385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:06.526042 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:06.526042 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:06.526042 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:06.526042 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 31 14:22:06.526042 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:06.526042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45e1ecb0-0e9a-407a-b920-66076030d717 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:06.529744 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45e1ecb0-0e9a-407a-b920-66076030d717 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.013933 Oct 31 14:22:06.529744 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2295/4328] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 31 14:22:06 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:22:06.536836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e387a87a-55e6-4ce3-9aab-8f8bc7412b5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106591ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.591500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:06.604591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:06.606421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:06.607943 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbbeb3b5-61e8-46c5-9ed3-095f39733e3b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.188341 Oct 31 14:22:06.628196 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2034/4329] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:06 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:06.633342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.633968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:06.640916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:06.641742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:06.642439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:06.643395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:06.644073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:06.644838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:06.938849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:06.952762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ba50b4d-6d9b-4b59-b777-f0c2c2cc47de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.323373 Oct 31 14:22:06.955701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2035/4330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:06 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:06.988478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:06.989214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:06.998607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.009759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.012699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.013571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.014113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.015516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.024403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:07.290073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e387a87a-55e6-4ce3-9aab-8f8bc7412b5a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a" status: 202 len: 0 microversion: 2.1 time: 0.761838 Oct 31 14:22:07.293806 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2296/4331] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:06 2022] DELETE /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:07.301503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:07.302015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:07.317504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.318318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.318779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.319518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.319944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.320376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.381440 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3f3f01a-66a7-41ca-954d-42034888e887 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/ips" status: 200 len: 145 microversion: 2.1 time: 0.086409 Oct 31 14:22:07.382077 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2297/4332] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:22:07 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/ips => generated 145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:07.392124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:07.399701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10652b700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:07.407018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-589390ec-3747-42e9-8d3a-6db83e3571db tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.423383 Oct 31 14:22:07.407606 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2036/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:06 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:07.434770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9c36b6b-fef9-4d8d-b4d5-85897e710147 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:07.435482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9c36b6b-fef9-4d8d-b4d5-85897e710147 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Failed to fetch instance by id -1 {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 14:22:07.436309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a9c36b6b-fef9-4d8d-b4d5-85897e710147 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance -1 could not be found. Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9c36b6b-fef9-4d8d-b4d5-85897e710147 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance -1 could not be found. Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '-1'} Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:07.439827 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:07.443583 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:07.443583 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:07.443583 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 31 14:22:07.443583 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.449414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9c36b6b-fef9-4d8d-b4d5-85897e710147 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:07.451209 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a9c36b6b-fef9-4d8d-b4d5-85897e710147 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.021180 Oct 31 14:22:07.452405 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2037/4334] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:22:07 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:22:07.471876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:07.476349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:07.494908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.495671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.498343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.499312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.500060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.501687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.712879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:07.713633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a not found {{(pid=120640) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:07.714317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.714317 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a HTTP/1.1 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a'} Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:07.716599 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-40146dad-da39-44da-a543-28ce6fc3e7b4'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7b357d3-8c5b-4c1e-a9f4-1dd1cdec76f4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a" status: 404 len: 194 microversion: 2.1 time: 0.334952 Oct 31 14:22:07.722548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2298/4335] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:22:07 2022] GET /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a => generated 194 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:07.736300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:07.738845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:07.764986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.766104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.766931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.770459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:07.772061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:07.772784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:07.800479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:07.821699 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9120f929-0072-423b-b927-4c513b35a949 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.357413 Oct 31 14:22:07.822697 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2038/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:07 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:07.829971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3902ca51-1b9e-45be-ade5-7f2ab1347e33 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106aaf310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:07.979261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:08.007776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:08.009436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:08.018905 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1aae78a9-a9a1-4982-bd4e-9d45469e3403 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.292673 Oct 31 14:22:08.019573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2299/4337] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:07 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:08.035169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:08.035844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:08.060276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:08.060482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:08.060887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:08.069617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:08.070128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:08.070606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:08.220980 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3902ca51-1b9e-45be-ade5-7f2ab1347e33 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d" status: 202 len: 0 microversion: 2.1 time: 0.396949 Oct 31 14:22:08.221564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2039/4338] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:07 2022] DELETE /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:08.229522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107db19d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:08.296277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:08.308240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:08.308922 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.308922 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d HTTP/1.1 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3f636ce1-923d-48bf-8acd-fc1d75221e1d'} Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:08.310857 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-af22f237-6abe-4840-b6c4-a2e636c78679'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43e09a35-58d8-4447-974f-3a2a403bb2e7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d" status: 404 len: 194 microversion: 2.1 time: 0.086630 Oct 31 14:22:08.319507 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2040/4339] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:22:08 2022] GET /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:22:08.322400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8412bc7-134b-4ebb-8208-f2e93c85ebd8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107ce3670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:08.595716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8412bc7-134b-4ebb-8208-f2e93c85ebd8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4" status: 202 len: 0 microversion: 2.1 time: 0.277649 Oct 31 14:22:08.597595 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2041/4340] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:08 2022] DELETE /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:08.613736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107ce3e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:08.650327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:08.651261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group c2a25aef-6d03-4c91-a302-d277f33dfec4 not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:08.651934 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.651934 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4 HTTP/1.1 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c2a25aef-6d03-4c91-a302-d277f33dfec4'} Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:08.654005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] Oct 31 14:22:08.658078 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:08.663125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:08.663125 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-4560d6c5-28ea-463a-9166-4b625a30beb2'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:08.670909 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8aa40d6-4ce5-42a0-bc1a-ee552ef5989e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4" status: 404 len: 194 microversion: 2.1 time: 0.069083 Oct 31 14:22:08.677332 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2042/4341] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:22:08 2022] GET /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:22:08.685622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebae8c13-a361-4111-bf63-c72292dabf15 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10fc42040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:09.105729 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebae8c13-a361-4111-bf63-c72292dabf15 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.424014 Oct 31 14:22:09.107049 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2043/4342] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:22:08 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:09.115060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:09.120375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:09.129568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:09.130592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:09.131347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:09.132906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:09.133599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:09.134260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:09.231090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:09.244005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:09.245452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:09.246800 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5222fcbe-7446-4221-8c73-a3384247b5c6 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.138402 Oct 31 14:22:09.247701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2044/4343] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:09 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:09.259458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27fbbd29-de07-47eb-adef-a74d5ea49681 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe106aaf310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-194680021", "description": "tempest-description-1514040575"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:09.498073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:09.533369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f19d676-d3c2-49e7-935d-0742862ea75d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.511777 Oct 31 14:22:09.535032 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2300/4344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:08 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:09.572695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a61ca6a-4d35-4fc8-901f-a7bd6e33bd92 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:09.573959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a61ca6a-4d35-4fc8-901f-a7bd6e33bd92 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 73905078-bf49-44ee-97d4-29bddd22496c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:09.587961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0a61ca6a-4d35-4fc8-901f-a7bd6e33bd92 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 73905078-bf49-44ee-97d4-29bddd22496c could not be found. Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a61ca6a-4d35-4fc8-901f-a7bd6e33bd92 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/73905078-bf49-44ee-97d4-29bddd22496c/action HTTP/1.1 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 19 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: {"forceDelete": {}} Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 73905078-bf49-44ee-97d4-29bddd22496c could not be found. Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '73905078-bf49-44ee-97d4-29bddd22496c', 'body': {'forceDelete': {}}} Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73905078-bf49-44ee-97d4-29bddd22496c could not be found. Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73905078-bf49-44ee-97d4-29bddd22496c could not be found. Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:09.598595 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:09.602504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:09.602504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:09.602504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73905078-bf49-44ee-97d4-29bddd22496c could not be found. Oct 31 14:22:09.602504 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:09.602504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a61ca6a-4d35-4fc8-901f-a7bd6e33bd92 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 73905078-bf49-44ee-97d4-29bddd22496c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:09.604409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a61ca6a-4d35-4fc8-901f-a7bd6e33bd92 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/73905078-bf49-44ee-97d4-29bddd22496c/action" status: 404 len: 111 microversion: 2.1 time: 0.043750 Oct 31 14:22:09.612617 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2301/4345] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:09 2022] POST /compute/v2.1/servers/73905078-bf49-44ee-97d4-29bddd22496c/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:22:09.626122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:09.628808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:09.648455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:09.649834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:09.650377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:09.651629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:09.654809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:09.655419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:09.751821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27fbbd29-de07-47eb-adef-a74d5ea49681 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.502839 Oct 31 14:22:09.762741 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2045/4346] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:22:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:09.770894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8e452ae-3d2a-4e95-89ba-ca88dd778923 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe107cc05e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-263261972", "description": "tempest-description-1680583534"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:10.087601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:10.100066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b564576-c5c6-4319-9208-546a809089eb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.485045 Oct 31 14:22:10.120070 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2302/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:09 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:10.140856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:10.141506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:10.162696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:10.163231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:10.166574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:10.167652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:10.169579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:10.171238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:10.185644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:10.545734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:10.558618 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31a0d0eb-8aad-4b75-a791-d097c44f61e9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.428332 Oct 31 14:22:10.572735 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2303/4348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:10 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:10.587118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73af4c85-ac53-40dd-9fdc-7b6f483761ca"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:10.593856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:10.605823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:10.606851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:10.607503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:10.608412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:10.610119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:10.611201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:10.793361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8e452ae-3d2a-4e95-89ba-ca88dd778923 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.029460 Oct 31 14:22:10.808110 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2046/4349] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:22:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:10.817926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:10.819707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:10.828942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:10.829636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:10.830498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:10.832439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:10.833426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:10.834552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:10.990771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:11.009369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:11.012345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:11.013563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72028e25-af45-4195-b471-df6935eddd6f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.202564 Oct 31 14:22:11.014919 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2047/4350] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:10 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:11.020979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e829703-5ec3-4c8e-8524-a087112fb19e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:11.023823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e829703-5ec3-4c8e-8524-a087112fb19e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:11.030132 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3e829703-5ec3-4c8e-8524-a087112fb19e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b could not be found. Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e829703-5ec3-4c8e-8524-a087112fb19e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b/action HTTP/1.1 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 39 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: {"os-getConsoleOutput": {"length": 10}} Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b could not be found. Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b could not be found. Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b could not be found. Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:11.040353 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b could not be found. Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e829703-5ec3-4c8e-8524-a087112fb19e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e829703-5ec3-4c8e-8524-a087112fb19e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b/action" status: 404 len: 111 microversion: 2.1 time: 0.026177 Oct 31 14:22:11.045216 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2048/4351] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:11 2022] POST /compute/v2.1/servers/6a8fa9c8-55cf-4223-bc7a-194dfa7d0c3b/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:11.061336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-811283190", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "84a39bcc-6a8e-4ec2-9898-abb1247f91c2"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:11.112263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a877697a-58fa-4c60-a912-e515e2d18e2a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537651 Oct 31 14:22:11.113011 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2304/4352] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:22:10 2022] POST /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:11.133801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:11.134620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:11.159520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:11.161732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:11.169273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:11.171289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:11.172279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:11.173078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:11.182485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] validate_networks() for [('84a39bcc-6a8e-4ec2-9898-abb1247f91c2', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:22:11.971314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:11.982342 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a06dcbd-09d3-4fbc-8e9d-30a17817b521 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.854671 Oct 31 14:22:11.986410 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2305/4353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:11 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:12.015963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:12.016906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:12.026562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:12.030512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:12.031229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:12.032846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:12.036685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:12.038392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:12.363321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:12.377812 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a2e49d2-ce05-46af-bc67-bfcc42ca9854 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.367351 Oct 31 14:22:12.378658 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2306/4354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:12 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:12.401005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:12.401768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:12.410110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:12.411035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:12.412192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:12.413332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:12.414037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:12.414710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:12.548539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:12.564580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:12.566085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:12.572627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4e37dbb-2704-431b-9924-1a6af9e0e180 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.192710 Oct 31 14:22:12.575706 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2307/4355] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:12 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:12.586367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3686554c-bbcb-4b28-9ef6-6d917511f43b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:12.591122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3686554c-bbcb-4b28-9ef6-6d917511f43b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 9b3bf185-54c0-41d1-9ff5-810a34f5c593] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:12.606583 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3686554c-bbcb-4b28-9ef6-6d917511f43b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 9b3bf185-54c0-41d1-9ff5-810a34f5c593 could not be found. Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3686554c-bbcb-4b28-9ef6-6d917511f43b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/9b3bf185-54c0-41d1-9ff5-810a34f5c593 HTTP/1.1 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 9b3bf185-54c0-41d1-9ff5-810a34f5c593 could not be found. Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '9b3bf185-54c0-41d1-9ff5-810a34f5c593'} Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3bf185-54c0-41d1-9ff5-810a34f5c593 could not be found. Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3bf185-54c0-41d1-9ff5-810a34f5c593 could not be found. Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:12.609802 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:12.613930 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:12.613930 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:12.613930 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:12.613930 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3bf185-54c0-41d1-9ff5-810a34f5c593 could not be found. Oct 31 14:22:12.613930 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:12.615230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3686554c-bbcb-4b28-9ef6-6d917511f43b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 9b3bf185-54c0-41d1-9ff5-810a34f5c593 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:12.616283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3686554c-bbcb-4b28-9ef6-6d917511f43b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/9b3bf185-54c0-41d1-9ff5-810a34f5c593" status: 404 len: 111 microversion: 2.1 time: 0.038836 Oct 31 14:22:12.617018 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2308/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:12 2022] GET /compute/v2.1/servers/9b3bf185-54c0-41d1-9ff5-810a34f5c593 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:12.628125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:12.628976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:12.641776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:12.642587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:12.643184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:12.644064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:12.644857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:12.645441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:12.982872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:12.996933 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76f0d0e9-ebae-4a55-b9e6-ea9d3aee7725 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.373889 Oct 31 14:22:13.014207 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2309/4357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:12 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:13.024363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:13.025322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:13.037971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.039025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.040910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.041576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.042278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.044186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.068753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:22:13.069774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:22:13.070501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:22:13.071127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:22:13.071781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:22:13.088703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.092428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.098534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.099371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.099854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.100293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.163508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Getting quotas for project 6a0c3a55e468402da1424750fc0ddd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:22:13.179646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Getting quotas for user 8117f4d2a50f416d92466798b7c2d5fc and project 6a0c3a55e468402da1424750fc0ddd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:22:13.200613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:22:13.212947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:22:13.296914 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0749d8df-be01-4349-a201-2659ec49f38f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252403 Oct 31 14:22:13.297589 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2049/4358] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:22:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:22:13.347977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fc41168d-40a7-4a29-b806-fa39b1b64b2d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:13.348618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fc41168d-40a7-4a29-b806-fa39b1b64b2d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:13.613078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:13.628914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fc41168d-40a7-4a29-b806-fa39b1b64b2d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:13.641239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fc41168d-40a7-4a29-b806-fa39b1b64b2d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1215 microversion: 2.1 time: 0.318801 Oct 31 14:22:13.642538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e10bbbfe-db3b-4992-b479-6b5d4ae51e3d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.622297 Oct 31 14:22:13.643132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2310/4359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:13 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:13.675308 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2050/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:13 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1215 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:13.692207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:13.696599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:13.698716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=86 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:13.711852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.712354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.712865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.713512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.713976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.714436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.873000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57cea360-07d2-4580-a348-cfc347878681 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-378093041", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57cea360-07d2-4580-a348-cfc347878681 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 237 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-378093041", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-378093041', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.908775 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 14:22:13.913468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:13.916091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57cea360-07d2-4580-a348-cfc347878681 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:13.917293 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57cea360-07d2-4580-a348-cfc347878681 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.058847 Oct 31 14:22:13.918600 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2051/4361] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:22:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:22:13.927129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:13.928234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:13.944249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.947487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.948336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.951550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:13.952229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:13.952996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:13.957766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:14.014588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:14.023478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:14.047613 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f480eb60-17f4-4c02-9e69-164db171369b tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.372689 Oct 31 14:22:14.051936 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2311/4362] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:13 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:14.704686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:14.705515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:14.725423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:14.726812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:14.734869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:14.737001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:14.739680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:14.740128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:14.957845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:14.979450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de3e9e3a-0d49-4d8b-9543-7352f10ca615 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1267 microversion: 2.1 time: 0.282860 Oct 31 14:22:14.980950 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2312/4363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:14 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:15.019921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:15.049368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45f9f3e8-119b-4e3a-b172-6a2bf8d38d28 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.126743 Oct 31 14:22:15.053527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2052/4364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:13 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:15.084718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:15.085574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:15.087728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:15.089764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:15.106809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:15.108065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:15.109730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:15.111372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:15.111850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:15.112346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:15.112595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:15.113510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:15.115898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:15.117010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:15.117373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:15.132500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:15.329997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:15.345437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:15.348087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:15.353670 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-152b52ea-8a5e-48fc-b5b2-e8d861652e01 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.280478 Oct 31 14:22:15.354837 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2313/4365] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:15 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:16.008629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:16.008629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:16.018231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.018736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.019180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.019894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.020359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.020785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.043216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:16.052618 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-863ebbd1-66a8-4775-9e7c-21995d5a440c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.974938 Oct 31 14:22:16.053205 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2053/4366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:15 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:16.306724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92a77fa9-bef5-4da7-a496-d3f798fa6922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-272191325", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92a77fa9-bef5-4da7-a496-d3f798fa6922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 234 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-272191325", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-272191325', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.311117 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92a77fa9-bef5-4da7-a496-d3f798fa6922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:16.317615 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92a77fa9-bef5-4da7-a496-d3f798fa6922 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010338 Oct 31 14:22:16.322582 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2054/4367] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:22:16 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:16.327693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:16.335909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcdbca94-f6e2-4c01-a66e-f5a1d9fb2d7e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1273 microversion: 2.1 time: 0.332409 Oct 31 14:22:16.341671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:16.342534 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2314/4368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:16 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:16.342671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:16.350045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:16.351847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.352619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.353432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.354496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.355177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.355818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.382722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:16.383738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:16.390492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.395295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.396004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.397540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.403044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.406425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.663888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:16.691162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:16.695528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:16.699833 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afd1e784-d099-48ed-b835-4ea5fb4ca0c5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.320266 Oct 31 14:22:16.715796 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2315/4369] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:16 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:16.861979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:16.905227 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1db56c08-3128-4f8c-b3f6-6706c1a91636 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.581146 Oct 31 14:22:16.934044 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2055/4370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:16 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:16.937578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:16.938372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:16.945374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.956342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.956981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:16.957864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:16.958660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:16.959221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:17.367170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:17.368617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:17.387225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:17.387977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:17.388690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:17.389606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:17.390996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:17.394475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:17.652550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:17.654977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:17.666042 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3343e11-be64-4f38-a27b-de201b26f10d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.732668 Oct 31 14:22:17.666840 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2316/4371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:16 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:17.689707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc178c86-8af6-4665-8394-977b684f434f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:17.691514 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49d054ab-fe51-418f-9b34-d3ff9eadf181 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1273 microversion: 2.1 time: 0.329844 Oct 31 14:22:17.693092 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2056/4372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:17 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:17.708426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc178c86-8af6-4665-8394-977b684f434f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 5d51ec91-ed02-4115-bf5f-ffabdd9b806f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:17.711094 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-dc178c86-8af6-4665-8394-977b684f434f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 5d51ec91-ed02-4115-bf5f-ffabdd9b806f could not be found. Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc178c86-8af6-4665-8394-977b684f434f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/5d51ec91-ed02-4115-bf5f-ffabdd9b806f/action HTTP/1.1 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 13 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: {"pause": {}} Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 5d51ec91-ed02-4115-bf5f-ffabdd9b806f could not be found. Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '5d51ec91-ed02-4115-bf5f-ffabdd9b806f', 'body': {'pause': {}}} Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d51ec91-ed02-4115-bf5f-ffabdd9b806f could not be found. Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d51ec91-ed02-4115-bf5f-ffabdd9b806f could not be found. Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:17.717634 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:17.722987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:17.722987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:17.722987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d51ec91-ed02-4115-bf5f-ffabdd9b806f could not be found. Oct 31 14:22:17.722987 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:17.723488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc178c86-8af6-4665-8394-977b684f434f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 5d51ec91-ed02-4115-bf5f-ffabdd9b806f could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:17.724490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc178c86-8af6-4665-8394-977b684f434f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/5d51ec91-ed02-4115-bf5f-ffabdd9b806f/action" status: 404 len: 111 microversion: 2.1 time: 0.038893 Oct 31 14:22:17.725566 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2317/4373] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:17 2022] POST /compute/v2.1/servers/5d51ec91-ed02-4115-bf5f-ffabdd9b806f/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:17.735321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:17.736294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:17.745447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:17.746238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:17.754141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:17.758145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:17.758806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:17.760999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:17.762660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:17.763163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:17.763600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:17.763868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:17.764651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:17.771149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:17.776942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:17.779722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:18.119400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:18.133723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:18.139250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:18.148617 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc37496c-3f56-44a4-bd0e-3f0e95a3ab23 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.405089 Oct 31 14:22:18.149784 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2318/4374] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:17 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:22:18.648946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:18.662951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0f5b1aa-98f5-4cf0-ae2d-c70175c2b09d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.932124 Oct 31 14:22:18.676505 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2057/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:17 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:18.689843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:18.690606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:18.715773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:18.720488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:18.729402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:18.733783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:18.735672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:18.736490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:18.737068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:18.737593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:18.739012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:18.739498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:18.740568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:18.741332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:18.741555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:18.742119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:19.312817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:19.326881 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62e09587-8311-4654-bd39-e21d0d6ff841 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.637218 Oct 31 14:22:19.334382 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2319/4376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:18 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:19.347130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:19.347849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:19.370042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:19.370761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:19.372052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:19.372971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:19.373595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:19.374202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:19.418087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:19.710787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:19.733521 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16914dc5-cef8-4439-bfda-790a97ec767a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 1.018424 Oct 31 14:22:19.736360 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2058/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:18 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:19.750087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:19.751521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:19.770006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:19.770993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:19.772388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:19.780435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:19.781903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:19.782538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:19.934524 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50c7d183-dc83-4781-9ab1-e2db2670918c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.196697 Oct 31 14:22:19.938512 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2059/4378] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:19 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:19.952174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:19.957085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:19.972139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:19.972985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:19.973595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:19.975405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:19.976933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:19.977673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:20.153471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:20.166456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:20.169952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:20.172539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3df7906f-b886-46e1-926b-c54c53d065f5 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.836893 Oct 31 14:22:20.197325 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2320/4379] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:19 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:20.461780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:20.482504 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7827a751-fee9-4b85-aab2-116cddff355b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1512 microversion: 2.1 time: 0.541960 Oct 31 14:22:20.500044 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2060/4380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:19 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:20.757193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:20.758091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:20.771820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:20.772664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:20.773265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:20.774147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:20.774793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:20.779785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:20.804855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4117cb1d-a44e-44c9-a4ed-27a13ff8c846 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Action: 'create', calling method: .version_select at 0x7fe107db1430>, body: {"keypair": {"name": "tempest-keypair-1803251660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTt9GgOC98+XqirOvt3uuZgkMSmRaYGBsOSuVrOtgs/3vIa6JI4GxuUitP7+JLI4vJKRZQk1pERFtZsg5fpWPn9Loihu9nxMx4XVMonMorkMwZizMfdycPj+M7E+mBypQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:20.865493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4117cb1d-a44e-44c9-a4ed-27a13ff8c846 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Getting quotas for project 470dc32e543245bf86911af99cff6687. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:22:20.903154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4117cb1d-a44e-44c9-a4ed-27a13ff8c846 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Getting quotas for user 2317857a46254953834ffdd2361dc586 and project 470dc32e543245bf86911af99cff6687. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:22:20.976575 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4117cb1d-a44e-44c9-a4ed-27a13ff8c846 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.175534 Oct 31 14:22:20.978663 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2061/4381] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:22:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:22:21.155570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:21.167311 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5550505-d39d-4042-bbb0-dd236eadaeb8 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.414045 Oct 31 14:22:21.167922 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2321/4382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:20 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:21.206912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:21.207592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:21.255014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:21.256312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:21.257271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:21.258509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:21.259700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:21.261377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:21.513879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:21.515756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:21.529930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:21.535926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:21.536627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:21.540905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:21.542673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:21.545290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:21.765283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:21.795972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:21.798931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:21.800593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8a0a83b-ed19-4be2-9a7e-2789b6c37949 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.600562 Oct 31 14:22:21.803767 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2062/4383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:21 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:22.074913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:22.089047 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13466a25-3404-411b-9a49-3bcdb4630beb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1492 microversion: 2.1 time: 0.578340 Oct 31 14:22:22.090993 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2322/4384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:21 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1492 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:22.117197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:22.119013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:22.144512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.145280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.146052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.146989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.147609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.148247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.189390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:22.190984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:22.201634 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'pause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state paused Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 13 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: {"pause": {}} Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'pause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state paused Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'pause': {}}} Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state paused. Cannot pause while the instance is in this state. Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state paused Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:22.203724 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:22.209320 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:22.209320 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:22.209320 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:22.209320 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state paused Oct 31 14:22:22.209320 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:22.211179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.211179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.211179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.211179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.211719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.212303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.214668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'pause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state paused {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:22.216093 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83ccb6c3-f025-4e1f-a40f-3dd9d2d7903d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 143 microversion: 2.1 time: 0.105032 Oct 31 14:22:22.220795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2063/4385] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:22 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 143 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:22:22.226536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:22.227475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:22.243975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.244490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.245078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.246309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.246870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.247229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.399280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:22.415550 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48adf405-41cc-4b14-911e-da79d6ddc0a2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.193653 Oct 31 14:22:22.416292 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2064/4386] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:22 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:22:22.449661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bf73c332-be6a-45f0-b1f8-be3b04796fe5 req-ccf8466f-242d-483f-9403-816db51e3d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce17942-fbf2-4196-ba9f-05b6d1ca8e84", "tag": "a411f9f6-3e8b-4f9e-87bc-788508725105"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:22.471348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf73c332-be6a-45f0-b1f8-be3b04796fe5 req-ccf8466f-242d-483f-9403-816db51e3d35 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.471853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf73c332-be6a-45f0-b1f8-be3b04796fe5 req-ccf8466f-242d-483f-9403-816db51e3d35 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.472576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf73c332-be6a-45f0-b1f8-be3b04796fe5 req-ccf8466f-242d-483f-9403-816db51e3d35 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.489965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bf73c332-be6a-45f0-b1f8-be3b04796fe5 req-ccf8466f-242d-483f-9403-816db51e3d35 service nova] Creating event network-changed:a411f9f6-3e8b-4f9e-87bc-788508725105 for instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 on n-h1-863052-1 Oct 31 14:22:22.497313 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bf73c332-be6a-45f0-b1f8-be3b04796fe5 req-ccf8466f-242d-483f-9403-816db51e3d35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061231 Oct 31 14:22:22.498138 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2065/4387] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:22.506470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:22.507479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:22.517904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.518687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.519276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.520146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.520785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.521390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.664716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:22.673611 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89648343-7c57-4c0c-92be-989539468c1a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.488599 Oct 31 14:22:22.679173 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2323/4388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:22 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:22.833649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:22.834501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:22.849933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.850820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.851862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.852927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:22.853572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:22.854939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:22.988113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:23.001428 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c267e810-3b14-4d1c-a5b9-46203ef0d98c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1499 microversion: 2.1 time: 0.501882 Oct 31 14:22:23.002020 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2066/4389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:22 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1499 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:23.067264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:23.087301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:23.088743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:23.089952 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-818e5cb3-aa00-46d8-ae76-0ddf369509bc tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.260344 Oct 31 14:22:23.095644 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2324/4390] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:22 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:23.703681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:23.709591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:23.717414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:23.740356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:23.741447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:23.742964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:23.746950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:23.748435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:23.749802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.028845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:24.030183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:24.046039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.046039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.046494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.047221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.047683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.048121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.365392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:24.377503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4bca04a4-d627-463a-a22f-b683b1faccaf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.353997 Oct 31 14:22:24.388414 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2325/4391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:24 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:24.407379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:24.412062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:24.427894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.428410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.428855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.429565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.430016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.430479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.551251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:24.569618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:24.572322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:24.573837 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9198c928-36b5-45f8-bb5b-4dea83719936 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.180463 Oct 31 14:22:24.574629 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2326/4392] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:24 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:24.606058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:24.606860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:24.615461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:24.628965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.629499 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1396e3db-a4d7-484b-855a-c5abfe4973a4 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.926681 Oct 31 14:22:24.630279 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2067/4393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:23 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:24.630839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.631387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.632216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.632778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.633996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.846353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:24.859159 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdd40d2f-7a8c-41c4-98f3-454bb1584fd2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.259367 Oct 31 14:22:24.862727 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2327/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:24 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:24.886777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:24.889834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:24.909386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.911443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.912196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.913792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.914852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.915981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.935772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948/action HTTP/1.1 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 28 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: {"reboot": {"type": "SOFT"}} Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '44c1698c-2f83-4f1f-a7ab-8f6c9d0be948', 'body': {'reboot': {'type': 'SOFT'}}} Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:24.938250 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:24.944896 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:24.958221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:24.959859 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6295dbd9-a83d-46e6-a157-6193448f2a9f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948/action" status: 404 len: 111 microversion: 2.1 time: 0.077037 Oct 31 14:22:24.964533 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2068/4395] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:24 2022] POST /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:24.971975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:24.972599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:24.986085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.986815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.987450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:24.988394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:24.989015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:24.990633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.264427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:25.275155 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc5de0a9-e0f1-4fae-95b9-e4a370af47cd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.307626 Oct 31 14:22:25.292378 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2328/4396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:24 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:25.301814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:25.302702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:25.309227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:25.309962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:25.310716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.311660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:25.312123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:25.312558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.604636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:25.605313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:25.611532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:25.612049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:25.612496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.613195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:25.613654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:25.614087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.721224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:25.731511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:25.734502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:25.735882 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-876e5bf0-0780-4e12-a3d3-d25d8db1e37a tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.135212 Oct 31 14:22:25.736820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2329/4397] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:25 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:22:25.742981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:25.743869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:25.751505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:25.752016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:25.752390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.753284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:25.753739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:25.754182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:25.986299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:25.996814 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-095f0f25-3f0c-41cd-bcd1-19680b87e6e0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.698831 Oct 31 14:22:26.001926 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2069/4398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:25 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:26.029310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0594a749-dea7-4f04-b090-4943008b281d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:26.033517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0594a749-dea7-4f04-b090-4943008b281d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 3f12ac24-aee7-45a1-b2b7-6169d74f911f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:26.053645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-0594a749-dea7-4f04-b090-4943008b281d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 3f12ac24-aee7-45a1-b2b7-6169d74f911f could not be found. Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0594a749-dea7-4f04-b090-4943008b281d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/3f12ac24-aee7-45a1-b2b7-6169d74f911f/action HTTP/1.1 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 28 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: {"reboot": {"type": "SOFT"}} Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 3f12ac24-aee7-45a1-b2b7-6169d74f911f could not be found. Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3f12ac24-aee7-45a1-b2b7-6169d74f911f', 'body': {'reboot': {'type': 'SOFT'}}} Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f12ac24-aee7-45a1-b2b7-6169d74f911f could not be found. Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f12ac24-aee7-45a1-b2b7-6169d74f911f could not be found. Oct 31 14:22:26.058995 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f12ac24-aee7-45a1-b2b7-6169d74f911f could not be found. Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0594a749-dea7-4f04-b090-4943008b281d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 3f12ac24-aee7-45a1-b2b7-6169d74f911f could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:26.063522 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0594a749-dea7-4f04-b090-4943008b281d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/3f12ac24-aee7-45a1-b2b7-6169d74f911f/action" status: 404 len: 111 microversion: 2.1 time: 0.036275 Oct 31 14:22:26.066901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2070/4399] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:26 2022] POST /compute/v2.1/servers/3f12ac24-aee7-45a1-b2b7-6169d74f911f/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:26.078954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:26.079759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:26.117534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:26.118045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:26.118797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:26.119526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:26.119970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:26.120401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:26.150111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:26.158648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b6d6d72-f567-4f1e-a548-ad6420f9e350 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.420975 Oct 31 14:22:26.162634 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2330/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:25 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:26.485621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:26.501931 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f6c139b-a977-469c-99ef-27c67ecf3842 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.432485 Oct 31 14:22:26.502815 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2071/4401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:26 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:26.532192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:26.533866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:26.544305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:26.549120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:26.549793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:26.551139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:26.553443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:26.554689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:26.719200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1325172614", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8e151641-d509-4c49-b11c-0a91a1dbe30a"}, {"port": "7de5dba0-411e-42b4-bc5d-96a1f3fa33f2", "tag": "port-1"}, {"port": "33358b3f-c979-4750-b51f-c7e629059f82", "tag": "port-2"}, {"uuid": "58c12580-a288-4c66-bed4-bd3ead0747bd", "tag": "net-1"}, {"uuid": "58c12580-a288-4c66-bed4-bd3ead0747bd"}, {"uuid": "30ea37d0-a9a2-476d-80f2-790897991e82", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "30ea37d0-a9a2-476d-80f2-790897991e82", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2f1a1b07-0e9e-4f92-9f57-3ddc4fa961d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "55d0c794-c4b5-4c66-bdb5-e16c1e6a5ccd", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ea9991eb-6c57-484a-b707-3b1c14bfb39b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--216804676"}], "key_name": "tempest-keypair-1803251660", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:26.875707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] validate_networks() for [('8e151641-d509-4c49-b11c-0a91a1dbe30a', None, None, None, None, None), (None, None, '7de5dba0-411e-42b4-bc5d-96a1f3fa33f2', None, None, None), (None, None, '33358b3f-c979-4750-b51f-c7e629059f82', None, None, None), ('58c12580-a288-4c66-bed4-bd3ead0747bd', None, None, None, None, None), ('58c12580-a288-4c66-bed4-bd3ead0747bd', None, None, None, None, None), ('30ea37d0-a9a2-476d-80f2-790897991e82', '10.2.2.100', None, None, None, None), ('30ea37d0-a9a2-476d-80f2-790897991e82', '10.2.2.200', None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:22:27.032399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:27.041880 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3761d41f-67cf-4ff0-a86b-ffd497019997 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.514208 Oct 31 14:22:27.042506 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2331/4402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:26 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:27.068578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:27.069201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:27.089982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.090513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.090958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.091672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.092150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.092578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.267281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:27.285366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:27.288332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:27.290093 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9d6e4e3-ccc4-4817-a20c-e9ff55a8cfc7 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.226345 Oct 31 14:22:27.291398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2332/4403] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:27 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:27.306221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:27.310975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:27.328198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.329494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.331355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.332331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.334122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.338368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.360818 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948/action HTTP/1.1 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 65 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '44c1698c-2f83-4f1f-a7ab-8f6c9d0be948', 'body': {'rebuild': {'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66'}}} Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 14:22:27.363257 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:22:27.368934 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:27.372023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:27.373125 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfdcaa14-14b8-4c49-94d4-e70e2286e811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948/action" status: 404 len: 111 microversion: 2.1 time: 0.075279 Oct 31 14:22:27.373938 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2333/4404] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:27 2022] POST /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:27.381678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:27.382825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:27.390357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.391179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.392066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.393058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.393738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.394494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.610304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:27.622681 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9509ebb0-4662-4bdd-9f3e-48aec701f21d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.247189 Oct 31 14:22:27.640265 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2334/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:27 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:27.645342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:27.646198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:27.654033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.654847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.656046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.657635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.658402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.659023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.861792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:27.870110 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2fcc18cf-d427-4084-9f98-bea2d6179bad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.228463 Oct 31 14:22:27.870721 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2335/4406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:27 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:27.895840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:27.896463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:27.910199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.911055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.911655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:27.912541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:27.913149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:27.913746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:28.497789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:28.508678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-277975cf-7dd4-41d7-a552-00a54736e46f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.614988 Oct 31 14:22:28.509387 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2336/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:27 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:28.517306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:28.521498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:28.532113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:28.534360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:28.536198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:28.537056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:28.538652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:28.539209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:28.648964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:28.665317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:28.675934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:28.677963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:28.680398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dae36d3-ee64-43f6-aa57-bc830f52778f tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1603 microversion: 2.32 time: 0.168365 Oct 31 14:22:28.696390 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2337/4408] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:28 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:28.711951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b851f40d-ff3a-425e-a09d-d4d9b961d06b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:28.723056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b851f40d-ff3a-425e-a09d-d4d9b961d06b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: d948b0c3-da08-4a96-b7eb-86432a860bc8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:28.731994 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b851f40d-ff3a-425e-a09d-d4d9b961d06b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance d948b0c3-da08-4a96-b7eb-86432a860bc8 could not be found. Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b851f40d-ff3a-425e-a09d-d4d9b961d06b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/d948b0c3-da08-4a96-b7eb-86432a860bc8/action HTTP/1.1 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 65 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance d948b0c3-da08-4a96-b7eb-86432a860bc8 could not be found. Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'd948b0c3-da08-4a96-b7eb-86432a860bc8', 'body': {'rebuild': {'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66'}}} Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d948b0c3-da08-4a96-b7eb-86432a860bc8 could not be found. Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 14:22:28.734405 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d948b0c3-da08-4a96-b7eb-86432a860bc8 could not be found. Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d948b0c3-da08-4a96-b7eb-86432a860bc8 could not be found. Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b851f40d-ff3a-425e-a09d-d4d9b961d06b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance d948b0c3-da08-4a96-b7eb-86432a860bc8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b851f40d-ff3a-425e-a09d-d4d9b961d06b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/d948b0c3-da08-4a96-b7eb-86432a860bc8/action" status: 404 len: 111 microversion: 2.1 time: 0.038325 Oct 31 14:22:28.743940 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2338/4409] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:28 2022] POST /compute/v2.1/servers/d948b0c3-da08-4a96-b7eb-86432a860bc8/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:28.758983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:28.759532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:28.767910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:28.768404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:28.768841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:28.769534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:28.778411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:28.781494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:29.123801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:29.135053 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2ce69d6-2507-49a0-9ea7-c6e058bdc015 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.379962 Oct 31 14:22:29.138334 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2339/4410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:28 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:29.164198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:29.166201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:29.179209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:29.184433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:29.185184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:29.186118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:29.186837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:29.187454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:29.540295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:29.556272 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a36ba65d-d0ef-4591-aeab-0f14b6b74dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.414247 Oct 31 14:22:29.558515 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2340/4411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:29 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:29.587087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:29.588117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:29.604573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:29.607614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:29.610721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:29.611672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:29.616630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:29.617258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:30.239012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:30.253919 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcf7a495-81ef-4642-8760-67a8367e11ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.674905 Oct 31 14:22:30.254780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2341/4412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:29 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:30.268098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:30.283639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:30.304736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:30.308235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:30.308976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:30.312138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:30.312689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:30.314868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:30.431735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:30.432448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:30.433518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:30.433730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lazy-loading 'fault' on Instance uuid cbb98a6f-ffa6-454e-9973-2e6b21a64ace {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:22:30.580981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:30.591428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:30.593301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906b646261334b8fa6f8dddaace2b8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da7c5476c60a47c6a49c9b0e556d4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:30.599105 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd8abc8b-b6e8-4d1b-802f-29751407538d tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 200 len: 1370 microversion: 2.32 time: 0.341594 Oct 31 14:22:30.607475 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2342/4413] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:30 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:30.619599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:30.621897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:30.630300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:30.631478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:30.634670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:30.642654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:30.643671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:30.644347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:30.940860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=12 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:31.127928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:31.148082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7bd4cc8-cdb0-46a5-bf81-b3630a84a50a tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1315 microversion: 2.1 time: 0.537499 Oct 31 14:22:31.151398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2343/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:30 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:31.190734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c36274c7-f107-494f-8201-efaa68e5ddf0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:31.193076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c36274c7-f107-494f-8201-efaa68e5ddf0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:31.216299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c36274c7-f107-494f-8201-efaa68e5ddf0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55 could not be found. Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c36274c7-f107-494f-8201-efaa68e5ddf0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55/action HTTP/1.1 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 15 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: {"restore": {}} Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55 could not be found. Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55', 'body': {'restore': {}}} Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55 could not be found. Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55 could not be found. Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:31.221331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:31.225200 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:31.225200 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:31.225200 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55 could not be found. Oct 31 14:22:31.225200 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:31.226501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c36274c7-f107-494f-8201-efaa68e5ddf0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:31.235332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c36274c7-f107-494f-8201-efaa68e5ddf0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55/action" status: 404 len: 111 microversion: 2.1 time: 0.082348 Oct 31 14:22:31.237621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2344/4415] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:31 2022] POST /compute/v2.1/servers/c9d6c8bc-d3ad-4b3a-b1de-873d8c8d3d55/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:31.244103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5f0583a2-fce1-40d2-8bf9-f9c1cedea130 req-483caafe-1fd8-42e0-b7bc-66742226de7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce17942-fbf2-4196-ba9f-05b6d1ca8e84", "name": "network-vif-plugged", "status": "completed", "tag": "a411f9f6-3e8b-4f9e-87bc-788508725105"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:31.261069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f0583a2-fce1-40d2-8bf9-f9c1cedea130 req-483caafe-1fd8-42e0-b7bc-66742226de7d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:31.261956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f0583a2-fce1-40d2-8bf9-f9c1cedea130 req-483caafe-1fd8-42e0-b7bc-66742226de7d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:31.262794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f0583a2-fce1-40d2-8bf9-f9c1cedea130 req-483caafe-1fd8-42e0-b7bc-66742226de7d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:31.293804 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5f0583a2-fce1-40d2-8bf9-f9c1cedea130 req-483caafe-1fd8-42e0-b7bc-66742226de7d service nova] Creating event network-vif-plugged:a411f9f6-3e8b-4f9e-87bc-788508725105 for instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 on n-h1-863052-1 Oct 31 14:22:31.300077 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5f0583a2-fce1-40d2-8bf9-f9c1cedea130 req-483caafe-1fd8-42e0-b7bc-66742226de7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060716 Oct 31 14:22:31.307828 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2345/4416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:31.313548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:31.314294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:31.336495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:31.336495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:31.336721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:31.337368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:31.341604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:31.342207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:31.872929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:31.884057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82f09054-dcb6-4093-9eb9-b638400c9b01 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.574311 Oct 31 14:22:31.884809 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2346/4417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:31 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:31.914752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:31.923262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:31.936025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:31.944015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:31.956194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:31.957333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:31.959876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:31.960524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:32.012300 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] HTTP exception thrown: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Request method failure captured: Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace HTTP/1.1 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9iMB7plKX4Lcvkm-_3eSCyP7t-k1c1LeaIPNx5AYZCi36cxW5UL4Qdgsq2O0FAb08xN_WkhoCx3gVaSd_tk-IGXW299WiXMcIEYa8Qyt-5o-dobckPvntNWuOHQcdOrGkExVEBYDucGWe-uqVkBFVyGkQd1gkW_2gsrEr8YL5rXY7E Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: da7c5476c60a47c6a49c9b0e556d4fc7 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da7c5476c60a47c6a49c9b0e556d4fc7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: da7c5476c60a47c6a49c9b0e556d4fc7 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TaggedBootDevicesTest-260652874-project Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 906b646261334b8fa6f8dddaace2b8ba Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TaggedBootDevicesTest-260652874-project Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'cbb98a6f-ffa6-454e-9973-2e6b21a64ace'} Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:32.026014 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:32.029943 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:32.032276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Returning 404 to user: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:32.033362 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3793600f-3edf-4590-aa08-54f1a05dcd28 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 404 len: 111 microversion: 2.32 time: 0.147331 Oct 31 14:22:32.034360 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2347/4418] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:31 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:32.039879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:32.042387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:32.066935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:32.067754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:32.068415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:32.069369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:32.070037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:32.070722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:32.459143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:32.470585 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce6c961d-6986-41f7-88d5-bfbd53acf778 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.434828 Oct 31 14:22:32.471868 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2348/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:32 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:32.477479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3dd80ae-c99d-45a2-b14f-2a4fe38dc3ae tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '.version_select at 0x7fe1065dae50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:32.482648 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b3dd80ae-c99d-45a2-b14f-2a4fe38dc3ae tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [ec38f98c-0f67-4531-a17e-d336b7ecc116] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 14:22:32.525847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:22:32.526390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:22:32.526849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:22:32.527271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:22:32.527690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:22:32.545547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:32.547110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:32.547565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:32.550436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:32.554386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:32.555007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:32.603557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Getting quotas for project 470dc32e543245bf86911af99cff6687. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:22:32.611812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Getting quotas for user 2317857a46254953834ffdd2361dc586 and project 470dc32e543245bf86911af99cff6687. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:22:33.117985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:22:33.122450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2f1a1b07-0e9e-4f92-9f57-3ddc4fa961d3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='55d0c794-c4b5-4c66-bdb5-e16c1e6a5ccd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea9991eb-6c57-484a-b707-3b1c14bfb39b',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:22:33.492025 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [None req-b3dd80ae-c99d-45a2-b14f-2a4fe38dc3ae tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [ec38f98c-0f67-4531-a17e-d336b7ecc116] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41996. Oct 31 14:22:33.538942 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3dd80ae-c99d-45a2-b14f-2a4fe38dc3ae tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998249687" status: 204 len: 0 microversion: 2.32 time: 1.065617 Oct 31 14:22:33.542349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2349/4420] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998249687 => generated 0 bytes in 1069 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:22:33.557849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:33.558819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:33.576762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:33.580419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:33.581653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:33.582676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:33.584382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:33.586930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:33.688274 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b519a0f-9c6c-45b8-8304-c6276ea0baa6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.973588 Oct 31 14:22:33.689570 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2072/4421] 10.222.0.27 () {62 vars in 1189 bytes} [Mon Oct 31 14:22:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 6976 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 31 14:22:33.700231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:33.701043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:33.710055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:33.712440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:33.713412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:33.717917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:33.720444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:33.721653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:33.764002 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'restore' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 15 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: {"restore": {}} Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'restore' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'restore': {}}} Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state active. Cannot restore while the instance is in this state. Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:33.765792 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'restore' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29a5dcac-4e84-4dcb-bd03-a7a6b279a4ed tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 145 microversion: 2.1 time: 0.076600 Oct 31 14:22:33.769958 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2073/4422] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:33 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:22:33.774661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f626837f-a1d2-44bd-bf6d-bd77f2083975 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:33.775285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f626837f-a1d2-44bd-bf6d-bd77f2083975 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:34.085918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f626837f-a1d2-44bd-bf6d-bd77f2083975 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:34.099225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f626837f-a1d2-44bd-bf6d-bd77f2083975 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:34.103203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f626837f-a1d2-44bd-bf6d-bd77f2083975 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:34.109081 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f626837f-a1d2-44bd-bf6d-bd77f2083975 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1286 microversion: 2.42 time: 0.337955 Oct 31 14:22:34.109879 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2074/4423] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:33 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1286 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:34.115686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:34.131100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:34.157779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:34.161353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:34.162395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:34.164609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:34.166515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:34.168324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:34.193813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:34.202252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7586f95e-9ebb-43c5-9222-ec6b7efcfd26 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1502 microversion: 2.1 time: 0.657646 Oct 31 14:22:34.206638 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2350/4424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:33 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1502 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:34.230597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-194680021"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:34.231242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:34.239571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:34.240002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:34.240443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:34.241150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:34.241600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:34.242020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:34.567002 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.network.security_group_api [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Adding security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 to port a411f9f6-3e8b-4f9e-87bc-788508725105 Oct 31 14:22:34.789427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:34.797542 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f746782-904a-4557-94bd-884eb6edc945 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.685454 Oct 31 14:22:34.814622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2075/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:34 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:34.822988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:34.823905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:34.831551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:34.832219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:34.832829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:34.833714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:34.834374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:34.834957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.152336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:35.164960 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e69319a6-1dac-4923-b433-943140d730bf tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.345589 Oct 31 14:22:35.180282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2076/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:34 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:35.192960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:35.193626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:35.199922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.201017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.201458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.203010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.203664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.204278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.334955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:35.345366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:35.346886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:35.358654 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-733c4a04-4527-4573-857a-e0a1e1058159 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1520 microversion: 2.42 time: 0.170521 Oct 31 14:22:35.359276 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2077/4427] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:35 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:35.375090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c879d9f0-93a7-49fa-9187-a6f2148ed3ca tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:35.375913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c879d9f0-93a7-49fa-9187-a6f2148ed3ca tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 72ab161b-d26b-47e4-bd64-7bd99262eced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:35.384612 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c879d9f0-93a7-49fa-9187-a6f2148ed3ca tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 72ab161b-d26b-47e4-bd64-7bd99262eced could not be found. Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c879d9f0-93a7-49fa-9187-a6f2148ed3ca tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/72ab161b-d26b-47e4-bd64-7bd99262eced/action HTTP/1.1 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 14 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: {"resume": {}} Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 72ab161b-d26b-47e4-bd64-7bd99262eced could not be found. Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '72ab161b-d26b-47e4-bd64-7bd99262eced', 'body': {'resume': {}}} Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ab161b-d26b-47e4-bd64-7bd99262eced could not be found. Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ab161b-d26b-47e4-bd64-7bd99262eced could not be found. Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:35.392665 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ab161b-d26b-47e4-bd64-7bd99262eced could not be found. Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c879d9f0-93a7-49fa-9187-a6f2148ed3ca tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 72ab161b-d26b-47e4-bd64-7bd99262eced could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c879d9f0-93a7-49fa-9187-a6f2148ed3ca tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/72ab161b-d26b-47e4-bd64-7bd99262eced/action" status: 404 len: 111 microversion: 2.1 time: 0.035830 Oct 31 14:22:35.398331 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2078/4428] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:35 2022] POST /compute/v2.1/servers/72ab161b-d26b-47e4-bd64-7bd99262eced/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:35.405798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:35.406447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:35.423735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.424581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.425276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.426029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.426534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.426973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.788626 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8826a3f-df25-4910-be9d-6ecba7bf606e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84/action" status: 202 len: 0 microversion: 2.1 time: 1.562478 Oct 31 14:22:35.790479 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2351/4429] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:34 2022] POST /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84/action => generated 0 bytes in 1565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:35.802718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-327d5767-a407-4029-81c3-c8aee33da78b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe1064eb940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:35.811021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:35.823502 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-abe25109-af6c-4c16-9600-18450fbeadc5 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.422119 Oct 31 14:22:35.827844 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2079/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:35 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:35.846428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2e11d592-4089-4580-aaac-3cef5d27ce96 req-f66490c1-b770-458a-a891-b90c0e16dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce17942-fbf2-4196-ba9f-05b6d1ca8e84", "tag": "a411f9f6-3e8b-4f9e-87bc-788508725105"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:35.866102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e11d592-4089-4580-aaac-3cef5d27ce96 req-f66490c1-b770-458a-a891-b90c0e16dfe2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.866977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e11d592-4089-4580-aaac-3cef5d27ce96 req-f66490c1-b770-458a-a891-b90c0e16dfe2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.867777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e11d592-4089-4580-aaac-3cef5d27ce96 req-f66490c1-b770-458a-a891-b90c0e16dfe2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.891823 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2e11d592-4089-4580-aaac-3cef5d27ce96 req-f66490c1-b770-458a-a891-b90c0e16dfe2 service nova] Creating event network-changed:a411f9f6-3e8b-4f9e-87bc-788508725105 for instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 on n-h1-863052-1 Oct 31 14:22:35.907088 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2e11d592-4089-4580-aaac-3cef5d27ce96 req-f66490c1-b770-458a-a891-b90c0e16dfe2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077611 Oct 31 14:22:35.910508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2080/4431] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:35.923024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:35.924052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:35.946038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.947628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.952132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:35.956735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:35.957586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:35.958330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.498537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-327d5767-a407-4029-81c3-c8aee33da78b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use.", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:36.500317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-327d5767-a407-4029-81c3-c8aee33da78b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.500317 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-327d5767-a407-4029-81c3-c8aee33da78b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5 HTTP/1.1 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: exception: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '541a3ea9-aa63-4cd6-9cfe-f296111391c5'} Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:36.503695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] Oct 31 14:22:36.508120 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.512677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-327d5767-a407-4029-81c3-c8aee33da78b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 400 to user: Security Group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 in use. Oct 31 14:22:36.512677 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-cff3ed1f-8503-453c-8a40-ba939aa76200'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:36.513780 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-327d5767-a407-4029-81c3-c8aee33da78b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5" status: 400 len: 185 microversion: 2.1 time: 0.719009 Oct 31 14:22:36.515097 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2352/4432] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:35 2022] DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5 => generated 185 bytes in 721 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:36.541769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:36.543604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:36.572387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:36.579426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:36.580522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.581517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:36.582146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:36.582957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.727995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:36.745433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:36.776092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:36.782312 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17953842-ca4b-4944-9cda-078304df4301 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1594 microversion: 2.42 time: 0.258563 Oct 31 14:22:36.783349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2353/4433] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:36 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1594 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:36.804325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:36.828636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:36.830064 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42227ce4-3e57-4346-8227-d3352be530c4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.913077 Oct 31 14:22:36.831263 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2081/4434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:35 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:36.841662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:36.858448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:36.859367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:36.872218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:36.873111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:36.875317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.892961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:36.895008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:36.895508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:36.896197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.896939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:36.897931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:36.898612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.900414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:36.901066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:36.963264 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'resume' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 14 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: {"resume": {}} Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'resume' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'resume': {}}} Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state active. Cannot resume while the instance is in this state. Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:36.965478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:22:36.969441 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:36.972939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'resume' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:36.974112 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-260287ba-4ab2-4c7b-9235-ac3dd885eea9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 144 microversion: 2.1 time: 0.120556 Oct 31 14:22:36.979241 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2082/4435] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:36 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 144 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:22:36.988801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:36.989805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:37.004159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:37.009259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:37.009958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:37.011599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:37.012262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:37.013686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:37.086770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6c9006b-1f4b-4bdf-a197-f088e3217236 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84/action" status: 202 len: 0 microversion: 2.1 time: 0.299994 Oct 31 14:22:37.087796 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2354/4436] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:36 2022] POST /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:37.098411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:37.099543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:37.107814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:37.108774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:37.109494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:37.110507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:37.111886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:37.112729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:37.711459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:37.726230 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8ea0916-251a-4891-9e84-b11f9a9d5d11 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1572 microversion: 2.1 time: 0.632795 Oct 31 14:22:37.727484 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2355/4437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:37 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1572 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:37.812708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:37.813604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:37.823207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:37.827770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:37.828754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:37.830316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:37.831022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:37.831689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:38.089404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:38.106383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:38.111912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:38.113376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ef4b11e-78fe-4856-9afd-8e69f7a235ea tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1594 microversion: 2.42 time: 0.304958 Oct 31 14:22:38.116330 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2356/4438] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:37 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1594 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:38.222787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:38.235296 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f4d69a6-8d38-47bb-8ce4-368f4e570932 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.251655 Oct 31 14:22:38.237503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2083/4439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:36 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:38.268918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:38.273194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:38.308520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:38.309023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:38.309473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:38.310241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:38.310721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:38.311207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:38.751808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:38.752426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:38.768741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:38.769507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:38.769945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:38.770704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:38.771157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:38.771584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:38.911116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:38.928802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09de96e6-22c0-4d81-ad76-5544b3c901ab tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.667290 Oct 31 14:22:38.952257 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2357/4440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:38 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:39.126568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cef92651-6b7e-45dd-bc65-7fa8f8553c16 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cef92651-6b7e-45dd-bc65-7fa8f8553c16 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 160 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9f8924a5-c038-416a-9512-8369ddd99493"}]}} Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'server': {'name': '', 'imageRef': 'cf380c16-a362-46be-bffa-e45fdf8f7e66', 'flavorRef': '452', 'networks': [{'uuid': '9f8924a5-c038-416a-9512-8369ddd99493'}]}}} Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '' Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:22:39.133825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:22:39.138619 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:39.140201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cef92651-6b7e-45dd-bc65-7fa8f8553c16 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:39.141478 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cef92651-6b7e-45dd-bc65-7fa8f8553c16 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019437 Oct 31 14:22:39.145307 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2358/4441] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:22:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:22:39.155605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:39.160779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:39.186509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:39.187584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:39.192082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:39.193204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:39.195387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:39.196527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:39.322591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:39.339022 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78f62ac8-3cf8-43d6-bdd4-a6c4f14b8afc tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1572 microversion: 2.1 time: 0.589735 Oct 31 14:22:39.340934 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2084/4442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:38 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1572 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:39.359263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:39.359907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:39.367811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:39.368556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:39.369155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:39.370022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:39.379943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:39.380608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:39.417323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:39.420015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:39.437732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:39.439669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:39.443527 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50a8e02b-86b7-4328-b212-f76272225d8a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1594 microversion: 2.42 time: 0.295704 Oct 31 14:22:39.444602 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2359/4443] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:39 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1594 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:39.872000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:39.881009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a22e1134-5b8b-41e4-8102-d8d6f0b7f0c8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.538805 Oct 31 14:22:39.882268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2085/4444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:39 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:39.912496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:39.914330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:39.922041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:39.922824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:39.923425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:39.925048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:39.926346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:39.927012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:40.363595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:40.365442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:40.382599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:40.384807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:40.387007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:40.389069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:40.389754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:40.394878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:40.677016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:40.686433 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f892e47f-8dc0-4edc-b52c-87098df4ab8a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.778497 Oct 31 14:22:40.690829 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2360/4445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:39 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:40.715238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:40.715861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:40.722267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:40.723657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:40.724386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:40.725005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:40.725731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:40.726454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:40.726904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.130638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:41.150366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:41.152155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:41.153384 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-614d2248-418f-4383-ac92-25eaa3b6d9e1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1661 microversion: 2.42 time: 0.448411 Oct 31 14:22:41.153956 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2361/4446] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:40 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1661 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:41.163449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:41.172811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:41.180026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.180729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.181343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.182060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.182580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.183016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.246200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4635168-da94-40ff-b44a-ed37d4af2521 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086577 Oct 31 14:22:41.252504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2362/4447] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:22:41 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:41.262395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcfb1409-d477-4830-a1c5-1d1683ff6465 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:41.263075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcfb1409-d477-4830-a1c5-1d1683ff6465 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 802166de-32e2-490e-ad0d-38b8aa83681c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:41.273545 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-fcfb1409-d477-4830-a1c5-1d1683ff6465 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 802166de-32e2-490e-ad0d-38b8aa83681c could not be found. Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcfb1409-d477-4830-a1c5-1d1683ff6465 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/802166de-32e2-490e-ad0d-38b8aa83681c/action HTTP/1.1 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 14 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: {"shelve": {}} Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 802166de-32e2-490e-ad0d-38b8aa83681c could not be found. Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '802166de-32e2-490e-ad0d-38b8aa83681c', 'body': {'shelve': {}}} Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802166de-32e2-490e-ad0d-38b8aa83681c could not be found. Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802166de-32e2-490e-ad0d-38b8aa83681c could not be found. Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:41.283440 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802166de-32e2-490e-ad0d-38b8aa83681c could not be found. Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcfb1409-d477-4830-a1c5-1d1683ff6465 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 802166de-32e2-490e-ad0d-38b8aa83681c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcfb1409-d477-4830-a1c5-1d1683ff6465 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/802166de-32e2-490e-ad0d-38b8aa83681c/action" status: 404 len: 111 microversion: 2.1 time: 0.031545 Oct 31 14:22:41.291775 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2363/4448] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:41 2022] POST /compute/v2.1/servers/802166de-32e2-490e-ad0d-38b8aa83681c/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:41.293651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:41.294184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:41.313588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.314116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.314778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.315513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.315969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.316391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.421330 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-714939f4-6c19-4ec8-9199-b81ef66a0581 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/73af4c85-ac53-40dd-9fdc-7b6f483761ca" status: 200 len: 194 microversion: 2.1 time: 0.133215 Oct 31 14:22:41.432606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2364/4449] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 31 14:22:41 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/73af4c85-ac53-40dd-9fdc-7b6f483761ca => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:41.438433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:41.450528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:41.451110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:41.457743 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-436615d1-49ce-4044-978b-950f4fc9b62b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1570 microversion: 2.1 time: 1.098239 Oct 31 14:22:41.464147 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2086/4450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:40 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1570 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:41.480793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.481314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.481763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.482520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.496832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.497163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-263261972"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:41.497539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.498299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:41.510936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.514746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.516760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.519461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:41.522151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:41.523740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:41.852683 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Adding security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 to port a411f9f6-3e8b-4f9e-87bc-788508725105 Oct 31 14:22:42.426662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:42.438929 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5cc78f93-797a-43d3-9ff8-399048ac4ee9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.004317 Oct 31 14:22:42.440586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2365/4451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:41 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:42.453183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:42.455151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:42.469666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:42.470180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:42.473421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:42.476610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:42.477396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:42.479948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:42.574007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:43.249784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:43.275045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:43.276711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:43.313492 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43ad76b6-5a60-480b-8005-cf57af67747d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1707 microversion: 2.42 time: 0.857405 Oct 31 14:22:43.319312 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2366/4452] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:42 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1707 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:43.349164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:43.358365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:43.382999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:43.384379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:43.384827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:43.386977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:43.388759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:43.392958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:43.398781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0c9fec24-eebd-4aab-abec-9b3de9e5366c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84/action" status: 202 len: 0 microversion: 2.1 time: 1.906308 Oct 31 14:22:43.403828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2087/4453] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:41 2022] POST /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84/action => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:22:43.411108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-106b1698-1b10-454b-af44-756da65cd2d1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10749e040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:44.097824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:44.293502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-106b1698-1b10-454b-af44-756da65cd2d1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use.", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:44.295175 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-106b1698-1b10-454b-af44-756da65cd2d1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.295175 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-106b1698-1b10-454b-af44-756da65cd2d1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 HTTP/1.1 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: exception: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '6ec6dcd1-cbc2-47be-8da9-f5dc58afc338'} Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:44.297260 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-106b1698-1b10-454b-af44-756da65cd2d1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 400 to user: Security Group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 in use. Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-83c77ea6-eb6e-4619-8d4d-2837a153370c'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-106b1698-1b10-454b-af44-756da65cd2d1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338" status: 400 len: 185 microversion: 2.1 time: 0.893860 Oct 31 14:22:44.303336 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2088/4454] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:43 2022] DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 => generated 185 bytes in 895 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:44.313881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3a69e603-8f89-434e-9f91-6cf8ff998f65 req-d78c0fe4-3a70-46cd-9b18-b56c61d7de38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce17942-fbf2-4196-ba9f-05b6d1ca8e84", "tag": "a411f9f6-3e8b-4f9e-87bc-788508725105"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:44.354762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3a69e603-8f89-434e-9f91-6cf8ff998f65 req-d78c0fe4-3a70-46cd-9b18-b56c61d7de38 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.359621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3a69e603-8f89-434e-9f91-6cf8ff998f65 req-d78c0fe4-3a70-46cd-9b18-b56c61d7de38 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.360122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3a69e603-8f89-434e-9f91-6cf8ff998f65 req-d78c0fe4-3a70-46cd-9b18-b56c61d7de38 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.378865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:44.402998 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3a69e603-8f89-434e-9f91-6cf8ff998f65 req-d78c0fe4-3a70-46cd-9b18-b56c61d7de38 service nova] Creating event network-changed:a411f9f6-3e8b-4f9e-87bc-788508725105 for instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 on n-h1-863052-1 Oct 31 14:22:44.417298 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3a69e603-8f89-434e-9f91-6cf8ff998f65 req-d78c0fe4-3a70-46cd-9b18-b56c61d7de38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116629 Oct 31 14:22:44.417906 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2089/4455] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:44.432982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:44.437006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:44.444766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:44.454032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64bbd96a-e8c8-4d43-b498-8f9ca86fb648 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.133512 Oct 31 14:22:44.465569 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2367/4456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:43 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:44.479287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.479287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.479287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.479287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.479287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.479287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.480312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:44.481135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:44.502534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.507307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.509724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.511078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.516243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.518970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.584562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:22:44.790297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:44.810202 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94f7f102-4288-4042-b668-ec9201a4482b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 204 len: 0 microversion: 2.1 time: 0.387498 Oct 31 14:22:44.813209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2090/4457] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:22:44 2022] DELETE /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:22:44.830505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:44.831482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:44.841807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.843225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.843823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.844700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:44.846079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:44.846701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:44.901250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lazy-loading 'flavor' on Instance uuid e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:22:45.249795 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b91fe082-730c-4e2e-980a-62520671bf99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.435116 Oct 31 14:22:45.251193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2091/4458] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:22:44 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:45.258494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b527ff-70ed-45f7-aa73-05752339a4d9"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:45.261529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:45.304584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:45.339202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:45.339879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:45.340805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:45.341417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:45.343885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:46.025452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:46.058200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:46.061998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:46.067486 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da9a0190-41d2-4897-bbc2-e4a0183fc191 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1753 microversion: 2.42 time: 1.600789 Oct 31 14:22:46.072453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2368/4459] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:44 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1753 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:46.077647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:46.126766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:46.141304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:46.141804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:46.142272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:46.142978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:46.157847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:46.158447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:46.298442 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-264192ac-e072-463e-bd37-caf689cef210 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "POST /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044426 Oct 31 14:22:46.299433 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2092/4460] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:22:45 2022] POST /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:46.346025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:46.352010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:46.385539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:46.386325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:46.386939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:46.387813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:46.389001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:46.389582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:46.975700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:46.994779 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c573b507-6369-42a7-b626-870c708d53b1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.676146 Oct 31 14:22:46.998483 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2093/4461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:46 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:47.041522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:47.063328 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50cf3645-ab99-47f6-be86-bed9e3aec86b tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1644 microversion: 2.1 time: 0.986889 Oct 31 14:22:47.068469 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2369/4462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:46 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1644 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:47.101418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:47.102407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:47.153423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:47.173104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:47.178634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:47.185195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:47.185807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:47.193729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:48.027426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:48.028651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:48.044525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:48.047288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:48.049237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:48.051104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:48.052727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:48.055108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:48.948551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:48.983787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:48.988348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:48.998777 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f10c9ed6-155b-4537-8772-66bb23fef408 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1753 microversion: 2.42 time: 1.897028 Oct 31 14:22:49.001179 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2094/4463] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:47 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1753 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:49.025294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:49.032358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:49.057451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:49.058856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:49.059692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:49.068114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:49.070221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:49.070966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:49.690178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:49.703012 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf48b35c-ce83-4db1-ba0f-2154d7e0fd13 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1644 microversion: 2.1 time: 0.699265 Oct 31 14:22:49.725509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2095/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:49 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1644 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:49.950611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:49.984973 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bf4fe2b-871e-41cb-ae64-f787a700eef1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 1.962068 Oct 31 14:22:50.007656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2370/4465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:48 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:50.028766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:50.028766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:50.039680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:50.041189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.041904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:50.047076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.047810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.048832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.049546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.050349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.064057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.064754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.065172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.071040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.071704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.072296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.166508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] HTTP exception thrown: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Request method failure captured: Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace HTTP/1.1 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9iMB7plKX4Lcvkm-_3eSCyP7t-k1c1LeaIPNx5AYZCi36cxW5UL4Qdgsq2O0FAb08xN_WkhoCx3gVaSd_tk-IGXW299WiXMcIEYa8Qyt-5o-dobckPvntNWuOHQcdOrGkExVEBYDucGWe-uqVkBFVyGkQd1gkW_2gsrEr8YL5rXY7E Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: da7c5476c60a47c6a49c9b0e556d4fc7 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da7c5476c60a47c6a49c9b0e556d4fc7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: da7c5476c60a47c6a49c9b0e556d4fc7 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TaggedBootDevicesTest-260652874-project Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 906b646261334b8fa6f8dddaace2b8ba Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TaggedBootDevicesTest-260652874-project Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'cbb98a6f-ffa6-454e-9973-2e6b21a64ace'} Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:50.182864 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Returning 404 to user: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:50.188985 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfc4eb5f-8c2e-4084-ae52-9c14fc20d419 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 404 len: 111 microversion: 2.32 time: 0.149132 Oct 31 14:22:50.194192 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2371/4466] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:22:50 2022] DELETE /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:50.200604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:50.201521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] [instance: cbb98a6f-ffa6-454e-9973-2e6b21a64ace] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:50.244610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.245167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.245739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.246630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.247106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.247595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.325593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] HTTP exception thrown: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Request method failure captured: Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace HTTP/1.1 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9iMB7plKX4Lcvkm-_3eSCyP7t-k1c1LeaIPNx5AYZCi36cxW5UL4Qdgsq2O0FAb08xN_WkhoCx3gVaSd_tk-IGXW299WiXMcIEYa8Qyt-5o-dobckPvntNWuOHQcdOrGkExVEBYDucGWe-uqVkBFVyGkQd1gkW_2gsrEr8YL5rXY7E Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: da7c5476c60a47c6a49c9b0e556d4fc7 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da7c5476c60a47c6a49c9b0e556d4fc7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da7c5476c60a47c6a49c9b0e556d4fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: da7c5476c60a47c6a49c9b0e556d4fc7 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TaggedBootDevicesTest-260652874 Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TaggedBootDevicesTest-260652874-project Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 906b646261334b8fa6f8dddaace2b8ba Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TaggedBootDevicesTest-260652874-project Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'cbb98a6f-ffa6-454e-9973-2e6b21a64ace'} Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:50.333317 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] Returning 404 to user: Instance cbb98a6f-ffa6-454e-9973-2e6b21a64ace could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:50.337027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38ba4607-59e4-490e-b4d3-2f24bbb98c98 tempest-TaggedBootDevicesTest-260652874 tempest-TaggedBootDevicesTest-260652874-project] 10.222.0.27 "GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace" status: 404 len: 111 microversion: 2.32 time: 0.140546 Oct 31 14:22:50.344762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2372/4467] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:50 2022] GET /compute/v2.1/servers/cbb98a6f-ffa6-454e-9973-2e6b21a64ace => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:22:50.360722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f929e266-c4fb-40fb-af8d-7a1db034e191 req-d7a10db8-294b-472f-bffd-d79bd9aa558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce17942-fbf2-4196-ba9f-05b6d1ca8e84", "name": "network-vif-deleted", "tag": "a411f9f6-3e8b-4f9e-87bc-788508725105"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:50.383928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f929e266-c4fb-40fb-af8d-7a1db034e191 req-d7a10db8-294b-472f-bffd-d79bd9aa558d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.384551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f929e266-c4fb-40fb-af8d-7a1db034e191 req-d7a10db8-294b-472f-bffd-d79bd9aa558d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.385092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f929e266-c4fb-40fb-af8d-7a1db034e191 req-d7a10db8-294b-472f-bffd-d79bd9aa558d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.413106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f929e266-c4fb-40fb-af8d-7a1db034e191 req-d7a10db8-294b-472f-bffd-d79bd9aa558d service nova] Creating event network-vif-deleted:a411f9f6-3e8b-4f9e-87bc-788508725105 for instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 on n-h1-863052-1 Oct 31 14:22:50.426129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f929e266-c4fb-40fb-af8d-7a1db034e191 req-d7a10db8-294b-472f-bffd-d79bd9aa558d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079723 Oct 31 14:22:50.430588 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2373/4468] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:50.475255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:50.506457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:50.516763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:50.529275 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9fd1330-40b2-4795-9126-6351e34c5564 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1799 microversion: 2.42 time: 0.504897 Oct 31 14:22:50.537428 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2096/4469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:50 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1799 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:50.730965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:50.732132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:50.756513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.757138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.757827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.758812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.759437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.766859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.839032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:50.839508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:50.840006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:50.850956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lazy-loading 'fault' on Instance uuid 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:22:50.938105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:50.954681 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65bd7b46-313d-47a2-9b4c-9b324b5a9d79 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 200 len: 1305 microversion: 2.1 time: 0.228210 Oct 31 14:22:50.970622 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2374/4470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:50 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:51.032531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:51.035077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:51.064353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:51.068758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:51.069793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:51.077817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:51.081049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:51.086837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:51.589586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:51.597936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:51.614686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:51.623894 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04c334ac-cf1a-481e-a245-f842299f22f1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.612797 Oct 31 14:22:51.634685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:51.635515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:51.635843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:51.636801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2097/4471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:51 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:51.639726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:51.645160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:51.645796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:51.985980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:51.986964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:52.003792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:52.004586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:52.005220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:52.006430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:52.007062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:52.007695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:52.053155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 HTTP/1.1 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '2ce17942-fbf2-4196-ba9f-05b6d1ca8e84'} Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:52.059950 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:52.064447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:52.066220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:52.071950 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67e54214-53f9-42b2-b5da-3b829b01017e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 404 len: 111 microversion: 2.1 time: 0.090548 Oct 31 14:22:52.075945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2098/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:51 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:22:52.101743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7128bb4-26e5-4dca-b4ce-16b4a763fc84 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107aae0d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:52.405965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:52.438446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:52.457919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:52.459129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b707f1c-6e98-4b8b-96f2-91abaebf953c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1845 microversion: 2.42 time: 0.874096 Oct 31 14:22:52.459708 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2375/4473] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:51 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1845 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:22:52.722143 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7128bb4-26e5-4dca-b4ce-16b4a763fc84 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5" status: 202 len: 0 microversion: 2.1 time: 0.642311 Oct 31 14:22:52.722741 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2099/4474] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:52 2022] DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:52.731822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f623a24e-2dc5-405e-b0c4-d42fc7fd4d21 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe1078384c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:52.740590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:52.741427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:52.755832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:52.756754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:52.757711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:52.758647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:52.759266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:52.759850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:53.172316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:53.189804 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bee3f926-0dfc-4e9d-af87-2ff7b3676c95 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.452789 Oct 31 14:22:53.190491 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2100/4475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:52 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:53.485240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0d2e82d0-662c-49dd-9333-5193753c776d req-a7e02607-f4a5-4239-86ce-710768b37335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "1349ac4d-b953-46a1-8f79-a2a70cbbaa4b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:53.511059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d2e82d0-662c-49dd-9333-5193753c776d req-a7e02607-f4a5-4239-86ce-710768b37335 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:53.511676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d2e82d0-662c-49dd-9333-5193753c776d req-a7e02607-f4a5-4239-86ce-710768b37335 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:53.512111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d2e82d0-662c-49dd-9333-5193753c776d req-a7e02607-f4a5-4239-86ce-710768b37335 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:53.531432 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0d2e82d0-662c-49dd-9333-5193753c776d req-a7e02607-f4a5-4239-86ce-710768b37335 service nova] Creating event network-changed:1349ac4d-b953-46a1-8f79-a2a70cbbaa4b for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:22:53.537500 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0d2e82d0-662c-49dd-9333-5193753c776d req-a7e02607-f4a5-4239-86ce-710768b37335 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058303 Oct 31 14:22:53.539000 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2101/4476] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:53.545951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:53.547117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:53.554210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:53.554962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:53.555570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:53.556681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:53.557504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:53.558219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:53.992274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:54.011250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:54.015473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:54.017160 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-975a966e-1e5e-4098-b604-3a27b7581560 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1845 microversion: 2.42 time: 0.476759 Oct 31 14:22:54.028317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2102/4477] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:53 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1845 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:54.086679 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f623a24e-2dc5-405e-b0c4-d42fc7fd4d21 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338" status: 202 len: 0 microversion: 2.1 time: 1.357661 Oct 31 14:22:54.089030 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2376/4478] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:52 2022] DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 => generated 0 bytes in 1362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:54.100730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46f31505-601f-458a-8db1-8dcaf3e7488f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'create', calling method: .version_select at 0x7fe107939670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-132866424", "description": "tempest-description-1571639658"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:54.234868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:54.235935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:54.250660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:54.252119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:54.252798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:54.253908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:54.254701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:54.256111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:54.491898 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46f31505-601f-458a-8db1-8dcaf3e7488f tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.394973 Oct 31 14:22:54.493833 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2103/4479] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 31 14:22:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:54.514430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d326db6-ac86-454d-929f-67bc416ca1d2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Action: 'update', calling method: .version_select at 0x7fe107eb1f70>, body: {"security_group": {"name": "tempest-sg-hth-861628148", "description": "tempest-description-hth-1644535079"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:54.832415 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d326db6-ac86-454d-929f-67bc416ca1d2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/ba0f0c30-aa99-445b-8d00-768496b1d4bb" status: 200 len: 217 microversion: 2.1 time: 0.328022 Oct 31 14:22:54.833318 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2104/4480] 10.222.0.27 () {60 vars in 1290 bytes} [Mon Oct 31 14:22:54 2022] PUT /compute/v2.1/os-security-groups/ba0f0c30-aa99-445b-8d00-768496b1d4bb => generated 217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:54.848728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f0707de2-d223-49d4-b78f-7e01e4bec3f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107ce35e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:54.873949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:54.883808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19214788-a72b-4d8d-863c-2902f4c27d76 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.657050 Oct 31 14:22:54.885265 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2377/4481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:54 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:55.047051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.047711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:55.048583 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f0707de2-d223-49d4-b78f-7e01e4bec3f1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/ba0f0c30-aa99-445b-8d00-768496b1d4bb" status: 200 len: 217 microversion: 2.1 time: 0.204927 Oct 31 14:22:55.049268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2105/4482] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:22:54 2022] GET /compute/v2.1/os-security-groups/ba0f0c30-aa99-445b-8d00-768496b1d4bb => generated 217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:55.065989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b505f11-45d1-4620-9841-4499e04c660d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107a4e040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.078456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.079204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.079863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.080810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.081580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.082392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.579682 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b505f11-45d1-4620-9841-4499e04c660d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ba0f0c30-aa99-445b-8d00-768496b1d4bb" status: 202 len: 0 microversion: 2.1 time: 0.518370 Oct 31 14:22:55.581348 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2106/4483] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:55 2022] DELETE /compute/v2.1/os-security-groups/ba0f0c30-aa99-445b-8d00-768496b1d4bb => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:22:55.590720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.591633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:55.605119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.605919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.606753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.608157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.608853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.609491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.632058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 HTTP/1.1 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '2ce17942-fbf2-4196-ba9f-05b6d1ca8e84'} Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:55.634673 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:55.640006 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15c7770b-d5f8-44b6-bd10-ff4317dca90e tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 404 len: 111 microversion: 2.1 time: 0.051657 Oct 31 14:22:55.643079 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2107/4484] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:22:55 2022] DELETE /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:55.648133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.649129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:55.658491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.658997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.659497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.660235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.660739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.661167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.678483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 HTTP/1.1 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '2ce17942-fbf2-4196-ba9f-05b6d1ca8e84'} Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.680057 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Instance 2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-03dd63b2-75be-4955-870c-a321166f691d tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84" status: 404 len: 111 microversion: 2.1 time: 0.038344 Oct 31 14:22:55.685971 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2108/4485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:55 2022] GET /compute/v2.1/servers/2ce17942-fbf2-4196-ba9f-05b6d1ca8e84 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:55.690857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107af50d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.756431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:55.757144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:55.757805 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.757805 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 HTTP/1.1 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '6ec6dcd1-cbc2-47be-8da9-f5dc58afc338'} Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:55.759825 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] Oct 31 14:22:55.764913 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.778363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 does not exist Oct 31 14:22:55.778363 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-e58b5339-46c9-44c5-a47d-e74245ea3278'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:55.779536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79cc7033-3156-48e0-8813-5cfed8ea5667 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338" status: 404 len: 194 microversion: 2.1 time: 0.092410 Oct 31 14:22:55.780356 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2109/4486] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:55 2022] DELETE /compute/v2.1/os-security-groups/6ec6dcd1-cbc2-47be-8da9-f5dc58afc338 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:55.788715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3e2c6aec-dd7e-47f9-a9c7-74c70ed5517b req-536f6e3d-4f11-4b6d-9e14-6d1574b98475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "7de5dba0-411e-42b4-bc5d-96a1f3fa33f2"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:55.803098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3e2c6aec-dd7e-47f9-a9c7-74c70ed5517b req-536f6e3d-4f11-4b6d-9e14-6d1574b98475 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.804177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3e2c6aec-dd7e-47f9-a9c7-74c70ed5517b req-536f6e3d-4f11-4b6d-9e14-6d1574b98475 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.804708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3e2c6aec-dd7e-47f9-a9c7-74c70ed5517b req-536f6e3d-4f11-4b6d-9e14-6d1574b98475 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.817672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:55.820543 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3e2c6aec-dd7e-47f9-a9c7-74c70ed5517b req-536f6e3d-4f11-4b6d-9e14-6d1574b98475 service nova] Creating event network-changed:7de5dba0-411e-42b4-bc5d-96a1f3fa33f2 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:22:55.827341 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3e2c6aec-dd7e-47f9-a9c7-74c70ed5517b req-536f6e3d-4f11-4b6d-9e14-6d1574b98475 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045153 Oct 31 14:22:55.828826 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2110/4487] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:55.836404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10c0c6ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.887536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:55.891564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:55.892599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.892599 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5 HTTP/1.1 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '541a3ea9-aa63-4cd6-9cfe-f296111391c5'} Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:55.895617 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] Oct 31 14:22:55.899410 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:55.906836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 541a3ea9-aa63-4cd6-9cfe-f296111391c5 does not exist Oct 31 14:22:55.906836 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-ae3a95de-ec4d-4682-beed-d0c1d0ad6477'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:55.909107 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-862e5dbc-6a08-49e8-94a2-8978b3793329 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5" status: 404 len: 194 microversion: 2.1 time: 0.077843 Oct 31 14:22:55.915945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2111/4488] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:55 2022] DELETE /compute/v2.1/os-security-groups/541a3ea9-aa63-4cd6-9cfe-f296111391c5 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:55.920880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:55.921608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:55.930829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.931248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.931686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.932393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:55.932846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:55.933268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:55.964450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:55.975676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:55.987600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:55.988847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e470aac4-53df-4dd7-b648-0f4f804750cc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1866 microversion: 2.42 time: 0.946034 Oct 31 14:22:55.989918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2378/4489] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:55 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1866 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:22:55.995632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106612a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:56.100182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:56.101178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group c2a25aef-6d03-4c91-a302-d277f33dfec4 not found {{(pid=120640) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:56.102010 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.102010 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4 HTTP/1.1 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c2a25aef-6d03-4c91-a302-d277f33dfec4'} Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:56.104880 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] Oct 31 14:22:56.111958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.119211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group c2a25aef-6d03-4c91-a302-d277f33dfec4 does not exist Oct 31 14:22:56.119211 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-07e7a185-dd27-4a3f-904c-b270d6758d94'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:56.121414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1d04620-db6d-43bd-9510-067abd9f7912 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4" status: 404 len: 194 microversion: 2.1 time: 0.130282 Oct 31 14:22:56.122464 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2379/4490] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:55 2022] DELETE /compute/v2.1/os-security-groups/c2a25aef-6d03-4c91-a302-d277f33dfec4 => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:56.131466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106632dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:56.152551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:56.174931 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c3eac0e2-eb83-4295-93dc-70e244bb8734 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.256394 Oct 31 14:22:56.202678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:56.204316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d not found {{(pid=120640) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:56.205013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.205013 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] Oct 31 14:22:56.205755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2112/4491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:55 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d HTTP/1.1 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '3f636ce1-923d-48bf-8acd-fc1d75221e1d'} Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:56.208245 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] Oct 31 14:22:56.212450 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.220904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 3f636ce1-923d-48bf-8acd-fc1d75221e1d does not exist Oct 31 14:22:56.220904 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-23a2eca9-dcdc-4c8d-9d16-e7ecf7794b64'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:56.222110 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2288c8f3-9859-45f7-9b4c-a71132d67b5c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d" status: 404 len: 194 microversion: 2.1 time: 0.095368 Oct 31 14:22:56.223468 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2380/4492] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:56 2022] DELETE /compute/v2.1/os-security-groups/3f636ce1-923d-48bf-8acd-fc1d75221e1d => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:56.231945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe107cc0d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:56.347319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG neutronclient.v2_0.client [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist", "detail": ""}} {{(pid=120641) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:56.349176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.security_group_api [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a not found {{(pid=120641) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:56.350062 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.350062 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a HTTP/1.1 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: exception: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a'} Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:56.352876 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] Oct 31 14:22:56.357848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.361572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a does not exist Oct 31 14:22:56.361572 n-d-863052-1 devstack@n-api.service[120641]: Neutron server returns request_ids: ['req-a0fd1e79-f0ac-4027-ab4e-d60720d3d161'] {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:56.361572 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bd28161-bf6f-49d7-b81a-797ba16f219c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a" status: 404 len: 194 microversion: 2.1 time: 0.133840 Oct 31 14:22:56.362504 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2113/4493] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:56 2022] DELETE /compute/v2.1/os-security-groups/60fb6a2c-1f05-4147-aeeb-d225cf2c1a2a => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:22:56.371158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10c0f8e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:56.495285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG neutronclient.v2_0.client [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist", "detail": ""}} {{(pid=120640) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 14:22:56.496173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.security_group_api [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Neutron security group 7328f35b-753e-431e-bb03-912ee3294a11 not found {{(pid=120640) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 14:22:56.496955 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.496955 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11 HTTP/1.1 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: exception: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '7328f35b-753e-431e-bb03-912ee3294a11'} Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 14:22:56.499648 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] Oct 31 14:22:56.503891 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:22:56.511055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Security group 7328f35b-753e-431e-bb03-912ee3294a11 does not exist Oct 31 14:22:56.511055 n-d-863052-1 devstack@n-api.service[120640]: Neutron server returns request_ids: ['req-082e87c2-86ff-491e-9a7b-847f553c2f82'] {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:22:56.512247 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e6e3224-f72f-420d-98af-a4ff4d264df7 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11" status: 404 len: 194 microversion: 2.1 time: 0.145540 Oct 31 14:22:56.513400 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2381/4494] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:22:56 2022] DELETE /compute/v2.1/os-security-groups/7328f35b-753e-431e-bb03-912ee3294a11 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:56.524345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:56.525251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:56.536804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:56.538008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:56.538787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:56.540185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:56.541252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:56.542132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:56.594626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:22:56.712953 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-347ceb6a-272e-4c8e-b09e-fd61a4e081f2 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 204 len: 0 microversion: 2.1 time: 0.194284 Oct 31 14:22:56.714320 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2114/4495] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:22:56 2022] DELETE /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:22:56.722705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:56.723636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:56.731157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:56.732078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:56.732726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:56.733597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:56.734297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:56.734883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:57.017807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:57.018621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:57.025348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:57.026212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:57.026939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:57.027903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:57.028611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:57.029872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:57.334553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:57.336737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:57.347511 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87d87212-b3bd-42a5-8b68-922dbcbb90e1 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1644 microversion: 2.1 time: 0.628985 Oct 31 14:22:57.348436 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2382/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:56 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1644 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:22:57.348693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:57.351155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:57.352542 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c741780-1c4d-4767-aed5-405534f6d694 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.339979 Oct 31 14:22:57.353564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2115/4497] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:57 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:22:57.369150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:57.376027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:57.383648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:57.384151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:57.384594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:57.385516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:57.386147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:57.386612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:57.390034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:57.646808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:57.655760 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef8e731e-db7e-4fbd-9a16-387abf1c9d5e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1534 microversion: 2.1 time: 0.304352 Oct 31 14:22:57.668192 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2383/4498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:57 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1534 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:57.869081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "33358b3f-c979-4750-b51f-c7e629059f82"}, {"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "acdd42f6-9226-4857-858c-c8144a9ddd1c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:22:57.880762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:57.881578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:57.882255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:57.895085 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] Creating event network-changed:33358b3f-c979-4750-b51f-c7e629059f82 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:22:57.897106 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] Creating event network-changed:acdd42f6-9226-4857-858c-c8144a9ddd1c for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:22:57.903030 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fc8ed3d5-3594-49f1-a309-27a562574a56 req-2f20d06a-3a81-443b-9a5a-69b2a226c96c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037843 Oct 31 14:22:57.904098 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2116/4499] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:22:58.374362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:58.375204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:58.383472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:58.384569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:58.392917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:58.393429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:58.393868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:58.395364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:58.397522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:58.401024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:58.401515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:58.401955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:58.402397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:58.403400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:58.404120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:58.404770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:59.057601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:59.078699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:59.082275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:59.096539 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a1371c6-9834-45fa-a0fe-50b392615d01 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.717435 Oct 31 14:22:59.097244 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2117/4500] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:22:58 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:22:59.120574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:22:59.125943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:22:59.141158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:59.142020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:59.142748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:59.143710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:22:59.144796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:22:59.147478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:22:59.393125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:59.405810 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-673f3b89-c0e9-4bb7-904b-17057969fc87 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.307266 Oct 31 14:22:59.412492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2118/4501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:59 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:22:59.734418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:22:59.769748 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a59e3a2-e96c-4187-a529-b662fa39e820 tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1644 microversion: 2.1 time: 1.402996 Oct 31 14:22:59.778484 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2384/4502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:22:58 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1644 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:00.130951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:00.131395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:00.158993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:00.160327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:00.160783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:00.161513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:00.161976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:00.162432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:00.440083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:00.441000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:00.467004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:00.471011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:00.471768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:00.473374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:00.477723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:00.483654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:01.115313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:01.130918 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b460abf3-69f1-4a5a-b8ab-043e57f20f22 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.695689 Oct 31 14:23:01.131535 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2385/4503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:00 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:01.157428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-64e5ab32-691a-4d2b-9a34-14650157472a req-e897b03d-bbd0-4043-950f-cd3db5ed18da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230412fe-c163-48f5-90ab-4edcf0ad57b2", "name": "network-vif-deleted", "tag": "412833dd-d9f4-495d-a3a6-5dede3ed7ff5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:01.193828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-64e5ab32-691a-4d2b-9a34-14650157472a req-e897b03d-bbd0-4043-950f-cd3db5ed18da service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:01.195801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-64e5ab32-691a-4d2b-9a34-14650157472a req-e897b03d-bbd0-4043-950f-cd3db5ed18da service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:01.199620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-64e5ab32-691a-4d2b-9a34-14650157472a req-e897b03d-bbd0-4043-950f-cd3db5ed18da service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:01.271011 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-64e5ab32-691a-4d2b-9a34-14650157472a req-e897b03d-bbd0-4043-950f-cd3db5ed18da service nova] Creating event network-vif-deleted:412833dd-d9f4-495d-a3a6-5dede3ed7ff5 for instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 on n-h2-863052-1 Oct 31 14:23:01.289246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:01.296219 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-64e5ab32-691a-4d2b-9a34-14650157472a req-e897b03d-bbd0-4043-950f-cd3db5ed18da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158175 Oct 31 14:23:01.302262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:01.307376 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2386/4504] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:01.308248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:01.309490 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fba0e76f-9995-4a39-a766-d3b933446a30 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 1.183236 Oct 31 14:23:01.312195 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2119/4505] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:00 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:01.340844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:01.343439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:01.357416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:01.362649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:01.363329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:01.364287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:01.368801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:01.369458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:01.448700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:01.452554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:01.454965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:01.455717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lazy-loading 'fault' on Instance uuid 230412fe-c163-48f5-90ab-4edcf0ad57b2 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:23:01.483399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e6041ba5-244d-4b6f-9a85-8c097e5b777f req-7bf05e2a-3863-46b2-9cd1-9cb7deeb5241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c2c342-ac89-4ca5-98f0-5cad14e05ad6", "name": "network-vif-plugged", "status": "completed", "tag": "782d392a-a5cb-401c-b1cc-ac4fb1e65d41"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:01.503611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e6041ba5-244d-4b6f-9a85-8c097e5b777f req-7bf05e2a-3863-46b2-9cd1-9cb7deeb5241 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:01.505849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e6041ba5-244d-4b6f-9a85-8c097e5b777f req-7bf05e2a-3863-46b2-9cd1-9cb7deeb5241 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:01.508350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e6041ba5-244d-4b6f-9a85-8c097e5b777f req-7bf05e2a-3863-46b2-9cd1-9cb7deeb5241 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:01.582693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e6041ba5-244d-4b6f-9a85-8c097e5b777f req-7bf05e2a-3863-46b2-9cd1-9cb7deeb5241 service nova] Creating event network-vif-plugged:782d392a-a5cb-401c-b1cc-ac4fb1e65d41 for instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 on n-h1-863052-1 Oct 31 14:23:01.592716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e6041ba5-244d-4b6f-9a85-8c097e5b777f req-7bf05e2a-3863-46b2-9cd1-9cb7deeb5241 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125177 Oct 31 14:23:01.593343 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2120/4506] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 31 14:23:01.625760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8117f4d2a50f416d92466798b7c2d5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0c3a55e468402da1424750fc0ddd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:01.634144 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55d07bf6-bd4e-4b6d-9661-2eb4cedb755c tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 200 len: 1305 microversion: 2.1 time: 0.325335 Oct 31 14:23:01.634785 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2387/4507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:01 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 1305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:02.160036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:02.161034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:02.180625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:02.181636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:02.183677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:02.184736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:02.187212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:02.187954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:02.339376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:02.340244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:02.351134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:02.354503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:02.355123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:02.356038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:02.359101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:02.359757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:02.970197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:02.988724 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e5de71c-a2b9-4fcd-9b42-02d7c8f83fd9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.834046 Oct 31 14:23:02.989706 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2121/4508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:02 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:02.999335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:03.000117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] [instance: 230412fe-c163-48f5-90ab-4edcf0ad57b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:03.025979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:03.028701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:03.029906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:03.034913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:03.036490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:03.036959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:03.104203 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] HTTP exception thrown: Instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 could not be found. Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Request method failure captured: Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 HTTP/1.1 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ntJvQmOCYvHPaUvWKkCBwgzID6blg9MPbwi3v-TyetGAfGQ_N-Coi89a_x4gECAaxm2_9PECv7muZKKA0J2X3RBAn5Vw7ZiCSfozNH0v_TD6TCdTPgKNI-9BBa2GbuDaLrWsESpRWPy_mVaVkEq3xaDXRQHlH5hxAn5KpfrfoejAE Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a0c3a55e468402da1424750fc0ddd41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a0c3a55e468402da1424750fc0ddd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6a0c3a55e468402da1424750fc0ddd41 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1451344495 Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 8117f4d2a50f416d92466798b7c2d5fc Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-SecurityGroupsTestJSON-1451344495-project Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 could not be found. Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '230412fe-c163-48f5-90ab-4edcf0ad57b2'} Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 could not be found. Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 could not be found. Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:23:03.115688 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 could not be found. Oct 31 14:23:03.119941 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:03.128833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Returning 404 to user: Instance 230412fe-c163-48f5-90ab-4edcf0ad57b2 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:23:03.132643 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1231f4f2-e46e-4b59-8cff-a5d732ea62de tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2" status: 404 len: 111 microversion: 2.1 time: 0.139216 Oct 31 14:23:03.134943 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2122/4509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:02 2022] GET /compute/v2.1/servers/230412fe-c163-48f5-90ab-4edcf0ad57b2 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:23:03.160075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0349542-196c-49e3-8c31-882fa0f152ab tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe10c5fda60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:03.160892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:03.182409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:03.182409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:03.182409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96630551-f3cb-4280-827d-1a0c2098b01f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.841144 Oct 31 14:23:03.182409 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2388/4510] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:02 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:03.694930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a9c9bbc1-01af-4edf-98db-191e6fdeec87 req-6c8cc812-e35e-472e-b779-d8caea8d1461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "fa944ae6-a9d5-4831-aba8-5a89c9ace075"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:03.733237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a9c9bbc1-01af-4edf-98db-191e6fdeec87 req-6c8cc812-e35e-472e-b779-d8caea8d1461 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:03.734980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a9c9bbc1-01af-4edf-98db-191e6fdeec87 req-6c8cc812-e35e-472e-b779-d8caea8d1461 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:03.738625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a9c9bbc1-01af-4edf-98db-191e6fdeec87 req-6c8cc812-e35e-472e-b779-d8caea8d1461 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:03.777292 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a9c9bbc1-01af-4edf-98db-191e6fdeec87 req-6c8cc812-e35e-472e-b779-d8caea8d1461 service nova] Creating event network-changed:fa944ae6-a9d5-4831-aba8-5a89c9ace075 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:23:03.804093 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a9c9bbc1-01af-4edf-98db-191e6fdeec87 req-6c8cc812-e35e-472e-b779-d8caea8d1461 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114368 Oct 31 14:23:03.807582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2389/4511] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:23:04.013951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:04.016131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:04.027382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:04.032044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:04.034500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:04.035450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:04.039024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:04.042839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:04.784274 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0349542-196c-49e3-8c31-882fa0f152ab tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/238b26aa-9a95-4a56-a6d8-ca8c0281b967" status: 202 len: 0 microversion: 2.1 time: 1.644420 Oct 31 14:23:04.785915 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2123/4512] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:23:03 2022] DELETE /compute/v2.1/os-security-groups/238b26aa-9a95-4a56-a6d8-ca8c0281b967 => generated 0 bytes in 1648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:23:04.791201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:04.792174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:04.828472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:04.829110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:04.829706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:04.846342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:04.847255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:04.847622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:05.298383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:05.314765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e19e3f43-088c-4371-8795-144bd7ca2f37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 1.303398 Oct 31 14:23:05.316186 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2390/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:04 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:05.325576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f26925c-fc91-4807-a570-6ebd15c99cbe tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] Calling method '.version_select at 0x7fe106407280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:05.445472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:05.485567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:05.488943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:05.490934 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ce18572-ad6b-47bc-918a-0c46894942f3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.703786 Oct 31 14:23:05.493171 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2124/4514] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:04 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:06.340092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:06.341450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:06.351675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:06.355646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:06.359482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:06.360572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:06.361194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:06.362892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:07.297754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:07.313973 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f15e46c-04af-418a-a01f-ca3d62e5dd0c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.978151 Oct 31 14:23:07.314918 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2125/4515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:06 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:07.321421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:07.324459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:07.351236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:07.351852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:07.355618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:07.356457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:07.356975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:07.357417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.179740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:08.189804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:08.191296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:08.195909 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-336a58bf-88f5-459c-a8aa-281111f4a7f0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.879831 Oct 31 14:23:08.196517 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2126/4516] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:07 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:08.229169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:08.241224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:08.266703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.270311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.271122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.274543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.275039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.278016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.401858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1c2e905b-876e-48f8-9646-1dc084bf2707 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.176594 Oct 31 14:23:08.414271 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2127/4517] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:23:08 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments => generated 371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:08.428351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-04e16b87-75cb-4d93-a8a1-bdf561189f0e req-0b0b227e-b0e5-4062-b1e7-197758c9eb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "2a27dfa3-f22f-4c11-b335-53837a2326d0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:08.465386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-04e16b87-75cb-4d93-a8a1-bdf561189f0e req-0b0b227e-b0e5-4062-b1e7-197758c9eb9a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.465876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-04e16b87-75cb-4d93-a8a1-bdf561189f0e req-0b0b227e-b0e5-4062-b1e7-197758c9eb9a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.478828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-04e16b87-75cb-4d93-a8a1-bdf561189f0e req-0b0b227e-b0e5-4062-b1e7-197758c9eb9a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.530392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-04e16b87-75cb-4d93-a8a1-bdf561189f0e req-0b0b227e-b0e5-4062-b1e7-197758c9eb9a service nova] Creating event network-changed:2a27dfa3-f22f-4c11-b335-53837a2326d0 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:23:08.539580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-04e16b87-75cb-4d93-a8a1-bdf561189f0e req-0b0b227e-b0e5-4062-b1e7-197758c9eb9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128195 Oct 31 14:23:08.541344 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2128/4518] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:08.549842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:08.550860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:08.569963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.570596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.571106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.571947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.572590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.573211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.647620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f26925c-fc91-4807-a570-6ebd15c99cbe tempest-SecurityGroupsTestJSON-1451344495 tempest-SecurityGroupsTestJSON-1451344495-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b084a636-e318-4adf-921d-1166c7a256f1" status: 202 len: 0 microversion: 2.1 time: 3.329836 Oct 31 14:23:08.648977 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2391/4519] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 14:23:05 2022] DELETE /compute/v2.1/os-security-groups/b084a636-e318-4adf-921d-1166c7a256f1 => generated 0 bytes in 3332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:23:08.655436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:08.656140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:08.676479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.677306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.677942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.678903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.681349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.682707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.773961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5cb1143a-15fe-4e54-b5e2-650a68547558 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/73af4c85-ac53-40dd-9fdc-7b6f483761ca" status: 200 len: 194 microversion: 2.1 time: 0.123411 Oct 31 14:23:08.775217 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2392/4520] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 31 14:23:08 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/73af4c85-ac53-40dd-9fdc-7b6f483761ca => generated 194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:08.790075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:08.790885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:08.805078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.805607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.806051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:08.809269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:08.811159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:08.816652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:09.006849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lazy-loading 'services' on Instance uuid 992e8f7b-3c0f-4675-b126-64a54baef38e {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:23:09.227355 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca0e4c4a-a2c0-4941-b57e-15560f25c93e tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/73af4c85-ac53-40dd-9fdc-7b6f483761ca" status: 202 len: 0 microversion: 2.1 time: 0.444305 Oct 31 14:23:09.229391 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2393/4521] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:23:08 2022] DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/73af4c85-ac53-40dd-9fdc-7b6f483761ca => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:23:09.304407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:09.312766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:09.332486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:09.333751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:09.334783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:09.335926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:09.337672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:09.338941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:09.693488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:09.708116 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-469c6f7c-8ae9-4ed7-9a54-1fbb08c84d36 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 1.164839 Oct 31 14:23:09.729257 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2129/4522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:08 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:10.239115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:10.267624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:10.273373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:10.275990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f51f09a9-341a-4b54-bea8-5d2abf8fb32a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 1.041257 Oct 31 14:23:10.303690 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2394/4523] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:09 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:10.739065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:10.739758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:10.761500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:10.761941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:10.762435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:10.766322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7026613d-cc01-46c0-baf0-c1aab62a4e5b req-348ed6d8-5945-4937-9a4a-b44233a1f06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "9758c520-9e3f-41c0-a5c4-f047d0ec16b5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:10.768212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:10.768707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:10.771749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:10.788404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=62 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:10.791168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7026613d-cc01-46c0-baf0-c1aab62a4e5b req-348ed6d8-5945-4937-9a4a-b44233a1f06a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:10.792062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7026613d-cc01-46c0-baf0-c1aab62a4e5b req-348ed6d8-5945-4937-9a4a-b44233a1f06a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:10.793367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7026613d-cc01-46c0-baf0-c1aab62a4e5b req-348ed6d8-5945-4937-9a4a-b44233a1f06a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:10.813692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7026613d-cc01-46c0-baf0-c1aab62a4e5b req-348ed6d8-5945-4937-9a4a-b44233a1f06a service nova] Creating event network-changed:9758c520-9e3f-41c0-a5c4-f047d0ec16b5 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:23:10.820371 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7026613d-cc01-46c0-baf0-c1aab62a4e5b req-348ed6d8-5945-4937-9a4a-b44233a1f06a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059810 Oct 31 14:23:10.828054 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2395/4524] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:23:11.307321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:11.308088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:11.328007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:11.330324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:11.332071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:11.334007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:11.335338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:11.341792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:11.343998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:11.352742 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b17fa4f-2c28-458c-ba2d-52f6be49c30a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.619044 Oct 31 14:23:11.365217 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2130/4525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:10 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:12.379125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:12.379842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:12.393116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:12.393629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:12.400357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:12.401182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:12.401661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:12.402099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:12.458411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:12.603481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:12.624805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:12.627033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:12.632398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5abc0b8b-659d-429f-b0b3-4c7cb5e5cf66 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 1.331861 Oct 31 14:23:12.636281 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2396/4526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:11 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:23:13.270261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:13.279580 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8a50126-8d50-4c69-ad9a-9cf64776838a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.904497 Oct 31 14:23:13.284317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2131/4527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:12 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:13.665566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:13.667602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:13.687348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:13.689010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:13.689854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:13.691361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:13.693435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:13.694862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:14.308914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:14.310526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:14.321847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:14.326441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:14.327168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:14.330203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:14.332388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:14.333091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:14.699238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:14.717861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:14.719876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:14.725901 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9c3fc30-8d3b-4e0d-a5e4-2a1ff93cd808 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 1.061429 Oct 31 14:23:14.727779 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2397/4528] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:13 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:14.738387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:14.748257 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f82ea5e9-709d-45a0-a764-404c1241ec49 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.443530 Oct 31 14:23:14.764787 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2132/4529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:14 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:15.753256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:15.753881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:15.780278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:15.781161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:15.781830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:15.782831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:15.783610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:15.784292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:15.787277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:15.787971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:15.791228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:15.807235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:15.816510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:15.821083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:15.822233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:15.823687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:15.824416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:16.201954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:16.226938 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-287dea06-e1eb-408f-a634-2f4f8ece1cfb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.444922 Oct 31 14:23:16.231977 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2133/4530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:15 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:17.128093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:17.141467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:17.143611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:17.145098 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52471fb5-2a4d-474b-b74a-f7852f31df97 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 1.395856 Oct 31 14:23:17.156930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2398/4531] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:15 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:17.258982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:17.259970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:17.275225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:17.275770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:17.276250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:17.276975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:17.280012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:17.280611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:18.185518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:18.186146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:18.199258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:18.207344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:18.210945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:18.211929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:18.214792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:18.218833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:18.338663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:18.347492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-044cfc75-8dfd-4033-887e-4e00ed713279 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 1.092565 Oct 31 14:23:18.369906 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2134/4532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:17 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:19.376782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:19.377391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:19.387321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:19.397772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:19.403127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:19.403784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:19.406927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:19.407695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:19.408182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:19.408608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:19.410283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:19.412890 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9b84dd1-a357-4159-b234-938d9a4263bb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 1.231821 Oct 31 14:23:19.440078 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2399/4533] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:18 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:19.597300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:19.597808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:19.624557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:19.628417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:19.632398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:19.642886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:19.646842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:19.647603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:19.779328 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c31b028d-adde-4e77-9398-1e1a6f1f8144 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/b9b527ff-70ed-45f7-aa73-05752339a4d9" status: 200 len: 194 microversion: 2.1 time: 0.185162 Oct 31 14:23:19.780761 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2400/4534] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 31 14:23:19 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/b9b527ff-70ed-45f7-aa73-05752339a4d9 => generated 194 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:19.813989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:19.815416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:19.840367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:19.847041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:19.848729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:19.849662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:19.852292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:19.852740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:20.225765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:20.237254 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-085fdd8b-b12e-433c-aaaa-e7173d85a35b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.866117 Oct 31 14:23:20.237850 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2135/4535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:19 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:20.288689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:20.290549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lazy-loading 'services' on Instance uuid 992e8f7b-3c0f-4675-b126-64a54baef38e {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:23:20.444859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:20.446193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:20.463884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:20.464771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:20.467751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:20.468763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:20.472485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:20.476233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:20.670100 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-619884e1-cce8-4c0d-8767-ef4779078a79 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/b9b527ff-70ed-45f7-aa73-05752339a4d9" status: 202 len: 0 microversion: 2.1 time: 0.882350 Oct 31 14:23:20.680548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2401/4536] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:23:19 2022] DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments/b9b527ff-70ed-45f7-aa73-05752339a4d9 => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:23:21.025046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:21.036493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:21.041228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:21.047036 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5df62475-2a43-4733-8aba-ca75da1847ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.603160 Oct 31 14:23:21.049273 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2136/4537] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:20 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:23:21.265125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:21.265739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:21.310725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:21.311518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:21.312128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:21.313562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:21.325403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:21.326255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:22.077622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:22.078962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:22.090491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:22.091536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:22.091989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:22.092696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:22.093154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:22.093590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:22.672304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:22.682799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:22.689977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:22.694057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b54e4dde-89f0-4ad6-a002-ccc08666992d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.621010 Oct 31 14:23:22.699616 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2137/4538] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:22 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:22.818585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:22.838709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dae6e81e-206e-4016-8e4c-7c66fe5c802f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 1.569622 Oct 31 14:23:22.842636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2402/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:21 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:23.725380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:23.726701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:23.744760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:23.749637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:23.752071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:23.754723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:23.755501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:23.756460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:23.868259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:23.868881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:23.895413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:23.895928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:23.896392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:23.897090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:23.897546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:23.897976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:24.296781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:24.305131 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc79c4ec-eff2-4a14-91ed-2f6217c892e3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.440944 Oct 31 14:23:24.307792 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2403/4540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:23 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:24.652467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:24.677735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:24.679525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:24.681152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c1cf1d1-7349-4ba4-9082-6a48c47bf627 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1887 microversion: 2.42 time: 0.959751 Oct 31 14:23:24.694754 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2138/4541] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:23 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1887 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:25.332768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:25.334430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:25.347862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:25.353171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:25.356223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:25.359529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:25.361982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:25.363301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:25.718819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:25.719429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:25.732896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:25.734565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:25.744519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:25.748910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:25.750159 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-620c0d09-e81e-4ca6-81fb-8cfcee7499c2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.421143 Oct 31 14:23:25.750944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:25.753800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2404/4542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:25 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:25.754263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:25.757417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:26.780714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:26.782461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:26.796933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:26.797424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:26.802887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:26.804231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:26.805912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:26.811563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:26.900414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:26.921697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:26.927391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:26.934447 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c475105b-3f2a-4a5a-803c-55ea6a205034 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.219918 Oct 31 14:23:26.936385 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2139/4543] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:25 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:27.554033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:27.594599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28af8bb5-5802-4b97-b263-8da3775bcb1e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.818628 Oct 31 14:23:27.595825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2405/4544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:26 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:27.970553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:27.971804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:27.988660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:27.989431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:27.991031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:27.995290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:27.997837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:27.999268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:28.624010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:28.626885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:28.645761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:28.649593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:28.650129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:28.650927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:28.655723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:28.656497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:28.807173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:28.823757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:28.826565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:28.835318 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e83b5532-d166-4012-bae4-7f4934a4e9ce tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.870274 Oct 31 14:23:28.837744 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2140/4545] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:27 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:29.242424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:29.254551 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2db9d7b4-5b08-471d-9c64-f5837dcb584f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.632515 Oct 31 14:23:29.257904 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2406/4546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:28 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:29.865869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:29.867080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:29.877959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:29.892717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:29.893448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:29.894394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:29.897265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:29.897909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:30.283931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:30.284718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:30.328347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:30.328941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:30.333878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:30.339054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:30.341620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:30.342439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:30.845209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:30.860797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:30.871424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:30.889548 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa57c8fa-1368-4725-a5ef-4fde781d0f47 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.027333 Oct 31 14:23:30.890401 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2141/4547] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:29 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:31.083887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:31.092526 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ed83789-25b7-45bf-a123-696586c48fa4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1529 microversion: 2.1 time: 0.814141 Oct 31 14:23:31.102418 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2407/4548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:30 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1529 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:31.924574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:31.925319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:31.939952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:31.952600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:31.954424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:31.955437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:31.957425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:31.958565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:32.115791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:32.117320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:32.149013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:32.150859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:32.152107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:32.154216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:32.156087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:32.158376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:32.585503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:32.597075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:32.599950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:32.601446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-313d2c40-0a30-4f07-b169-e5fd3d43ba99 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.685543 Oct 31 14:23:32.602660 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2142/4549] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:31 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:33.489442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:33.513802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1bb62fa5-a819-484e-8282-7f0b90246dbb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1511 microversion: 2.1 time: 1.401855 Oct 31 14:23:33.515146 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2408/4550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:32 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1511 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:33.637635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:33.639315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:33.654272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:33.655043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:33.655863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:33.656789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:33.657655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:33.658404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:33.943946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:33.946583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:33.957096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:33.960436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:33.961545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:33.962998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:33.964683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:33.967646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.038045 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec212ae8-8ab7-4d30-a366-c4239cbf8596 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098054 Oct 31 14:23:34.038944 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2409/4551] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:23:33 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 14:23:34.267640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:34.275124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:34.277701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:34.297762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:34.299290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:34.314038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.314589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.315040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.315761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.316232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.316674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.318755 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3bda018b-7b74-4cc8-985f-c0a768e25c1f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.685581 Oct 31 14:23:34.320622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2143/4552] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:33 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:34.353504 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2354e574-76fe-48e8-9e31-6fb77dbe0eaf tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082297 Oct 31 14:23:34.354386 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2410/4553] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:23:34 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 14:23:34.470089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:34.472395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:34.488897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.489748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.490402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.491514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.492384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.493798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.538844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:34.539641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:34.560194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.560710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.561160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.561885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.562385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.562820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.573286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:23:34.883476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a275c13-ebc8-45f6-978b-669eb6fda443 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 204 len: 0 microversion: 2.1 time: 0.416844 Oct 31 14:23:34.884180 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2144/4554] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:23:34 2022] DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:23:34.893938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:34.894604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:34.916209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.917000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.917530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:34.919289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:34.919781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:34.920223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:35.197389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:35.209711 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09b19d8a-3aba-4029-9245-5be30075ddca tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1673 microversion: 2.1 time: 0.320392 Oct 31 14:23:35.211271 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2145/4555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:34 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1673 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:35.353599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:35.354245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:35.362486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:35.362989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:35.363490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:35.364416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:35.365034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:35.365620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:35.392798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:35.472407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:35.482188 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-beac8ea1-eded-4235-8003-116d2399fd91 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1511 microversion: 2.1 time: 0.947450 Oct 31 14:23:35.488680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2411/4556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:34 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1511 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:36.236570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:36.237190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:36.250212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:36.250802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:36.251245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:36.251955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:36.252427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:36.252853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:36.488084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:36.506254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:36.509971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:36.512371 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6df878c7-0b6f-4f3c-8ff3-9f6222ea7b03 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.163062 Oct 31 14:23:36.513875 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2146/4557] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:35 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:23:36.518945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:36.519992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:36.529703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:36.535198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:36.535965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:36.536950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:36.538332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:36.539018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:36.805090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:36.817728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8665ee1-6847-4e52-bf03-4f927d886a98 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1511 microversion: 2.1 time: 0.302430 Oct 31 14:23:36.819346 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2147/4558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:36 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:36.838310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9a3151e9-3763-4438-9f27-340c7b4b7656 req-f6ce9824-17cc-4173-83a1-4adf05f0865a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c2c342-ac89-4ca5-98f0-5cad14e05ad6", "name": "network-vif-unplugged", "status": "completed", "tag": "782d392a-a5cb-401c-b1cc-ac4fb1e65d41"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:36.869560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9a3151e9-3763-4438-9f27-340c7b4b7656 req-f6ce9824-17cc-4173-83a1-4adf05f0865a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:36.870059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9a3151e9-3763-4438-9f27-340c7b4b7656 req-f6ce9824-17cc-4173-83a1-4adf05f0865a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:36.870531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9a3151e9-3763-4438-9f27-340c7b4b7656 req-f6ce9824-17cc-4173-83a1-4adf05f0865a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:36.917229 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9a3151e9-3763-4438-9f27-340c7b4b7656 req-f6ce9824-17cc-4173-83a1-4adf05f0865a service nova] Creating event network-vif-unplugged:782d392a-a5cb-401c-b1cc-ac4fb1e65d41 for instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 on n-h1-863052-1 Oct 31 14:23:36.935882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9a3151e9-3763-4438-9f27-340c7b4b7656 req-f6ce9824-17cc-4173-83a1-4adf05f0865a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113277 Oct 31 14:23:36.939702 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2148/4559] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:37.135304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:37.166278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36155fe7-3e92-4379-832e-aa39afb3175d tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1673 microversion: 2.1 time: 0.933783 Oct 31 14:23:37.169772 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2412/4560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:36 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1673 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:37.541579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:37.543980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:37.555058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:37.557135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:37.557751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:37.558697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:37.559424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:37.560053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:37.846908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:37.847530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:37.867257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:37.868539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:37.869829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:37.871121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:37.873838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:37.874688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:38.158862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:38.172393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:38.183606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:38.189476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1bbd5c06-7fdd-4023-b2b0-45adf411c078 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.652177 Oct 31 14:23:38.190630 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2149/4561] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:37 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:38.205211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:38.206086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:38.215238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:38.216064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:38.226523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:38.227447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:38.229491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:38.229491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:38.672757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:38.684222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd979b1f-a6ff-4dfd-a2bb-611f764e5a14 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1673 microversion: 2.1 time: 0.482514 Oct 31 14:23:38.692393 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2150/4562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:38 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1673 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:38.774446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:38.787875 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57c8a7e5-4a19-488f-b7bc-78ab85afa388 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1454 microversion: 2.1 time: 0.942137 Oct 31 14:23:38.789898 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2413/4563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:37 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1454 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:38.822923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:38.823572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:38.841192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:38.841700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:38.851939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:38.860188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:38.860812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:38.861276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.226188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:39.226879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:39.250346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:39.251259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:39.251915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.252848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:39.254926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:39.259150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.348514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:39.358083 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8946e09f-84c8-40c9-9197-e6575e6f75ee tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1454 microversion: 2.1 time: 0.546838 Oct 31 14:23:39.363291 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2151/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:38 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1454 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:39.452532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:39.453279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:39.463334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:39.465938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:39.467757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.470700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:39.471362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:39.471952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.590316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lazy-loading 'flavor' on Instance uuid e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:23:39.635163 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'shelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state shelved_offloaded Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 14 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: {"shelve": {}} Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'shelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state shelved_offloaded Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'shelve': {}}} Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:23:39.651242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state shelved_offloaded Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state shelved_offloaded Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'shelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state shelved_offloaded {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50e71286-071c-4c96-8059-5d61c13c7a4b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 155 microversion: 2.1 time: 0.205140 Oct 31 14:23:39.657681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2152/4565] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:23:39 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 155 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:23:39.702748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:39.703412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:39.716415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:39.716911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:39.717357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.718074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:39.730042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:39.730545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:39.877273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120641) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 14:23:40.102726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad57042c-a204-41f2-9c44-b507b27a513c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.425047 Oct 31 14:23:40.107062 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2153/4566] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:23:39 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:23:40.113950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:40.117401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:40.133651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:40.134874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:40.135997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:40.139345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:40.139888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:40.140549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:40.254831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:40.284035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:40.286999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:40.289323 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-520bde7b-506e-42f2-b1a2-6b6fefc7d274 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.067954 Oct 31 14:23:40.294263 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2414/4567] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:39 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:40.300011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:40.300845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:40.305069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:40.316348 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8cf337b9-c0bd-45be-a548-3aa569a2c2db tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1605 microversion: 2.1 time: 0.208864 Oct 31 14:23:40.319676 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2154/4568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:40 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:40.321650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:40.322352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:40.323163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:40.324124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:40.325281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:40.326047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:41.325695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:41.326797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:41.337168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:41.340518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:41.345113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:41.346069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:41.348514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:41.349133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:41.898347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:41.928496 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4906d71-3d0c-4e2c-b6f0-65c05535638b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1462 microversion: 2.1 time: 1.632869 Oct 31 14:23:41.943099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2415/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:40 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1462 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:41.958431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:41.959746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:41.967496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=42 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:41.975047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:41.978540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:41.979805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:41.985236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:41.986594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:41.988611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:42.089046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:42.110536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:42.126158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:42.132979 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7a085f7-d148-40a0-9a7b-01e7c8f593ff tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.813041 Oct 31 14:23:42.141048 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2155/4570] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:41 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:42.504860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e4bd89c8-62f5-4a07-be9c-00146b8b5215 req-04644338-1ce3-4d48-b1f4-06b53cbd5f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992e8f7b-3c0f-4675-b126-64a54baef38e", "name": "network-vif-deleted", "tag": "2ca06734-78d6-49a9-bf3e-7bc77c30f8e0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:42.512196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e63e0b7bc4137a40010062e345b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c77e61574c4725ac06c32c9f858560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:42.547200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57264592-2df8-4ad3-9e7e-7bd9777552a7 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 200 len: 1605 microversion: 2.1 time: 0.593517 Oct 31 14:23:42.554609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e4bd89c8-62f5-4a07-be9c-00146b8b5215 req-04644338-1ce3-4d48-b1f4-06b53cbd5f4b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:42.555145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e4bd89c8-62f5-4a07-be9c-00146b8b5215 req-04644338-1ce3-4d48-b1f4-06b53cbd5f4b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:42.555594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e4bd89c8-62f5-4a07-be9c-00146b8b5215 req-04644338-1ce3-4d48-b1f4-06b53cbd5f4b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:42.569339 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2416/4571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:41 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 1605 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:42.595535 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e4bd89c8-62f5-4a07-be9c-00146b8b5215 req-04644338-1ce3-4d48-b1f4-06b53cbd5f4b service nova] Creating event network-vif-deleted:2ca06734-78d6-49a9-bf3e-7bc77c30f8e0 for instance 992e8f7b-3c0f-4675-b126-64a54baef38e on n-h2-863052-1 Oct 31 14:23:42.604675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e4bd89c8-62f5-4a07-be9c-00146b8b5215 req-04644338-1ce3-4d48-b1f4-06b53cbd5f4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103366 Oct 31 14:23:42.627682 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2156/4572] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:42.974541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:42.976582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:42.994557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:42.999345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:43.001654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:43.003435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:43.008020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:43.010241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:43.169043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:43.169892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:43.183504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:43.184784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:43.185244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:43.185999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:43.191154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:43.191824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:43.822262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:43.828269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:43.861681 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc0504c0-47c1-460c-85dc-6efb86841931 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1462 microversion: 2.1 time: 0.893471 Oct 31 14:23:43.864330 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2417/4573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:42 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1462 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:43.887960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:43.888867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:43.906399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:43.908448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:43.908950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:43.909689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:43.912814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:43.914482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:43.946871 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] HTTP exception thrown: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Request method failure captured: Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e HTTP/1.1 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9j2L2-4sGnoB4mjLiKFJ61t0bbN8Bd7H_xti7uiJYO_5qbPbf5qNrvkUZVxJlFl46y6q6bMtJ7IdbRZuCRzkNwnU-sdLlz3bCsNxbiIfVXVOhhdGx8klvVZpPg2Ok9w1Sqdh_OwHGbzJJgOfiiu9es75fXp-J2-iDFcWSRH6y5tAFo Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a9c77e61574c4725ac06c32c9f858560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 7f2e63e0b7bc4137a40010062e345b8f Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '992e8f7b-3c0f-4675-b126-64a54baef38e'} Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:23:43.953204 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Returning 404 to user: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:23:43.957360 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-988f64b5-a966-4153-82e0-1881f2aef42a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 404 len: 111 microversion: 2.1 time: 0.089436 Oct 31 14:23:43.958987 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2418/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:43 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:23:43.963773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4336a49-a384-4d07-bb16-6ea3d33f0cb6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '.version_select at 0x7fe10656e1f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:44.017319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4336a49-a384-4d07-bb16-6ea3d33f0cb6 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747739063" status: 202 len: 0 microversion: 2.1 time: 0.057115 Oct 31 14:23:44.021487 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2419/4575] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:23:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747739063 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:23:44.694646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:44.720119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:44.727898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:44.736123 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a9e2ab10-2b47-4441-8daa-906d3d9ecdd4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.567479 Oct 31 14:23:44.742338 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2157/4576] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:43 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:23:44.891552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:44.901846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:45.000266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:45.003118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:45.004748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:45.008195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:45.016698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:45.021099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:45.400451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-893147188", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:45.522626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:23:46.788833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:46.803403 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cdba7e20-587b-4615-bb7c-a74a96927a00 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 1.920135 Oct 31 14:23:46.828536 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2420/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:44 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:46.835424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:46.850570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:46.863513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:46.874878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:46.875472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:46.876348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:46.876928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:46.877474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:47.980824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:47.992175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:48.001232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:48.005636 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-367e93ce-2439-4a34-b0df-32f83b2b87f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.174095 Oct 31 14:23:48.008780 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2421/4578] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:46 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:48.017168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:48.023305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:48.041126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:48.044872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:48.045651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:48.046668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:48.047306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:48.052164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:48.183332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:23:48.184865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:23:48.185515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:23:48.186088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:23:48.186859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:23:48.190289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:48.216639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:48.218235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:48.219464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:48.221569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:48.222801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:48.224038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:48.264916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:23:48.271830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:23:48.307993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:23:48.317666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:23:48.416541 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b55ce5bf-27b4-4f34-b353-d8317861075f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.136607 Oct 31 14:23:48.418034 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2158/4579] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:23:48.432661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e3990029-ca86-4927-8edd-7a67f2bf48e7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:48.434043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e3990029-ca86-4927-8edd-7a67f2bf48e7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:48.575011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e3990029-ca86-4927-8edd-7a67f2bf48e7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:48.602413 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e3990029-ca86-4927-8edd-7a67f2bf48e7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1214 microversion: 2.1 time: 0.174832 Oct 31 14:23:48.604582 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2159/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:48 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:49.040210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:49.043812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:49.062856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:49.064326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:49.067962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:49.069670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:49.073822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:49.075973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:49.076442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:49.079385 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a2a7400-f688-4dc3-8dc3-4ee2ed0e784c tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 1.066283 Oct 31 14:23:49.102754 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2422/4581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:48 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:49.627000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8816c354-c1d0-4d5f-a544-7b2572478908 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:49.627629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8816c354-c1d0-4d5f-a544-7b2572478908 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:49.828740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8816c354-c1d0-4d5f-a544-7b2572478908 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:49.836783 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8816c354-c1d0-4d5f-a544-7b2572478908 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1214 microversion: 2.1 time: 0.213785 Oct 31 14:23:49.843954 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2423/4582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:49 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:50.109662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:50.110386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:50.129254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:50.132935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:50.133583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:50.138745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:50.142806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:50.144586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:50.154529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:50.176301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:50.177773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:50.204284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da27e962-988e-4b44-b498-f7c35a5773f7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.164073 Oct 31 14:23:50.205641 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2160/4583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:49 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:50.863105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:50.864579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:50.884975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:50.894596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:50.895325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:50.896106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:50.896847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:50.898683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:50.927717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:50.947830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aedea2dd-70d1-4a8a-a0df-8144e779606d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.842581 Oct 31 14:23:50.950857 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2424/4584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:50 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:51.236467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:51.238700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:51.253328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:51.254076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:51.254731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:51.255637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:51.256273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:51.257007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:51.545971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:51.555196 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-489a55e6-2363-4b19-95b8-65db919accc7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1266 microversion: 2.1 time: 0.696343 Oct 31 14:23:51.574896 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2161/4585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:50 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1266 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:51.989420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:51.993281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:52.033740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:52.034328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:52.034786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:52.044531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:52.048496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:52.049205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:52.371619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:52.410014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:52.414239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:52.415504 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90aeda49-6dae-459c-9a1e-d862f16097fa tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.186467 Oct 31 14:23:52.429409 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2425/4586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:51 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:23:52.591871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:52.592503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:52.607305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:52.611610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:52.611718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:52.612413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:52.618993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:52.633887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:52.834858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:52.846438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7ba0313-bc95-45ea-9252-9600305c0eb3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1272 microversion: 2.1 time: 0.258887 Oct 31 14:23:52.858429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2426/4587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:52 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:53.077283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:53.096765 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b2f7a9e-c924-4d9f-97a8-71647b0b716f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 1.123724 Oct 31 14:23:53.100215 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2162/4588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:51 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:23:53.452425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:53.453044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:53.473757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:53.474447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:53.474914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:53.475660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:53.476121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:53.476554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:53.876191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:53.876953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:53.890011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:53.890945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:53.891677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:53.897699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:53.898790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:53.899458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:54.251991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:54.265136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b2e55fa-cb5c-4eb2-9a51-3dd84b81511a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1272 microversion: 2.1 time: 0.394433 Oct 31 14:23:54.282213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2163/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:53 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1272 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:54.282213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:54.296146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:54.325489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:54.326514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:54.328336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:54.331658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:54.332932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:54.333648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:54.623046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:54.636004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:54.660150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:54.661746 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4d02026-240f-45fe-90e6-e7116151c886 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.213326 Oct 31 14:23:54.662697 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2427/4590] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:53 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:55.295764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:55.296955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:55.322263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:55.323632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:55.325326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:55.331957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:55.333803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:55.338804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:55.615498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:55.639237 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb42355f-e2af-441f-baf4-4218963efde6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1272 microversion: 2.1 time: 0.342752 Oct 31 14:23:55.640431 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2428/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:55 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1272 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:55.690315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:55.691133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:55.706443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:55.710844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:55.711432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:55.712319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:55.718968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:55.719553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:56.154049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:56.166239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-814aa2c9-90cd-4d06-8ef5-b50b639e4c5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 1.895127 Oct 31 14:23:56.175536 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2164/4592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:54 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:56.512374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:56.533659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:56.556496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:56.560086 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11bcf8e0-40d9-48e3-b5a4-48bc54cb94fb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.874385 Oct 31 14:23:56.562339 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2429/4593] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:55 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:56.668214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:56.669640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:56.681145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:56.682153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:56.683370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:56.685106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:56.686377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:56.687797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:56.716240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d07e302a-d874-466e-a32f-396fa9bf7e0f req-f7cf3568-d954-4f07-94f8-63c5db92bfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "fa944ae6-a9d5-4831-aba8-5a89c9ace075"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:56.740576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d07e302a-d874-466e-a32f-396fa9bf7e0f req-f7cf3568-d954-4f07-94f8-63c5db92bfb7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:56.751036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d07e302a-d874-466e-a32f-396fa9bf7e0f req-f7cf3568-d954-4f07-94f8-63c5db92bfb7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:56.751490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d07e302a-d874-466e-a32f-396fa9bf7e0f req-f7cf3568-d954-4f07-94f8-63c5db92bfb7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:56.768240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:56.791138 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d07e302a-d874-466e-a32f-396fa9bf7e0f req-f7cf3568-d954-4f07-94f8-63c5db92bfb7 service nova] Creating event network-vif-plugged:fa944ae6-a9d5-4831-aba8-5a89c9ace075 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:23:56.817364 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d07e302a-d874-466e-a32f-396fa9bf7e0f req-f7cf3568-d954-4f07-94f8-63c5db92bfb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268570 Oct 31 14:23:56.826623 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2165/4594] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:23:57.021927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:57.041370 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74e2c12f-f8de-4990-b6f2-c67d1d8cb0f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1272 microversion: 2.1 time: 0.381052 Oct 31 14:23:57.043550 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2430/4595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:56 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1272 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:57.201922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:57.203461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:57.241205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:57.241834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:57.242320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:57.243360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:57.243844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:57.246453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:57.597166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:57.598260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:57.633430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:57.633948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:57.642199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:57.643099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:57.644001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:57.646395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:58.237285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:58.599407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:58.607326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:58.628415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:58.630345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:58.641035 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79d2760b-018b-4dbe-8f08-0060fdc4acec tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.043470 Oct 31 14:23:58.654190 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2431/4596] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:57 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:23:58.663914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:58.663914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:58.692686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:58.696372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:58.698658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:58.705049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:58.705568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:58.706032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:59.560912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:59.575189 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55b0b9de-aea5-4df0-8d0d-0ab96dadf168 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.923863 Oct 31 14:23:59.585134 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2432/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:58 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:59.599550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b732faf0-a242-4772-9d99-267c2d104f93 req-15eeb27b-99f1-455d-a63a-5463a6eb6aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "7de5dba0-411e-42b4-bc5d-96a1f3fa33f2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:23:59.637461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b732faf0-a242-4772-9d99-267c2d104f93 req-15eeb27b-99f1-455d-a63a-5463a6eb6aba service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:59.638119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b732faf0-a242-4772-9d99-267c2d104f93 req-15eeb27b-99f1-455d-a63a-5463a6eb6aba service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:59.638393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b732faf0-a242-4772-9d99-267c2d104f93 req-15eeb27b-99f1-455d-a63a-5463a6eb6aba service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:59.694125 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b732faf0-a242-4772-9d99-267c2d104f93 req-15eeb27b-99f1-455d-a63a-5463a6eb6aba service nova] Creating event network-vif-plugged:7de5dba0-411e-42b4-bc5d-96a1f3fa33f2 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:23:59.709259 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b732faf0-a242-4772-9d99-267c2d104f93 req-15eeb27b-99f1-455d-a63a-5463a6eb6aba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122717 Oct 31 14:23:59.714882 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2433/4598] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:23:59.729715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:23:59.733245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:23:59.755331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:59.755848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:59.756303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:59.756945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:23:59.764191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:23:59.764796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:23:59.765292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:23:59.787723 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4641378-682a-4b95-a46f-f9b024cb0ece tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 2.592571 Oct 31 14:23:59.804284 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2166/4599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:23:57 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:23:59.860004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:00.602843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:00.603736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:00.638256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:00.638965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:00.646926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:00.648695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:00.649155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:00.649701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:00.834999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:00.852156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:00.859359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:00.869935 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e47a9c86-cf5e-4f32-849d-e627bf5cdad7 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.153436 Oct 31 14:24:00.871820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2434/4600] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:23:59 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:00.889164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:00.892590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:00.929908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:00.939346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:00.940335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:00.943640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:00.944234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:00.948799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:01.485241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:01.495134 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-284b4e8d-9253-42f6-803e-2f8f81ee0bba tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.619484 Oct 31 14:24:01.503010 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2435/4601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:00 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:01.902533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:01.903880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:01.920600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:01.930180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:01.933794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:01.939368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:01.940179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:01.946769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:01.952157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:01.970261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48b79e5f-f130-4564-9c9e-442a44fce483 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 1.371013 Oct 31 14:24:01.973382 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2167/4602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:00 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:01.989041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "1349ac4d-b953-46a1-8f79-a2a70cbbaa4b"}, {"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "9758c520-9e3f-41c0-a5c4-f047d0ec16b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:02.048004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:02.055685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:02.059681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:02.113195 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] Creating event network-vif-plugged:1349ac4d-b953-46a1-8f79-a2a70cbbaa4b for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:24:02.113717 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] Creating event network-vif-plugged:9758c520-9e3f-41c0-a5c4-f047d0ec16b5 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:24:02.155110 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-da41ebfb-6e41-46fd-ae40-21ab07c8c7aa req-4d0bb1e5-8805-498f-9195-9863f14fdceb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.177381 Oct 31 14:24:02.155795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2168/4603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:02.538050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:02.548616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:02.565364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:02.565861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:02.566352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:02.567071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:02.567527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:02.567956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:03.447943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:03.458051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:03.472860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:03.481030 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6683d52-2185-496b-ad49-d83b59b5020e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 1.583368 Oct 31 14:24:03.494709 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2436/4604] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:24:01 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:03.518489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:03.519451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:03.538708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:03.548866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:03.549679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:03.550706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:03.551387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:03.552070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:03.776181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:03.786412 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e9ed13f-f9e5-49dc-875a-33fc83c3881d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 1.252536 Oct 31 14:24:03.806206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2169/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:02 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:04.252039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "2a27dfa3-f22f-4c11-b335-53837a2326d0"}, {"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "33358b3f-c979-4750-b51f-c7e629059f82"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:04.273465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:04.274301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:04.274990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:04.311745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] Creating event network-vif-plugged:2a27dfa3-f22f-4c11-b335-53837a2326d0 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:24:04.318216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] Creating event network-vif-plugged:33358b3f-c979-4750-b51f-c7e629059f82 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:24:04.340156 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5cfdf7c5-4bcd-438a-8918-78e1fca5b316 req-53c3e20f-2406-4874-be96-e18e31c12a8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091347 Oct 31 14:24:04.351239 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2170/4606] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:24:04.514190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:04.516503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:04.531369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:04.533393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:04.534083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:04.535708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:04.537519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:04.538383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:05.301722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:05.310498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:05.319062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eeedb2bc-0a3c-4b4d-826a-7fc0f7149dfa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 1.822686 Oct 31 14:24:05.320327 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2437/4607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:03 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:05.336810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:05.340890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:05.359409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:05.360167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:05.364887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:05.367295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:05.368489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:05.369489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:05.874156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:05.917709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11d57cd6-22de-4450-85f4-072f50c080d6 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.593346 Oct 31 14:24:05.919221 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2438/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:05 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:05.990325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:05.991008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:06.017406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.018697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.022933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.024154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.025878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.028604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.057689 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] HTTP exception thrown: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Request method failure captured: Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e HTTP/1.1 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9j2L2-4sGnoB4mjLiKFJ61t0bbN8Bd7H_xti7uiJYO_5qbPbf5qNrvkUZVxJlFl46y6q6bMtJ7IdbRZuCRzkNwnU-sdLlz3bCsNxbiIfVXVOhhdGx8klvVZpPg2Ok9w1Sqdh_OwHGbzJJgOfiiu9es75fXp-J2-iDFcWSRH6y5tAFo Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a9c77e61574c4725ac06c32c9f858560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 7f2e63e0b7bc4137a40010062e345b8f Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '992e8f7b-3c0f-4675-b126-64a54baef38e'} Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:06.060782 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.066226 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.068237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Returning 404 to user: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:06.069747 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2091678f-1a1c-4705-8dc0-92191eb8e073 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 404 len: 111 microversion: 2.1 time: 0.084462 Oct 31 14:24:06.076191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2439/4609] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:24:05 2022] DELETE /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:24:06.083647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:06.084796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 992e8f7b-3c0f-4675-b126-64a54baef38e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:06.093372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.094315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.094949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.096468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.097113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.097834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.121520 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] HTTP exception thrown: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Request method failure captured: Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e HTTP/1.1 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9j2L2-4sGnoB4mjLiKFJ61t0bbN8Bd7H_xti7uiJYO_5qbPbf5qNrvkUZVxJlFl46y6q6bMtJ7IdbRZuCRzkNwnU-sdLlz3bCsNxbiIfVXVOhhdGx8klvVZpPg2Ok9w1Sqdh_OwHGbzJJgOfiiu9es75fXp-J2-iDFcWSRH6y5tAFo Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a9c77e61574c4725ac06c32c9f858560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 7f2e63e0b7bc4137a40010062e345b8f Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '992e8f7b-3c0f-4675-b126-64a54baef38e'} Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:06.124160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Returning 404 to user: Instance 992e8f7b-3c0f-4675-b126-64a54baef38e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:06.134762 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-063135b8-e8c4-41bd-9b41-c957bfe0d70a tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e" status: 404 len: 111 microversion: 2.1 time: 0.048785 Oct 31 14:24:06.142859 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2440/4610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:06 2022] GET /compute/v2.1/servers/992e8f7b-3c0f-4675-b126-64a54baef38e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:06.356256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:06.356985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:06.375619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.380666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.391011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.396472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.397261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.397993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.614367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:06.634159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:06.636078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:06.637359 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7cd8523b-2bbb-487d-b2be-a46a9a5637db tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 2.129249 Oct 31 14:24:06.638374 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2171/4611] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:24:04 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:06.643474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-88d45039-ec4c-4468-8ddd-2c2c98c22d80 req-bb2f45c5-8265-4644-ae92-28fb584255b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-plugged", "status": "completed", "tag": "acdd42f6-9226-4857-858c-c8144a9ddd1c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:06.654527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88d45039-ec4c-4468-8ddd-2c2c98c22d80 req-bb2f45c5-8265-4644-ae92-28fb584255b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.655364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88d45039-ec4c-4468-8ddd-2c2c98c22d80 req-bb2f45c5-8265-4644-ae92-28fb584255b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.656023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88d45039-ec4c-4468-8ddd-2c2c98c22d80 req-bb2f45c5-8265-4644-ae92-28fb584255b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.676270 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-88d45039-ec4c-4468-8ddd-2c2c98c22d80 req-bb2f45c5-8265-4644-ae92-28fb584255b0 service nova] Creating event network-vif-plugged:acdd42f6-9226-4857-858c-c8144a9ddd1c for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:24:06.685063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-88d45039-ec4c-4468-8ddd-2c2c98c22d80 req-bb2f45c5-8265-4644-ae92-28fb584255b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045176 Oct 31 14:24:06.686072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2172/4612] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:06.955214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:06.963044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-676ec11e-1d74-4dda-862f-5eaa5dfa00fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.612400 Oct 31 14:24:06.963643 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2441/4613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:06 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:06.973970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:06.974618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:06.992890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:06.996307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:06.996771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:06.999286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:07.000427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:07.001517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:07.012486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f971102c-2df5-460c-ad46-85b64fc1437f req-864b5cf0-bfa1-4e1c-936a-8aa4ad5b624e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53bf1ac-12bb-40cc-a714-dfc6da9f55e0", "tag": "e08a8076-33be-4a49-b669-016d0792943d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:07.047402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f971102c-2df5-460c-ad46-85b64fc1437f req-864b5cf0-bfa1-4e1c-936a-8aa4ad5b624e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:07.049439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f971102c-2df5-460c-ad46-85b64fc1437f req-864b5cf0-bfa1-4e1c-936a-8aa4ad5b624e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:07.050059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f971102c-2df5-460c-ad46-85b64fc1437f req-864b5cf0-bfa1-4e1c-936a-8aa4ad5b624e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:07.082285 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f971102c-2df5-460c-ad46-85b64fc1437f req-864b5cf0-bfa1-4e1c-936a-8aa4ad5b624e service nova] Creating event network-changed:e08a8076-33be-4a49-b669-016d0792943d for instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 on n-h1-863052-1 Oct 31 14:24:07.094343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f971102c-2df5-460c-ad46-85b64fc1437f req-864b5cf0-bfa1-4e1c-936a-8aa4ad5b624e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406863 Oct 31 14:24:07.094957 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2173/4614] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:07.677072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:07.681658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:07.702763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:07.703282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:07.703733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:07.704459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:07.704918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:07.734011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:07.890702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:07.909515 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9caf8e7-27dc-43da-b8a9-aaf689f68b79 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.940543 Oct 31 14:24:07.911359 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2442/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:06 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:07.988580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:07.989639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:08.004528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:08.005491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:08.008755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:08.009746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:08.010405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:08.013456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:08.165912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:08.185105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:08.187170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:08.189284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1f94aae-8dd0-4bfa-a7e6-bb1210b1673f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1875 microversion: 2.42 time: 0.522433 Oct 31 14:24:08.204168 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2174/4616] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:24:07 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1875 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:08.558034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:08.570386 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc49c384-8b07-46f6-a0d3-33360926e7de tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.584804 Oct 31 14:24:08.571386 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2443/4617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:07 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:08.939442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:08.940052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:08.955237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:08.955972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:08.956586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:08.957448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:08.958046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:08.958663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:09.220041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:09.221311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:09.232870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:09.238985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:09.239702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:09.240631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:09.241237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:09.241821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:09.478193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:09.504391 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e34ff91b-2b80-419c-b874-5382fd57c655 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.568563 Oct 31 14:24:09.504942 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2175/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:08 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:09.593660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:09.594798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:09.605376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:09.608010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:09.608883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:09.611833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:09.614816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:09.615548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:09.875723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:09.896318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:09.897413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:09.898754 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-291e1630-4232-483d-a71c-e3375f583bab tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2833 microversion: 2.42 time: 0.682673 Oct 31 14:24:09.906128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2444/4619] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:24:09 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2833 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:24:09.941906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:09.942836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:09.950893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:09.951768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:09.952527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:09.954011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:09.954724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:09.957120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:10.036128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:10.048831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4cb53ce2-e1fe-441b-b581-2a2a841c9f4d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.457094 Oct 31 14:24:10.050862 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2176/4620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:09 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:10.311668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f57e9842-16a1-4b10-ad4a-3ee4632f8a3a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.373640 Oct 31 14:24:10.322940 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2445/4621] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:24:09 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217/os-interface => generated 1832 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:10.550228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:10.551388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:10.563072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:10.563904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:10.564742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:10.565665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:10.566447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:10.567225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.074152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:11.074759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:11.085971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:11.090950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:11.091693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.092452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:11.092921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:11.093358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.141776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:11.163810 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84723534-1bf6-4f19-99c5-f7a3cd75b9a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.619203 Oct 31 14:24:11.166117 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2177/4622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:10 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:11.550674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:11.568614 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efaa1aa9-f079-4d73-b419-3e3b280de2b2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.497942 Oct 31 14:24:11.573777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2446/4623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:11 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:11.831143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:11.832137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:11.842931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:11.844419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:11.846651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.847457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:11.850112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:11.850631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.883542 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] HTTP exception thrown: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Request method failure captured: Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c HTTP/1.1 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9j2L2-4sGnoB4mjLiKFJ61t0bbN8Bd7H_xti7uiJYO_5qbPbf5qNrvkUZVxJlFl46y6q6bMtJ7IdbRZuCRzkNwnU-sdLlz3bCsNxbiIfVXVOhhdGx8klvVZpPg2Ok9w1Sqdh_OwHGbzJJgOfiiu9es75fXp-J2-iDFcWSRH6y5tAFo Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a9c77e61574c4725ac06c32c9f858560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 7f2e63e0b7bc4137a40010062e345b8f Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '679c6ed9-8d8f-47cb-b1c1-752bf554da3c'} Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:11.887162 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.891564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.894257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Returning 404 to user: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:11.895630 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f85b236-e42a-4d34-8c6d-033dadab8849 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 404 len: 111 microversion: 2.1 time: 0.068558 Oct 31 14:24:11.896733 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2178/4624] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:24:11 2022] DELETE /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:11.910377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:11.911351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] [instance: 679c6ed9-8d8f-47cb-b1c1-752bf554da3c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:11.928366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:11.930951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:11.932058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.934504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:11.935071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:11.937607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:11.972578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] HTTP exception thrown: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Request method failure captured: Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c HTTP/1.1 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9j2L2-4sGnoB4mjLiKFJ61t0bbN8Bd7H_xti7uiJYO_5qbPbf5qNrvkUZVxJlFl46y6q6bMtJ7IdbRZuCRzkNwnU-sdLlz3bCsNxbiIfVXVOhhdGx8klvVZpPg2Ok9w1Sqdh_OwHGbzJJgOfiiu9es75fXp-J2-iDFcWSRH6y5tAFo Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a9c77e61574c4725ac06c32c9f858560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a9c77e61574c4725ac06c32c9f858560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a9c77e61574c4725ac06c32c9f858560 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1399161236 Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 7f2e63e0b7bc4137a40010062e345b8f Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1399161236-project Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '679c6ed9-8d8f-47cb-b1c1-752bf554da3c'} Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:11.975501 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:11.982899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] Returning 404 to user: Instance 679c6ed9-8d8f-47cb-b1c1-752bf554da3c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:11.984648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45a2ede3-2384-42c5-9956-1ba10d52a8b2 tempest-AttachVolumeTestJSON-1399161236 tempest-AttachVolumeTestJSON-1399161236-project] 10.222.0.27 "GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c" status: 404 len: 111 microversion: 2.1 time: 0.082836 Oct 31 14:24:11.985714 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2447/4625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:11 2022] GET /compute/v2.1/servers/679c6ed9-8d8f-47cb-b1c1-752bf554da3c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:12.197008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:12.200926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:12.241172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:12.246939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:12.247916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:12.256236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:12.257389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:12.258418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:12.574737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:12.587262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a23e058f-9d4c-497e-92f9-c1741cc6ab8d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.399107 Oct 31 14:24:12.588188 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2179/4626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:12 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:12.592924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:12.593796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:12.608697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:12.610524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:12.611022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:12.611584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:12.612350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:12.619590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:12.620062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:12.922771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6fb147d9-4db6-4a01-b4eb-622cb2eb6f98 req-6658898a-fbc6-4b51-9ab4-4144d9bfdef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "tag": "1349ac4d-b953-46a1-8f79-a2a70cbbaa4b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:12.933929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6fb147d9-4db6-4a01-b4eb-622cb2eb6f98 req-6658898a-fbc6-4b51-9ab4-4144d9bfdef0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:12.934466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6fb147d9-4db6-4a01-b4eb-622cb2eb6f98 req-6658898a-fbc6-4b51-9ab4-4144d9bfdef0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:12.934912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6fb147d9-4db6-4a01-b4eb-622cb2eb6f98 req-6658898a-fbc6-4b51-9ab4-4144d9bfdef0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:12.957102 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6fb147d9-4db6-4a01-b4eb-622cb2eb6f98 req-6658898a-fbc6-4b51-9ab4-4144d9bfdef0 service nova] Creating event network-changed:1349ac4d-b953-46a1-8f79-a2a70cbbaa4b for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:24:12.981111 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6fb147d9-4db6-4a01-b4eb-622cb2eb6f98 req-6658898a-fbc6-4b51-9ab4-4144d9bfdef0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062174 Oct 31 14:24:12.994707 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2180/4627] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:24:13.614441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:13.615955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:13.632738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:13.633628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:13.634340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:13.635279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:13.636538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:13.637191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:13.870814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:13.879354 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c858787c-65b7-4292-b3f6-c3534f501b99 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.269100 Oct 31 14:24:13.883650 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2181/4628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:13 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:14.371601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:14.391126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-142aac1a-53c2-48e6-aef7-e76e904bb462 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 1.802614 Oct 31 14:24:14.410146 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2448/4629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:12 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:14.908827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:14.909489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:14.920841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:14.921346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:14.921784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:14.924861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:14.925352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:14.925780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:15.025892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3e15172d-7757-495f-9039-8ccc16197afb req-0e94f0f8-0289-44ad-a4b9-247de5092ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c2c342-ac89-4ca5-98f0-5cad14e05ad6", "name": "network-vif-plugged", "status": "completed", "tag": "782d392a-a5cb-401c-b1cc-ac4fb1e65d41"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:15.052534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3e15172d-7757-495f-9039-8ccc16197afb req-0e94f0f8-0289-44ad-a4b9-247de5092ddd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:15.055216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3e15172d-7757-495f-9039-8ccc16197afb req-0e94f0f8-0289-44ad-a4b9-247de5092ddd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:15.055717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3e15172d-7757-495f-9039-8ccc16197afb req-0e94f0f8-0289-44ad-a4b9-247de5092ddd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:15.075113 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3e15172d-7757-495f-9039-8ccc16197afb req-0e94f0f8-0289-44ad-a4b9-247de5092ddd service nova] Creating event network-vif-plugged:782d392a-a5cb-401c-b1cc-ac4fb1e65d41 for instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 on n-h1-863052-1 Oct 31 14:24:15.086448 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3e15172d-7757-495f-9039-8ccc16197afb req-0e94f0f8-0289-44ad-a4b9-247de5092ddd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066061 Oct 31 14:24:15.087607 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2449/4630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:24:15.192858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:15.201592 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-841c13eb-1997-4fb4-a065-21441cd7e96f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.298132 Oct 31 14:24:15.214754 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2182/4631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:14 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:15.416108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:15.416857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:15.430702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:15.431480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:15.432046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:15.435552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:15.436156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:15.436701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:15.973592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:15.994691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc1348b9-4cfc-4615-86b7-d033661bf73a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.582593 Oct 31 14:24:15.995343 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2450/4632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:15 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:16.226658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:16.227962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:16.235808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:16.236632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:16.237323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:16.238274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:16.238928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:16.239567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:16.551328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:16.564989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-14c9ab61-bbdb-47f8-a439-890214ee0c0b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.338593 Oct 31 14:24:16.568092 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2183/4633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:16 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:17.031318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:17.032323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:17.072099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:17.072702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:17.078192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:17.079215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:17.081580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:17.084747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:17.127957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bdc28cf8-9bed-4f6e-b394-4482a8bb1165 req-0a3ad57f-694d-4edd-b4f4-237f261ffa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53bf1ac-12bb-40cc-a714-dfc6da9f55e0", "name": "network-vif-plugged", "status": "completed", "tag": "e08a8076-33be-4a49-b669-016d0792943d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:17.143481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bdc28cf8-9bed-4f6e-b394-4482a8bb1165 req-0a3ad57f-694d-4edd-b4f4-237f261ffa68 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:17.146380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bdc28cf8-9bed-4f6e-b394-4482a8bb1165 req-0a3ad57f-694d-4edd-b4f4-237f261ffa68 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:17.147204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bdc28cf8-9bed-4f6e-b394-4482a8bb1165 req-0a3ad57f-694d-4edd-b4f4-237f261ffa68 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:17.177314 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bdc28cf8-9bed-4f6e-b394-4482a8bb1165 req-0a3ad57f-694d-4edd-b4f4-237f261ffa68 service nova] Creating event network-vif-plugged:e08a8076-33be-4a49-b669-016d0792943d for instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 on n-h1-863052-1 Oct 31 14:24:17.206437 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bdc28cf8-9bed-4f6e-b394-4482a8bb1165 req-0a3ad57f-694d-4edd-b4f4-237f261ffa68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083703 Oct 31 14:24:17.216475 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2184/4634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:17.598619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:17.600329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:17.615924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:17.616717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:17.617627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:17.619099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:17.619832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:17.621362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:17.899171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:17.916998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8de7e3cb-77b6-4433-8f8e-a286ab8e88ef tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1314 microversion: 2.1 time: 0.888416 Oct 31 14:24:17.918029 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2451/4635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:17 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:18.147302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:18.175137 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd6b5460-f77d-4a1b-b09d-d744e4c1e9fe tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1520 microversion: 2.1 time: 0.577993 Oct 31 14:24:18.175763 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2185/4636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:17 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:18.947362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:18.950542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:18.968554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:18.969115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:18.969582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:18.971023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:18.971491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:18.971927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.208567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:19.209806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:19.231196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:19.232960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:19.233508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:19.233954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.234744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:19.235269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:19.235704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.426284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:19.449373 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2df5d78-2c00-4d58-955c-09fe0097a0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1501 microversion: 2.1 time: 0.505834 Oct 31 14:24:19.484814 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2452/4637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:18 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1501 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:19.508433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:19.509080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:19.535702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:19.536300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:19.536753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.538989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:19.542375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:19.543036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.663653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:24:19.797574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d802b662-e9dd-4e2b-b15c-0ffeb4751969 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 204 len: 0 microversion: 2.1 time: 0.308096 Oct 31 14:24:19.803437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2453/4638] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:24:19 2022] DELETE /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:24:19.824803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:19.825747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:19.840138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:19.840794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:19.841328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.845398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:19.846271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:19.846730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:19.969855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:19.991860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d22a074-5135-484f-92f5-a479c828ec53 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.789442 Oct 31 14:24:19.997940 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2186/4639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:19 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:20.025323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:20.027959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:20.057866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:20.063332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:20.072579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:20.077013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:20.080828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:20.084007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:20.102393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:20.485894 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:24:20.487626 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:24:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 (ip 10.222.0.27) !!! Oct 31 14:24:20.577902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:20.594426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5124f241-2da0-458f-9cde-c51a950390cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1507 microversion: 2.1 time: 0.787376 Oct 31 14:24:20.597353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2454/4640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:19 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1507 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:20.604848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:20.619195 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4504b7aa-cebf-4a75-a440-5d39abaaf706 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.598081 Oct 31 14:24:20.621267 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2187/4641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:20 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:20.660113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:20.660958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:20.667954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:20.668873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:20.669945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:20.670885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:20.671597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:20.672181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:21.081281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:21.094062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:21.099013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a77270f-39ec-4976-aefa-e26e5d98cbcb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.442685 Oct 31 14:24:21.101347 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2455/4642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:20 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:21.123225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2ad7003-15bf-49fe-a207-22055bbc65de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:21.145446 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b2ad7003-15bf-49fe-a207-22055bbc65de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance f9fb8ab2-2a7a-4443-81dc-4108c396b3fe has no mapping to a cell. Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2ad7003-15bf-49fe-a207-22055bbc65de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/f9fb8ab2-2a7a-4443-81dc-4108c396b3fe/action HTTP/1.1 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 15 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: {"os-stop": {}} Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance f9fb8ab2-2a7a-4443-81dc-4108c396b3fe has no mapping to a cell. Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'f9fb8ab2-2a7a-4443-81dc-4108c396b3fe', 'body': {'os-stop': {}}} Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance f9fb8ab2-2a7a-4443-81dc-4108c396b3fe has no mapping to a cell. Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:21.158885 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fb8ab2-2a7a-4443-81dc-4108c396b3fe has no mapping to a cell. Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fb8ab2-2a7a-4443-81dc-4108c396b3fe has no mapping to a cell. Oct 31 14:24:21.163614 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:21.165210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2ad7003-15bf-49fe-a207-22055bbc65de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance f9fb8ab2-2a7a-4443-81dc-4108c396b3fe has no mapping to a cell. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:21.166282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b2ad7003-15bf-49fe-a207-22055bbc65de tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/f9fb8ab2-2a7a-4443-81dc-4108c396b3fe/action" status: 404 len: 117 microversion: 2.1 time: 0.047391 Oct 31 14:24:21.176299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:21.177262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:21.181071 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2188/4643] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:21 2022] POST /compute/v2.1/servers/f9fb8ab2-2a7a-4443-81dc-4108c396b3fe/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:21.185209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:21.187509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:21.190720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:21.191683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:21.192328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:21.193733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:21.624407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:21.625682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:21.636076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:21.636790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:21.637393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:21.638398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:21.639096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:21.639741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:21.693984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:21.708941 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69125197-9cbb-4e2a-8c42-7c34f3f9dfef tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.536043 Oct 31 14:24:21.709965 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2456/4644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:21 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:21.737478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:21.738398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:21.745648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:21.746510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:21.747108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:21.747983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:21.748601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:21.749204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.012672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:22.020654 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-892daf62-e19a-4274-965d-f7cdbff4ce5b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.287245 Oct 31 14:24:22.031341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2457/4645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:21 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:22.045211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d50aa6c8-3dbf-443e-8e88-8d6ab0805ed1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:22.046098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d50aa6c8-3dbf-443e-8e88-8d6ab0805ed1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 2be9157d-ff81-4505-9d24-d8e90e053b0e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:22.052480 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d50aa6c8-3dbf-443e-8e88-8d6ab0805ed1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 2be9157d-ff81-4505-9d24-d8e90e053b0e could not be found. Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d50aa6c8-3dbf-443e-8e88-8d6ab0805ed1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/2be9157d-ff81-4505-9d24-d8e90e053b0e/action HTTP/1.1 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 15 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: {"suspend": {}} Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 2be9157d-ff81-4505-9d24-d8e90e053b0e could not be found. Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2be9157d-ff81-4505-9d24-d8e90e053b0e', 'body': {'suspend': {}}} Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be9157d-ff81-4505-9d24-d8e90e053b0e could not be found. Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be9157d-ff81-4505-9d24-d8e90e053b0e could not be found. Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:22.054463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be9157d-ff81-4505-9d24-d8e90e053b0e could not be found. Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d50aa6c8-3dbf-443e-8e88-8d6ab0805ed1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 2be9157d-ff81-4505-9d24-d8e90e053b0e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d50aa6c8-3dbf-443e-8e88-8d6ab0805ed1 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/2be9157d-ff81-4505-9d24-d8e90e053b0e/action" status: 404 len: 111 microversion: 2.1 time: 0.016435 Oct 31 14:24:22.062067 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2458/4646] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:22 2022] POST /compute/v2.1/servers/2be9157d-ff81-4505-9d24-d8e90e053b0e/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:24:22.066648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:22.067270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:22.075284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.075792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.076236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.076945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.077405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.077975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.225097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:22.234438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9b1e51b-3255-4499-8929-19d8e897c5a7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.171402 Oct 31 14:24:22.235827 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2459/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:22 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:22.259326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:22.260798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:22.267947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.268690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.269312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.270403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.271123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.271733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.335134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:22.345651 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c73b0c4f-3bbe-40ab-bc41-367bdd34674c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1507 microversion: 2.1 time: 0.727899 Oct 31 14:24:22.365580 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2189/4648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:21 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:22.455175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:22.464103 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73ae62ac-095c-4225-a754-afbf97b535dd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.208090 Oct 31 14:24:22.464686 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2460/4649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:22 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:22.487210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:22.488116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:22.495745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.496636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.497162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.498119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.498890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.499558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.528884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lazy-loading 'flavor' on Instance uuid e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:24:22.711024 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc5ef3d6-784e-4220-b9fc-3a82f85745c9 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.226805 Oct 31 14:24:22.716045 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2190/4650] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:22 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:24:22.723126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:22.723749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:22.754846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.756630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.758760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:22.762304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:22.763585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:22.764202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:23.212783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-79217e0b-2f44-4eb4-a7b6-182b5e500eb6 req-12e8f86e-c981-4499-b007-73398b5a330e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53bf1ac-12bb-40cc-a714-dfc6da9f55e0", "name": "network-vif-deleted", "tag": "e08a8076-33be-4a49-b669-016d0792943d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:23.240361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79217e0b-2f44-4eb4-a7b6-182b5e500eb6 req-12e8f86e-c981-4499-b007-73398b5a330e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:23.241447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79217e0b-2f44-4eb4-a7b6-182b5e500eb6 req-12e8f86e-c981-4499-b007-73398b5a330e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:23.254445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79217e0b-2f44-4eb4-a7b6-182b5e500eb6 req-12e8f86e-c981-4499-b007-73398b5a330e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:23.277960 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-79217e0b-2f44-4eb4-a7b6-182b5e500eb6 req-12e8f86e-c981-4499-b007-73398b5a330e service nova] Creating event network-vif-deleted:e08a8076-33be-4a49-b669-016d0792943d for instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 on n-h1-863052-1 Oct 31 14:24:23.308496 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-79217e0b-2f44-4eb4-a7b6-182b5e500eb6 req-12e8f86e-c981-4499-b007-73398b5a330e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099962 Oct 31 14:24:23.309596 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2191/4651] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:24:23.369713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:23.370974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:23.394254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:23.394762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:23.395405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:23.396330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:23.396962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:23.397558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:23.490754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:23.491261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:23.491704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:23.492172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lazy-loading 'fault' on Instance uuid e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:24:23.601869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:23.612726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dfe153bd-2c26-46b6-85ce-ca13b171edf0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 200 len: 1304 microversion: 2.1 time: 0.247594 Oct 31 14:24:23.618925 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2192/4652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:23 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:23.828008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:23.836166 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47ce963b-2aa4-4bd0-be62-cd47254b38d3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1515 microversion: 2.1 time: 1.116823 Oct 31 14:24:23.847130 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2461/4653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:22 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1515 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:24.645717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:24.647266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:24.662808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:24.663690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:24.664549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:24.665518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:24.666219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:24.667528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:24.692046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 HTTP/1.1 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e53bf1ac-12bb-40cc-a714-dfc6da9f55e0'} Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:24.694065 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:24:24.698338 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:24.703531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:24.712074 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ba98882-7e0d-4aa1-a408-9ae7d4ec6453 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 404 len: 111 microversion: 2.1 time: 0.066970 Oct 31 14:24:24.714466 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2193/4654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:24 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:24:24.860978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:24.861682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:24.871599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:24.875017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:24.875642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:24.876553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:24.877169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:24.877765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:24.908492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-973475467", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:25.036363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:24:25.367229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:25.377836 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0132700b-a0a0-4a6e-b69d-79bef7277d11 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1498 microversion: 2.1 time: 0.520666 Oct 31 14:24:25.391751 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2462/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:24 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1498 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:25.403752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:25.404707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:25.411976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:25.412826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:25.413671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:25.414761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:25.415746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:25.416918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:25.445500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lazy-loading 'flavor' on Instance uuid e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:24:25.465824 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'suspend' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state suspended Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 15 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: {"suspend": {}} Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot 'suspend' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state suspended Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'suspend': {}}} Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 31 14:24:25.468580 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state suspended Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state suspended Oct 31 14:24:25.472896 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:25.475611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'suspend' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state suspended {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:25.476688 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2472ae92-baa6-4ddd-b428-4eaf318bd80a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 148 microversion: 2.1 time: 0.077457 Oct 31 14:24:25.481610 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2463/4656] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:25 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 148 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:24:25.488118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:25.488918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:25.498964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:25.499990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:25.500661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:25.501859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:25.502600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:25.503216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:25.606505 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e41909e2-fea4-4274-903f-5c03dc227687 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.122223 Oct 31 14:24:25.608429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2464/4657] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:25 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:24:25.627931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:25.630599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:25.679705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:25.680360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:25.682714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:25.688944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:25.689385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:25.689782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:26.032903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:26.051747 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06443b60-bc6c-4d4e-bb13-20fa48f69c37 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1504 microversion: 2.1 time: 0.432220 Oct 31 14:24:26.062652 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2465/4658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:25 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:27.084461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:27.091494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:27.114839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:27.115522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:27.116289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:27.117296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:27.118197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:27.118776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:27.463340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:27.479183 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4d2a38e-3d1e-49eb-bb8b-4b625472fa12 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1504 microversion: 2.1 time: 0.402709 Oct 31 14:24:27.493144 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2466/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:27 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:27.984535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:24:27.985104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:24:27.985423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:24:27.985835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:24:27.986452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:24:27.996175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:27.996648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:27.997091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:27.997822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:27.998305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:27.998838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:28.057906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:24:28.074314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:24:28.100275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:24:28.106517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:24:28.204346 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0cfba832-1e75-485a-a2c1-fb7236aa42cc tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.299634 Oct 31 14:24:28.210867 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2194/4660] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:24:28.222427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41f72641-f434-4d19-9ab2-0c6a19b899c7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:28.223663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41f72641-f434-4d19-9ab2-0c6a19b899c7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:28.323088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-41f72641-f434-4d19-9ab2-0c6a19b899c7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:28.330830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41f72641-f434-4d19-9ab2-0c6a19b899c7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1214 microversion: 2.1 time: 0.112269 Oct 31 14:24:28.341763 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2467/4661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:28 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:28.508465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:28.509101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:28.516342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:28.516841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:28.517277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:28.517979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:28.522995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:28.525497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:29.154711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:29.168101 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6aebf2e3-6db8-4d6e-a935-0fa3e673578a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1504 microversion: 2.1 time: 0.663384 Oct 31 14:24:29.169342 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2195/4662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:28 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1504 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:29.357750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:29.358469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:29.389137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:29.389137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:29.389137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:29.407285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:29.411393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:29.412151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:29.606192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:29.615664 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dcb00a2-1c51-42b6-b792-d38db6fffb71 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1218 microversion: 2.1 time: 0.262205 Oct 31 14:24:29.624561 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2468/4663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:29 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:30.196059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:30.196695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:30.213602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:30.217445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:30.217903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:30.219794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:30.222997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:30.223474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:30.654937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:30.656246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:30.674970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:30.676412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:30.677702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:30.680128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:30.680973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:30.683183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:30.932544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:30.943319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d83e4b72-3a15-4040-98d9-38c756290268 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1272 microversion: 2.1 time: 0.293580 Oct 31 14:24:30.943930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2469/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:30 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:31.057752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:31.067218 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36d75549-e3be-4110-bca9-81cb7196aeb8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.875584 Oct 31 14:24:31.073143 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2196/4665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:30 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:31.094050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:31.094710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:31.110436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:31.112695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:31.114277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:31.115028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:31.115493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:31.115919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:31.750661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:31.807249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fa79fc2-203c-4710-9913-c52dbd40f89e tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.715196 Oct 31 14:24:31.813144 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2470/4666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:31 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:31.838861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27686f06-a7d5-4427-b788-6667ae4e8d7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:31.840022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27686f06-a7d5-4427-b788-6667ae4e8d7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 5c695628-dd37-459c-9f27-78716a821709] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:31.852978 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-27686f06-a7d5-4427-b788-6667ae4e8d7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 5c695628-dd37-459c-9f27-78716a821709 could not be found. Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27686f06-a7d5-4427-b788-6667ae4e8d7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/5c695628-dd37-459c-9f27-78716a821709/action HTTP/1.1 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 15 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: {"unpause": {}} Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 5c695628-dd37-459c-9f27-78716a821709 could not be found. Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '5c695628-dd37-459c-9f27-78716a821709', 'body': {'unpause': {}}} Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c695628-dd37-459c-9f27-78716a821709 could not be found. Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c695628-dd37-459c-9f27-78716a821709 could not be found. Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:31.857755 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:31.862411 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:31.862411 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:31.862411 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c695628-dd37-459c-9f27-78716a821709 could not be found. Oct 31 14:24:31.862411 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:31.865608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27686f06-a7d5-4427-b788-6667ae4e8d7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 5c695628-dd37-459c-9f27-78716a821709 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:31.868470 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27686f06-a7d5-4427-b788-6667ae4e8d7b tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/5c695628-dd37-459c-9f27-78716a821709/action" status: 404 len: 111 microversion: 2.1 time: 0.034455 Oct 31 14:24:31.877160 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2197/4667] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:31 2022] POST /compute/v2.1/servers/5c695628-dd37-459c-9f27-78716a821709/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:31.881980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:31.883984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:31.896468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:31.897271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:31.901484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:31.902490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:31.903162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:31.904011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:31.972765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:31.974283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:31.986134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:31.988405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:31.989266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:31.993847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:31.994974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:31.995708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:32.510987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:32.531082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6f64a3e-f76c-4da2-a91a-5b7f819fcccb tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.653093 Oct 31 14:24:32.531645 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2471/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:31 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:32.556544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:32.557648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:32.564479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:32.565252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:32.565921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:32.566996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:32.567678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:32.568334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:32.846456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:32.877653 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd9f06a6-79e6-4656-9a5f-0cb83318edb2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.906329 Oct 31 14:24:32.881374 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2198/4669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:31 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:33.427463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:33.455098 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42cafdf7-d6dc-4072-8f63-e56ce4b260ad tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.899722 Oct 31 14:24:33.457811 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2472/4670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:32 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:33.485469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:33.486697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:33.504628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:33.506875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:33.507695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:33.511612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:33.512861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:33.515811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:33.597973 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'unpause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 15 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: {"unpause": {}} Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: exception: Cannot 'unpause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'unpause': {}}} Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state active. Cannot unpause while the instance is in this state. Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:33.603867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'unpause' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2017095-5de4-41d6-89cc-542531bb8a3f tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 145 microversion: 2.1 time: 0.127472 Oct 31 14:24:33.612104 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2199/4671] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:33 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 145 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:24:33.620507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:33.621398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:33.633489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:33.637301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:33.638814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:33.640277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:33.643933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:33.644207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:33.688549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:33.924120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:33.927271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:33.967571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:33.970343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:33.972559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:33.973580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:33.975973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:33.976431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:34.360780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:34.372422 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b656e73-7be3-4625-86a9-a60cfa555743 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.757071 Oct 31 14:24:34.375031 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2473/4672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:33 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:34.419016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:34.420696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:34.433439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:34.438296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:34.439209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:34.439397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:34.444021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:34.444548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:34.516918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:34.531859 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c232a3c-72a7-45be-98db-fa05bc97849f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.617296 Oct 31 14:24:34.532562 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2200/4673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:33 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:34.741085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:34.759271 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab208f58-56fc-48f2-8a46-5c6cbf89d584 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.354551 Oct 31 14:24:34.761054 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2474/4674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:34 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:34.787508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27a47490-92c6-42ca-96e7-7045a7593bdd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:34.788542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27a47490-92c6-42ca-96e7-7045a7593bdd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:34.794862 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-27a47490-92c6-42ca-96e7-7045a7593bdd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4 could not be found. Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27a47490-92c6-42ca-96e7-7045a7593bdd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4/action HTTP/1.1 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 18 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: {"unshelve": null} Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4 could not be found. Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4', 'body': {'unshelve': None}} Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4 could not be found. Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4 could not be found. Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:34.796707 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4 could not be found. Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:34.803480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27a47490-92c6-42ca-96e7-7045a7593bdd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:34.809705 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27a47490-92c6-42ca-96e7-7045a7593bdd tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4/action" status: 404 len: 111 microversion: 2.1 time: 0.022023 Oct 31 14:24:34.813540 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2201/4675] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:34 2022] POST /compute/v2.1/servers/8109b6aa-c7a1-40bf-a2ba-adf2609fd3f4/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:24:34.821827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:34.823051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:34.831477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:34.832046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:34.832493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:34.833241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:34.833701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:34.834228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:35.133483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:35.150056 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d1347136-3678-43dc-adb5-bf71269be811 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.331925 Oct 31 14:24:35.155800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2475/4676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:34 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:35.181527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:35.183140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:35.194682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:35.195743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:35.196299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:35.197831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:35.198757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:35.199398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:35.557816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:35.559461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:35.575554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:35.578692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:35.579160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:35.582468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:35.582963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:35.583532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:35.923727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:35.934431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0b61915-a389-4e9a-9e65-52dd093fa702 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.380672 Oct 31 14:24:35.934431 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2476/4677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:35 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:36.207040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:36.216111 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-907bfe94-7187-4745-b6d1-96d8b6465f96 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 1.038500 Oct 31 14:24:36.221755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2202/4678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:35 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:36.251060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:36.252182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:36.276529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:36.280043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:36.280673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:36.283779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:36.284462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:36.286618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:36.333464 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Cannot 'unshelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action HTTP/1.1 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 18 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: {"unshelve": null} Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: exception: Cannot 'unshelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'unshelve': None}} Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 in vm_state active. Cannot unshelve while the instance is in this state. Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:24:36.335423 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active Oct 31 14:24:36.339499 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:36.343032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 409 to user: Cannot 'unshelve' instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 while it is in vm_state active {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:36.345534 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f6a5eb1-a4bf-4296-bb7d-a5d5d834ed73 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action" status: 409 len: 146 microversion: 2.1 time: 0.102408 Oct 31 14:24:36.349194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2477/4679] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:24:36 2022] POST /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6/action => generated 146 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:24:36.363029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:36.363818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:36.377604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:36.378797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:36.379334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:36.380125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:36.381783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:36.383518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:36.964781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:36.965399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:36.984047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:36.984552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:36.990925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:36.996852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:36.998924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:37.000035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:37.018125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:37.028510 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97c61f3d-629e-4f04-ac3b-893f97e460f0 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.675308 Oct 31 14:24:37.032073 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2203/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:36 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:37.061405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:37.062490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:37.071321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:37.079298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:37.081184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:37.084436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:37.091647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:37.092898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:37.375718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:37.383623 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73ba6be6-66b7-4679-bd1d-271bdcb69e66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.423127 Oct 31 14:24:37.387478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2478/4681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:36 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:37.392204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-466622c0-866d-4b52-bd60-4a1eb58020d5 req-6e330991-d6d0-4f76-afed-9aa3cd164185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ace873-e45d-4ed2-97df-9bc10f77ea33", "tag": "4c2285a9-5ace-4632-9df4-da548c35ff2d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:37.404524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-466622c0-866d-4b52-bd60-4a1eb58020d5 req-6e330991-d6d0-4f76-afed-9aa3cd164185 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:37.405301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-466622c0-866d-4b52-bd60-4a1eb58020d5 req-6e330991-d6d0-4f76-afed-9aa3cd164185 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:37.405926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-466622c0-866d-4b52-bd60-4a1eb58020d5 req-6e330991-d6d0-4f76-afed-9aa3cd164185 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:37.419390 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-466622c0-866d-4b52-bd60-4a1eb58020d5 req-6e330991-d6d0-4f76-afed-9aa3cd164185 service nova] Creating event network-changed:4c2285a9-5ace-4632-9df4-da548c35ff2d for instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 on n-h1-863052-1 Oct 31 14:24:37.424628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-466622c0-866d-4b52-bd60-4a1eb58020d5 req-6e330991-d6d0-4f76-afed-9aa3cd164185 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035940 Oct 31 14:24:37.426013 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2479/4682] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:37.791944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:37.803523 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1de507b1-264b-45e9-af2b-f72815bd08a3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.744220 Oct 31 14:24:37.804643 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2204/4683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:37 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:37.848242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d47ebb83-28fe-41c7-b914-cef1c79f2803 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1903473978_updated"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:37.859365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d47ebb83-28fe-41c7-b914-cef1c79f2803 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: a3fd899b-8739-478d-8b96-c8f492f5cdd7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:37.872423 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d47ebb83-28fe-41c7-b914-cef1c79f2803 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance a3fd899b-8739-478d-8b96-c8f492f5cdd7 could not be found. Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d47ebb83-28fe-41c7-b914-cef1c79f2803 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/servers/a3fd899b-8739-478d-8b96-c8f492f5cdd7 HTTP/1.1 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 81 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1903473978_updated"}} Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a3fd899b-8739-478d-8b96-c8f492f5cdd7 could not be found. Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a3fd899b-8739-478d-8b96-c8f492f5cdd7', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1903473978_updated'}}} Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3fd899b-8739-478d-8b96-c8f492f5cdd7 could not be found. Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 31 14:24:37.875815 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3fd899b-8739-478d-8b96-c8f492f5cdd7 could not be found. Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3fd899b-8739-478d-8b96-c8f492f5cdd7 could not be found. Oct 31 14:24:37.880286 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:37.884062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d47ebb83-28fe-41c7-b914-cef1c79f2803 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance a3fd899b-8739-478d-8b96-c8f492f5cdd7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:37.885201 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d47ebb83-28fe-41c7-b914-cef1c79f2803 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "PUT /compute/v2.1/servers/a3fd899b-8739-478d-8b96-c8f492f5cdd7" status: 404 len: 111 microversion: 2.1 time: 0.059581 Oct 31 14:24:37.886638 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2480/4684] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:24:37 2022] PUT /compute/v2.1/servers/a3fd899b-8739-478d-8b96-c8f492f5cdd7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:37.895097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:37.895783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:37.906727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:37.907300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:37.907754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:37.908471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:37.911090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:37.913843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:38.019667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:38.087363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:38.409359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:38.410304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:38.416174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:38.428878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:38.429385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:38.429919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:38.430536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:38.436799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:38.437447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:38.686670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:38.698220 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4d438a2-32fa-4121-9ae9-ecd04f866e1d tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.806300 Oct 31 14:24:38.716528 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2205/4685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:37 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:38.723979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:38.724662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:38.731934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:38.732486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:38.732920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:38.733624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:38.734120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:38.734573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:38.869929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:38.889995 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65616075-dadc-44e0-bd2a-f245ac5845fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.477227 Oct 31 14:24:38.891686 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2481/4686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:38 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:39.237271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:39.247652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a38c116-093d-4e0c-97e8-fcc50a9a60a8 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.527441 Oct 31 14:24:39.253613 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2206/4687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:38 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:39.277705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34a5d8c5-687a-4eed-b914-e0d38694686a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34a5d8c5-687a-4eed-b914-e0d38694686a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 HTTP/1.1 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 280 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.281730 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:39.285036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34a5d8c5-687a-4eed-b914-e0d38694686a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:39.304112 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34a5d8c5-687a-4eed-b914-e0d38694686a tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "PUT /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 400 len: 619 microversion: 2.1 time: 0.010192 Oct 31 14:24:39.307664 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2482/4688] 10.222.0.27 () {60 vars in 1257 bytes} [Mon Oct 31 14:24:39 2022] PUT /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:24:39.325796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:39.326928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:39.335803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:39.336541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:39.337135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:39.338545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:39.339183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:39.339862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:39.865066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1241811974", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6abe00ba-c90d-4228-aa14-90863003bd28"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:39.939733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] validate_networks() for [('6abe00ba-c90d-4228-aa14-90863003bd28', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:24:40.036354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:40.049658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cbc226e-5e78-4d85-b5fd-298b0ed1f025 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.729684 Oct 31 14:24:40.052182 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2483/4689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:39 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:40.059858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:40.060663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:40.090987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:40.095334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:40.096910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:40.098362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:40.101059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:40.101738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:40.598972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:40.609424 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc0621e3-e42f-4eef-9bde-447a7891a6bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.555868 Oct 31 14:24:40.614968 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2484/4690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:40 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:40.624168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:40.627046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:40.641811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:40.642681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:40.643286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:40.655686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:40.656420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:40.657025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.189290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:41.229938 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8da5ad1e-e317-44bf-9477-7c795c412b26 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.613249 Oct 31 14:24:41.238155 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2485/4691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:40 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:41.265480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7def0c76-412d-4e1b-a84e-072564a30097 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7def0c76-412d-4e1b-a84e-072564a30097 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: request: PUT /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 HTTP/1.1 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 24 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: {"server": {"name": ""}} Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6', 'body': {'server': {'name': ''}}} Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '' Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:24:41.272107 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:41.276692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7def0c76-412d-4e1b-a84e-072564a30097 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:41.277811 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7def0c76-412d-4e1b-a84e-072564a30097 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "PUT /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 400 len: 108 microversion: 2.1 time: 0.017426 Oct 31 14:24:41.281774 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2486/4692] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:24:41 2022] PUT /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:24:41.294860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:41.300521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:41.314702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.315677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.318681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.320869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.321515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.325493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.416604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:24:41.417651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:24:41.418367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:24:41.419089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:24:41.419743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:24:41.434666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.436406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.438663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.439568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.447973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.448672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.464971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:41.496138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Getting quotas for project f550ed7bbad847308956a0b8f435088c. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:24:41.507179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Getting quotas for user 992331a1ab134e88b95b60cc64eb8888 and project f550ed7bbad847308956a0b8f435088c. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:24:41.533115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Going to run 2 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:24:41.535200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:24:41.600945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:24:41.691253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce4e10db-55cb-402c-875d-55fe0cc5d530 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.378136 Oct 31 14:24:41.692268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2207/4693] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:24:41.695322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:41.708521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:41.710158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:41.717819 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93335fc8-05a2-4a1f-851d-7cb8bf9c24b3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1507 microversion: 2.1 time: 0.427819 Oct 31 14:24:41.718822 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2487/4694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:41 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:41.723567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:41.728983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.730078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.731266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.732243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.732932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.733580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.767478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:41.767478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Searching by: {'deleted': False, 'project_id': 'f550ed7bbad847308956a0b8f435088c'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:24:41.792146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.792639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.793076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.793811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:41.794299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:41.794731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:41.849252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9044224b-3aa5-4c21-bb79-de712c09fa23 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.129297 Oct 31 14:24:41.852394 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2488/4695] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:24:41 2022] GET /compute/v2.1/servers => generated 677 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:41.901828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f856b861-adf6-4544-b149-73a5beb2f2f4 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:41.903232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f856b861-adf6-4544-b149-73a5beb2f2f4 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:42.164324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f856b861-adf6-4544-b149-73a5beb2f2f4 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:42.171066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:42.182960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f856b861-adf6-4544-b149-73a5beb2f2f4 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1220 microversion: 2.1 time: 0.315503 Oct 31 14:24:42.198774 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd25fe76-2016-4e7f-b490-d28ab71d1a47 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.504281 Oct 31 14:24:42.214194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2208/4697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:41 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:42.214472 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2489/4697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:41 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1220 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:43.208603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-332fbded-dfc1-4eea-9c50-5d49bfa079e8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:43.209977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-332fbded-dfc1-4eea-9c50-5d49bfa079e8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:43.226575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:43.227976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:43.244805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:43.259099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:43.262541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:43.263193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:43.264102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:43.283619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:43.283619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:43.426520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-332fbded-dfc1-4eea-9c50-5d49bfa079e8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:43.437367 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-332fbded-dfc1-4eea-9c50-5d49bfa079e8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1220 microversion: 2.1 time: 0.231001 Oct 31 14:24:43.437993 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2209/4698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:43 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1220 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:44.468713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:44.469593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:44.488391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:44.490669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:44.494838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:44.496217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:44.497565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:44.497894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:44.500469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:44.511920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1da368b3-69aa-4f7b-a73f-9227499e8f7a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 1.289414 Oct 31 14:24:44.512528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2490/4699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:43 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:44.945031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:45.004395 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-676b7f0f-4780-4c9d-a965-bc27fb07e727 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1272 microversion: 2.1 time: 0.522260 Oct 31 14:24:45.030767 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2210/4700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:44 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1272 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:45.080199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-80fcff92-404b-4cb8-b7eb-cc4434847aa0 req-84d28f12-6b23-4515-a422-07d99971b020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ace873-e45d-4ed2-97df-9bc10f77ea33", "name": "network-vif-plugged", "status": "completed", "tag": "4c2285a9-5ace-4632-9df4-da548c35ff2d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:45.108868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80fcff92-404b-4cb8-b7eb-cc4434847aa0 req-84d28f12-6b23-4515-a422-07d99971b020 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:45.109382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80fcff92-404b-4cb8-b7eb-cc4434847aa0 req-84d28f12-6b23-4515-a422-07d99971b020 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:45.109870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80fcff92-404b-4cb8-b7eb-cc4434847aa0 req-84d28f12-6b23-4515-a422-07d99971b020 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:45.155075 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-80fcff92-404b-4cb8-b7eb-cc4434847aa0 req-84d28f12-6b23-4515-a422-07d99971b020 service nova] Creating event network-vif-plugged:4c2285a9-5ace-4632-9df4-da548c35ff2d for instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 on n-h1-863052-1 Oct 31 14:24:45.174924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-80fcff92-404b-4cb8-b7eb-cc4434847aa0 req-84d28f12-6b23-4515-a422-07d99971b020 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097341 Oct 31 14:24:45.178850 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2491/4701] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:45.540070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:45.543248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:45.572852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:45.573867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:45.574560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:45.577171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:45.579799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:45.581973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:46.042334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:46.045962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:46.061457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:46.062049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:46.062569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:46.063294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:46.063781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:46.064214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:46.330497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:46.342209 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3faab27e-b8ea-44db-9289-ed66fc1bf7f0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.806561 Oct 31 14:24:46.344420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2211/4702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:45 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:46.789430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:46.805169 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd8358c4-69d9-4c66-96d1-f0d70ec1a63f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1278 microversion: 2.1 time: 0.768095 Oct 31 14:24:46.805775 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2492/4703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:46 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1278 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:47.373654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:47.374472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:47.407432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:47.408003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:47.408449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:47.409242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:47.409703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:47.410131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:47.835544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:47.836173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:47.847379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:47.847988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:47.848433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:47.857193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:47.871518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:47.873762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:48.289485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:48.313185 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de3a76a1-2379-4ea8-abba-a5c23d249724 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1314 microversion: 2.1 time: 0.943658 Oct 31 14:24:48.316210 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2212/4704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:47 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:49.345731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:49.346535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:49.351440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:49.356327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:49.364474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:49.364970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:49.365414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:49.368246 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88481a4c-0a56-4052-b628-f42cb09fe0d2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 1.537211 Oct 31 14:24:49.368425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:49.369179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:49.369513 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2493/4705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:47 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:49.370102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:49.705403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:49.720223 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79458208-468c-4a9e-8a1d-8da1d70d3ed6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1500 microversion: 2.1 time: 0.380930 Oct 31 14:24:49.722046 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2213/4706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:49 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1500 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:50.076186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-caf84ab7-b08c-4545-a8cb-b56c3d502bd1 req-8fa396cf-8578-4d12-99f0-36d3e4354a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda1cf8f-bd00-4eb9-a348-eb758f6e421d", "tag": "c0b674b3-f39d-4d09-8272-ae9135b8873a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:50.113115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-caf84ab7-b08c-4545-a8cb-b56c3d502bd1 req-8fa396cf-8578-4d12-99f0-36d3e4354a92 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:50.114090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-caf84ab7-b08c-4545-a8cb-b56c3d502bd1 req-8fa396cf-8578-4d12-99f0-36d3e4354a92 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:50.114090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-caf84ab7-b08c-4545-a8cb-b56c3d502bd1 req-8fa396cf-8578-4d12-99f0-36d3e4354a92 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:50.157066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-caf84ab7-b08c-4545-a8cb-b56c3d502bd1 req-8fa396cf-8578-4d12-99f0-36d3e4354a92 service nova] Creating event network-changed:c0b674b3-f39d-4d09-8272-ae9135b8873a for instance dda1cf8f-bd00-4eb9-a348-eb758f6e421d on n-h1-863052-1 Oct 31 14:24:50.168100 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-caf84ab7-b08c-4545-a8cb-b56c3d502bd1 req-8fa396cf-8578-4d12-99f0-36d3e4354a92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098330 Oct 31 14:24:50.170957 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2494/4707] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:50.395484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:50.396379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:50.411474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:50.411878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:50.412330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:50.413071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:50.413473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:50.418984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.225886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:51.259762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ee83110-562f-4ac5-a240-32e94e0d7739 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 0.867355 Oct 31 14:24:51.281479 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2214/4708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:50 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:51.525938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:51.526982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:51.547796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.556934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.557445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.558235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.558716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.559147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.621043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 HTTP/1.1 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '44c1698c-2f83-4f1f-a7ab-8f6c9d0be948'} Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:51.623673 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.628671 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.630558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:51.633061 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9df4f4eb-3826-4696-b582-84422672c598 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 404 len: 111 microversion: 2.1 time: 0.110778 Oct 31 14:24:51.643489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:51.644806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:51.648981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:51.650713 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2495/4709] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:24:51 2022] DELETE /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:51.656070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.656844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.657615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.658667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.659874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.660495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.685871 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 HTTP/1.1 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '44c1698c-2f83-4f1f-a7ab-8f6c9d0be948'} Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:51.688501 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:51.693826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance 44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:51.695162 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37ed5d78-4868-4c8e-89bc-dd37e2364e47 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948" status: 404 len: 111 microversion: 2.1 time: 0.055700 Oct 31 14:24:51.699135 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2215/4710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:51 2022] GET /compute/v2.1/servers/44c1698c-2f83-4f1f-a7ab-8f6c9d0be948 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:51.705378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:51.706666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:51.718516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.719338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.721571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.723306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.724088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.725598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.767223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:24:51.817258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:51.838686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:51.919612 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4a1246a-fff4-4f5d-86a8-efb1fede08e7 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 204 len: 0 microversion: 2.1 time: 0.218626 Oct 31 14:24:51.920644 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2496/4711] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:24:51 2022] DELETE /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:24:51.929615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:51.930384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:51.949488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.951790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.952430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:51.961801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:51.962650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:51.963256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:52.297691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:52.298801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:52.305806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:52.310446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:52.311263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:52.311788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:52.312756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:52.313299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:52.313826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:52.501167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:52.548501 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-428d43e2-7060-4a62-b646-3dde57cbd4be tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.623236 Oct 31 14:24:52.553235 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2216/4712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:51 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:52.714723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b9b1ddf-7ae1-4d41-8f70-e29f87729576"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:52.718144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:52.725515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:52.726299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:52.726935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:52.727842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:52.728463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:52.728895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:52.729643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:52.776396 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b97f7c4-f90e-4467-873b-a0d7847f0f5f tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 0.482833 Oct 31 14:24:52.781013 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2497/4713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:52 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:53.434685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:53.522909 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a27baa7-4519-4938-aa97-d204df1f3c8b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812099 Oct 31 14:24:53.541877 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2217/4714] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:24:52 2022] POST /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:24:53.576578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:53.578157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:53.594013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:53.596166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:53.597880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:53.599164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:53.602452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:53.603293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:53.805507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b2beb3c6-5e3a-41d2-be7e-ea43469261e5 req-679af934-e254-4592-9e8d-50e5fdbae955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4", "tag": "2fb02d01-d9d0-4541-835f-60f098acfc99"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:53.826542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b2beb3c6-5e3a-41d2-be7e-ea43469261e5 req-679af934-e254-4592-9e8d-50e5fdbae955 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:53.827403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b2beb3c6-5e3a-41d2-be7e-ea43469261e5 req-679af934-e254-4592-9e8d-50e5fdbae955 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:53.828120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b2beb3c6-5e3a-41d2-be7e-ea43469261e5 req-679af934-e254-4592-9e8d-50e5fdbae955 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:53.856189 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b2beb3c6-5e3a-41d2-be7e-ea43469261e5 req-679af934-e254-4592-9e8d-50e5fdbae955 service nova] Creating event network-changed:2fb02d01-d9d0-4541-835f-60f098acfc99 for instance abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4 on n-h2-863052-1 Oct 31 14:24:53.866146 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b2beb3c6-5e3a-41d2-be7e-ea43469261e5 req-679af934-e254-4592-9e8d-50e5fdbae955 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077598 Oct 31 14:24:53.869805 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2218/4715] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:53.876001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:53.877580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:53.888601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:53.889411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:53.890665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:53.892087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:53.892777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:53.893487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:54.638464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:54.648317 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69aa5439-79ab-4be1-9f26-d2c1dba325c8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 0.776898 Oct 31 14:24:54.663144 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2219/4716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:53 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:55.167055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:55.182436 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc073f14-ed16-4eed-abb2-d5dacbcb47ff tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 1.610478 Oct 31 14:24:55.186123 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2498/4717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:53 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:55.684835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:55.686415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:55.704871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:55.708736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:55.711699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:55.716127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:55.718494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:55.721848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:56.065050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:56.077812 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2fd8cd11-4f63-4294-b328-36829dbc8928 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 0.405785 Oct 31 14:24:56.080650 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2220/4718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:55 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:56.186273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:56.186779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:56.204190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:56.205048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:56.205789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:56.206810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:56.208080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:56.210012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:56.210518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:56.211298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:56.228100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:56.229252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:56.230703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:56.234473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:56.236870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:56.238873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:56.632900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:56.649412 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1675d728-2dc1-462f-bea9-1d71dec2dcf2 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1513 microversion: 2.1 time: 0.444955 Oct 31 14:24:56.667465 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2221/4719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:56 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1513 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:56.774008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:56.795348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:56.797615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:56.800519 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65e8bce0-9b3f-4280-9c48-62ab5acda8a8 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2952 microversion: 2.42 time: 0.619516 Oct 31 14:24:56.801972 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2499/4720] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:24:56 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2952 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:56.839732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:56.840272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:56.861832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:56.865515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:56.869074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:56.872883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:56.874449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:56.878001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.113857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:57.115219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:57.138899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:57.152616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:57.154270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.159784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:57.160330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:57.160718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.460507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-225f37af-27c3-4a12-9133-0dc11deb1030 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.631572 Oct 31 14:24:57.462651 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2222/4721] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:24:56 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217/os-interface => generated 1832 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:24:57.478665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8aa127cc-8ccc-4df0-aa9b-cf4ccaf8d9c1 req-01e4334a-00d5-40cf-8a67-e82c48b64ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c2c342-ac89-4ca5-98f0-5cad14e05ad6", "name": "network-vif-deleted", "tag": "782d392a-a5cb-401c-b1cc-ac4fb1e65d41"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:24:57.527534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8aa127cc-8ccc-4df0-aa9b-cf4ccaf8d9c1 req-01e4334a-00d5-40cf-8a67-e82c48b64ecf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:57.528009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8aa127cc-8ccc-4df0-aa9b-cf4ccaf8d9c1 req-01e4334a-00d5-40cf-8a67-e82c48b64ecf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:57.528446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8aa127cc-8ccc-4df0-aa9b-cf4ccaf8d9c1 req-01e4334a-00d5-40cf-8a67-e82c48b64ecf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.571899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8aa127cc-8ccc-4df0-aa9b-cf4ccaf8d9c1 req-01e4334a-00d5-40cf-8a67-e82c48b64ecf service nova] Creating event network-vif-deleted:782d392a-a5cb-401c-b1cc-ac4fb1e65d41 for instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 on n-h1-863052-1 Oct 31 14:24:57.604651 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8aa127cc-8ccc-4df0-aa9b-cf4ccaf8d9c1 req-01e4334a-00d5-40cf-8a67-e82c48b64ecf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140148 Oct 31 14:24:57.605705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2223/4722] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:24:57.683999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:57.684713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:57.697648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:57.701167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:57.701686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.702462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:57.702933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:57.703363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.803118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:57.813496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:57.815792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:57.819820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lazy-loading 'fault' on Instance uuid e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:24:58.264452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:58.280614 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9e81052-43a0-42dd-a619-bed0c0eb19fc tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 1.175344 Oct 31 14:24:58.283518 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2500/4723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:57 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:24:58.322606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09698dbdb79d475aba0d84611879f2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc0b8f573048159de0a59092c3e547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:24:58.333332 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-883b521c-33d8-4c2d-912c-55930898ebc3 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 200 len: 1307 microversion: 2.1 time: 0.657256 Oct 31 14:24:58.338122 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2224/4724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:57 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 1307 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:24:59.314941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:59.315748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:59.344242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:59.344771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:59.345217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:59.345946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:59.369919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:24:59.371316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] [instance: e7c2c342-ac89-4ca5-98f0-5cad14e05ad6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:24:59.378282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:59.380018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:59.384603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:59.406580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:59.407276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:59.418753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:24:59.419633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:24:59.431530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:24:59.491226 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] HTTP exception thrown: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 could not be found. Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Request method failure captured: Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 HTTP/1.1 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9m__8inyYKskEG9gDt7pfDPSTZOTfhkhEdPwQPhkbQyT5vqIMzBbK1Ava4b7Fbvf7Y1l5M08MEUYKBXOSZiUwFE6IBwhzSMb7LkKCGu96WhE-Zlrvsinq5R4iHtI8UrY800JowLckrsQfL_3Dhv-gSxggoEanVQGD9-CRdolQsOwlY Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dc0b8f573048159de0a59092c3e547", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dc0b8f573048159de0a59092c3e547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 51dc0b8f573048159de0a59092c3e547 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-173484608 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 09698dbdb79d475aba0d84611879f2e3 Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-173484608-project Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 could not be found. Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e7c2c342-ac89-4ca5-98f0-5cad14e05ad6'} Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 could not be found. Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 could not be found. Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:24:59.495063 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 could not be found. Oct 31 14:24:59.499502 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:24:59.505739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] Returning 404 to user: Instance e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:24:59.510046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4cf555cc-ef3d-4825-8464-dad1b48461e4 tempest-ServersNegativeTestJSON-173484608 tempest-ServersNegativeTestJSON-173484608-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6" status: 404 len: 111 microversion: 2.1 time: 0.144765 Oct 31 14:24:59.519731 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2225/4725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:59 2022] GET /compute/v2.1/servers/e7c2c342-ac89-4ca5-98f0-5cad14e05ad6 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:00.108598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:00.125264 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3c77feb-ffe4-4626-99c1-d93e0898d803 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 0.818707 Oct 31 14:25:00.129128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2501/4726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:24:59 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:01.155455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:01.156210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:01.169911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:01.171347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:01.171970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:01.172854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:01.175572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:01.176341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:01.222043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-88574f9a-5a9b-42d5-8aed-51467973f27c req-3c30942d-6523-4a0d-bc45-38df6dc5e34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda1cf8f-bd00-4eb9-a348-eb758f6e421d", "name": "network-vif-plugged", "status": "completed", "tag": "c0b674b3-f39d-4d09-8272-ae9135b8873a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:01.259773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-88574f9a-5a9b-42d5-8aed-51467973f27c req-3c30942d-6523-4a0d-bc45-38df6dc5e34d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:01.260970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-88574f9a-5a9b-42d5-8aed-51467973f27c req-3c30942d-6523-4a0d-bc45-38df6dc5e34d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:01.262104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-88574f9a-5a9b-42d5-8aed-51467973f27c req-3c30942d-6523-4a0d-bc45-38df6dc5e34d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:01.325133 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-88574f9a-5a9b-42d5-8aed-51467973f27c req-3c30942d-6523-4a0d-bc45-38df6dc5e34d service nova] Creating event network-vif-plugged:c0b674b3-f39d-4d09-8272-ae9135b8873a for instance dda1cf8f-bd00-4eb9-a348-eb758f6e421d on n-h1-863052-1 Oct 31 14:25:01.337457 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-88574f9a-5a9b-42d5-8aed-51467973f27c req-3c30942d-6523-4a0d-bc45-38df6dc5e34d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121630 Oct 31 14:25:01.342995 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2502/4727] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:25:02.363213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:02.374938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:02.384820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd8a73cd-b71c-4a53-b113-8e07e5bdeca7 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1320 microversion: 2.1 time: 1.231783 Oct 31 14:25:02.388036 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2226/4728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:01 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1320 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:03.416932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:03.419613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:03.459136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:03.464174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:03.465153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:03.465926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:03.466441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:03.466880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:03.717701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c72039fe-40e2-4f43-af0a-1c8569b40caa req-7e4b5a02-1cbd-459e-be61-b0d94b69a273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4", "name": "network-vif-plugged", "status": "completed", "tag": "2fb02d01-d9d0-4541-835f-60f098acfc99"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:03.748156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c72039fe-40e2-4f43-af0a-1c8569b40caa req-7e4b5a02-1cbd-459e-be61-b0d94b69a273 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:03.750814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c72039fe-40e2-4f43-af0a-1c8569b40caa req-7e4b5a02-1cbd-459e-be61-b0d94b69a273 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:03.753350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c72039fe-40e2-4f43-af0a-1c8569b40caa req-7e4b5a02-1cbd-459e-be61-b0d94b69a273 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:03.787605 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c72039fe-40e2-4f43-af0a-1c8569b40caa req-7e4b5a02-1cbd-459e-be61-b0d94b69a273 service nova] Creating event network-vif-plugged:2fb02d01-d9d0-4541-835f-60f098acfc99 for instance abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4 on n-h2-863052-1 Oct 31 14:25:03.804063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c72039fe-40e2-4f43-af0a-1c8569b40caa req-7e4b5a02-1cbd-459e-be61-b0d94b69a273 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094819 Oct 31 14:25:03.806772 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2227/4729] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:25:03.864599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:03.883520 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f46aeee-a9a5-478d-ad98-887797ae35ff tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 200 len: 1507 microversion: 2.1 time: 0.472333 Oct 31 14:25:03.887456 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2503/4730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:03 2022] GET /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:03.915886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:03.916601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:03.934988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:03.935830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:03.935957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:03.936902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:03.937535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:03.937803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:04.643595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:04.659263 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa919b70-dc33-47b3-8568-4c0799cc93d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4" status: 200 len: 1320 microversion: 2.1 time: 0.748212 Oct 31 14:25:04.662641 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2228/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:03 2022] GET /compute/v2.1/servers/abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4 => generated 1320 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:05.684196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:05.684819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:05.704060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:05.704822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:05.705554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:05.707024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:05.713514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:05.714458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:06.769863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:06.786625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f8d3222-57cf-4281-9d50-1d259ba646ae tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4" status: 200 len: 1507 microversion: 2.1 time: 1.106996 Oct 31 14:25:06.795478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2504/4732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:05 2022] GET /compute/v2.1/servers/abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4 => generated 1507 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:06.823876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:06.824414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:06.834737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:06.835250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:06.835700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:06.836427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:06.839375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:06.839836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:06.932421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:25:07.234478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e4e7f77-0468-4dfd-b63c-75cde53c29a2 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4" status: 204 len: 0 microversion: 2.1 time: 0.415714 Oct 31 14:25:07.235006 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2229/4733] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:25:06 2022] DELETE /compute/v2.1/servers/abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:25:07.245083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:07.245606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:07.260228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:07.261086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:07.261704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:07.265919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:07.266941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:07.270814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:07.370194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: dda1cf8f-bd00-4eb9-a348-eb758f6e421d] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:25:07.574920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3097825-89bf-4d9a-8e5d-292d719f7890 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d" status: 204 len: 0 microversion: 2.1 time: 0.335139 Oct 31 14:25:07.575532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2505/4734] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:25:07 2022] DELETE /compute/v2.1/servers/dda1cf8f-bd00-4eb9-a348-eb758f6e421d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:25:07.879971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-309078263", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6abe00ba-c90d-4228-aa14-90863003bd28"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:07.999959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] validate_networks() for [('6abe00ba-c90d-4228-aa14-90863003bd28', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:25:09.971924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:25:09.973231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:25:09.973940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:25:09.974634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:25:09.975125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:25:09.999319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:09.999824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:10.000265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:10.001012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:10.001457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:10.006245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:10.073561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Getting quotas for project f550ed7bbad847308956a0b8f435088c. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:25:10.092432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Getting quotas for user 992331a1ab134e88b95b60cc64eb8888 and project f550ed7bbad847308956a0b8f435088c. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:25:10.112745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Going to run 2 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:25:10.115911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:25:10.176527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=c8ac5250-8ed0-4515-89ca-359aea264515,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:25:10.308789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef520708-2958-4254-8867-9c0e1e63f13b tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.431633 Oct 31 14:25:10.313797 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2230/4735] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:25:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 2438 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 14:25:10.319572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:10.332516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:10.339268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Searching by: {'deleted': False, 'project_id': 'f550ed7bbad847308956a0b8f435088c'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 14:25:10.376393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:10.376889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:10.377399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:10.378489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:10.379598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:10.379755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:10.416578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 14:25:10.488448 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ee140ed-c108-4501-8537-71a6974940b6 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.172199 Oct 31 14:25:10.490952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2506/4736] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 14:25:10 2022] GET /compute/v2.1/servers => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:10.503100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1282bc0e-25d3-4282-95b3-18ba1a3afdf9 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:10.504159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1282bc0e-25d3-4282-95b3-18ba1a3afdf9 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:10.786381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1282bc0e-25d3-4282-95b3-18ba1a3afdf9 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:10.793876 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1282bc0e-25d3-4282-95b3-18ba1a3afdf9 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1217 microversion: 2.1 time: 0.295144 Oct 31 14:25:10.795711 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2231/4737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:10 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1217 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:11.729581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-95e6f889-d306-4290-b7cd-8b5575379148 req-9582b61e-b590-4b44-bfa2-17263d86406f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4", "name": "network-vif-deleted", "tag": "2fb02d01-d9d0-4541-835f-60f098acfc99"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:11.766549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-95e6f889-d306-4290-b7cd-8b5575379148 req-9582b61e-b590-4b44-bfa2-17263d86406f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:11.767397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-95e6f889-d306-4290-b7cd-8b5575379148 req-9582b61e-b590-4b44-bfa2-17263d86406f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:11.769140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-95e6f889-d306-4290-b7cd-8b5575379148 req-9582b61e-b590-4b44-bfa2-17263d86406f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:11.814925 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-95e6f889-d306-4290-b7cd-8b5575379148 req-9582b61e-b590-4b44-bfa2-17263d86406f service nova] Creating event network-vif-deleted:2fb02d01-d9d0-4541-835f-60f098acfc99 for instance abcbe3fa-d2ff-4a94-a6cf-fb31c25079a4 on n-h2-863052-1 Oct 31 14:25:11.824358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0f0dcb8-d2b7-4956-93e8-433a876dae9a tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:11.825313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0f0dcb8-d2b7-4956-93e8-433a876dae9a tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:11.828358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-95e6f889-d306-4290-b7cd-8b5575379148 req-9582b61e-b590-4b44-bfa2-17263d86406f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.918288 Oct 31 14:25:11.831575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2507/4738] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:25:11.983555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c0f0dcb8-d2b7-4956-93e8-433a876dae9a tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:12.001518 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0f0dcb8-d2b7-4956-93e8-433a876dae9a tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1217 microversion: 2.1 time: 0.181803 Oct 31 14:25:12.003289 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2232/4739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:11 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:12.462086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:12.463151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:12.478909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:12.495659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:12.502403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:12.504283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:12.505289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:12.511587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:12.605148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:25:12.817483 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db9e5287-f241-4f11-8a68-68679c6feba2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 204 len: 0 microversion: 2.1 time: 0.364330 Oct 31 14:25:12.818428 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2508/4740] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:25:12 2022] DELETE /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:25:12.827160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:12.831577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:12.846777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:12.850455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:12.851061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:12.854977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:12.856452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:12.860681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:13.031793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:13.033002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:13.058736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:13.063092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:13.067493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:13.081165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:13.082631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:13.083722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:13.223580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:13.237224 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d449f8de-4374-4d65-b08f-d31768b173fd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1552 microversion: 2.1 time: 0.414277 Oct 31 14:25:13.241194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2233/4741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:12 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1552 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:13.279680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:13.313539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1d8ca8a-6ed2-469f-b870-e1bafc29cf2c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1269 microversion: 2.1 time: 0.289085 Oct 31 14:25:13.316343 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2509/4742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:13 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1269 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:14.081573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ec81d462-4369-4ffa-a8ff-1c9be3b92fcc req-e60287b9-1d2f-4257-8605-51872f58c3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda1cf8f-bd00-4eb9-a348-eb758f6e421d", "name": "network-vif-deleted", "tag": "c0b674b3-f39d-4d09-8272-ae9135b8873a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:14.123566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec81d462-4369-4ffa-a8ff-1c9be3b92fcc req-e60287b9-1d2f-4257-8605-51872f58c3b6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:14.124374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec81d462-4369-4ffa-a8ff-1c9be3b92fcc req-e60287b9-1d2f-4257-8605-51872f58c3b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:14.166565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec81d462-4369-4ffa-a8ff-1c9be3b92fcc req-e60287b9-1d2f-4257-8605-51872f58c3b6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:14.248090 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ec81d462-4369-4ffa-a8ff-1c9be3b92fcc req-e60287b9-1d2f-4257-8605-51872f58c3b6 service nova] Creating event network-vif-deleted:c0b674b3-f39d-4d09-8272-ae9135b8873a for instance dda1cf8f-bd00-4eb9-a348-eb758f6e421d on n-h1-863052-1 Oct 31 14:25:14.264386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:14.265618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:14.269047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:14.294550 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ec81d462-4369-4ffa-a8ff-1c9be3b92fcc req-e60287b9-1d2f-4257-8605-51872f58c3b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214716 Oct 31 14:25:14.298615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:14.300211 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2234/4743] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:14.300864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:14.304947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:14.306865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:14.311097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:14.311778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:14.351565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:14.352742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:14.353723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:14.372792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:14.373301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:14.373746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:14.381158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:14.381813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:14.382287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:14.576875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:14.593286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f05c0d0-97e5-4b79-91a2-db541a1ab85c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1269 microversion: 2.1 time: 0.252716 Oct 31 14:25:14.595553 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2235/4744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:14 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:14.809208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:14.838259 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87a10b63-0261-44e3-aaca-c3b937cd8cee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1552 microversion: 2.1 time: 0.577772 Oct 31 14:25:14.839349 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2510/4745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:14 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1552 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:15.621940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:15.622581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:15.635374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:15.638987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:15.639803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:15.640739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:15.641366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:15.643811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:15.865824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:15.866539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:15.891101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:15.893149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:15.894776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:15.897956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:15.901037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:15.901739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:15.980343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:15.993438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a22f8e19-4cc9-4fff-84af-835fe416f94d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1275 microversion: 2.1 time: 0.377354 Oct 31 14:25:15.996038 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2236/4746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:15 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1275 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:16.457427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:16.472446 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31f6cb57-f34f-4071-b210-03d96d5a54d1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1510 microversion: 2.1 time: 0.614489 Oct 31 14:25:16.480199 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2511/4747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:15 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:16.496512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-67d322c6-500c-4f66-b57b-44786c48a303 req-4b5bad7a-82d6-439f-a15e-4ba8eed839b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ace873-e45d-4ed2-97df-9bc10f77ea33", "name": "network-vif-deleted", "tag": "4c2285a9-5ace-4632-9df4-da548c35ff2d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:16.529612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-67d322c6-500c-4f66-b57b-44786c48a303 req-4b5bad7a-82d6-439f-a15e-4ba8eed839b5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:16.530088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-67d322c6-500c-4f66-b57b-44786c48a303 req-4b5bad7a-82d6-439f-a15e-4ba8eed839b5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:16.530606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-67d322c6-500c-4f66-b57b-44786c48a303 req-4b5bad7a-82d6-439f-a15e-4ba8eed839b5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:16.562330 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-67d322c6-500c-4f66-b57b-44786c48a303 req-4b5bad7a-82d6-439f-a15e-4ba8eed839b5 service nova] Creating event network-vif-deleted:4c2285a9-5ace-4632-9df4-da548c35ff2d for instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 on n-h1-863052-1 Oct 31 14:25:16.577698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-67d322c6-500c-4f66-b57b-44786c48a303 req-4b5bad7a-82d6-439f-a15e-4ba8eed839b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091639 Oct 31 14:25:16.578703 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2512/4748] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:16.661871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45543e6f-fede-401a-9d0e-c9c384207106 tempest-ExtensionsTest-210188789 tempest-ExtensionsTest-210188789-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:16.664326 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45543e6f-fede-401a-9d0e-c9c384207106 tempest-ExtensionsTest-210188789 tempest-ExtensionsTest-210188789-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.327755 Oct 31 14:25:16.665145 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2237/4749] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 31 14:25:16 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:25:16.679382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95ef2224-97df-4c98-b759-8ef65d9e78ae tempest-ExtensionsTest-210188789 tempest-ExtensionsTest-210188789-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:16.689060 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95ef2224-97df-4c98-b759-8ef65d9e78ae tempest-ExtensionsTest-210188789 tempest-ExtensionsTest-210188789-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016450 Oct 31 14:25:16.704393 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2513/4750] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 31 14:25:16 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:25:17.022700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:17.024554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:17.050579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:17.051192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:17.051815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:17.057928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:17.061219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:17.061863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:17.503967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:17.505684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:17.528075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:17.534260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:17.535033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:17.548255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:17.553600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:17.554249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:17.865708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:17.878492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89e89a5b-7511-411d-9dc8-e94287f71f85 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.860097 Oct 31 14:25:17.890089 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2238/4751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:17 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:17.950764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:17.968030 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d899fb6-c66b-4af0-b2ba-5574beecf500 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.463228 Oct 31 14:25:17.973985 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2514/4752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:17 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:18.912298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:18.912921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:18.937388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:18.941469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:18.942183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:18.947499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:18.948670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:18.950592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:19.002280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:19.002905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:19.036749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:19.037315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:19.037768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:19.048237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:19.048832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:19.049296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:19.566694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:19.585484 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d00efa2-82b2-4374-8c46-d060b63ee9c0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.583823 Oct 31 14:25:19.587700 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2515/4753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:18 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:20.050350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:20.255204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3c667d4f-c3fd-4886-930e-df7fb0620ecb req-df5c736a-6910-47ff-9f70-21d98cf252af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ac5250-8ed0-4515-89ca-359aea264515", "tag": "ae5af19b-3b60-4d7c-bd76-36db60fe3ead"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:20.309956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3c667d4f-c3fd-4886-930e-df7fb0620ecb req-df5c736a-6910-47ff-9f70-21d98cf252af service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:20.310695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3c667d4f-c3fd-4886-930e-df7fb0620ecb req-df5c736a-6910-47ff-9f70-21d98cf252af service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:20.312177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3c667d4f-c3fd-4886-930e-df7fb0620ecb req-df5c736a-6910-47ff-9f70-21d98cf252af service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:20.359132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3c667d4f-c3fd-4886-930e-df7fb0620ecb req-df5c736a-6910-47ff-9f70-21d98cf252af service nova] Creating event network-changed:ae5af19b-3b60-4d7c-bd76-36db60fe3ead for instance c8ac5250-8ed0-4515-89ca-359aea264515 on n-h2-863052-1 Oct 31 14:25:20.372137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3c667d4f-c3fd-4886-930e-df7fb0620ecb req-df5c736a-6910-47ff-9f70-21d98cf252af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118334 Oct 31 14:25:20.374938 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2516/4754] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:20.612949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:20.619324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:20.620073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:20.648151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:20.649195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:20.649646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:20.650407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:20.650871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:20.651303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:20.749742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:20.763152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-849d7b4a-0974-47ce-9ea9-ea8aa0f00737 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 1.856111 Oct 31 14:25:20.769057 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2239/4755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:18 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:20.897187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:20.912850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cbd6f0a-4c1f-438a-9ef4-b08b1aae1ec6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.305361 Oct 31 14:25:20.930259 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2517/4756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:20 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:21.292660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-05744660-bd87-4a9d-8850-a77a5d9d7572 req-c5000d92-9c4b-439b-8286-6db1a8e4ee52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d11071-7535-4889-b3d4-73a4c6b3b86b", "tag": "649635f5-d5aa-42ad-8610-a54b4d72fe06"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:21.300884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:21.319629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-05744660-bd87-4a9d-8850-a77a5d9d7572 req-c5000d92-9c4b-439b-8286-6db1a8e4ee52 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:21.320121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-05744660-bd87-4a9d-8850-a77a5d9d7572 req-c5000d92-9c4b-439b-8286-6db1a8e4ee52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:21.320629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-05744660-bd87-4a9d-8850-a77a5d9d7572 req-c5000d92-9c4b-439b-8286-6db1a8e4ee52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:21.356809 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-05744660-bd87-4a9d-8850-a77a5d9d7572 req-c5000d92-9c4b-439b-8286-6db1a8e4ee52 service nova] Creating event network-changed:649635f5-d5aa-42ad-8610-a54b4d72fe06 for instance a8d11071-7535-4889-b3d4-73a4c6b3b86b on n-h1-863052-1 Oct 31 14:25:21.368431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-05744660-bd87-4a9d-8850-a77a5d9d7572 req-c5000d92-9c4b-439b-8286-6db1a8e4ee52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080285 Oct 31 14:25:21.375891 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2240/4757] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:25:21.793693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:21.794345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:21.806694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:21.808453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:21.808906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:21.809642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:21.810097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:21.813319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:21.944087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:21.944805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:21.959916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:21.960425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:21.960868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:21.961655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:21.962104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:21.962706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:22.017238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:22.142533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:22.154032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-751a4e98-c2e3-4407-a178-3498424d8dd1 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.364455 Oct 31 14:25:22.155532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2518/4758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:21 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:22.684395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:22.695627 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4874601a-9d6f-4935-a8f0-540c51a19c17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.756057 Oct 31 14:25:22.696232 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2241/4759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:21 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:23.182468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:23.183186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:23.192288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:23.202088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:23.202738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:23.203613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:23.205330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:23.206744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:23.723115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:23.723874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:23.737696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:23.738345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:23.738889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:23.739703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:23.740265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:23.740793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:23.860075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:23.870901 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e8e4bc5a-2a66-4d8c-b4e5-2fd9ce7dd37e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.151824 Oct 31 14:25:23.887792 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2242/4760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:23 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:24.025255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:24.060407 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-158fc9e7-a950-46b3-8c88-619500ab5b52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.874474 Oct 31 14:25:24.061115 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2519/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:23 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:24.894799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:24.895445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:24.908813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:24.909331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:24.909755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:24.910514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:24.915950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:24.916413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:25.055787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:25.073726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1e46160-8206-49f1-b3cf-ea0ed6f285f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.183461 Oct 31 14:25:25.078069 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2243/4762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:24 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:25.098489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:25.099738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:25.108593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:25.118914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:25.119721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:25.120701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:25.121404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:25.122065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:25.681443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:25.697043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09025b84-d519-4d2a-8847-8f504e82f58c tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.595909 Oct 31 14:25:25.697934 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2520/4763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:25 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:26.101744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:26.102473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:26.113576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:26.125005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:26.125674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:26.127593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:26.128188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:26.130115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:26.315276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:26.324221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d6c0c762-1376-40d7-8941-cbffc2fc17c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1345 microversion: 2.1 time: 0.227149 Oct 31 14:25:26.332390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2244/4764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:26 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:26.724843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:26.725640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:26.737861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:26.738821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:26.744503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:26.745426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:26.747665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:26.749084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:26.831099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-cd39971d-e5f3-4351-8bf8-574ef0152c9a req-e9252906-e954-4291-bfea-0c30c6a11092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ac5250-8ed0-4515-89ca-359aea264515", "name": "network-vif-plugged", "status": "completed", "tag": "ae5af19b-3b60-4d7c-bd76-36db60fe3ead"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:26.852006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cd39971d-e5f3-4351-8bf8-574ef0152c9a req-e9252906-e954-4291-bfea-0c30c6a11092 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:26.852843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cd39971d-e5f3-4351-8bf8-574ef0152c9a req-e9252906-e954-4291-bfea-0c30c6a11092 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:26.853531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-cd39971d-e5f3-4351-8bf8-574ef0152c9a req-e9252906-e954-4291-bfea-0c30c6a11092 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:26.880164 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-cd39971d-e5f3-4351-8bf8-574ef0152c9a req-e9252906-e954-4291-bfea-0c30c6a11092 service nova] Creating event network-vif-plugged:ae5af19b-3b60-4d7c-bd76-36db60fe3ead for instance c8ac5250-8ed0-4515-89ca-359aea264515 on n-h2-863052-1 Oct 31 14:25:26.900379 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-cd39971d-e5f3-4351-8bf8-574ef0152c9a req-e9252906-e954-4291-bfea-0c30c6a11092 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073098 Oct 31 14:25:26.901440 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2245/4765] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:27.367624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:27.368393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:27.384294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:27.394001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:27.396008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:27.401218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:27.402194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:27.402826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:27.420928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:27.436827 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4684e860-13aa-4f7c-8aba-81ba072053d8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.716237 Oct 31 14:25:27.437656 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2521/4766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:26 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:27.493295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:27.494214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:27.494828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:27.495443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lazy-loading 'fault' on Instance uuid b7ace873-e45d-4ed2-97df-9bc10f77ea33 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:25:27.651383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:27.663823 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a7d4c2b-d84e-4f53-a140-0fcf164a2213 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 200 len: 1304 microversion: 2.1 time: 0.318193 Oct 31 14:25:27.670486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2246/4767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:27 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 1304 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:28.475724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:28.479071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:28.491137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:28.491612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:28.492384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:28.496610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:28.497099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:28.499267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:28.694660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:28.695825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:28.707673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:28.716684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:28.717149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:28.717934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:28.718428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:28.718876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:28.786747 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 HTTP/1.1 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b7ace873-e45d-4ed2-97df-9bc10f77ea33'} Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:28.788564 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:25:28.792845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa9e39d6-06ed-41af-98c1-bd15cfea4b8e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 404 len: 111 microversion: 2.1 time: 0.099394 Oct 31 14:25:28.810077 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2247/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:28 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:25:28.994683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:29.002758 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9248599f-f6ea-4df0-9d19-b3fb5d642acf tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.532734 Oct 31 14:25:29.004473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:29.007308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:29.014838 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2522/4769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:28 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:29.015977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:29.016629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:29.017231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:29.018420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:29.019042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:29.019989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:29.022882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9ec0a4fd-79e6-43d1-9393-cf22e887807c req-06d8f490-180d-4137-8876-8e3c2d556735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d11071-7535-4889-b3d4-73a4c6b3b86b", "name": "network-vif-plugged", "status": "completed", "tag": "649635f5-d5aa-42ad-8610-a54b4d72fe06"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:29.036019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33/os-volume_attachments HTTP/1.1 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': 'b7ace873-e45d-4ed2-97df-9bc10f77ea33'} Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:25:29.037902 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:25:29.043176 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:29.044755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:25:29.045806 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4631c5b5-9b86-4bf6-b261-1b51783b1dc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046663 Oct 31 14:25:29.046744 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2248/4770] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:25:28 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:25:29.078980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ec0a4fd-79e6-43d1-9393-cf22e887807c req-06d8f490-180d-4137-8876-8e3c2d556735 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:29.079478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ec0a4fd-79e6-43d1-9393-cf22e887807c req-06d8f490-180d-4137-8876-8e3c2d556735 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:29.100127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ec0a4fd-79e6-43d1-9393-cf22e887807c req-06d8f490-180d-4137-8876-8e3c2d556735 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:29.141866 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9ec0a4fd-79e6-43d1-9393-cf22e887807c req-06d8f490-180d-4137-8876-8e3c2d556735 service nova] Creating event network-vif-plugged:649635f5-d5aa-42ad-8610-a54b4d72fe06 for instance a8d11071-7535-4889-b3d4-73a4c6b3b86b on n-h1-863052-1 Oct 31 14:25:29.152677 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9ec0a4fd-79e6-43d1-9393-cf22e887807c req-06d8f490-180d-4137-8876-8e3c2d556735 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134244 Oct 31 14:25:29.156211 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2523/4771] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:29.379215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-450081145", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:29.478686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:25:30.042025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:30.043032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:30.064286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:30.064948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:30.066358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:30.073183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:30.073933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:30.075910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:30.361831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:30.375868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-716f7922-da1e-460c-835c-66dc32b5a82d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.338311 Oct 31 14:25:30.376816 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2524/4772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:30 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:31.405168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:31.407459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:31.422580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:31.423506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:31.425472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:31.426523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:31.428751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:31.429808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:31.735969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:25:31.736589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:25:31.737025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:25:31.737437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:25:31.738060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:25:31.759933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:31.760683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:31.762112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:31.764265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:31.765183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:31.767629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:31.791562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:31.806098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:25:31.815601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:25:31.833573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:25:31.836985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:25:31.907693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89d6d67f-2c86-4c42-a4c4-88ebb559bc08 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.535370 Oct 31 14:25:31.915948 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2249/4773] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:25:31.923659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a076ab1-faf0-44cf-b8b5-2a29015195c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:31.924591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a076ab1-faf0-44cf-b8b5-2a29015195c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:32.296240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a076ab1-faf0-44cf-b8b5-2a29015195c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:32.310959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a076ab1-faf0-44cf-b8b5-2a29015195c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18" status: 200 len: 1214 microversion: 2.1 time: 0.388741 Oct 31 14:25:32.312297 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2250/4774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:31 2022] GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 => generated 1214 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:32.337033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73182bc3-50b1-4d29-9143-e1762eee5336 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:32.338139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73182bc3-50b1-4d29-9143-e1762eee5336 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:32.356535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:32.376617 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90979db4-01dd-4e9a-9482-f8fcd98efdee tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1317 microversion: 2.1 time: 0.975028 Oct 31 14:25:32.377685 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2525/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:31 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1317 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:32.405494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73182bc3-50b1-4d29-9143-e1762eee5336 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:25:32.969280 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.compute.api [None req-73182bc3-50b1-4d29-9143-e1762eee5336 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Instance Mapping does not exist while attempting local delete cleanup. Oct 31 14:25:32.973373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73182bc3-50b1-4d29-9143-e1762eee5336 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18" status: 204 len: 0 microversion: 2.1 time: 0.639022 Oct 31 14:25:32.974049 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2251/4776] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:25:32 2022] DELETE /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:25:32.986039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-513f6e0e-e4f9-4eaa-bebd-a23ccd73ddd5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:32.987817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-513f6e0e-e4f9-4eaa-bebd-a23ccd73ddd5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:33.010940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-513f6e0e-e4f9-4eaa-bebd-a23ccd73ddd5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-513f6e0e-e4f9-4eaa-bebd-a23ccd73ddd5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 HTTP/1.1 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ef73a994-0a4b-421e-b6d0-f9066985db18'} Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:33.017719 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:33.022630 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:33.022630 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:25:33.022630 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:25:33.022630 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:25:33.022630 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:25:33.025555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-513f6e0e-e4f9-4eaa-bebd-a23ccd73ddd5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:25:33.028629 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-513f6e0e-e4f9-4eaa-bebd-a23ccd73ddd5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18" status: 404 len: 111 microversion: 2.1 time: 0.047025 Oct 31 14:25:33.032890 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2526/4777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:32 2022] GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:33.256408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1385277199", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:33.366159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:25:33.404858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:33.405707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:33.417833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:33.421264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:33.421951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:33.422902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:33.423524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:33.426964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:33.920473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:33.929526 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93e0a15b-048a-45b5-aecd-7fe5a480682d tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 200 len: 1504 microversion: 2.1 time: 0.528647 Oct 31 14:25:33.932137 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2527/4778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:33 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:33.955031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:33.955907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:33.963154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:33.963905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:33.964497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:33.965364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:33.965983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:33.966597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.358694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:34.380640 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c7cb3a3-1f1d-44fc-8a8c-b313a11c25d5 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515" status: 200 len: 1505 microversion: 2.1 time: 0.429578 Oct 31 14:25:34.404888 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2528/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:33 2022] GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:34.420252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:34.420766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:34.435225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:34.435731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:34.436178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.437452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:34.438602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:34.439047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.484001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:25:34.534950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:25:34.535399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:25:34.535774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:25:34.536924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:25:34.537501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:25:34.577684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:34.578417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:34.579781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.580398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:34.586443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:34.591660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.598979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:34.692744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:25:34.703217 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f82af95-7c76-43a4-9cdc-f3fd460c8211 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515" status: 204 len: 0 microversion: 2.1 time: 0.287936 Oct 31 14:25:34.704402 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2529/4780] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:25:34 2022] DELETE /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:25:34.714681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:25:34.727796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:34.728645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:34.746060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:34.747095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:34.747708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.752783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:34.753700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:34.755065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:34.761127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:25:34.773322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:25:34.831480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:25:34.943696 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5206f9eb-adb1-4540-a5df-a695d785a8e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689676 Oct 31 14:25:34.959468 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2252/4781] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:25:34.993229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b49e6b2d-d820-4648-94f3-411b158fc7ee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:34.997659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b49e6b2d-d820-4648-94f3-411b158fc7ee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:35.109381 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9e9b63f-ef99-4b57-b8c3-c675155afb54 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 204 len: 0 microversion: 2.1 time: 0.396357 Oct 31 14:25:35.113600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2530/4782] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:25:34 2022] DELETE /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:25:35.131058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:35.131781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:35.152030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:35.152534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:35.152973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:35.154117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:35.154117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:35.163475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:35.491612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b49e6b2d-d820-4648-94f3-411b158fc7ee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:35.508188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b49e6b2d-d820-4648-94f3-411b158fc7ee tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1215 microversion: 2.1 time: 0.543418 Oct 31 14:25:35.527131 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2253/4783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:34 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1215 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:35.814337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:35.848757 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd805541-1bbb-48b3-9b3f-a164fde34a84 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515" status: 200 len: 1511 microversion: 2.1 time: 0.729475 Oct 31 14:25:35.849362 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2531/4784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:35 2022] GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 => generated 1511 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:36.541190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:36.542457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:36.560330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:36.561956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:36.564934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:36.565886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:36.570559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:36.573885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:36.817267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:36.827230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d08a47e-1914-4eef-994b-d35df50159e4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1267 microversion: 2.1 time: 0.290210 Oct 31 14:25:36.830029 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2254/4785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:36 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:36.877766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:36.878557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:36.891870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:36.893973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:36.895497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:36.898848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:36.901116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:36.901953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:37.852904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:37.853699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:37.873391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:37.874758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:37.877279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:37.881147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:37.885614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:37.886275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:38.216590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:38.235174 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fae6ab7-0e6a-46a0-87da-cdf6642a3756 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1273 microversion: 2.1 time: 0.384455 Oct 31 14:25:38.236042 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2255/4786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:37 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1273 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:38.266461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4911b65e-25ba-41c0-9ee5-a9ff7b36ec37 req-bfc859b2-eb6c-460f-b5ad-d47f7a81b6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d11071-7535-4889-b3d4-73a4c6b3b86b", "name": "network-vif-deleted", "tag": "649635f5-d5aa-42ad-8610-a54b4d72fe06"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:38.304704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4911b65e-25ba-41c0-9ee5-a9ff7b36ec37 req-bfc859b2-eb6c-460f-b5ad-d47f7a81b6fa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:38.305625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4911b65e-25ba-41c0-9ee5-a9ff7b36ec37 req-bfc859b2-eb6c-460f-b5ad-d47f7a81b6fa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:38.306241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4911b65e-25ba-41c0-9ee5-a9ff7b36ec37 req-bfc859b2-eb6c-460f-b5ad-d47f7a81b6fa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:38.325232 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4911b65e-25ba-41c0-9ee5-a9ff7b36ec37 req-bfc859b2-eb6c-460f-b5ad-d47f7a81b6fa service nova] Creating event network-vif-deleted:649635f5-d5aa-42ad-8610-a54b4d72fe06 for instance a8d11071-7535-4889-b3d4-73a4c6b3b86b on n-h1-863052-1 Oct 31 14:25:38.334227 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4911b65e-25ba-41c0-9ee5-a9ff7b36ec37 req-bfc859b2-eb6c-460f-b5ad-d47f7a81b6fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093834 Oct 31 14:25:38.335516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2256/4787] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:38.485857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:38.499322 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6b30ad8-5e55-44ab-ab6a-2cb8e5ee9181 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515" status: 200 len: 1511 microversion: 2.1 time: 1.626073 Oct 31 14:25:38.504132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2532/4788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:36 2022] GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 => generated 1511 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:39.271840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:39.275476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:39.327210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-28af728e-2538-41d1-b413-53d85d363960 req-64a820fe-b9e3-4fca-87b4-9568a739bf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ac5250-8ed0-4515-89ca-359aea264515", "name": "network-vif-deleted", "tag": "ae5af19b-3b60-4d7c-bd76-36db60fe3ead"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:39.339067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:39.339632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:39.345238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:39.346854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:39.348007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:39.348926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:39.362379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-28af728e-2538-41d1-b413-53d85d363960 req-64a820fe-b9e3-4fca-87b4-9568a739bf23 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:39.363708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-28af728e-2538-41d1-b413-53d85d363960 req-64a820fe-b9e3-4fca-87b4-9568a739bf23 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:39.367334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-28af728e-2538-41d1-b413-53d85d363960 req-64a820fe-b9e3-4fca-87b4-9568a739bf23 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:39.425138 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-28af728e-2538-41d1-b413-53d85d363960 req-64a820fe-b9e3-4fca-87b4-9568a739bf23 service nova] Creating event network-vif-deleted:ae5af19b-3b60-4d7c-bd76-36db60fe3ead for instance c8ac5250-8ed0-4515-89ca-359aea264515 on n-h2-863052-1 Oct 31 14:25:39.449493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-28af728e-2538-41d1-b413-53d85d363960 req-64a820fe-b9e3-4fca-87b4-9568a739bf23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126102 Oct 31 14:25:39.457578 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2533/4789] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:39.525376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:39.526779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:39.542259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:39.544425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:39.545397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:39.546406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:39.548345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:39.548992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:39.553359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:39.575009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25e2d83c-878c-46d8-b195-5b04e2e7a061 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1273 microversion: 2.1 time: 0.314822 Oct 31 14:25:39.593779 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2257/4790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:39 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:39.658671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:39.659173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:39.659624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:39.660093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lazy-loading 'fault' on Instance uuid c8ac5250-8ed0-4515-89ca-359aea264515 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:25:39.744574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992331a1ab134e88b95b60cc64eb8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f550ed7bbad847308956a0b8f435088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:39.759314 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fbf83c3-772e-4752-8015-1edf5eac994e tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515" status: 200 len: 1307 microversion: 2.1 time: 0.239644 Oct 31 14:25:39.761463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2534/4791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:39 2022] GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:40.339301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6815750f-2f2f-4399-915e-1239eefcaf08 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: .version_select at 0x7fe1069ab310>, body: {"keypair": {"name": "tempest-keypair-1993467809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw2HLy8YyGnB0wDgUdRhZ0e18azv2cBD7x7qcXsh3fzuHKzjMi45U4hRriI42S+yi4vK7doFd9b3m9mOKQiZfZ12kl4loqBd/NJ3lG/vb0z4giXURAuKHt7vIDI6zVr7A=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:40.370699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6815750f-2f2f-4399-915e-1239eefcaf08 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:25:40.378987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6815750f-2f2f-4399-915e-1239eefcaf08 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:25:40.412435 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6815750f-2f2f-4399-915e-1239eefcaf08 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430282 Oct 31 14:25:40.414529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2258/4792] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:25:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:40.608248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:40.608895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:40.635179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:40.641869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:40.642389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:40.643137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:40.643603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:40.644033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:40.785626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:40.787019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: c8ac5250-8ed0-4515-89ca-359aea264515] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:40.797466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:40.802636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:40.803096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:40.803844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:40.804342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:40.804770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:40.842467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] HTTP exception thrown: Instance c8ac5250-8ed0-4515-89ca-359aea264515 could not be found. Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Request method failure captured: Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 HTTP/1.1 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9qnaJ2zMkXtqIcp8V4K5R4Gt21bxF7Du7dROLnUtNBe9IuQt9dUmvbfbUjtoeiwBcjiuw1O8MCmNq-wVrRLpcex4vov1aqztxnVw58vKJE1hzW926YSEjYgj2WruUYG81CHcL_QP_xwD5yLWHtlbTm4Ol953-1FfJisTNQCs7xpnEg Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: f550ed7bbad847308956a0b8f435088c Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateTestJSON-825323314 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f550ed7bbad847308956a0b8f435088c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f550ed7bbad847308956a0b8f435088c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f550ed7bbad847308956a0b8f435088c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f550ed7bbad847308956a0b8f435088c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateTestJSON-825323314 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: f550ed7bbad847308956a0b8f435088c Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateTestJSON-825323314 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateTestJSON-825323314-project Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 992331a1ab134e88b95b60cc64eb8888 Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateTestJSON-825323314-project Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c8ac5250-8ed0-4515-89ca-359aea264515 could not be found. Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c8ac5250-8ed0-4515-89ca-359aea264515'} Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ac5250-8ed0-4515-89ca-359aea264515 could not be found. Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ac5250-8ed0-4515-89ca-359aea264515 could not be found. Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:40.847286 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ac5250-8ed0-4515-89ca-359aea264515 could not be found. Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Returning 404 to user: Instance c8ac5250-8ed0-4515-89ca-359aea264515 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:25:40.851997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-91392d78-5143-4f69-b69f-d1b0af446d52 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515" status: 404 len: 111 microversion: 2.1 time: 0.067326 Oct 31 14:25:40.858277 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2259/4793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:40 2022] GET /compute/v2.1/servers/c8ac5250-8ed0-4515-89ca-359aea264515 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:40.868555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:40.869543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] [instance: a8d11071-7535-4889-b3d4-73a4c6b3b86b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:40.886052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:40.895291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:40.896225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:40.897532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:40.899091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:40.899700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:40.933845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] HTTP exception thrown: Instance a8d11071-7535-4889-b3d4-73a4c6b3b86b could not be found. Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Request method failure captured: Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b HTTP/1.1 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9qnaJ2zMkXtqIcp8V4K5R4Gt21bxF7Du7dROLnUtNBe9IuQt9dUmvbfbUjtoeiwBcjiuw1O8MCmNq-wVrRLpcex4vov1aqztxnVw58vKJE1hzW926YSEjYgj2WruUYG81CHcL_QP_xwD5yLWHtlbTm4Ol953-1FfJisTNQCs7xpnEg Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: f550ed7bbad847308956a0b8f435088c Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-MultipleCreateTestJSON-825323314 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f550ed7bbad847308956a0b8f435088c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f550ed7bbad847308956a0b8f435088c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f550ed7bbad847308956a0b8f435088c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f550ed7bbad847308956a0b8f435088c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-MultipleCreateTestJSON-825323314 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: f550ed7bbad847308956a0b8f435088c Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-MultipleCreateTestJSON-825323314 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-MultipleCreateTestJSON-825323314-project Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 992331a1ab134e88b95b60cc64eb8888 Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-MultipleCreateTestJSON-825323314-project Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a8d11071-7535-4889-b3d4-73a4c6b3b86b could not be found. Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a8d11071-7535-4889-b3d4-73a4c6b3b86b'} Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d11071-7535-4889-b3d4-73a4c6b3b86b could not be found. Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d11071-7535-4889-b3d4-73a4c6b3b86b could not be found. Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:25:40.936395 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d11071-7535-4889-b3d4-73a4c6b3b86b could not be found. Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] Returning 404 to user: Instance a8d11071-7535-4889-b3d4-73a4c6b3b86b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:25:40.940830 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8e90943-b37d-4cf5-b710-bf3580cdb3a8 tempest-MultipleCreateTestJSON-825323314 tempest-MultipleCreateTestJSON-825323314-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b" status: 404 len: 111 microversion: 2.1 time: 0.078609 Oct 31 14:25:40.943736 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2260/4794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:40 2022] GET /compute/v2.1/servers/a8d11071-7535-4889-b3d4-73a4c6b3b86b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:41.521074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:41.534646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e237b9c7-7cf3-4204-803b-94249d7e5bdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.935742 Oct 31 14:25:41.537523 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2535/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:40 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:42.561325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:42.561950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:42.577256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:42.578645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:42.580452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:42.584524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:42.586069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:42.589348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:43.205787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:43.217907 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-085e2961-3323-4e4f-a826-093822013ea5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.660594 Oct 31 14:25:43.225316 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2261/4796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:42 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:44.212638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-43a3819d-47cb-448c-88b8-d4ecaec96629 req-95d56bb5-4b63-4efd-967a-d41addb4e869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96987382-4cff-4328-a1d9-b7108a21398e", "tag": "9b5ea025-ad50-40e9-9d69-f3881e54e55f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:44.243350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-43a3819d-47cb-448c-88b8-d4ecaec96629 req-95d56bb5-4b63-4efd-967a-d41addb4e869 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:44.244107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-43a3819d-47cb-448c-88b8-d4ecaec96629 req-95d56bb5-4b63-4efd-967a-d41addb4e869 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:44.245916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-43a3819d-47cb-448c-88b8-d4ecaec96629 req-95d56bb5-4b63-4efd-967a-d41addb4e869 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:44.256513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:44.258259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:44.274329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:44.276938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:44.277631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:44.287576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:44.288077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:44.290497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:44.323049 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-43a3819d-47cb-448c-88b8-d4ecaec96629 req-95d56bb5-4b63-4efd-967a-d41addb4e869 service nova] Creating event network-changed:9b5ea025-ad50-40e9-9d69-f3881e54e55f for instance 96987382-4cff-4328-a1d9-b7108a21398e on n-h1-863052-1 Oct 31 14:25:44.331610 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-43a3819d-47cb-448c-88b8-d4ecaec96629 req-95d56bb5-4b63-4efd-967a-d41addb4e869 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127305 Oct 31 14:25:44.335490 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2536/4797] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:44.628678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:45.061052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:45.073125 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5cb07ca-bde8-4e54-87e0-cfddee838937 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.821004 Oct 31 14:25:45.086568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2262/4798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:44 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:45.466872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-220709512", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed57bab-14ab-45b9-8b44-cc4a46a76802"}], "security_groups": [{"name": "tempest-securitygroup--480530622"}], "key_name": "tempest-keypair-1993467809", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:45.504576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:45.759384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] validate_networks() for [('0ed57bab-14ab-45b9-8b44-cc4a46a76802', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:25:46.113260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:46.115609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:46.131737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:46.137119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:46.150621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:46.152842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:46.154139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:46.160334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:46.161283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:46.882303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:46.891102 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cec1ed3-6920-4916-b2ec-f9e2d54ad359 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.796427 Oct 31 14:25:46.895468 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2263/4799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:46 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:47.736300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:25:47.736885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:25:47.737187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:25:47.737595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:25:47.738006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:25:47.763688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:47.764182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:47.764617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:47.765344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:47.765800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:47.774072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:47.834510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:25:47.855318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:25:47.881363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:25:47.885056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:25:47.916974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:47.917589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:47.936482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:47.936970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:47.937410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:47.941111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:47.941850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:47.942553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:48.043856 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f39781d-d5d1-494e-a801-c84e8bc8bef0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.584447 Oct 31 14:25:48.066714 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2537/4800] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:25:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:25:48.087369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b2c6e1a-1b38-4545-8b2f-edbaef5393a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:48.088074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b2c6e1a-1b38-4545-8b2f-edbaef5393a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:48.495722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b2c6e1a-1b38-4545-8b2f-edbaef5393a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:48.511352 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b2c6e1a-1b38-4545-8b2f-edbaef5393a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1241 microversion: 2.1 time: 0.443690 Oct 31 14:25:48.511982 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2538/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:48 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1241 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:48.805832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:48.825880 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-62f1f873-330d-48c6-bd2d-34451f62bb37 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.912586 Oct 31 14:25:48.838204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2264/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:47 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:49.540755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:49.541392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:49.555610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:49.556123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:49.556599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:49.557435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:49.567525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:49.568252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:49.836768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:49.844835 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0bf2cc8-77b2-4967-a83f-204970569779 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1237 microversion: 2.1 time: 0.310439 Oct 31 14:25:49.853437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2539/4803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:49 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1237 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:49.864725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:49.867379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:49.882845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:49.887482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:49.893851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:49.900688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:49.904192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:49.905169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:50.388299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=22 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:50.462308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:50.488824 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df5b63b5-ddbc-4a18-bd24-a64518bcf306 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.636483 Oct 31 14:25:50.499077 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2265/4804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:49 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:50.868205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:50.868931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:50.883535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:50.887034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:50.892567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:50.893540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:50.895364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:50.896501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:51.129122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:51.139492 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60cc9a0b-2ed1-4c87-ae79-bbdd5f5108a8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1299 microversion: 2.1 time: 0.275572 Oct 31 14:25:51.140111 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2540/4805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:50 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:51.532019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:51.533420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:51.556104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:51.556823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:51.557569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:51.560864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:51.562493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:51.564500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:51.878698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:51.894408 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ec753f0-6216-4b48-b66c-4d2f8eb2aaea tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.369926 Oct 31 14:25:51.906881 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2266/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:51 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:52.169500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:52.170118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:52.187440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:52.191879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:52.192582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:52.198240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:52.198930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:52.200306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:52.556257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:52.568591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-079d773b-8475-4233-8dd8-693b53a58b38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1299 microversion: 2.1 time: 0.402972 Oct 31 14:25:52.569257 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2541/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:52 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1299 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:52.922779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:52.924085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:52.938418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:52.941262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:52.947385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:52.948460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:52.949209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:52.949878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:52.992273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cb975039-b7dc-4c0b-9585-ccbb4d9c03af req-13ae9c92-d9f9-48a2-9216-382e2e6cf238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96987382-4cff-4328-a1d9-b7108a21398e", "name": "network-vif-plugged", "status": "completed", "tag": "9b5ea025-ad50-40e9-9d69-f3881e54e55f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:53.005202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cb975039-b7dc-4c0b-9585-ccbb4d9c03af req-13ae9c92-d9f9-48a2-9216-382e2e6cf238 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:53.005985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cb975039-b7dc-4c0b-9585-ccbb4d9c03af req-13ae9c92-d9f9-48a2-9216-382e2e6cf238 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:53.007242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cb975039-b7dc-4c0b-9585-ccbb4d9c03af req-13ae9c92-d9f9-48a2-9216-382e2e6cf238 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:53.023065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cb975039-b7dc-4c0b-9585-ccbb4d9c03af req-13ae9c92-d9f9-48a2-9216-382e2e6cf238 service nova] Creating event network-vif-plugged:9b5ea025-ad50-40e9-9d69-f3881e54e55f for instance 96987382-4cff-4328-a1d9-b7108a21398e on n-h1-863052-1 Oct 31 14:25:53.030511 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cb975039-b7dc-4c0b-9585-ccbb4d9c03af req-13ae9c92-d9f9-48a2-9216-382e2e6cf238 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044944 Oct 31 14:25:53.031800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2542/4808] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:53.469127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:53.481726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-548a4702-7874-48e5-8a31-09db0e64537c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.564514 Oct 31 14:25:53.494617 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2267/4809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:52 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:53.597822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:53.602289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:53.627800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:53.631167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:53.637631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:53.639434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:53.641804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:53.642966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:53.940969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:53.964910 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a78a368-3068-4953-8d72-255f8233845c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1299 microversion: 2.1 time: 0.373895 Oct 31 14:25:53.968789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2543/4810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:53 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1299 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:54.509453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:54.511360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:54.524874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:54.525817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:54.527058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:54.528247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:54.528975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:54.529855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:54.995705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:54.997026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:55.008678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:55.009535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:55.013693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:55.014533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:55.015009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:55.015446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:55.103878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:55.112565 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c5524b4-30f1-4f2a-ab61-febd6396f6e9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1315 microversion: 2.1 time: 0.609853 Oct 31 14:25:55.118716 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2268/4811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:54 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:56.018647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:56.029949 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0dfcebb1-3072-49a2-94c7-cad390f0fbaa tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 1.038795 Oct 31 14:25:56.052080 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2544/4812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:54 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:56.146658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:56.147865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:56.172661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:56.173446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:56.175325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:56.179142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:56.179788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:56.180570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.059024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:57.060379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:57.074039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:57.076049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:57.076871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.078100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:57.079958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:57.082116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.285290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:57.297026 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bcac142-7bb6-4d42-ae39-f383fef8f21f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1502 microversion: 2.1 time: 1.157347 Oct 31 14:25:57.301199 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2269/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:56 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1502 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:57.325756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:57.326706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:57.353521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:57.354732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:57.356015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.358852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:57.359597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:57.361002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.521056 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7546d8d0-17ea-48aa-8103-e5c544913652 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e/action" status: 202 len: 0 microversion: 2.1 time: 0.198727 Oct 31 14:25:57.522219 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2270/4814] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:25:57 2022] POST /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:25:57.534478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:57.536555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:57.542606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:57.598934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:57.599436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:57.599881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.602298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:57.602772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:57.603201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:57.626664 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90080b1a-58f4-45be-988f-2943e817760d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 0.570158 Oct 31 14:25:57.633054 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2545/4815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:57 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:25:58.519664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:58.539713 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4eff5a67-cc83-4e19-b742-91d87bb003eb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1507 microversion: 2.1 time: 1.009671 Oct 31 14:25:58.541812 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2271/4816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:57 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1507 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:58.661532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:58.662990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:58.671845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:58.674144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:58.679063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:58.680077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:58.681037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:58.682530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:58.683226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:58.683825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:59.129542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-74c4fe5b-ce6b-436f-a0d8-9d79122b05a4 req-eec757e5-1cc5-46d0-9916-8f0d8263e07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9f19e0-c98f-48c1-896b-e02c143e1365", "tag": "427978b2-1627-4e5d-ac3c-9e4ddf1a18a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:25:59.184373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-74c4fe5b-ce6b-436f-a0d8-9d79122b05a4 req-eec757e5-1cc5-46d0-9916-8f0d8263e07e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:59.187726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-74c4fe5b-ce6b-436f-a0d8-9d79122b05a4 req-eec757e5-1cc5-46d0-9916-8f0d8263e07e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:59.188683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-74c4fe5b-ce6b-436f-a0d8-9d79122b05a4 req-eec757e5-1cc5-46d0-9916-8f0d8263e07e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:59.209197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:59.224963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-74c4fe5b-ce6b-436f-a0d8-9d79122b05a4 req-eec757e5-1cc5-46d0-9916-8f0d8263e07e service nova] Creating event network-changed:427978b2-1627-4e5d-ac3c-9e4ddf1a18a4 for instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 on n-h2-863052-1 Oct 31 14:25:59.244053 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-74c4fe5b-ce6b-436f-a0d8-9d79122b05a4 req-eec757e5-1cc5-46d0-9916-8f0d8263e07e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120938 Oct 31 14:25:59.245391 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2272/4817] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:25:59.469980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:25:59.481895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf959c50-02d6-46f4-b858-c6a81fcb3825 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 0.826426 Oct 31 14:25:59.505759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2546/4818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:58 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:25:59.564947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:25:59.565650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:25:59.581548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:59.582627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:59.583229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:25:59.584115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:25:59.589763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:25:59.590969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:00.026240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:00.041141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd4f9724-2571-4037-8611-b19fe990c26b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1487 microversion: 2.1 time: 0.480302 Oct 31 14:26:00.048924 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2273/4819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:25:59 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1487 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:00.079119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:00.080270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:00.092499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:00.094367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:00.096638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:00.097966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:00.101005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:00.102023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:00.169831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:26:00.177671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:00.386805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-070a63ec-e046-43ab-9b9f-2a915d679872 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 204 len: 0 microversion: 2.1 time: 0.312078 Oct 31 14:26:00.387733 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2547/4820] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:26:00 2022] DELETE /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:26:00.396844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:00.398013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:00.415069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:00.417751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:00.418482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:00.419435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:00.421343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:00.423043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:00.514147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:00.514889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:00.524964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:00.525471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:00.525916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:00.526659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:00.527167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:00.527531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:01.031122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:01.047432 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b1db073b-a6da-4999-bb62-34a19c40a526 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1493 microversion: 2.1 time: 0.655376 Oct 31 14:26:01.048020 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2274/4821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:00 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1493 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:01.597297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:01.608347 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-072836e6-384d-47e7-9dbe-2922ecdfc72c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 1.098584 Oct 31 14:26:01.611469 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2548/4822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:00 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:02.071455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:02.072064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:02.092253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:02.092755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:02.093391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:02.094300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:02.094752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:02.097117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:02.638713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:02.640422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:02.656128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:02.656668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:02.659201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:02.660264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:02.662879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:02.663341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:02.739715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:02.752352 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e444a85-fa46-44c7-973e-00372f6a0eff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1493 microversion: 2.1 time: 0.685841 Oct 31 14:26:02.759192 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2275/4823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:02 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1493 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:03.356500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:03.375256 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83eb3c68-a358-4912-9f92-809d0e915cd8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 0.740337 Oct 31 14:26:03.390194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2549/4824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:02 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:03.784201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:03.788969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:03.823594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:03.826716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:03.832531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:03.833657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:03.835326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:03.836025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:04.016311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:04.035174 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d86710c-6e66-44f8-ad7b-15217034c940 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1451 microversion: 2.1 time: 0.252022 Oct 31 14:26:04.035672 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2276/4825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:03 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1451 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:04.401622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:04.402433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:04.412112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:04.416419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:04.416940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:04.417783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:04.418184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:04.418707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:04.503845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6b586374-6236-498b-bc3c-b37dd80b446b req-9c9184e8-90f8-4874-afde-c11bdea2e39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96987382-4cff-4328-a1d9-b7108a21398e", "name": "network-vif-deleted", "tag": "9b5ea025-ad50-40e9-9d69-f3881e54e55f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:04.527930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6b586374-6236-498b-bc3c-b37dd80b446b req-9c9184e8-90f8-4874-afde-c11bdea2e39b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:04.527930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6b586374-6236-498b-bc3c-b37dd80b446b req-9c9184e8-90f8-4874-afde-c11bdea2e39b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:04.530597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6b586374-6236-498b-bc3c-b37dd80b446b req-9c9184e8-90f8-4874-afde-c11bdea2e39b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:04.583654 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6b586374-6236-498b-bc3c-b37dd80b446b req-9c9184e8-90f8-4874-afde-c11bdea2e39b service nova] Creating event network-vif-deleted:9b5ea025-ad50-40e9-9d69-f3881e54e55f for instance 96987382-4cff-4328-a1d9-b7108a21398e on n-h1-863052-1 Oct 31 14:26:04.597406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6b586374-6236-498b-bc3c-b37dd80b446b req-9c9184e8-90f8-4874-afde-c11bdea2e39b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101233 Oct 31 14:26:04.599158 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2277/4826] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:26:05.069677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:05.071236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:05.080669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:05.082244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:05.083227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:05.085528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:05.087938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:05.095120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:05.167382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:05.170317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:05.178188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:05.179987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lazy-loading 'fault' on Instance uuid 96987382-4cff-4328-a1d9-b7108a21398e {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:05.370590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:05.379371 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95c25a13-0d02-4d29-8207-ebe95744ea5c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 200 len: 1305 microversion: 2.1 time: 0.323805 Oct 31 14:26:05.379962 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2278/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:05 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 1305 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:05.463874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:05.473414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8a6b298-753e-4ed4-bf33-81cee417f0f7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 1.077329 Oct 31 14:26:05.482327 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2550/4828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:04 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:06.405276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:06.406487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:06.424543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:06.425052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:06.425597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:06.426345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:06.426809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:06.431909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:06.480863 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e HTTP/1.1 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '96987382-4cff-4328-a1d9-b7108a21398e'} Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:26:06.482633 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:26:06.487826 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc0c3be8-caec-4f3d-9438-b19ebd78980c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 404 len: 111 microversion: 2.1 time: 0.083015 Oct 31 14:26:06.510065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:06.510740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:06.524698 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2279/4829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:06 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:26:06.527558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:06.528095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:06.528533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:06.529251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:06.533812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:06.555200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:06.816226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-845019604", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:06.973080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:26:07.448604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:07.461588 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f06aff55-3954-45bc-9a3b-b3e8e60a5d88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 0.953001 Oct 31 14:26:07.462961 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2551/4830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:06 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:07.714112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-667682a2-8e95-4174-a7ab-e9597e59c6d4 req-9d2d9427-258b-4ab6-9096-1ae9e145b1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9f19e0-c98f-48c1-896b-e02c143e1365", "name": "network-vif-plugged", "status": "completed", "tag": "427978b2-1627-4e5d-ac3c-9e4ddf1a18a4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:07.756128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-667682a2-8e95-4174-a7ab-e9597e59c6d4 req-9d2d9427-258b-4ab6-9096-1ae9e145b1b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:07.757415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-667682a2-8e95-4174-a7ab-e9597e59c6d4 req-9d2d9427-258b-4ab6-9096-1ae9e145b1b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:07.759486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-667682a2-8e95-4174-a7ab-e9597e59c6d4 req-9d2d9427-258b-4ab6-9096-1ae9e145b1b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:07.801967 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-667682a2-8e95-4174-a7ab-e9597e59c6d4 req-9d2d9427-258b-4ab6-9096-1ae9e145b1b0 service nova] Creating event network-vif-plugged:427978b2-1627-4e5d-ac3c-9e4ddf1a18a4 for instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 on n-h2-863052-1 Oct 31 14:26:07.815262 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-667682a2-8e95-4174-a7ab-e9597e59c6d4 req-9d2d9427-258b-4ab6-9096-1ae9e145b1b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115466 Oct 31 14:26:07.817614 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2552/4831] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:08.179900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:26:08.181041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:26:08.181694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:26:08.182485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:26:08.183141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:26:08.204140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:08.204961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:08.205543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:08.206661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:08.207299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:08.207891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:08.260863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:26:08.274866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:26:08.308733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:26:08.316029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:26:08.422362 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10d258a1-fc67-4a8d-93c3-ca4d6af0dd5b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631973 Oct 31 14:26:08.423534 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2280/4832] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:26:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:26:08.437299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e9ff8d3-6c64-4368-99ad-55aa30d9cad4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:08.438603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e9ff8d3-6c64-4368-99ad-55aa30d9cad4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:08.488785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:08.489654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:08.502256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:08.503637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:08.507823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:08.510086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:08.512195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:08.512821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:08.748253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e9ff8d3-6c64-4368-99ad-55aa30d9cad4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:08.757349 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e9ff8d3-6c64-4368-99ad-55aa30d9cad4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1214 microversion: 2.1 time: 0.325594 Oct 31 14:26:08.773327 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2553/4833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:08 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:09.756867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:09.769804 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6d90da4-d58c-40ed-aa86-49a883bb355b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1366 microversion: 2.1 time: 1.285364 Oct 31 14:26:09.772218 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2281/4834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:08 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1366 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:09.785673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:09.786509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:09.804215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:09.804801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:09.805258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:09.806009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:09.809812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:09.810809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:09.994925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:10.026961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77834e82-4ae0-43c2-8c50-6eab12b292b4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1266 microversion: 2.1 time: 0.245093 Oct 31 14:26:10.027577 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2554/4835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:09 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:10.796457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:10.797829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:10.809959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:10.811395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:10.811909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:10.812628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:10.813308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:10.813949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:11.051974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:11.053806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:11.072999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:11.072999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:11.072999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:11.072999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:11.072999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:11.072999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:11.202569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:11.210779 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7df62e0-f6bb-40b7-a2ae-46a8860424ba tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1556 microversion: 2.1 time: 0.418833 Oct 31 14:26:11.211373 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2282/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:10 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1556 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:11.237098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:11.237903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:11.255785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:11.256971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:11.257577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:11.274660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:11.275173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:11.275617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:11.283676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:11.301058 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-431ea7aa-9981-4b06-b233-37d74811fc56 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1272 microversion: 2.1 time: 0.249103 Oct 31 14:26:11.302324 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2555/4837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:11 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:11.566593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68b7c9c7-d3d7-42b9-89ce-2e90c29fb28a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333251 Oct 31 14:26:11.567195 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2283/4838] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:26:11 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-interface => generated 284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:26:12.326088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:12.327580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:12.353254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:12.354068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:12.356133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:12.358034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:12.361010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:12.361722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:13.036316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:13.047585 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d2f5c20-975e-4c43-9034-8a16be8a95f7 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1272 microversion: 2.1 time: 0.726058 Oct 31 14:26:13.048362 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2556/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:12 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1272 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:14.078315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:14.079616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:14.094933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:14.096532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:14.107830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:14.110532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:14.111299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:14.112626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:15.825803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:15.845429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5e2a57d6-64a0-44f0-9635-44b62448d337 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 1.772584 Oct 31 14:26:15.846766 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2284/4840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:14 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:16.433292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4c3fc848-09ab-4a12-b6ef-2a14b60bbaf9 req-f377febd-d312-41c7-8b93-9f2e14b32402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87a78d9-dd4f-45b5-81f3-04824792b608", "tag": "eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:16.459746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:16.464434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4c3fc848-09ab-4a12-b6ef-2a14b60bbaf9 req-f377febd-d312-41c7-8b93-9f2e14b32402 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:16.466300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4c3fc848-09ab-4a12-b6ef-2a14b60bbaf9 req-f377febd-d312-41c7-8b93-9f2e14b32402 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:16.467774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4c3fc848-09ab-4a12-b6ef-2a14b60bbaf9 req-f377febd-d312-41c7-8b93-9f2e14b32402 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:16.508986 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4c3fc848-09ab-4a12-b6ef-2a14b60bbaf9 req-f377febd-d312-41c7-8b93-9f2e14b32402 service nova] Creating event network-changed:eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3 for instance e87a78d9-dd4f-45b5-81f3-04824792b608 on n-h1-863052-1 Oct 31 14:26:16.515884 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4c3fc848-09ab-4a12-b6ef-2a14b60bbaf9 req-f377febd-d312-41c7-8b93-9f2e14b32402 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088618 Oct 31 14:26:16.517093 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2557/4841] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:16.879572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:16.880196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:16.895019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:16.906134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:16.906961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:16.907583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:16.908469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:16.909646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:16.912868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:17.228295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1937390853", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "9b85302b-cf66-4ae1-999b-9eb98264c665"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:17.402292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] validate_networks() for [('9b85302b-cf66-4ae1-999b-9eb98264c665', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:26:17.979148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:17.990279 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65f1e10d-edb4-49f7-a030-50a34fd850bf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 1.120091 Oct 31 14:26:17.994945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2285/4842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:16 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:18.109198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:26:18.109737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:26:18.110341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:26:18.111008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:26:18.111654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:26:18.129712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:18.131445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:18.135467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:18.136641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:18.138739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:18.143919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:18.196509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Getting quotas for project 94fd549e094a4635be26b1b6f99dae50. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:26:18.212881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Getting quotas for user 99c5f22a812048f8b785df7b419c91c7 and project 94fd549e094a4635be26b1b6f99dae50. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:26:18.255578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:26:18.258820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:26:18.417059 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95581274-2847-408f-976b-186abe0c96cd tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.463363 Oct 31 14:26:18.425930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2558/4843] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:26:18.437053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7cb0f332-8881-47d8-b0cb-45b52dcbd38e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:18.437053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7cb0f332-8881-47d8-b0cb-45b52dcbd38e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:18.441685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:18.442749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:18.738516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cb0f332-8881-47d8-b0cb-45b52dcbd38e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:18.747219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cb0f332-8881-47d8-b0cb-45b52dcbd38e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:18.748666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7cb0f332-8881-47d8-b0cb-45b52dcbd38e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:18.749819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7cb0f332-8881-47d8-b0cb-45b52dcbd38e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1262 microversion: 2.26 time: 0.317484 Oct 31 14:26:18.754501 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2286/4844] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:18 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1262 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:18.776992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e7b1adbe-5d8f-4817-a984-c2c6ab4607c0 req-1520fc30-0b93-46cf-8ef5-bdc51976bbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9f19e0-c98f-48c1-896b-e02c143e1365", "tag": "427978b2-1627-4e5d-ac3c-9e4ddf1a18a4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:18.801816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e7b1adbe-5d8f-4817-a984-c2c6ab4607c0 req-1520fc30-0b93-46cf-8ef5-bdc51976bbaf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:18.802331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e7b1adbe-5d8f-4817-a984-c2c6ab4607c0 req-1520fc30-0b93-46cf-8ef5-bdc51976bbaf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:18.803923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e7b1adbe-5d8f-4817-a984-c2c6ab4607c0 req-1520fc30-0b93-46cf-8ef5-bdc51976bbaf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:18.845363 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e7b1adbe-5d8f-4817-a984-c2c6ab4607c0 req-1520fc30-0b93-46cf-8ef5-bdc51976bbaf service nova] Creating event network-changed:427978b2-1627-4e5d-ac3c-9e4ddf1a18a4 for instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 on n-h2-863052-1 Oct 31 14:26:18.854633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e7b1adbe-5d8f-4817-a984-c2c6ab4607c0 req-1520fc30-0b93-46cf-8ef5-bdc51976bbaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081404 Oct 31 14:26:18.860673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2559/4845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:19.022920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:19.024316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:19.072449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:19.073260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:19.075009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:19.078735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:19.080290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:19.082270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:19.682933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:19.698993 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a29d00e-d44c-438c-b996-e279674ebc0d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 0.679890 Oct 31 14:26:19.699654 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2287/4846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:19 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:19.789128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:19.790694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:19.812712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:19.814904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:19.819270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:19.822937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:19.823654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:19.824308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:20.452638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:20.483817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:20.491090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:20.499063 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-210f9776-c3c5-47fa-a661-ee5d58c46dd7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1258 microversion: 2.26 time: 0.714647 Oct 31 14:26:20.515221 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2560/4847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:19 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1258 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:20.742127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:20.743814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:20.756930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:20.762232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:20.762923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:20.763861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:20.765553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:20.766202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:21.543379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:21.556470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:21.557285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:21.557469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de2c7c2a-f956-4b56-88c2-afd0b5846eec tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 0.821039 Oct 31 14:26:21.557908 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2288/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:20 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:21.636057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:21.637959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:21.640040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:21.641993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:21.645046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:21.646339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:22.166620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:22.180710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:22.184070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:22.188269 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4e39e86-ee8c-44ca-9a71-a048ee8f88c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1320 microversion: 2.26 time: 0.651194 Oct 31 14:26:22.189636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2561/4849] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:21 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1320 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:26:22.589105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:22.589727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:22.624960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:22.625495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:22.625955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:22.627398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:22.627398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:22.640358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:23.121247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:23.147364 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4711e112-a74a-468a-aea6-c3c89b900e61 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 0.562050 Oct 31 14:26:23.149372 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2289/4850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:22 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:23.220971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:23.223031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:23.238086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:23.240355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:23.241076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:23.242662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:23.245153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:23.245818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:23.671211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:23.687219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:23.692425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:23.697499 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67d6712e-0b89-4074-ba1e-ddae7cc80614 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.482344 Oct 31 14:26:23.719817 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2562/4851] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:23 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:24.175653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:24.176929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:24.189432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:24.190552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:24.192740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:24.194456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:24.197935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:24.198710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:24.739008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:24.743720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:24.772231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:24.772749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:24.778507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:24.784694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:24.785812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:24.790543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:24.796804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:24.818856 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-176ca893-0928-4333-b44f-602f665e8c7c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 0.635961 Oct 31 14:26:24.819841 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2290/4852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:24 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:25.071365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:25.083974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:25.085723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:25.087501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6564b04b-93e3-4b2e-bfac-b587db0d39be tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.356980 Oct 31 14:26:25.106504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2563/4853] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:24 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:25.288451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ae15f2b6-4543-43f4-8820-d3176c0e64ed req-ea36a2de-c0e7-4847-ae3d-983ebe6c8e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87a78d9-dd4f-45b5-81f3-04824792b608", "name": "network-vif-plugged", "status": "completed", "tag": "eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:25.316883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ae15f2b6-4543-43f4-8820-d3176c0e64ed req-ea36a2de-c0e7-4847-ae3d-983ebe6c8e4a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:25.319259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ae15f2b6-4543-43f4-8820-d3176c0e64ed req-ea36a2de-c0e7-4847-ae3d-983ebe6c8e4a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:25.319909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ae15f2b6-4543-43f4-8820-d3176c0e64ed req-ea36a2de-c0e7-4847-ae3d-983ebe6c8e4a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:25.367171 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ae15f2b6-4543-43f4-8820-d3176c0e64ed req-ea36a2de-c0e7-4847-ae3d-983ebe6c8e4a service nova] Creating event network-vif-plugged:eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3 for instance e87a78d9-dd4f-45b5-81f3-04824792b608 on n-h1-863052-1 Oct 31 14:26:25.378532 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ae15f2b6-4543-43f4-8820-d3176c0e64ed req-ea36a2de-c0e7-4847-ae3d-983ebe6c8e4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094671 Oct 31 14:26:25.379625 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2291/4854] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:25.844689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:25.845690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:25.860676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:25.862961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:25.863950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:25.866308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:25.868249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:25.869038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:26.120686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:26.121567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:26.140334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:26.141012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:26.141558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:26.142425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:26.143495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:26.144478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:26.436379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:26.448145 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd3c6961-d6a0-4b84-85ad-11d1362054a5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1314 microversion: 2.1 time: 0.608157 Oct 31 14:26:26.456551 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2564/4855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:25 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:26.872649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-970ab19e-17bb-451f-8e2b-8d1569021c2a req-7fab484c-63b7-4504-83d8-076e510b004e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abbd1dc-ad44-46d0-85a4-334a535b7350", "tag": "3050517c-56be-466f-bf06-731a8d0973ae"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:26.911305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-970ab19e-17bb-451f-8e2b-8d1569021c2a req-7fab484c-63b7-4504-83d8-076e510b004e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:26.911847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-970ab19e-17bb-451f-8e2b-8d1569021c2a req-7fab484c-63b7-4504-83d8-076e510b004e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:26.912284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-970ab19e-17bb-451f-8e2b-8d1569021c2a req-7fab484c-63b7-4504-83d8-076e510b004e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:26.957407 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-970ab19e-17bb-451f-8e2b-8d1569021c2a req-7fab484c-63b7-4504-83d8-076e510b004e service nova] Creating event network-changed:3050517c-56be-466f-bf06-731a8d0973ae for instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 on n-h1-863052-1 Oct 31 14:26:26.984781 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-970ab19e-17bb-451f-8e2b-8d1569021c2a req-7fab484c-63b7-4504-83d8-076e510b004e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112738 Oct 31 14:26:26.989872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2565/4856] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:26:27.242958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:27.268617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:27.272790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:27.276291 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-344918fa-583e-4b44-810c-2aeb2f1e1377 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 1.162843 Oct 31 14:26:27.277181 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2292/4857] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:26 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:27.473056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:27.473957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:27.497885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:27.499340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:27.500621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:27.502060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:27.502554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:27.503133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.025501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:28.047448 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d63aea8-2fd3-4c77-af49-7b53dd1b347a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1501 microversion: 2.1 time: 0.578833 Oct 31 14:26:28.065251 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2566/4858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:27 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1501 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:28.077314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:28.077843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:28.102887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:28.104273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:28.105843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.106642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:28.108177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:28.108598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.122260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.219642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lazy-loading 'flavor' on Instance uuid e87a78d9-dd4f-45b5-81f3-04824792b608 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:28.317167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:28.318388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:28.321679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.323352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.356196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:28.357638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:28.360770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.367635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:28.370677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:28.373367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.437499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.722330 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7332276d-3c76-4f04-b8d1-3280aaddac28 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608/action" status: 202 len: 0 microversion: 2.1 time: 0.649780 Oct 31 14:26:28.723420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2293/4859] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:26:28 2022] POST /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:26:28.740922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:28.743755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:28.758068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.765871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:28.767455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:28.768870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.770491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:28.771757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:28.773150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:28.832894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:28.842681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:28.844629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:28.845989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fcd84e6-f658-446a-a7c7-cdd523b93397 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.533920 Oct 31 14:26:28.847276 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2567/4860] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:28 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:26:29.032755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:29.043264 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb34398f-468b-4906-aa6c-eedfc0ac108a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.312881 Oct 31 14:26:29.046538 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2294/4861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:28 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:29.896570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:29.897209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:29.908071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:29.908581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:29.914234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:29.916039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:29.918607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:29.919070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:30.067083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:30.067722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:30.092019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:30.096407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:30.098241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:30.100551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:30.102042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:30.104267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:30.436159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:30.449684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:30.454241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:30.459782 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e23f5cc-ccad-4ef5-8b66-0e14b2b2fd56 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.569248 Oct 31 14:26:30.467233 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2568/4862] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:29 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:31.164660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:31.186782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c62e60fe-36ac-4c0a-9428-52f80154495d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 1.122091 Oct 31 14:26:31.201424 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2295/4863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:30 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:31.494075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:31.497585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:31.523495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:31.524074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:31.524516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:31.525228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:31.525739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:31.526127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:31.928331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:31.936997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:31.939329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:31.941213 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-943f7717-8b84-4485-9b66-2b00fafb75f2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.453057 Oct 31 14:26:31.942264 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2569/4864] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:31 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:32.212898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:32.213565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:32.229116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:32.229645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:32.230099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:32.237050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:32.237807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:32.238544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:32.971229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:32.971862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:32.987249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:32.988153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:32.988862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:32.990497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:32.994287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:32.995177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:33.102437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:33.112663 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ad52b90-28d5-492d-9f9b-1c41e6dfa887 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.904185 Oct 31 14:26:33.115508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2296/4865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:32 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:33.125467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-95294fa1-1d0d-4550-b02f-c0a0891649c5 req-0e191c39-0644-4896-8e79-12b858bc891a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abbd1dc-ad44-46d0-85a4-334a535b7350", "name": "network-vif-plugged", "status": "completed", "tag": "3050517c-56be-466f-bf06-731a8d0973ae"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:33.159070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-95294fa1-1d0d-4550-b02f-c0a0891649c5 req-0e191c39-0644-4896-8e79-12b858bc891a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:33.159553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-95294fa1-1d0d-4550-b02f-c0a0891649c5 req-0e191c39-0644-4896-8e79-12b858bc891a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:33.159990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-95294fa1-1d0d-4550-b02f-c0a0891649c5 req-0e191c39-0644-4896-8e79-12b858bc891a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:33.184535 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-95294fa1-1d0d-4550-b02f-c0a0891649c5 req-0e191c39-0644-4896-8e79-12b858bc891a service nova] Creating event network-vif-plugged:3050517c-56be-466f-bf06-731a8d0973ae for instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 on n-h1-863052-1 Oct 31 14:26:33.223040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-95294fa1-1d0d-4550-b02f-c0a0891649c5 req-0e191c39-0644-4896-8e79-12b858bc891a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105648 Oct 31 14:26:33.224992 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2297/4866] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:33.393660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:33.407712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:33.410044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:33.412328 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-646c4718-7f24-47b4-82b5-132ed54809d1 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.444487 Oct 31 14:26:33.431643 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2570/4867] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:32 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:34.143121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:34.143914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:34.152168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:34.152672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:34.153116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:34.153823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:34.156175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:34.156669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:34.444428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:34.445138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:34.456279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:34.467558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:34.471981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:34.472997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:34.473663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:34.474841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:34.736575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:34.755086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2184d80b-7c3c-4f3f-9c62-4f32e605897a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.617298 Oct 31 14:26:34.756006 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2298/4868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:34 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:35.072528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:35.085391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:35.088709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:35.091598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d76f5f1-a1e0-4fd2-b992-43d71aba4fe7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1362 microversion: 2.26 time: 0.651583 Oct 31 14:26:35.095157 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2571/4869] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:34 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:26:35.793145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:35.793782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:35.813791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:35.817299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:35.817981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:35.821759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:35.822433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:35.823723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.123377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:36.123909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:36.139582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.140386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.147364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.148518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.149153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.150820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.195691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:36.204534 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acce37dd-a68e-463b-9f99-f2c510f305ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.422590 Oct 31 14:26:36.205691 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2299/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:35 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:36.571814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:36.586206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:36.589615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:36.593964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fda19de3-1ad2-4749-be64-315d0aacfbc3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1546 microversion: 2.26 time: 0.473676 Oct 31 14:26:36.597023 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2572/4871] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:36 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1546 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:26:36.628832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe10fc89f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:36.661088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.663935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.664645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.665317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:36.672440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.675166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.675829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.676949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.677858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.678649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.714685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.715594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.716627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.735205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.736056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.737038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.791504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:36.815832 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16a860b6-e9c9-4bcf-b6fc-799576516be7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-714408286" status: 201 len: 0 microversion: 2.26 time: 0.194081 Oct 31 14:26:36.822527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2300/4872] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 31 14:26:36 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-714408286 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 31 14:26:36.828498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a10cb2dc-825f-48b0-bde8-5f7986bb7156 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe10fc381f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:36.848399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a10cb2dc-825f-48b0-bde8-5f7986bb7156 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.852757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a10cb2dc-825f-48b0-bde8-5f7986bb7156 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.853306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a10cb2dc-825f-48b0-bde8-5f7986bb7156 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.921259 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a10cb2dc-825f-48b0-bde8-5f7986bb7156 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-714408286" status: 204 len: 0 microversion: 2.26 time: 0.097350 Oct 31 14:26:36.931023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe106902790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:36.936042 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2573/4873] 10.222.0.27 () {60 vars in 1358 bytes} [Mon Oct 31 14:26:36 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-714408286 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:36.939510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.940002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.940442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.940922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:36.964753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.965265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.965709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:36.970566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:36.972808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:36.972808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.022339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.024496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.033723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.063801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:37.098439 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f9a7cbc6-ba0a-43c0-be63-2fc6f7827e39 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 204 len: 0 microversion: 2.26 time: 0.171853 Oct 31 14:26:37.111613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2fb1090d-55ea-4582-b25f-450981f03535 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1066ea790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.118341 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2301/4874] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 31 14:26:36 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:37.122526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb1090d-55ea-4582-b25f-450981f03535 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.123354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb1090d-55ea-4582-b25f-450981f03535 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.124912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb1090d-55ea-4582-b25f-450981f03535 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.139118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2fb1090d-55ea-4582-b25f-450981f03535 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 200 len: 12 microversion: 2.26 time: 0.031558 Oct 31 14:26:37.151827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1068e3c10>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.157267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2574/4875] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 14:26:37 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:37.164673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.165452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.165986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.166600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:37.172539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.173366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.174326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.175262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.175939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.176586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.204352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.205183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.205845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.216158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.217006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.217669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.233542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.234593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:37.243296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.244206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.244900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.245907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.246630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.256748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.265992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:37.299729 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe4976a5-72b0-497a-a4e1-588c731960c7 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-744796720" status: 201 len: 0 microversion: 2.26 time: 0.152211 Oct 31 14:26:37.305874 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2302/4876] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 31 14:26:37 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-744796720 => generated 0 bytes in 160 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 31 14:26:37.313605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b992eb6d-b584-413b-b12a-2139e95fd5b0 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe106888040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.330108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b992eb6d-b584-413b-b12a-2139e95fd5b0 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.336142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b992eb6d-b584-413b-b12a-2139e95fd5b0 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.337119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b992eb6d-b584-413b-b12a-2139e95fd5b0 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.347409 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b992eb6d-b584-413b-b12a-2139e95fd5b0 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 200 len: 35 microversion: 2.26 time: 0.040217 Oct 31 14:26:37.348106 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2303/4877] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 14:26:37 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 35 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:37.359696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe106888f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.368606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.369382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.370213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.370888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:37.378332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.379087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.379726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.381155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.381961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.382596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.429496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.430079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.430583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.437350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:37.473697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:37.500774 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e68167a-1555-4e78-bf5b-21d13ceddc6b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-744796720" status: 204 len: 0 microversion: 2.26 time: 0.145432 Oct 31 14:26:37.501950 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2304/4878] 10.222.0.27 () {60 vars in 1361 bytes} [Mon Oct 31 14:26:37 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-744796720 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:37.521800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2835ee2-186e-4931-971e-796c78b3ba01 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe106888820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.541631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2835ee2-186e-4931-971e-796c78b3ba01 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.542475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2835ee2-186e-4931-971e-796c78b3ba01 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.543147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2835ee2-186e-4931-971e-796c78b3ba01 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.553968 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2835ee2-186e-4931-971e-796c78b3ba01 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 200 len: 12 microversion: 2.26 time: 0.046958 Oct 31 14:26:37.555443 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2305/4879] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 14:26:37 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:37.566667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1068f74c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.602515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:37.615152 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-149d1cc8-4f65-4942-a376-49c7a0afa597 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.385626 Oct 31 14:26:37.616253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2575/4880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:37 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:37.619961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.620445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.620881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.621392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:37.636495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.636987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.637422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.640751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.641249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.641748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.688936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.689343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.689776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.717576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:37.756754 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b787819-15ed-4609-8ca1-f3eab6c92c2f tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 204 len: 0 microversion: 2.26 time: 0.191910 Oct 31 14:26:37.763367 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2306/4881] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 31 14:26:37 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:37.769286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1066da700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:37.787974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.787974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.787974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.787974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:37.803867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.804369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.811420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.812334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.812845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.813305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.875873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.876373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.885490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.908459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:37.908612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:37.909053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:37.985122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:38.016333 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20eec3f2-f74b-4d97-b051-6d6f655ce3e3 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-1014146819" status: 201 len: 0 microversion: 2.26 time: 0.251566 Oct 31 14:26:38.017320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2576/4882] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 31 14:26:37 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-1014146819 => generated 0 bytes in 253 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 14:26:38.031347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1068f7430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:38.047751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.048651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.049351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.050072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:38.057835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.058710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.059376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.060941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.062666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.063360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.133814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.134414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.134870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.156231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.160738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.163856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.214685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:38.244231 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f031ed74-64a5-4b79-b6a7-29a0ef7ced59 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-211771617" status: 201 len: 0 microversion: 2.26 time: 0.221132 Oct 31 14:26:38.250755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2307/4883] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 31 14:26:38 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-211771617 => generated 0 bytes in 228 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 31 14:26:38.257287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe107795ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:38.272831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.273471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.274201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.278395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:38.310079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.310550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.311238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.312061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.312393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.312852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.385907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.388826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.391557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.422561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:38.460288 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-232c1631-c0a5-408e-a413-29151ae97b5b tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 204 len: 0 microversion: 2.26 time: 0.209208 Oct 31 14:26:38.463356 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2577/4884] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 31 14:26:38 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:38.473065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-14c733da-72a1-4ace-b0da-9b01eb294685 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe106abba60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:38.485066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c733da-72a1-4ace-b0da-9b01eb294685 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.485559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c733da-72a1-4ace-b0da-9b01eb294685 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.493404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-14c733da-72a1-4ace-b0da-9b01eb294685 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.518158 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-14c733da-72a1-4ace-b0da-9b01eb294685 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 200 len: 12 microversion: 2.26 time: 0.050200 Oct 31 14:26:38.525968 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2308/4885] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 14:26:38 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:38.530405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1079793a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:38.545708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.552470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.553023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.603229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:38.631782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.632526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.634516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.638685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.640569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.642356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.643506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:38.644930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:38.655688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.656205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.656741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.657599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.658341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.660051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.697783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.698344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.698786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.722758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:38.763621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b622e827-a983-4161-9430-d0ead72585e5 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 204 len: 0 microversion: 2.26 time: 0.237582 Oct 31 14:26:38.764911 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2578/4886] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 31 14:26:38 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:38.782725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe107a11550>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:38.801688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.804539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.805225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.806551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:38.821727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.824505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.825168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.827503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.828212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.828858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.855745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:38.880601 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-595435aa-e5e4-435c-872a-e1b1ce1a7e5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.234659 Oct 31 14:26:38.880760 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2309/4887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:38 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:38.916708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.917151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.917598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.936601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:38.937098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:38.937539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:38.988239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:39.018764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-407f6200-9f95-4b3d-b168-e8a8d9654b4e tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-1259370818" status: 201 len: 0 microversion: 2.26 time: 0.248442 Oct 31 14:26:39.022372 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2579/4888] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 31 14:26:38 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-1259370818 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 14:26:39.039554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe10693e790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:39.077559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.080493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.080952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.081753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:39.095358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.097195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.098050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.098852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.099321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.099751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.140629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.141518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.142302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.154345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.155169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.155826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.188930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:39.217725 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9bf0d5fa-eeff-4689-92ec-c8a1c7c8e4e2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-797387167" status: 201 len: 0 microversion: 2.26 time: 0.186098 Oct 31 14:26:39.220980 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2310/4889] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 31 14:26:39 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags/tempest-tag-797387167 => generated 0 bytes in 190 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 31 14:26:39.228205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Action: 'update_all', calling method: .version_select at 0x7fe1079798b0>, body: {"tags": ["tempest-tag-938818434", "tempest-tag-217761886"]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:39.246226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.246821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.247270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.247928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:39.270736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.271358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.271734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.272664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.273297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.274915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.313792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:39.338979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.340078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.340577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.376940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:39.405586 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbc89cb5-f3b8-4d91-8df7-d1cfe0468f7a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 200 len: 60 microversion: 2.26 time: 0.181488 Oct 31 14:26:39.413327 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2580/4890] 10.222.0.27 () {62 vars in 1312 bytes} [Mon Oct 31 14:26:39 2022] PUT /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 60 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:39.418045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b24bb0a-89f9-4fd6-816b-09958b3cdaec tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe106d12d30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:39.429246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b24bb0a-89f9-4fd6-816b-09958b3cdaec tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.430120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b24bb0a-89f9-4fd6-816b-09958b3cdaec tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.430894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b24bb0a-89f9-4fd6-816b-09958b3cdaec tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.462113 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b24bb0a-89f9-4fd6-816b-09958b3cdaec tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 200 len: 60 microversion: 2.26 time: 0.048012 Oct 31 14:26:39.464558 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2311/4891] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 31 14:26:39 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 60 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:39.476616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '.version_select at 0x7fe1078381f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:39.486341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.487036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.487483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.489913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:39.497571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.498069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.498615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.499321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.499775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.500201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.528686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.529236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.530152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.550534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'flavor' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:39.595701 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3be1e7e4-6abe-4157-b076-784dc0655677 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags" status: 204 len: 0 microversion: 2.26 time: 0.121038 Oct 31 14:26:39.607324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:39.608054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:39.612918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2581/4892] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 31 14:26:39 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350/tags => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:39.618158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.618648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.619095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.619814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.620274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.620702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.694579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:26:39.862905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e53617d-c939-4646-9e8f-ce172b44b0d2 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 204 len: 0 microversion: 2.26 time: 0.255068 Oct 31 14:26:39.874159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:39.874972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:39.878492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2312/4893] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:26:39 2022] DELETE /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:26:39.882871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.883217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.883776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.885252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.885562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.886116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.936111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:39.937850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:39.967341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.968060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.968863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:39.971146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:39.971946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:39.972739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:40.315221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:40.326801 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99c963a7-c1b6-4a51-bf86-84a39b495fa4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.400769 Oct 31 14:26:40.338201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:40.340951 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2313/4894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:39 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:40.349671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:40.350603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:40.352096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29a9292c-4909-47fb-96f5-259644433b8a tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1552 microversion: 2.26 time: 0.483768 Oct 31 14:26:40.352745 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2582/4895] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:39 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1552 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:41.359256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:41.359872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:41.368366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:41.377672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:41.378364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:41.379274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:41.385217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:41.386921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:41.392531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:41.392981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:41.400687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:41.401482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:41.402120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:41.415757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:41.416596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:41.417237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:41.686305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:41.716386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:41.720140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:41.725777 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56d4e237-8009-4ca0-a60b-5b0822239abb tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1552 microversion: 2.26 time: 0.340567 Oct 31 14:26:41.734415 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2583/4896] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:41 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1552 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:41.978772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:41.986618 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f4d7833-a0a1-4958-a895-83f13e870416 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.631123 Oct 31 14:26:41.987193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2314/4897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:41 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:42.670158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ca053279-efbe-44d6-8ea9-c21b192b322a req-68ff22d6-40a3-4076-94a3-d88a1f6f4782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abbd1dc-ad44-46d0-85a4-334a535b7350", "name": "network-vif-deleted", "tag": "3050517c-56be-466f-bf06-731a8d0973ae"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:42.705057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ca053279-efbe-44d6-8ea9-c21b192b322a req-68ff22d6-40a3-4076-94a3-d88a1f6f4782 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:42.707669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ca053279-efbe-44d6-8ea9-c21b192b322a req-68ff22d6-40a3-4076-94a3-d88a1f6f4782 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:42.708175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ca053279-efbe-44d6-8ea9-c21b192b322a req-68ff22d6-40a3-4076-94a3-d88a1f6f4782 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:42.742716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ca053279-efbe-44d6-8ea9-c21b192b322a req-68ff22d6-40a3-4076-94a3-d88a1f6f4782 service nova] Creating event network-vif-deleted:3050517c-56be-466f-bf06-731a8d0973ae for instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 on n-h1-863052-1 Oct 31 14:26:42.753825 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ca053279-efbe-44d6-8ea9-c21b192b322a req-68ff22d6-40a3-4076-94a3-d88a1f6f4782 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087515 Oct 31 14:26:42.754520 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2584/4898] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:42.766207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:42.767418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:42.787880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:42.793338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:42.797385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:42.798434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:42.800136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:42.800847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:42.901763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:42.902392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:42.916273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:42.917315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lazy-loading 'fault' on Instance uuid 2abbd1dc-ad44-46d0-85a4-334a535b7350 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:26:43.011113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:43.013095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:43.027486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:43.027994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:43.030824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:43.032332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:43.033084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:43.033546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:43.034823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:43.035163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:43.045852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:43.047572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99c5f22a812048f8b785df7b419c91c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd549e094a4635be26b1b6f99dae50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:43.049723 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bfec378e-0d06-4f4e-a327-98a202ecac94 tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 200 len: 1352 microversion: 2.26 time: 0.292859 Oct 31 14:26:43.051038 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2315/4899] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:42 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 1352 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:26:43.436714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:43.448996 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3e1a605-3aee-4c86-9302-3a680e5d60c4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.443119 Oct 31 14:26:43.452473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2585/4900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:43 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:26:43.926149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:43.927260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:43.945106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:43.945767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:43.950118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:43.951088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:43.951571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:43.952012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:44.010429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ec07a88-7b58-436b-9a62-c87b5e62fd88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/ips" status: 200 len: 149 microversion: 2.1 time: 0.089264 Oct 31 14:26:44.011041 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2316/4901] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:26:43 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:44.079416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:44.080259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] [instance: 2abbd1dc-ad44-46d0-85a4-334a535b7350] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:44.090842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:44.095493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:44.096176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:44.097153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:44.100019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:44.100833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:44.139052 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] HTTP exception thrown: Instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 could not be found. Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Request method failure captured: Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 HTTP/1.1 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9sIy1wgSp9b8mk8RIG4rNOAxBL6RiNuvG604C7EPfaj0bvFAq_J0fLzRbN7V2WLd_DksPor_uoxV73ZQsZMQiNqXNCJwQsbcpSta4WPuQWoRyOTNXrVtjghTfZd4ghgdqGUeJ4kwCsmte9tWoV6aOPrqTHAyUzzEBQiuADgyx6vP1s Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.26 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 94fd549e094a4635be26b1b6f99dae50 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerTagsTestJSON-683854064 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94fd549e094a4635be26b1b6f99dae50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94fd549e094a4635be26b1b6f99dae50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94fd549e094a4635be26b1b6f99dae50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94fd549e094a4635be26b1b6f99dae50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerTagsTestJSON-683854064 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 94fd549e094a4635be26b1b6f99dae50 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerTagsTestJSON-683854064 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerTagsTestJSON-683854064-project Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 99c5f22a812048f8b785df7b419c91c7 Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerTagsTestJSON-683854064-project Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 could not be found. Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2abbd1dc-ad44-46d0-85a4-334a535b7350'} Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 could not be found. Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 could not be found. Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:26:44.145371 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 could not be found. Oct 31 14:26:44.151122 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:26:44.161520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] Returning 404 to user: Instance 2abbd1dc-ad44-46d0-85a4-334a535b7350 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:26:44.165276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-747e30cb-8c0c-4ca1-86ce-64476794b28d tempest-ServerTagsTestJSON-683854064 tempest-ServerTagsTestJSON-683854064-project] 10.222.0.27 "GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350" status: 404 len: 111 microversion: 2.26 time: 0.089781 Oct 31 14:26:44.178539 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2586/4902] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:26:44 2022] GET /compute/v2.1/servers/2abbd1dc-ad44-46d0-85a4-334a535b7350 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:26:44.474998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:44.475881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:44.485280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:44.488881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:44.494741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:44.495709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:44.496355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:44.497091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:45.083017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:45.091728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b305d0a6-36fc-47ec-a4b1-e54599cf7ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.622168 Oct 31 14:26:45.106439 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2317/4903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:44 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:46.121043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:46.121677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:46.133741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:46.134276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:46.134724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:46.135348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:46.135806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:46.136237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:46.835117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:26:46.838059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:46.848634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:46.857671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-610b84cb-1230-434f-b1a0-feead8062fe2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.741634 Oct 31 14:26:46.863353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2587/4904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:46 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:46.871323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:46.872131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:46.872847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:46.873863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:46.874583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:46.878545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:47.421787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-905d7c68-be8c-43b4-8478-aef6d849e0e3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591188 Oct 31 14:26:47.422911 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2318/4905] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:26:46 2022] POST /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:26:47.892436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:47.893152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:47.895980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:47.922112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:47.922844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:47.923287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:47.924043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:47.924509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:47.924940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:48.703796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:48.720980 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb95292d-cce0-4ddc-bdfe-99495eccb695 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.832907 Oct 31 14:26:48.736894 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2588/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:47 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:49.748078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:49.749561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:49.754262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:49.771277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:49.777257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:49.777848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:49.778751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:49.779329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:49.783730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:50.226021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:50.235605 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0612b30-1b0a-437e-952a-f70ec276e547 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.494752 Oct 31 14:26:50.240262 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2319/4907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:49 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:51.276137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:51.276783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:51.290838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:51.297111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:51.297896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:51.298877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:51.303142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:51.306312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:52.149890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:52.157936 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adbea7e7-221e-4807-b38d-aebcec5eefdd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.886196 Oct 31 14:26:52.170935 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2589/4908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:51 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:53.183002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:53.183671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:53.200925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:53.201425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:53.201872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:53.202645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:53.203100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:53.203730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:54.039312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:54.052323 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1c82d90-8e71-4653-b916-7753791fa0b8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1507 microversion: 2.1 time: 0.873153 Oct 31 14:26:54.066486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2320/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:53 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1507 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:55.079792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:55.080404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:55.092760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:55.095205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:55.095878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:55.097429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:55.103365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:55.104063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:56.043066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:56.051532 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67fd2e1a-407a-46e4-8e9e-cfaedf300c79 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1528 microversion: 2.1 time: 0.975888 Oct 31 14:26:56.061766 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2590/4910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:55 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1528 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:57.081086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:57.083694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:57.111627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:57.111956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:57.113004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:57.114067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:57.122760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:57.123834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:57.851866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:57.867981 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c4d5d52-38e7-49cb-b0e9-8ed3cc4cb05d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.791951 Oct 31 14:26:57.871885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2321/4911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:57 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:26:58.897405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:26:58.898712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:26:58.916255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:58.917075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:58.918251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:58.919332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:26:58.919964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:26:58.920568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:26:59.743740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:26:59.759118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-433d9da9-3e06-4852-ab03-17437798c803 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.866085 Oct 31 14:26:59.782702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2591/4912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:26:58 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:00.791583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:00.792201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:00.801335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:00.802650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:00.803276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:00.804372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:00.805151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:00.805765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:00.963867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-316674f0-5adc-47f2-8fb3-42ad15ae6b09 tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] Calling method '.version_select at 0x7fe106851820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:01.087078 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-316674f0-5adc-47f2-8fb3-42ad15ae6b09 tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.371325 Oct 31 14:27:01.087719 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2322/4913] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:27:00 2022] GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0/defaults => generated 371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:01.104905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45b6c694-64ee-4054-b97d-8605b7cbc649 tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] Calling method '.version_select at 0x7fe1068e3ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:01.318751 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45b6c694-64ee-4054-b97d-8605b7cbc649 tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0" status: 200 len: 371 microversion: 2.1 time: 0.222443 Oct 31 14:27:01.330395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2323/4914] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:27:01 2022] GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0 => generated 371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:01.335683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dab2b113-099e-4dab-84c5-49671e23136d tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] Calling method '.version_select at 0x7fe10693edc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:01.477175 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dab2b113-099e-4dab-84c5-49671e23136d tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.145294 Oct 31 14:27:01.477937 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2324/4915] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:27:01 2022] GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0/defaults => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:01.494308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ead067d-5fa9-4f9f-ae19-8fb797e46c8d tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] Calling method '.version_select at 0x7fe10693e310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:01.702224 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ead067d-5fa9-4f9f-ae19-8fb797e46c8d tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0" status: 200 len: 371 microversion: 2.1 time: 0.211859 Oct 31 14:27:01.702845 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2325/4916] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:27:01 2022] GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0 => generated 371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:27:01.718608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98029212-b29e-40ed-851e-322f47f4259d tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] Calling method '.version_select at 0x7fe106d12160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:01.918456 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98029212-b29e-40ed-851e-322f47f4259d tempest-QuotasTestJSON-506597470 tempest-QuotasTestJSON-506597470-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0?user_id=66b246406eaf47658eeccddeb3e9882b" status: 200 len: 371 microversion: 2.1 time: 0.200604 Oct 31 14:27:01.933503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2326/4917] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Oct 31 14:27:01 2022] GET /compute/v2.1/os-quota-sets/d5e8637373514750b83aeaee5393a7b0?user_id=66b246406eaf47658eeccddeb3e9882b => generated 371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:02.533473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:02.534682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:02.545969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:02.554857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:02.558704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:02.560057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:02.563102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:02.568446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:02.776115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:27:02.808434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:02.876684 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da5bafaa-2f66-4d99-ba27-a68e06c42aa8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 2.085254 Oct 31 14:27:02.882089 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2592/4918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:00 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 2096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:03.132369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-678dabf8-6c55-4bc3-8540-dc04ebf037e5 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 204 len: 0 microversion: 2.42 time: 1.144410 Oct 31 14:27:03.133713 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2327/4919] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:27:01 2022] DELETE /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:27:03.142916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:03.143793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:03.159254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:03.162487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:03.163247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:03.168714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:03.169615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:03.170332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:03.905845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:03.906909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:03.929196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:03.933904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:03.934840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:03.938825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:03.940363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:03.941000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:04.763088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:04.782670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:04.791449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:04.792814 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44d6745d-d24e-40bc-9220-261ec8c65f6a tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2958 microversion: 2.42 time: 1.654833 Oct 31 14:27:04.793398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2593/4920] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:03 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2958 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:04.814763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71da0acf-e82a-422c-8b59-cac583e6a390 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: .version_select at 0x7fe1066ea790>, body: {"keypair": {"name": "tempest-keypair-562422679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZcb7xzhZZWZEY+rkhhy6KM1faAALRmC/LhS0AS54bqUvXGwxkQ7x7h2Ggx5z8AcHFc71dXlO79DVtFDTYDfenowuCjYc+DCew4nDVuZ8/uOXTjEfLHkp22AVqd1G+ZTg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:04.876773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-71da0acf-e82a-422c-8b59-cac583e6a390 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:27:04.902495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-71da0acf-e82a-422c-8b59-cac583e6a390 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:27:05.031798 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71da0acf-e82a-422c-8b59-cac583e6a390 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.237277 Oct 31 14:27:05.040348 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2594/4921] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:27:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:05.667829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:05.686780 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3563dfc-e61a-4979-a282-de0ea824085c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 1.785510 Oct 31 14:27:05.692791 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2328/4922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:03 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:05.821962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:05.823000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:05.838407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:05.849112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:05.850210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:05.851601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:05.853911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:05.854851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:06.717175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:06.718558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:06.732639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:06.735787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:06.736505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:06.737488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:06.738305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:06.740305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:07.458621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:07.489089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:07.505683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:07.517095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:07.520731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78d18582-1923-4db6-a296-5146afa7be7c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2958 microversion: 2.42 time: 1.690722 Oct 31 14:27:07.521601 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2595/4923] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:05 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2958 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:07.526861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80d46627-c4f5-4844-9d0f-17ab57381cf1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.814369 Oct 31 14:27:07.531609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-18b30bc6-ec8a-4ecd-8c5c-54cfa7b44a6f req-5638dac6-b7b3-4886-a61c-f6254b235b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87a78d9-dd4f-45b5-81f3-04824792b608", "name": "network-vif-plugged", "status": "completed", "tag": "eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:07.538410 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2329/4924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:06 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:07.612379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18b30bc6-ec8a-4ecd-8c5c-54cfa7b44a6f req-5638dac6-b7b3-4886-a61c-f6254b235b50 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:07.612862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18b30bc6-ec8a-4ecd-8c5c-54cfa7b44a6f req-5638dac6-b7b3-4886-a61c-f6254b235b50 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:07.622719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18b30bc6-ec8a-4ecd-8c5c-54cfa7b44a6f req-5638dac6-b7b3-4886-a61c-f6254b235b50 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:07.678073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-18b30bc6-ec8a-4ecd-8c5c-54cfa7b44a6f req-5638dac6-b7b3-4886-a61c-f6254b235b50 service nova] Creating event network-vif-plugged:eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3 for instance e87a78d9-dd4f-45b5-81f3-04824792b608 on n-h1-863052-1 Oct 31 14:27:07.699795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-18b30bc6-ec8a-4ecd-8c5c-54cfa7b44a6f req-5638dac6-b7b3-4886-a61c-f6254b235b50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175539 Oct 31 14:27:07.705984 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2596/4925] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:08.552714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:08.558958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:08.559666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:08.560232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:08.588124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:08.588439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:08.589178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:08.590782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:08.591443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:08.597154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:08.598435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:08.599625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:08.601162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:08.602558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:08.603441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:08.605037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:09.102331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:09.114832 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db48cb30-ac86-4ab4-8e53-3850401da0ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.556653 Oct 31 14:27:09.119759 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2597/4926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:08 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:10.146255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:10.146994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:10.162862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:10.164357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:10.164929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:10.165763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:10.169446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:10.170036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:10.271408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:10.996197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:11.005848 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e15d1d87-f1ba-4b2c-92d5-94a5b5187cd8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.864094 Oct 31 14:27:11.010462 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2598/4927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:10 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:11.026489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f13541d1-2e14-407e-881f-6ddde8e40b22 req-7d7afcee-f7d8-4869-b473-c7ef3122b1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-unplugged", "status": "completed", "tag": "1349ac4d-b953-46a1-8f79-a2a70cbbaa4b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:11.075802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f13541d1-2e14-407e-881f-6ddde8e40b22 req-7d7afcee-f7d8-4869-b473-c7ef3122b1b4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:11.077333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f13541d1-2e14-407e-881f-6ddde8e40b22 req-7d7afcee-f7d8-4869-b473-c7ef3122b1b4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:11.081022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f13541d1-2e14-407e-881f-6ddde8e40b22 req-7d7afcee-f7d8-4869-b473-c7ef3122b1b4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:11.117741 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f13541d1-2e14-407e-881f-6ddde8e40b22 req-7d7afcee-f7d8-4869-b473-c7ef3122b1b4 service nova] Creating event network-vif-unplugged:1349ac4d-b953-46a1-8f79-a2a70cbbaa4b for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:11.127467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f13541d1-2e14-407e-881f-6ddde8e40b22 req-7d7afcee-f7d8-4869-b473-c7ef3122b1b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115429 Oct 31 14:27:11.128310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2599/4928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:11.386086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:11.403028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:11.416669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:11.419574 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da4de85f-dd16-4f5e-9dce-2322d6de3c75 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2958 microversion: 2.42 time: 2.871774 Oct 31 14:27:11.425301 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2330/4929] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:08 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2958 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:12.040716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:12.041603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:12.065634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:12.065634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:12.065634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:12.065634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:12.065634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:12.065634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:12.452830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:12.453443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:12.465950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:12.475007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:12.479336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:12.480246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:12.481970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:12.482477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:12.482913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:13.560489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:13.573649 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70f75751-ac40-4895-a076-ec7fecc503c3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 1.536794 Oct 31 14:27:13.573841 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2600/4930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:12 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:13.593711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ce9010e0-f943-4dd9-bba6-438591909bcc req-26239567-abd7-4f43-903a-9cae68396c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-unplugged", "status": "completed", "tag": "7de5dba0-411e-42b4-bc5d-96a1f3fa33f2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:13.633177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ce9010e0-f943-4dd9-bba6-438591909bcc req-26239567-abd7-4f43-903a-9cae68396c99 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:13.634844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ce9010e0-f943-4dd9-bba6-438591909bcc req-26239567-abd7-4f43-903a-9cae68396c99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:13.635634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ce9010e0-f943-4dd9-bba6-438591909bcc req-26239567-abd7-4f43-903a-9cae68396c99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:13.664383 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ce9010e0-f943-4dd9-bba6-438591909bcc req-26239567-abd7-4f43-903a-9cae68396c99 service nova] Creating event network-vif-unplugged:7de5dba0-411e-42b4-bc5d-96a1f3fa33f2 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:13.673013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ce9010e0-f943-4dd9-bba6-438591909bcc req-26239567-abd7-4f43-903a-9cae68396c99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090437 Oct 31 14:27:13.674283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2601/4931] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:14.603752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:14.605191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:14.621873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:14.626920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:14.627827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:14.628804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:14.629572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:14.632421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:14.878064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:14.880950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:14.901133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:14.905712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:14.909275 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31879262-bee1-455c-b32e-32a36a080588 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2937 microversion: 2.42 time: 2.461173 Oct 31 14:27:14.910893 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2331/4932] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:12 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2937 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:14.962023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:15.430107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:15.451106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11c934d5-2dd8-408d-9f0a-a117effd9b9f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.853265 Oct 31 14:27:15.469602 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2602/4933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:14 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:15.764640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bbc3776f-70c3-45e0-b216-0aa1740515fc req-2fd450ee-3940-4537-9167-c191a18d9a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-unplugged", "status": "completed", "tag": "acdd42f6-9226-4857-858c-c8144a9ddd1c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:15.804369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bbc3776f-70c3-45e0-b216-0aa1740515fc req-2fd450ee-3940-4537-9167-c191a18d9a15 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:15.807136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bbc3776f-70c3-45e0-b216-0aa1740515fc req-2fd450ee-3940-4537-9167-c191a18d9a15 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:15.807583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bbc3776f-70c3-45e0-b216-0aa1740515fc req-2fd450ee-3940-4537-9167-c191a18d9a15 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:15.854692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bbc3776f-70c3-45e0-b216-0aa1740515fc req-2fd450ee-3940-4537-9167-c191a18d9a15 service nova] Creating event network-vif-unplugged:acdd42f6-9226-4857-858c-c8144a9ddd1c for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:15.879645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bbc3776f-70c3-45e0-b216-0aa1740515fc req-2fd450ee-3940-4537-9167-c191a18d9a15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116369 Oct 31 14:27:15.882647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2332/4934] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:15.939698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:15.940586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:15.957066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:15.957625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:15.958081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:15.962102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:15.962777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:15.963402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:16.447184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:16.462985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:16.468257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:16.474566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a328b90a-6bcd-4d0d-90bb-0502adcb21dc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2916 microversion: 2.42 time: 0.539226 Oct 31 14:27:16.479369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:16.480360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:16.493733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:16.494650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:16.494926 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2603/4935] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:15 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2916 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:16.498509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:16.500724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:16.501434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:16.502343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:16.677508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-528188847", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed57bab-14ab-45b9-8b44-cc4a46a76802"}], "security_groups": [{"name": "tempest-securitygroup--747165759"}], "key_name": "tempest-keypair-562422679", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:16.927462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] validate_networks() for [('0ed57bab-14ab-45b9-8b44-cc4a46a76802', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:27:17.153052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:17.171263 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81e96e39-051d-4d54-b1a8-43d090e0d9b6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 0.695855 Oct 31 14:27:17.186212 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2333/4936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:16 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:17.510082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:17.510950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:17.533443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:17.533946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:17.534912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:17.536023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:17.538394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:17.539195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:18.106594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:18.120848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:18.124181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:18.139649 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c06f077-0149-4a29-985a-c8624362f4a2 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2870 microversion: 2.42 time: 0.633047 Oct 31 14:27:18.140009 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2334/4937] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:17 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2870 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:18.155145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-unplugged", "status": "completed", "tag": "fa944ae6-a9d5-4831-aba8-5a89c9ace075"}, {"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-unplugged", "status": "completed", "tag": "2a27dfa3-f22f-4c11-b335-53837a2326d0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:18.176568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:18.177051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:18.177484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:18.205767 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] Creating event network-vif-unplugged:fa944ae6-a9d5-4831-aba8-5a89c9ace075 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:18.206914 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] Creating event network-vif-unplugged:2a27dfa3-f22f-4c11-b335-53837a2326d0 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:18.233634 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-819e6d02-f699-42c1-bfd7-8f1942340ee4 req-b615b8d3-7902-45ca-8f62-37bebf848986 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.092299 Oct 31 14:27:18.234726 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2335/4938] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:18.243888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d935fff3-0bd3-400b-9fa5-5359b9c258ea req-2a1e0a1d-abb4-4847-a119-26924d6ce18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-deleted", "tag": "9758c520-9e3f-41c0-a5c4-f047d0ec16b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:18.272112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d935fff3-0bd3-400b-9fa5-5359b9c258ea req-2a1e0a1d-abb4-4847-a119-26924d6ce18a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:18.280575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d935fff3-0bd3-400b-9fa5-5359b9c258ea req-2a1e0a1d-abb4-4847-a119-26924d6ce18a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:18.281320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d935fff3-0bd3-400b-9fa5-5359b9c258ea req-2a1e0a1d-abb4-4847-a119-26924d6ce18a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:18.329638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d935fff3-0bd3-400b-9fa5-5359b9c258ea req-2a1e0a1d-abb4-4847-a119-26924d6ce18a service nova] Creating event network-vif-deleted:9758c520-9e3f-41c0-a5c4-f047d0ec16b5 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:18.356734 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d935fff3-0bd3-400b-9fa5-5359b9c258ea req-2a1e0a1d-abb4-4847-a119-26924d6ce18a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115351 Oct 31 14:27:18.357410 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2336/4939] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:18.381836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:18.387146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:18.412649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:18.413159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:18.413613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:18.414391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:18.414929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:18.415370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:19.355047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:19.377625 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34340d62-3616-47c1-b859-216ef61cae3a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 1.010715 Oct 31 14:27:19.378716 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2337/4940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:18 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:19.390962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:19.393563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:19.420420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:19.422301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:19.428386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:19.431143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:19.431763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:19.432496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:19.595454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:27:19.596199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:27:19.596666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:27:19.597777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:27:19.598217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:27:19.600188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:19.619402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:19.619889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:19.620321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:19.621044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:19.621511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:19.621924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:19.704424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:27:19.720361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:27:19.766257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:27:19.768603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:27:19.925646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7058107-92be-4bed-a6ec-506bea9f1c7a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.253139 Oct 31 14:27:19.935927 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2604/4941] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:27:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:27:19.941012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-237dbf6f-bd4d-44dd-9c0e-b7b75cc91fc1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:19.941641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-237dbf6f-bd4d-44dd-9c0e-b7b75cc91fc1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:20.045997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-237dbf6f-bd4d-44dd-9c0e-b7b75cc91fc1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:20.053892 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-237dbf6f-bd4d-44dd-9c0e-b7b75cc91fc1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1240 microversion: 2.1 time: 0.116749 Oct 31 14:27:20.055583 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2605/4942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:19 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:20.403799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:20.404685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:20.418240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:20.421405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:20.422357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:20.424843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:20.426079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:20.426759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:21.531774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:21.545489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:21.555891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:21.557545 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d840d350-5a83-4950-a049-35cb2e9def38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2756 microversion: 2.42 time: 2.170268 Oct 31 14:27:21.558253 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2338/4943] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:19 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2756 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:21.562905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-64781407-dd23-41e3-bdc5-888573a41fff req-dbb019b3-d4d9-4a17-81ae-459a36b494bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-deleted", "tag": "2a27dfa3-f22f-4c11-b335-53837a2326d0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:21.572609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:21.601769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64781407-dd23-41e3-bdc5-888573a41fff req-dbb019b3-d4d9-4a17-81ae-459a36b494bc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:21.612262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64781407-dd23-41e3-bdc5-888573a41fff req-dbb019b3-d4d9-4a17-81ae-459a36b494bc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:21.616466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-64781407-dd23-41e3-bdc5-888573a41fff req-dbb019b3-d4d9-4a17-81ae-459a36b494bc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:21.674605 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-64781407-dd23-41e3-bdc5-888573a41fff req-dbb019b3-d4d9-4a17-81ae-459a36b494bc service nova] Creating event network-vif-deleted:2a27dfa3-f22f-4c11-b335-53837a2326d0 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:21.699703 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-64781407-dd23-41e3-bdc5-888573a41fff req-dbb019b3-d4d9-4a17-81ae-459a36b494bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140019 Oct 31 14:27:21.705455 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2339/4944] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:21.712759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:21.725084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:21.756417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:21.757368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:21.763829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:21.764594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:21.765654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:21.766382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:21.767057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:21.777625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da1e8972-4a18-4be4-bf62-fef1e5325140 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 1.376011 Oct 31 14:27:21.783966 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2606/4945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:20 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:22.058413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:22.072516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b650794-6a6d-49c3-b690-708b0cdbb4c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1292 microversion: 2.1 time: 0.365484 Oct 31 14:27:22.098773 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2340/4946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:21 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1292 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:22.589173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:22.590054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:22.600980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:22.602785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:22.607346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:22.608298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:22.608931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:22.609545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:22.804671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:22.805356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:22.817364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:22.827361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:22.830362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:22.835027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:22.838977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:22.840826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:23.180231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:23.193271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:23.207920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:23.209249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e909d55-7a51-4f1d-a53a-fa1b2b775991 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2507 microversion: 2.42 time: 0.623986 Oct 31 14:27:23.226576 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2607/4947] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:22 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2507 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:23.231866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:23.234611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:23.258237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:23.258916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:23.259524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:23.260432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:23.261048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:23.261633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:23.502805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:23.514970 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d68c2fad-58c0-4032-b370-b2c14bc0bbff tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1298 microversion: 2.1 time: 0.287153 Oct 31 14:27:23.517220 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2608/4948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:23 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1298 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:23.806647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ef46130e-2921-4179-a453-05b40abfac31 req-fc26fb40-1eea-40aa-8f51-832f33078b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-deleted", "tag": "acdd42f6-9226-4857-858c-c8144a9ddd1c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:23.825628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:23.847721 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ac813b0-6de3-497e-87ff-cbab8abc6ec3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 1.043567 Oct 31 14:27:23.864997 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2341/4949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:22 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:23.882395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ef46130e-2921-4179-a453-05b40abfac31 req-fc26fb40-1eea-40aa-8f51-832f33078b05 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:23.882900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ef46130e-2921-4179-a453-05b40abfac31 req-fc26fb40-1eea-40aa-8f51-832f33078b05 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:23.883339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ef46130e-2921-4179-a453-05b40abfac31 req-fc26fb40-1eea-40aa-8f51-832f33078b05 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:23.949319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ef46130e-2921-4179-a453-05b40abfac31 req-fc26fb40-1eea-40aa-8f51-832f33078b05 service nova] Creating event network-vif-deleted:acdd42f6-9226-4857-858c-c8144a9ddd1c for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:23.999570 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ef46130e-2921-4179-a453-05b40abfac31 req-fc26fb40-1eea-40aa-8f51-832f33078b05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196481 Oct 31 14:27:24.008458 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2609/4950] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:27:24.245374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:24.246126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:24.265610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:24.266188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:24.266740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:24.267451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:24.267976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:24.268431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:24.546436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:24.547814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:24.571720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:24.579784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:24.582803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:24.595438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:24.598599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:24.601974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:24.848404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:24.864681 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a8c60d7-fb2e-4de5-badc-47d0b23bde1c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1298 microversion: 2.1 time: 0.320532 Oct 31 14:27:24.869601 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2610/4951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:24 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1298 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:24.888978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:24.889957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:24.916587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:24.918323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:24.918962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:24.923029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:24.924002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:24.924608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:26.996103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:27.033594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:27.045934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:27.049185 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2124a5d-5aa2-4d2c-ac2a-cdda8fe03d4f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2393 microversion: 2.42 time: 2.808229 Oct 31 14:27:27.051568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2342/4952] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:24 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2393 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:27.060871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:27.076454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:27.102461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:27.102958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:27.103424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:27.104138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:27.104586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:27.105012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:27.911322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:27.924017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-340a5d7c-d5ca-4876-becf-f87b37be368c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 3.037367 Oct 31 14:27:27.928212 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2611/4953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:24 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 3045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:28.015117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:28.019554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-52905bdc-83b1-40af-b568-7d8e2f3c1390 req-375282ca-9c1f-4113-a8d1-782eaebcb599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-deleted", "tag": "fa944ae6-a9d5-4831-aba8-5a89c9ace075"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:28.033541 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-776d2983-81b0-469a-bb1f-b0d54cdf7f2d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.975497 Oct 31 14:27:28.036495 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2343/4954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:27 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:28.056503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52905bdc-83b1-40af-b568-7d8e2f3c1390 req-375282ca-9c1f-4113-a8d1-782eaebcb599 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:28.057194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52905bdc-83b1-40af-b568-7d8e2f3c1390 req-375282ca-9c1f-4113-a8d1-782eaebcb599 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:28.057832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52905bdc-83b1-40af-b568-7d8e2f3c1390 req-375282ca-9c1f-4113-a8d1-782eaebcb599 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:28.078058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:28.079007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:28.083132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-52905bdc-83b1-40af-b568-7d8e2f3c1390 req-375282ca-9c1f-4113-a8d1-782eaebcb599 service nova] Creating event network-vif-deleted:fa944ae6-a9d5-4831-aba8-5a89c9ace075 for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:28.093504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:28.094422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:28.098075 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-52905bdc-83b1-40af-b568-7d8e2f3c1390 req-375282ca-9c1f-4113-a8d1-782eaebcb599 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081843 Oct 31 14:27:28.099091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:28.100805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:28.103687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:28.105729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:28.116886 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2612/4955] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:28.950126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:28.952254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:29.007063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:29.012711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:29.015408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:29.020640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:29.022056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:29.026393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:29.239091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:29.256516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:29.258463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:29.267588 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c040fbf5-f7e0-4c87-a352-cec1d5bdcda3 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2233 microversion: 2.42 time: 1.192247 Oct 31 14:27:29.268967 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2344/4956] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:28 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2233 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:29.280898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:29.281880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:29.328199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:29.328693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:29.333165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:29.335333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:29.343742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:29.347626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:29.656763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:30.054143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:30.194268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:30.202841 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcbb3a50-635d-4a51-b4da-24c166853d45 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1523 microversion: 2.1 time: 1.257578 Oct 31 14:27:30.203440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2613/4957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:28 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1523 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:30.314298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:30.314940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:30.352719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:30.355669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:30.356361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:30.357277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:30.358402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:30.361518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:30.751387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:30.763017 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a738282-ed0b-4d8d-beff-a94b28edc8b7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 1.491435 Oct 31 14:27:30.766471 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2345/4958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:29 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:31.079074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:31.106812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:31.109878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:31.114212 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67d7c2c5-763a-43ee-9571-881d88cfbc76 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 2166 microversion: 2.42 time: 0.804023 Oct 31 14:27:31.116350 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2614/4959] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:30 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 2166 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:31.228421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:31.229522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:31.251048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:31.254802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:31.259161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:31.259971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:31.265495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:31.274542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:31.792992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:31.794032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:31.818363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:31.819155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:31.819723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:31.820586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:31.821189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:31.826441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:32.240435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:32.262634 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ddefdf01-bb9e-45a4-be9b-751d6874e830 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1505 microversion: 2.1 time: 1.035930 Oct 31 14:27:32.263461 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2346/4960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:31 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1505 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:32.272910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:32.275531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:32.299063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:32.314041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:32.314745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:32.316207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:32.316923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:32.317463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:32.799990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:32.815955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:32.829930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:32.831314 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35b8f063-1e9e-4ef7-8088-f7daca4415e4 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.565198 Oct 31 14:27:32.858559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2347/4961] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:32 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:32.858559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d165160b-d78b-4706-8b94-bb329e992d97 req-b063178e-d7e7-476b-a3c7-e1d66f04e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9f4ea-5b8a-4cd4-817a-96c6704d1217", "name": "network-vif-deleted", "tag": "1349ac4d-b953-46a1-8f79-a2a70cbbaa4b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:32.906868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d165160b-d78b-4706-8b94-bb329e992d97 req-b063178e-d7e7-476b-a3c7-e1d66f04e8aa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:32.916624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d165160b-d78b-4706-8b94-bb329e992d97 req-b063178e-d7e7-476b-a3c7-e1d66f04e8aa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:32.922879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d165160b-d78b-4706-8b94-bb329e992d97 req-b063178e-d7e7-476b-a3c7-e1d66f04e8aa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:32.969717 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d165160b-d78b-4706-8b94-bb329e992d97 req-b063178e-d7e7-476b-a3c7-e1d66f04e8aa service nova] Creating event network-vif-deleted:1349ac4d-b953-46a1-8f79-a2a70cbbaa4b for instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 on n-h2-863052-1 Oct 31 14:27:32.998205 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d165160b-d78b-4706-8b94-bb329e992d97 req-b063178e-d7e7-476b-a3c7-e1d66f04e8aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153235 Oct 31 14:27:32.999139 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2348/4962] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:33.116750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:33.129287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-273d0d75-cf82-4474-b3aa-3d027347cff2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 1.340717 Oct 31 14:27:33.134050 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2615/4963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:31 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:33.294063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:33.295446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:33.312350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:33.318689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:33.326105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:33.327776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:33.328765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:33.334052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:33.874666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:33.875645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:33.887189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:33.889662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:33.891509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:33.893007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:33.895798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:33.897361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:34.777905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:34.800721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:34.802715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:34.806688 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eedd916d-d3e8-4f1d-a9a8-98d70c3e977d tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.935951 Oct 31 14:27:34.823044 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2616/4964] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:33 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:34.826776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8c6ab092-c03b-4b37-a043-8cc49940fccb req-bcfdba6e-f805-4f58-bd61-7853de8a8859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fe5f81-b02e-4727-8069-39ae420e2b54", "tag": "0c4ecb55-48df-425b-b6d5-d6d52f4e6619"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:34.857066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c6ab092-c03b-4b37-a043-8cc49940fccb req-bcfdba6e-f805-4f58-bd61-7853de8a8859 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:34.860609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c6ab092-c03b-4b37-a043-8cc49940fccb req-bcfdba6e-f805-4f58-bd61-7853de8a8859 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:34.861376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c6ab092-c03b-4b37-a043-8cc49940fccb req-bcfdba6e-f805-4f58-bd61-7853de8a8859 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:34.898903 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8c6ab092-c03b-4b37-a043-8cc49940fccb req-bcfdba6e-f805-4f58-bd61-7853de8a8859 service nova] Creating event network-changed:0c4ecb55-48df-425b-b6d5-d6d52f4e6619 for instance c8fe5f81-b02e-4727-8069-39ae420e2b54 on n-h1-863052-1 Oct 31 14:27:34.908670 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8c6ab092-c03b-4b37-a043-8cc49940fccb req-bcfdba6e-f805-4f58-bd61-7853de8a8859 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092518 Oct 31 14:27:34.911745 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2617/4965] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:34.922414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:34.927500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:34.956516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:34.958009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:34.962462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:34.963889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:34.965747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:34.968685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:35.076215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:35.092811 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78d76b64-0b26-4ba7-8c37-59014ee4770d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1505 microversion: 2.1 time: 1.807379 Oct 31 14:27:35.094931 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2349/4966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:33 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1505 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:35.580311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7c818452-4be8-4cc1-b31f-bd5a77848679 req-1d584997-f34e-4a1b-8cf3-48109207214b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87a78d9-dd4f-45b5-81f3-04824792b608", "name": "network-vif-unplugged", "status": "completed", "tag": "eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:35.602815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7c818452-4be8-4cc1-b31f-bd5a77848679 req-1d584997-f34e-4a1b-8cf3-48109207214b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:35.605868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7c818452-4be8-4cc1-b31f-bd5a77848679 req-1d584997-f34e-4a1b-8cf3-48109207214b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:35.610877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7c818452-4be8-4cc1-b31f-bd5a77848679 req-1d584997-f34e-4a1b-8cf3-48109207214b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:35.629279 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7c818452-4be8-4cc1-b31f-bd5a77848679 req-1d584997-f34e-4a1b-8cf3-48109207214b service nova] Creating event network-vif-unplugged:eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3 for instance e87a78d9-dd4f-45b5-81f3-04824792b608 on n-h1-863052-1 Oct 31 14:27:35.635331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7c818452-4be8-4cc1-b31f-bd5a77848679 req-1d584997-f34e-4a1b-8cf3-48109207214b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058825 Oct 31 14:27:35.636449 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2350/4967] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:27:35.843712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:35.844873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:35.858466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:35.862646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:35.863377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:35.864422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:35.865096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:35.868493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:35.991807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:36.017583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:36.019156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:36.020404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-676a0ed0-4292-4063-ab36-908eb490923b tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.183484 Oct 31 14:27:36.020983 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2351/4968] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:35 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:36.135050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:36.135673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:36.149585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:36.150078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:36.150551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:36.157430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:36.159665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:36.160011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:36.198651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:36.363142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:36.376226 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-119d2ef3-4eb5-47af-b992-9be684a83406 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 1.462688 Oct 31 14:27:36.376822 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2618/4969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:34 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:37.054290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:37.054919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:37.066505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:37.067002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:37.067500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:37.068155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:37.068606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:37.069030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:37.384742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:37.391373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:37.403265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:37.404779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:37.406010 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d717476-bcc5-46d2-8115-cc417b39eebc tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.355855 Oct 31 14:27:37.410441 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2619/4970] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:37 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:37.415537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:37.422999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:37.439041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:37.442355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:37.443361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:37.445651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:37.446897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:37.455782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:37.456239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:37.461042 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-920ca206-8c11-461c-b137-b2b4201112e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1505 microversion: 2.1 time: 1.330422 Oct 31 14:27:37.461929 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2352/4971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:36 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1505 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:38.431814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:38.440846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:38.441774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:38.445981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7e420cb-59b0-41d6-9829-302113befafd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 1.034107 Oct 31 14:27:38.446958 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2620/4972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:37 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:38.472563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:38.475676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:38.476344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:38.478296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:38.479147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:38.481938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:38.493214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:38.494393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:38.504566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:38.507613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:38.509332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:38.512411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:38.515957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:38.519734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:38.773555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:38.798818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:38.818456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:38.825061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bbf71bb1-e1f8-463f-bcd1-908891804b80 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.388956 Oct 31 14:27:38.825990 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2353/4973] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:38 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:39.325735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:39.340545 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d29138d-69dc-4f6d-884a-2da879f4488a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1505 microversion: 2.1 time: 0.853190 Oct 31 14:27:39.349085 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2621/4974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:38 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1505 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:39.474006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:39.474668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:39.486505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:39.487535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:39.493926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:39.494925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:39.500280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:39.500986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:39.840712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:39.856821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:39.857445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:39.858814 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7627b3b5-2393-4b5d-80ed-be71fed317b5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.389009 Oct 31 14:27:39.867694 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2354/4975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:39 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:39.877516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:39.881482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:39.882013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:39.882781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:39.883244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:39.884334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:40.245094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:40.311405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:40.320168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:40.324296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8c6a58e-d841-4f2f-888a-5bad1776442f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.471479 Oct 31 14:27:40.325716 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2622/4976] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:39 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:40.366844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:40.367577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:40.382640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:40.383134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:40.383803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:40.386858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:40.387525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:40.388034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:40.883783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:40.884549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:40.911514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:40.917498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:40.918155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:40.920107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:40.920630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:40.922602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:41.219272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:41.237568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a00f2f8a-6abc-42fd-a5f5-5a4338a801d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.358295 Oct 31 14:27:41.242147 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2623/4977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:40 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:41.355107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:41.356580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:41.367766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:41.370142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:41.370872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:41.373501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:41.374275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:41.376817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:41.578676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:41.610595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:41.613361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:41.618002 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c545aac6-6bdf-4e93-9b63-554bd2cce486 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.270060 Oct 31 14:27:41.619991 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2624/4978] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:41 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:41.715908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:41.735873 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e699621-b4cb-45fc-9d6c-ed68b7e2c1ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 200 len: 1448 microversion: 2.1 time: 1.374871 Oct 31 14:27:41.751162 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2355/4979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:40 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 1448 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:41.763887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:41.764634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:41.773722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:41.774480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:41.775131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:41.776704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:41.777383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:41.778573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:41.839204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:27:41.855720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Working on deleting snapshot 83abec4f-c2b2-4329-aef5-a52978785173 from shelved instance... Oct 31 14:27:42.267289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:42.268748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:42.292241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:42.292758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:42.293211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:42.293979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:42.294425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:42.294861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:43.099844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:43.108491 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b896d474-51f4-4f2c-890b-48aea2426e06 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.845848 Oct 31 14:27:43.115947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2356/4980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:42 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:43.138584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:43.139666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:43.146611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:43.147375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:43.148023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:43.148935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:43.149596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:43.150276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:43.378500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Doing local delete in cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) {{(pid=120640) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 31 14:27:43.379948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:43.381213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:43.381870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:43.382547 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 31 14:27:43.389071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] deallocate_for_instance() {{(pid=120640) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 31 14:27:43.875075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:43.889071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:43.899034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:43.904271 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1c6dac22-cf5f-46a7-9ffc-0abb5026730f tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.786435 Oct 31 14:27:43.906783 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2357/4981] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:43 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:44.269723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Updating instance_info_cache with network_info: [] {{(pid=120640) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 14:27:44.433356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:44.436247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:44.436738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:44.437187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:44.437926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:44.438411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:44.438839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:44.510032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d38743d-9d44-4804-8abc-999d1c83d5e5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.595909 Oct 31 14:27:44.514695 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2358/4982] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 31 14:27:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:44.522992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:44.525437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:44.537364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:44.539620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:44.541061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:44.541998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:44.546724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:44.547283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:44.871339 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b17eb58-1d1e-477a-b1b0-d3fcfbf032f3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 204 len: 0 microversion: 2.1 time: 3.112394 Oct 31 14:27:44.877871 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2625/4983] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:27:41 2022] DELETE /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 0 bytes in 3119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:27:44.884196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-37336629-67a1-4297-9416-a40821db1078 req-5e84f908-5467-4bba-b509-a8275f7ff4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87a78d9-dd4f-45b5-81f3-04824792b608", "name": "network-vif-deleted", "tag": "eeb0f27e-9ce5-422b-94b8-95e38e6a7ae3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:44.894381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37336629-67a1-4297-9416-a40821db1078 req-5e84f908-5467-4bba-b509-a8275f7ff4b8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:44.895023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37336629-67a1-4297-9416-a40821db1078 req-5e84f908-5467-4bba-b509-a8275f7ff4b8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:44.895715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37336629-67a1-4297-9416-a40821db1078 req-5e84f908-5467-4bba-b509-a8275f7ff4b8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:44.917080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-37336629-67a1-4297-9416-a40821db1078 req-5e84f908-5467-4bba-b509-a8275f7ff4b8 service nova] Unable to find a host for instance e87a78d9-dd4f-45b5-81f3-04824792b608. Dropping event network-vif-deleted {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 14:27:44.918430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-37336629-67a1-4297-9416-a40821db1078 req-5e84f908-5467-4bba-b509-a8275f7ff4b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039124 Oct 31 14:27:44.919273 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2626/4984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 14:27:44.924104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-315667934", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "availability_zone": "nova:n-h1-863052-1", "networks": [{"uuid": "71d219e0-61ef-4cb9-bc22-39fda04fc062"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:45.017174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] validate_networks() for [('71d219e0-61ef-4cb9-bc22-39fda04fc062', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:27:45.123895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:45.137221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35a6a22e-d8c8-4ef4-883f-7778dcfeb5cd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.620948 Oct 31 14:27:45.140042 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2359/4985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:44 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:45.151254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:45.156515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:45.179047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:45.179557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:45.180014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:45.180735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:45.183368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:45.185849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:45.214145 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 HTTP/1.1 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e87a78d9-dd4f-45b5-81f3-04824792b608'} Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:27:45.215860 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:27:45.220921 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aca24b1b-df6b-4761-b574-b6493f0ef967 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 404 len: 111 microversion: 2.1 time: 0.075634 Oct 31 14:27:45.234721 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2360/4986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:45 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:27:45.244376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:45.245016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:45.261131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:45.261637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:45.262093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:45.262845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:45.263308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:45.263967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:45.389420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:45.400992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:45.410661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:45.425118 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5e85f77c-303a-4857-83db-f8f480c6596e tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.180654 Oct 31 14:27:45.427972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2361/4987] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:45 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:45.463919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1310556387", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:45.591202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:27:46.613130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:27:46.616094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:27:46.616607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:27:46.617031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:27:46.617456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:27:46.662200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:46.662822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:46.663279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:46.664012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:46.664474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:46.664906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:46.742461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Getting quotas for project e9d4e87ba3fc468f84cd228ae3006076. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:27:46.748544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Getting quotas for user 0eaafbe9ed1846149b4d644f7cf2f1db and project e9d4e87ba3fc468f84cd228ae3006076. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:27:46.764393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:27:46.769176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:27:46.843775 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60e34d02-b2ba-48c0-9fca-604fe87f2608 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922828 Oct 31 14:27:46.844484 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2627/4988] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:27:46.854917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:46.856284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:46.865178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:46.866384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:46.867007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:46.867930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:46.868560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:46.869205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:46.923233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:27:46.925188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:27:46.925890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:27:46.926541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:27:46.927152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:27:46.952950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:46.953454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:46.953901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:46.960301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:46.960854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:46.961300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:47.048824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:27:47.064110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:27:47.094549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:27:47.106283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:27:47.250732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:47.266231 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bad6baaf-8def-4719-8df6-ac243c0758be tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.420241 Oct 31 14:27:47.286204 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2628/4989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:46 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:47.319812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:47.319812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:47.320813 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ffc7ab7c-a29b-42a9-bf08-5ad7e7489f96 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853384 Oct 31 14:27:47.320813 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2362/4990] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:27:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:27:47.321085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:47.321085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:47.321085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:47.321085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:47.321085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:47.321977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:47.331277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83129558-2d48-4a26-908f-ea655d664ff7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:47.331912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83129558-2d48-4a26-908f-ea655d664ff7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:47.467144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:47.478477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:47.479936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:47.486105 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49e0b654-29b7-453f-b19e-23386251bf38 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.214603 Oct 31 14:27:47.504369 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2629/4991] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:47 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:47.516780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f13f88ac-fc14-454e-ae31-18cb7ac0ba46 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:47.518486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f13f88ac-fc14-454e-ae31-18cb7ac0ba46 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:47.556865 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83129558-2d48-4a26-908f-ea655d664ff7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1328 microversion: 2.1 time: 0.241461 Oct 31 14:27:47.558033 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2363/4992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:47 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:47.573960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c2e3c80f-2626-4a02-b2ad-f5c3312d8790 req-13743a41-3d86-494b-8057-c396a4c34d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fe5f81-b02e-4727-8069-39ae420e2b54", "name": "network-vif-plugged", "status": "completed", "tag": "0c4ecb55-48df-425b-b6d5-d6d52f4e6619"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:47.623268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c2e3c80f-2626-4a02-b2ad-f5c3312d8790 req-13743a41-3d86-494b-8057-c396a4c34d3c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:47.625286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c2e3c80f-2626-4a02-b2ad-f5c3312d8790 req-13743a41-3d86-494b-8057-c396a4c34d3c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:47.626110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c2e3c80f-2626-4a02-b2ad-f5c3312d8790 req-13743a41-3d86-494b-8057-c396a4c34d3c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:47.656975 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c2e3c80f-2626-4a02-b2ad-f5c3312d8790 req-13743a41-3d86-494b-8057-c396a4c34d3c service nova] Creating event network-vif-plugged:0c4ecb55-48df-425b-b6d5-d6d52f4e6619 for instance c8fe5f81-b02e-4727-8069-39ae420e2b54 on n-h1-863052-1 Oct 31 14:27:47.668643 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c2e3c80f-2626-4a02-b2ad-f5c3312d8790 req-13743a41-3d86-494b-8057-c396a4c34d3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108641 Oct 31 14:27:47.670028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2364/4993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:47.715429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f13f88ac-fc14-454e-ae31-18cb7ac0ba46 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:47.723542 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f13f88ac-fc14-454e-ae31-18cb7ac0ba46 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1215 microversion: 2.1 time: 0.217999 Oct 31 14:27:47.724141 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2630/4994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:47 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:48.303572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:48.305282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:48.320439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.321537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.322152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.323754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.324983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.328878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.520751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:48.521854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:48.531616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.532496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.534610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.536361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.537828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.538633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.733028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:48.754756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:48.757055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:48.762635 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b893f635-d8e7-484a-a3a5-1dc4ceba5a54 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.246916 Oct 31 14:27:48.763553 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2631/4995] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:48 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:48.780227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:48.781053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:48.796535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.797141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.798887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.802403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.803332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.805757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.813163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:48.825784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7c90c11-d6fa-4757-9106-c5db4b386a31 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1365 microversion: 2.1 time: 0.528368 Oct 31 14:27:48.829589 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2365/4996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:48 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:48.848202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:48.851428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:48.873922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.876726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.878832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:48.881589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:48.886279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:48.887027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:48.889203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:49.099245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:49.113460 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e80b3a5d-d959-4398-b214-e4469987d15c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1267 microversion: 2.1 time: 0.278687 Oct 31 14:27:49.136452 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2366/4997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:48 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:49.280065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f60d16a-3733-4e8f-853e-1e4aceafcff2 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1337 microversion: 2.1 time: 0.513487 Oct 31 14:27:49.283209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2632/4998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:48 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1337 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:49.792913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:49.793436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:49.805109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:49.805708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:49.806054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:49.807076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:49.809546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:49.813704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:49.857537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:49.858934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:49.879900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:49.883834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:49.898708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:49.899257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:49.900319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:49.902282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:49.903001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.082508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:50.127296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:50.131317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:50.132578 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be151073-3ce4-465e-b86e-f789bd6d6aeb tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.344452 Oct 31 14:27:50.138850 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2367/4999] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:49 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:50.149934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:50.165467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:50.173976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:50.184120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:50.184931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.186445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:50.187929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:50.192457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.557272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:50.566310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:50.569846 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-39a10f8d-5f6a-498f-87db-7459e1ccf8d2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1273 microversion: 2.1 time: 0.429298 Oct 31 14:27:50.572556 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2368/5000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:50 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1273 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:50.582761 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da322c5b-f561-4861-bc83-1d32a1f82905 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1556 microversion: 2.1 time: 0.734597 Oct 31 14:27:50.589473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2633/5001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:49 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1556 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:50.589921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:50.591992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:50.603485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:50.604702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:50.605445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.606858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:50.607550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:50.608194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.608498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:50.609021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:50.631558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:50.632459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:50.633137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.634093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:50.634807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:50.638959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:50.795613 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c8cde20-0da8-4266-bc79-9f8ee356e841 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1421 microversion: 2.1 time: 0.217864 Oct 31 14:27:50.796213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2369/5002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:50 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1421 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:51.165273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:51.166046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:51.177726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:51.190345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:51.191120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:51.192154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:51.193599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:51.194972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:51.413724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:51.430471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:51.445483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:51.448399 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f052085-d3c1-4f11-82b6-8f674251acc6 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.288163 Oct 31 14:27:51.459559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2370/5003] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:51 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:51.594010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:51.594744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:51.610378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:51.612688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:51.613687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:51.618991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:51.625803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:51.629680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:51.657362 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5b496e6-58d2-437d-92c7-f184656c77a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.051972 Oct 31 14:27:51.659448 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2634/5004] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:27:50 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/os-interface => generated 285 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:51.820119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:51.820830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:51.829922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:51.831644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:51.832096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:51.838721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:51.841224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:51.841709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:51.917084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:51.930534 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd43e3d6-0845-425e-bb37-109ea63e69ca tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1273 microversion: 2.1 time: 0.335763 Oct 31 14:27:51.931791 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2371/5005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:51 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:27:52.241254 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21d659f9-4a87-4c92-95a2-2533122649b0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1421 microversion: 2.1 time: 0.424116 Oct 31 14:27:52.241254 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2635/5006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:51 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1421 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:52.488288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:52.488910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:52.492814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:52.507510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:52.508023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:52.510626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:52.517134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:52.518232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:52.518858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:52.932790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:52.935092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:52.956895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:52.959488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:52.960714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:52.962358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:52.963953 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bdb5d576-d2a1-455a-89aa-0cb4d8403bf0 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.480009 Oct 31 14:27:52.973852 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2372/5007] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:52 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:52.977006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:52.977364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:52.978072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:52.983456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:52.983963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:52.985924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:53.268850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:53.269577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:53.285734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:53.286575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:53.287160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:53.288040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:53.288661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:53.289260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:54.727299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:54.740208 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1f4c40d-1edd-4d06-a1e6-010076b4a5da tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 1.786478 Oct 31 14:27:54.746538 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2636/5008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:52 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:54.751697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:54.759611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:54.785036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:54.785561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:54.786015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:54.786794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:54.787259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:54.787696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:54.969225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:54.998334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:55.011861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:55.013119 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bbdbadac-6c49-4bc5-ae81-b4a643c9a4e9 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.265311 Oct 31 14:27:55.015481 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2637/5009] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:54 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:55.355703 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0041ece-efaf-408d-a357-a3c80cadcae5 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 2.091626 Oct 31 14:27:55.359025 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2373/5010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:53 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:55.769215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:55.770004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:55.783200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:55.784748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:55.786865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:55.787917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:55.790937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:55.792579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:56.048102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:56.050608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:56.074002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:56.074727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:56.075376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:56.076367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:56.076994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:56.077690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:56.331820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:56.349080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:56.353954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:56.357333 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9219590b-e62b-4814-8940-065a216fd6a1 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.315863 Oct 31 14:27:56.372338 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2374/5011] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:56 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:27:56.387508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:56.388127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:56.399105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:56.399601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:56.400230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:56.402476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:56.403580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:56.404187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:56.463778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:56.474969 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40938409-c0da-444d-a6e2-a33c260e0f66 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 0.711254 Oct 31 14:27:56.478420 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2638/5012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:55 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:56.765902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-171bed5d-77df-4bb5-8bb6-f127f87e701c req-f5d476ca-8d49-4133-8c24-ea3ea9e01123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fe5f81-b02e-4727-8069-39ae420e2b54", "tag": "0c4ecb55-48df-425b-b6d5-d6d52f4e6619"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:56.784895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:56.805265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-171bed5d-77df-4bb5-8bb6-f127f87e701c req-f5d476ca-8d49-4133-8c24-ea3ea9e01123 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:56.809516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-171bed5d-77df-4bb5-8bb6-f127f87e701c req-f5d476ca-8d49-4133-8c24-ea3ea9e01123 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:56.811828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-171bed5d-77df-4bb5-8bb6-f127f87e701c req-f5d476ca-8d49-4133-8c24-ea3ea9e01123 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:56.828941 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f79a6d13-0001-4aec-8ce2-aa92453bb065 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.444468 Oct 31 14:27:56.831829 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2375/5013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:56 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:56.857841 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-171bed5d-77df-4bb5-8bb6-f127f87e701c req-f5d476ca-8d49-4133-8c24-ea3ea9e01123 service nova] Creating event network-changed:0c4ecb55-48df-425b-b6d5-d6d52f4e6619 for instance c8fe5f81-b02e-4727-8069-39ae420e2b54 on n-h1-863052-1 Oct 31 14:27:56.874060 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-171bed5d-77df-4bb5-8bb6-f127f87e701c req-f5d476ca-8d49-4133-8c24-ea3ea9e01123 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111877 Oct 31 14:27:56.881690 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2639/5014] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:27:57.394050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:57.394923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:57.397070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:57.415697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.417584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.418032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:57.420978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.421459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.421892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:57.516774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:57.518689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:57.541855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.544218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.546587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:57.550462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.550696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:57.557079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.557860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:57.675103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:57.699375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:57.706908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2317857a46254953834ffdd2361dc586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dc32e543245bf86911af99cff6687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:57.708669 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68402cd8-bee8-46db-81c5-913b849d73ed tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 200 len: 1605 microversion: 2.42 time: 0.322312 Oct 31 14:27:57.724098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:57.726598 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2376/5015] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:57 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 1605 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:27:57.748656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f6e72ff7-f4ba-4a59-b8e3-13ed3a3fa7aa req-c444acf6-9bb8-4e94-9206-e25c4014a39a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44757522-00b6-4933-a586-d50f743122d6", "tag": "16ba3822-f271-493a-9330-8f6a2ad7b538"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:57.780153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f6e72ff7-f4ba-4a59-b8e3-13ed3a3fa7aa req-c444acf6-9bb8-4e94-9206-e25c4014a39a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.780638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f6e72ff7-f4ba-4a59-b8e3-13ed3a3fa7aa req-c444acf6-9bb8-4e94-9206-e25c4014a39a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.781065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f6e72ff7-f4ba-4a59-b8e3-13ed3a3fa7aa req-c444acf6-9bb8-4e94-9206-e25c4014a39a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:57.801343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f6e72ff7-f4ba-4a59-b8e3-13ed3a3fa7aa req-c444acf6-9bb8-4e94-9206-e25c4014a39a service nova] Creating event network-changed:16ba3822-f271-493a-9330-8f6a2ad7b538 for instance 44757522-00b6-4933-a586-d50f743122d6 on n-h2-863052-1 Oct 31 14:27:57.808065 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f6e72ff7-f4ba-4a59-b8e3-13ed3a3fa7aa req-c444acf6-9bb8-4e94-9206-e25c4014a39a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078370 Oct 31 14:27:57.809303 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2377/5016] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:57.863364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:57.865165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:57.885970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.886486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.886924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:57.887639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:57.888085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:57.888509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:58.237126 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c2dfe96-253d-490f-ba1f-1d9fc5368963 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.383168 Oct 31 14:27:58.238030 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2378/5017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:57 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:58.741784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:58.742595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:58.761501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:58.768548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:27:58.769636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:58.770350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:58.771928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:58.772653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:58.775665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:58.791440 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75e78d96-12f5-41f7-a63c-38589121307b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 1.293697 Oct 31 14:27:58.803508 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] HTTP exception thrown: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:27:58.803826 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2640/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:57 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Request method failure captured: Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 HTTP/1.1 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ncdvgKRjz3uT-Tulstq446ruLkJ6LHrfv4P3di28qudTpfBRzk6B0Vpvn1SV-iRM62nxF-b5JvUkCTG5Fi8Dji-9AHvX4Yg8ozTq-5ez3-Z5cTroxR9d6Gw-Lz4yYQOm_KU8PwroPehBwp-417mgrbJj1S0AuSVMTJ5gEK7lgq8fo Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 470dc32e543245bf86911af99cff6687 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_470dc32e543245bf86911af99cff6687", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/470dc32e543245bf86911af99cff6687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/470dc32e543245bf86911af99cff6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/470dc32e543245bf86911af99cff6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 470dc32e543245bf86911af99cff6687 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TaggedBootDevicesTest_v242-1775379335-project Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 2317857a46254953834ffdd2361dc586 Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1775379335-project Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd5f9f4ea-5b8a-4cd4-817a-96c6704d1217'} Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:58.807377 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:27:58.811856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:27:58.816413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Returning 404 to user: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:27:58.816413 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d007086-144e-43b9-ab16-17932dfc6618 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 404 len: 111 microversion: 2.42 time: 0.078252 Oct 31 14:27:58.817174 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2379/5019] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:27:58 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:27:58.826068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d49624d3-af0d-4831-85d6-5b44579adb2c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '.version_select at 0x7fe1077b5a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:58.848192 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d49624d3-af0d-4831-85d6-5b44579adb2c tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803251660" status: 204 len: 0 microversion: 2.42 time: 0.027226 Oct 31 14:27:58.852762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2641/5020] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 31 14:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803251660 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:27:58.900940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-dbfefa3b-b08e-44d2-92c4-b6ccf9148983 req-8387ee63-f366-4f2e-a435-7e40f63834b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2", "tag": "793d85c7-f0ca-4b2c-9614-4e84287ff41e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:27:58.911901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dbfefa3b-b08e-44d2-92c4-b6ccf9148983 req-8387ee63-f366-4f2e-a435-7e40f63834b4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:58.912673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dbfefa3b-b08e-44d2-92c4-b6ccf9148983 req-8387ee63-f366-4f2e-a435-7e40f63834b4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:58.913269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dbfefa3b-b08e-44d2-92c4-b6ccf9148983 req-8387ee63-f366-4f2e-a435-7e40f63834b4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:58.927361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-dbfefa3b-b08e-44d2-92c4-b6ccf9148983 req-8387ee63-f366-4f2e-a435-7e40f63834b4 service nova] Creating event network-changed:793d85c7-f0ca-4b2c-9614-4e84287ff41e for instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 on n-h1-863052-1 Oct 31 14:27:58.933731 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-dbfefa3b-b08e-44d2-92c4-b6ccf9148983 req-8387ee63-f366-4f2e-a435-7e40f63834b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036311 Oct 31 14:27:58.935143 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2380/5021] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:27:59.260769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:59.261385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:59.268401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:59.269307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:59.269970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:59.271018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:59.271578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:59.272097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:59.822780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:27:59.823220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:27:59.835557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:59.836044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:59.838808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:59.842368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:27:59.842981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:27:59.843433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:27:59.861700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d9344bb-f1bc-4117-9d10-94409b099b3d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.604053 Oct 31 14:27:59.874704 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2642/5022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:59 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:00.685219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:00.721434 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2caee4cc-1b86-4949-baac-fef0557124bd tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 0.903872 Oct 31 14:28:00.737335 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2381/5023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:27:59 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:00.895266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:00.895908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:00.910079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:00.910552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:00.910994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:00.919989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:00.920396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:00.920837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:01.336184 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2016085-6735-425c-b4cb-4fd5249d80a8 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.450611 Oct 31 14:28:01.351255 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2643/5024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:00 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:01.745701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:01.746523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:01.753333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:01.753818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:01.755096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:01.756181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:01.756946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:01.757385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:02.087002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:02.101372 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0333b22-6bca-4bd8-a6a8-8e21a9847dd2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 0.358253 Oct 31 14:28:02.103404 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2382/5025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:01 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:02.360497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:02.361376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:02.375698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:02.377038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:02.377713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:02.378860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:02.379689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:02.380509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:02.791305 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf64c314-b92b-4952-b2bb-f2fca944ea97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.434945 Oct 31 14:28:02.795163 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2644/5026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:02 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:03.134357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:03.135072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:03.149301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:03.150155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:03.150960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:03.152339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:03.153153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:03.154080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:03.533666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:03.545673 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a07a9c2-4412-4699-a792-e9655ef485ae tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 0.420034 Oct 31 14:28:03.547740 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2383/5027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:03 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:03.821375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:03.822092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:03.828806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:03.829615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:03.830328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:03.831115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:03.831743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:03.832037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:04.098276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed61ce59-b811-4c9a-b7c8-6381fa83c63d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.285080 Oct 31 14:28:04.100165 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2645/5028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:03 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:04.573434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:04.574142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:04.593167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:04.595009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:04.596625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:04.597383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:04.600451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:04.600940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:04.851279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:04.860274 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac6bb3c3-8862-4f6b-8e37-5b6527e59e17 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 0.292487 Oct 31 14:28:04.866912 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2384/5029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:04 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:05.123609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:05.124902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:05.131504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:05.132285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:05.132725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:05.133627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:05.134335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:05.134953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:05.413679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44757522-00b6-4933-a586-d50f743122d6", "name": "network-vif-plugged", "status": "completed", "tag": "16ba3822-f271-493a-9330-8f6a2ad7b538"}, {"server_uuid": "d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2", "name": "network-vif-plugged", "status": "completed", "tag": "793d85c7-f0ca-4b2c-9614-4e84287ff41e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:05.452310 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8070fac3-8d07-48fa-a882-e36c1e4133ae tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.333558 Oct 31 14:28:05.457539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:05.458339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:05.459769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:05.474606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2646/5030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:05 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:05.534385 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] Creating event network-vif-plugged:16ba3822-f271-493a-9330-8f6a2ad7b538 for instance 44757522-00b6-4933-a586-d50f743122d6 on n-h2-863052-1 Oct 31 14:28:05.534982 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] Creating event network-vif-plugged:793d85c7-f0ca-4b2c-9614-4e84287ff41e for instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 on n-h1-863052-1 Oct 31 14:28:05.621466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-32a55533-c885-4d99-8949-29ae018500b7 req-e301fad1-7f86-4ae7-ba41-242d1a6384b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.214028 Oct 31 14:28:05.628653 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2385/5031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:28:05.890879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:05.891562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:05.926462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:05.927008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:05.927465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:05.934293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:05.936101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:05.936914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:06.319039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:06.328984 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cdbf2b3-0ac1-4c6c-afe9-51e1be91f523 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1315 microversion: 2.1 time: 0.445534 Oct 31 14:28:06.342215 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2647/5032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:05 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:06.481975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:06.482632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:06.493994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:06.494551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:06.494991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:06.495726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:06.496146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:06.496641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:06.853986 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10d9aeae-5532-4998-a312-7df0a41370d7 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1463 microversion: 2.1 time: 0.376795 Oct 31 14:28:06.873603 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2386/5033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:06 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1463 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:07.081910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:07.082496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:07.094702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.095244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.095691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.096743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.097209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.097637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.123789 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] HTTP exception thrown: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Request method failure captured: Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 HTTP/1.1 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9ncdvgKRjz3uT-Tulstq446ruLkJ6LHrfv4P3di28qudTpfBRzk6B0Vpvn1SV-iRM62nxF-b5JvUkCTG5Fi8Dji-9AHvX4Yg8ozTq-5ez3-Z5cTroxR9d6Gw-Lz4yYQOm_KU8PwroPehBwp-417mgrbJj1S0AuSVMTJ5gEK7lgq8fo Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 470dc32e543245bf86911af99cff6687 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_470dc32e543245bf86911af99cff6687", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/470dc32e543245bf86911af99cff6687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/470dc32e543245bf86911af99cff6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/470dc32e543245bf86911af99cff6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 470dc32e543245bf86911af99cff6687 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TaggedBootDevicesTest_v242-1775379335-project Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 2317857a46254953834ffdd2361dc586 Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1775379335-project Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'd5f9f4ea-5b8a-4cd4-817a-96c6704d1217'} Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:07.125243 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Returning 404 to user: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:07.130603 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b588fd1-1b68-40ee-9237-b9526a0e4802 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 404 len: 111 microversion: 2.42 time: 0.052884 Oct 31 14:28:07.131507 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2648/5034] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:28:07 2022] DELETE /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:28:07.141234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:07.141234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] [instance: d5f9f4ea-5b8a-4cd4-817a-96c6704d1217] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:07.145562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.146055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.146816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.147591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.148937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.149438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.165039 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] HTTP exception thrown: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Request method failure captured: Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 HTTP/1.1 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9ncdvgKRjz3uT-Tulstq446ruLkJ6LHrfv4P3di28qudTpfBRzk6B0Vpvn1SV-iRM62nxF-b5JvUkCTG5Fi8Dji-9AHvX4Yg8ozTq-5ez3-Z5cTroxR9d6Gw-Lz4yYQOm_KU8PwroPehBwp-417mgrbJj1S0AuSVMTJ5gEK7lgq8fo Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 470dc32e543245bf86911af99cff6687 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_470dc32e543245bf86911af99cff6687", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/470dc32e543245bf86911af99cff6687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/470dc32e543245bf86911af99cff6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/470dc32e543245bf86911af99cff6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 470dc32e543245bf86911af99cff6687 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1775379335 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TaggedBootDevicesTest_v242-1775379335-project Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 2317857a46254953834ffdd2361dc586 Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1775379335-project Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd5f9f4ea-5b8a-4cd4-817a-96c6704d1217'} Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.167246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. Oct 31 14:28:07.171910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:07.174751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] Returning 404 to user: Instance d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:07.175882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-794ea25e-c243-4d82-95b7-d565b06f7e50 tempest-TaggedBootDevicesTest_v242-1775379335 tempest-TaggedBootDevicesTest_v242-1775379335-project] 10.222.0.27 "GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217" status: 404 len: 111 microversion: 2.42 time: 0.043757 Oct 31 14:28:07.177049 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2387/5035] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:28:07 2022] GET /compute/v2.1/servers/d5f9f4ea-5b8a-4cd4-817a-96c6704d1217 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:28:07.358620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:07.360570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:07.375390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.375903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.380227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.384585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.387524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.389296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.891018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:07.892997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:07.909128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:07.918718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.920749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.922880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.923714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.924077 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e57ca89c-c41e-42d4-99d2-ec0c6904b15a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1501 microversion: 2.1 time: 0.567997 Oct 31 14:28:07.930033 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2649/5036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:07 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1501 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:07.930515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.931024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:07.959901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d153253e-a649-4855-9dbc-47f86fd96880 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:07.979758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d153253e-a649-4855-9dbc-47f86fd96880 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:07.980267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d153253e-a649-4855-9dbc-47f86fd96880 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:07.983133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d153253e-a649-4855-9dbc-47f86fd96880 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:08.030962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d153253e-a649-4855-9dbc-47f86fd96880 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Going to try to stop instance {{(pid=120640) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:28:08.086535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:08.105128 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d153253e-a649-4855-9dbc-47f86fd96880 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6/action" status: 202 len: 0 microversion: 2.1 time: 0.156011 Oct 31 14:28:08.107445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2650/5037] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:28:07 2022] POST /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:28:08.122470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:08.125598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:08.140898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:08.142970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:08.143892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:08.145928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:08.147629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:08.148537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:08.264306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be17ea27-05b6-45e6-b363-672940140823 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1649 microversion: 2.1 time: 0.386386 Oct 31 14:28:08.266372 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2388/5038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:07 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1649 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:08.302934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:08.305285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:08.323917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:08.326698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:08.327805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:08.328228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:08.330684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:08.331155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:08.841745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-446ee5be-0ef4-4894-9f66-3ac12a2b4c08 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1649 microversion: 2.1 time: 0.551116 Oct 31 14:28:08.849004 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2389/5039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:08 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1649 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:08.874772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:08.875786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:08.883201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:08.884683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:08.885588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:08.887288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:08.887981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:08.888654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:09.010849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:09.020694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e27848bb-77e2-4f44-8fc3-e56f43108ebb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.909854 Oct 31 14:28:09.027920 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2651/5040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:08 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:09.193383 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d10d012-2f41-4ab3-b76b-6ff1763f7347 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1649 microversion: 2.1 time: 0.323779 Oct 31 14:28:09.193986 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2390/5041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:08 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1649 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:09.404319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1854271299", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "availability_zone": "nova:n-h2-863052-1", "networks": [{"uuid": "71d219e0-61ef-4cb9-bc22-39fda04fc062"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:09.511173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] validate_networks() for [('71d219e0-61ef-4cb9-bc22-39fda04fc062', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:28:10.053946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:10.055462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:10.074362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:10.076525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:10.077279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:10.079911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:10.080577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:10.082648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:10.346104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:10.360492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c862df8d-4dfa-4ffc-8d90-2dbd2f1d1e9b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.312994 Oct 31 14:28:10.375326 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2391/5042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:10 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:10.786546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:28:10.787726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:28:10.788427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:28:10.789079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:28:10.789841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:28:10.808889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:10.809869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:10.814767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:10.815874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:10.817614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:10.818302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:10.851650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Getting quotas for project e9d4e87ba3fc468f84cd228ae3006076. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:28:10.857817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Getting quotas for user 0eaafbe9ed1846149b4d644f7cf2f1db and project e9d4e87ba3fc468f84cd228ae3006076. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:28:10.872650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:28:10.875603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:28:10.955902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8415aa1d-2cbc-4a22-8df8-31e768c0f381 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555232 Oct 31 14:28:10.957198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2652/5043] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:28:10.971082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-55d78340-048f-41f7-b509-2bffff369b26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:10.971889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-55d78340-048f-41f7-b509-2bffff369b26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:11.158700 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-55d78340-048f-41f7-b509-2bffff369b26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1329 microversion: 2.1 time: 0.194297 Oct 31 14:28:11.160753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2392/5044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:10 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:11.399961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:11.400841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:11.417099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:11.419159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:11.422831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:11.423947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:11.424607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:11.425096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:12.189884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:12.190736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:12.217845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:12.219528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:12.221773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:12.224514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:12.225048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:12.225934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:12.502957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:12.513042 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5268f8c3-81e1-4bd4-938b-65bf973a5d51 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 1.119446 Oct 31 14:28:12.526831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2653/5045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:11 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:12.542596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:12.554751 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f6943f2-89f1-4cae-a5ca-b1380aa33f42 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1416 microversion: 2.1 time: 0.370260 Oct 31 14:28:12.555722 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2393/5046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:12 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1416 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:13.550349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:13.550987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:13.570773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:13.572826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:13.573783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:13.575055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:13.575531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:13.575965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:13.587726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:13.589106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:13.605710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:13.607187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:13.607650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:13.608376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:13.608840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:13.611575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:13.921406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:13.934550 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c45ca8f-506e-43cf-968f-290a23128d0e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.388911 Oct 31 14:28:13.936290 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2654/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:13 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:14.323397 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff4276f7-5f60-4bfd-ab24-5082911d3069 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1464 microversion: 2.1 time: 0.743422 Oct 31 14:28:14.329480 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2394/5048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:13 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1464 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:14.939875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-12dfe2db-9de8-41bd-88ee-29bfc9efcd93 req-2ec86a43-fd6c-4333-9718-c0469ae6f446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c55ae80b-44c1-478f-9e0b-e6a3101622a2", "tag": "674c3a79-8dcf-4521-8628-1eb09f678652"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:14.962354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:14.963185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:15.013081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:15.016375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:15.019814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:15.020598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:15.021309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12dfe2db-9de8-41bd-88ee-29bfc9efcd93 req-2ec86a43-fd6c-4333-9718-c0469ae6f446 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:15.021823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12dfe2db-9de8-41bd-88ee-29bfc9efcd93 req-2ec86a43-fd6c-4333-9718-c0469ae6f446 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:15.022284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-12dfe2db-9de8-41bd-88ee-29bfc9efcd93 req-2ec86a43-fd6c-4333-9718-c0469ae6f446 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:15.024466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:15.024959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:15.063261 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-12dfe2db-9de8-41bd-88ee-29bfc9efcd93 req-2ec86a43-fd6c-4333-9718-c0469ae6f446 service nova] Creating event network-changed:674c3a79-8dcf-4521-8628-1eb09f678652 for instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 on n-h2-863052-1 Oct 31 14:28:15.086491 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-12dfe2db-9de8-41bd-88ee-29bfc9efcd93 req-2ec86a43-fd6c-4333-9718-c0469ae6f446 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153332 Oct 31 14:28:15.090744 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2655/5049] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:28:15.353133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:15.355103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:15.365161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:15.366139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:15.367935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:15.369850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:15.370818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:15.371788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:15.542156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:15.554552 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0fae6463-5e9f-4ef1-bc0f-3e14670ff6f4 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.597132 Oct 31 14:28:15.557795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2395/5050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:14 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:15.764580 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ed67d31-d42d-4286-a05c-4b114d78d69f tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1464 microversion: 2.1 time: 0.415972 Oct 31 14:28:15.769658 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2656/5051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:15 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:16.584662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:16.585321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:16.595559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:16.602366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:16.603151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:16.604231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:16.604886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:16.605639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:16.792808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:16.794510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:16.806110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:16.812506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:16.813169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:16.814903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:16.815541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:16.816174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:17.056756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:17.116822 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ff278db-067a-4fd5-9d9e-1cadf20f4822 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.534786 Oct 31 14:28:17.117596 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2396/5052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:16 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:17.525261 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61764b8e-b072-4c05-8803-5a99be3ebc64 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1464 microversion: 2.1 time: 0.735450 Oct 31 14:28:17.528481 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2657/5053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:16 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1464 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:18.145009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:18.145618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:18.162632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:18.164504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:18.165197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:18.178538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:18.180916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:18.183323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:18.551383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:18.552861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:18.569645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:18.574910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:18.578139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:18.582360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:18.585030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:18.585771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:19.086928 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d237b975-2953-4822-90d6-46f2ecdc0a97 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1464 microversion: 2.1 time: 0.529328 Oct 31 14:28:19.088526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2658/5054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:18 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1464 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:19.728796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:19.753039 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b09c2c0a-3247-4cae-83f3-865b3b7a6d58 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 1.605972 Oct 31 14:28:19.766303 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2397/5055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:18 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:20.115232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:20.116713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:20.125333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:20.129581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:20.130898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:20.133862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:20.134927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:20.135670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:20.136575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:20.660636 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ff552f0-09b0-4220-84b8-3230ada83bcc tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1464 microversion: 2.1 time: 0.550865 Oct 31 14:28:20.667633 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2659/5056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:20 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1464 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:20.781196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:20.783410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:20.804253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:20.807286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:20.807757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:20.808491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:20.808956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:20.809379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:20.940192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:20.942156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:20.952569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5cb50cf5-3d4a-4138-80be-80171ba715fb req-1292de3f-9711-484e-b74c-1a2e98870f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55ae80b-44c1-478f-9e0b-e6a3101622a2", "name": "network-vif-plugged", "status": "completed", "tag": "674c3a79-8dcf-4521-8628-1eb09f678652"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:20.986911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5cb50cf5-3d4a-4138-80be-80171ba715fb req-1292de3f-9711-484e-b74c-1a2e98870f37 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:20.992130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5cb50cf5-3d4a-4138-80be-80171ba715fb req-1292de3f-9711-484e-b74c-1a2e98870f37 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:20.992727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5cb50cf5-3d4a-4138-80be-80171ba715fb req-1292de3f-9711-484e-b74c-1a2e98870f37 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:21.018885 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5cb50cf5-3d4a-4138-80be-80171ba715fb req-1292de3f-9711-484e-b74c-1a2e98870f37 service nova] Creating event network-vif-plugged:674c3a79-8dcf-4521-8628-1eb09f678652 for instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 on n-h2-863052-1 Oct 31 14:28:21.025032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5cb50cf5-3d4a-4138-80be-80171ba715fb req-1292de3f-9711-484e-b74c-1a2e98870f37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086393 Oct 31 14:28:21.026211 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2660/5057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:21.153881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:21.214721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:21.242471 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70fb4706-8ddd-48bf-a736-0a67d3f2b0fb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.468076 Oct 31 14:28:21.258928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2398/5058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:20 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:21.686374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:21.687119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:21.701397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:21.704590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:21.705319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:21.705900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:21.707955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:21.708417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:22.122996 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92b4553d-d0a9-4344-89e0-d936edd1c634 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1464 microversion: 2.1 time: 0.438684 Oct 31 14:28:22.124469 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2661/5059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:21 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1464 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:22.271966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:22.272579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:22.288477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:22.290917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:22.294961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:22.297226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:22.298693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:22.299139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:22.743797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:22.764672 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d47cd7e-ad95-472f-b67a-0c329ce2c5a6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.496167 Oct 31 14:28:22.768320 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2399/5060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:22 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:22.838727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:22.839302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:22.855013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:22.856297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:22.858319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:22.863263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:22.865030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:22.866607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:22.946527 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1ede71b-def9-4283-a3c0-2d8964d95f32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/ips" status: 200 len: 150 microversion: 2.1 time: 0.111943 Oct 31 14:28:22.948906 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2662/5061] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:28:22 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/ips => generated 150 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:22.962946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:22.966454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:22.973345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=58 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:22.975435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:22.976685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:22.977529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:22.978977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:22.979885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:22.982190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.118666 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Invalid volume: volume 2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 is already attached to instances: 7b9f19e0-c98f-48c1-896b-e02c143e1365 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/os-volume_attachments HTTP/1.1 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 74 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: {"volumeAttachment": {"volumeId": "2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9"}} Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid volume: volume 2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 is already attached to instances: 7b9f19e0-c98f-48c1-896b-e02c143e1365 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': 'c8fe5f81-b02e-4727-8069-39ae420e2b54', 'body': {'volumeAttachment': {'volumeId': '2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9'}}} Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 is already attached to instances: 7b9f19e0-c98f-48c1-896b-e02c143e1365 Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:28:23.121738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 is already attached to instances: 7b9f19e0-c98f-48c1-896b-e02c143e1365 Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 is already attached to instances: 7b9f19e0-c98f-48c1-896b-e02c143e1365 Oct 31 14:28:23.128848 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:23.132846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 400 to user: Invalid volume: volume 2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 is already attached to instances: 7b9f19e0-c98f-48c1-896b-e02c143e1365 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:23.133949 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2955994-5011-4477-a25a-09d01d268d65 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.176529 Oct 31 14:28:23.147791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:23.148688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:23.153922 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2400/5062] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:28:22 2022] POST /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54/os-volume_attachments => generated 174 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:28:23.165751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.166680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.167646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:23.167972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.168840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:23.169771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.170764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.171849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.203090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.207200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.210456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.211914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.214472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.217508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.285989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:28:23.414607 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5074bd91-49c6-4bd3-83a6-697ce9de18df tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 204 len: 0 microversion: 2.1 time: 0.274712 Oct 31 14:28:23.419403 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2663/5063] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:28:23 2022] DELETE /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:28:23.427408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:23.428330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:23.451307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.454312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.456349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.458794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.459687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.460622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.872409 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac04b785-abbb-41d2-bd40-40915359a1c4 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1650 microversion: 2.1 time: 0.716892 Oct 31 14:28:23.876639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2401/5064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:23 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1650 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:23.913784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:23.914521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:23.927805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.928317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.928756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:23.929479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:23.929943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:23.930403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:24.211061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:24.220348 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e3bf534-0007-424f-96d5-8905139dcc80 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.322155 Oct 31 14:28:24.221159 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2402/5065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:23 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:24.227351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:24.228351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:24.236032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:24.236881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:24.237802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:24.238820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:24.239357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:24.239787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:24.312292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:24.321102 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7177cf8-483b-4705-9038-80a057592d9d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1680 microversion: 2.1 time: 0.900234 Oct 31 14:28:24.322962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2664/5066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:23 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1680 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:24.444671 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbd7e13e-e8d5-444f-a2b6-b12763b4aa26 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1650 microversion: 2.1 time: 0.222005 Oct 31 14:28:24.446731 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2403/5067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:24 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1650 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:24.469297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:24.469950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:24.492471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:24.493015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:24.493469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:24.497650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:24.498159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:24.498863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:24.896150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb722c04-7574-469b-a3fa-0e62fba37e5c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1650 microversion: 2.1 time: 0.430914 Oct 31 14:28:24.896963 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2665/5068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:24 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1650 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:24.932624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:24.935064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:24.947164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:24.947979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:24.949865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:24.950918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:24.951623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:24.952493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:25.012743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:28:25.143441 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4868f381-ec5c-4963-a8d5-c5e1c3fea91c tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 204 len: 0 microversion: 2.1 time: 0.225741 Oct 31 14:28:25.154039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:25.154710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:25.162470 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2404/5069] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:28:24 2022] DELETE /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:28:25.164053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:25.164567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:25.165015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:25.165737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:25.166224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:25.166665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:25.246046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:25.247120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:25.263482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:25.264148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:25.264729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:25.265554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:25.266127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:25.266718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:25.758839 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c582515-7cf1-4a11-9d5f-cfa2fa304543 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1656 microversion: 2.1 time: 0.608326 Oct 31 14:28:25.781918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2666/5070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:25 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1656 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:25.791734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:25.792642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:25.800827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:25.801412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:25.801862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:25.802619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:25.803596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:25.804044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:26.087579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:26.096298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:26.106807 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7234731a-62ba-48be-97a3-bc30c6f8d48b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.865183 Oct 31 14:28:26.119108 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0635d35-7532-45e9-be95-be0939f1de1a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1613 microversion: 2.1 time: 0.323358 Oct 31 14:28:26.119674 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2667/5071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:25 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1613 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:26.130897 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2405/5072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:25 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:26.643894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-df7430ef-2d61-4eee-93eb-6df2c15ef6b2 req-c626e296-aa54-4bc0-afb9-611cd274fed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fe5f81-b02e-4727-8069-39ae420e2b54", "name": "network-vif-deleted", "tag": "0c4ecb55-48df-425b-b6d5-d6d52f4e6619"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:26.674039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-df7430ef-2d61-4eee-93eb-6df2c15ef6b2 req-c626e296-aa54-4bc0-afb9-611cd274fed9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:26.676240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-df7430ef-2d61-4eee-93eb-6df2c15ef6b2 req-c626e296-aa54-4bc0-afb9-611cd274fed9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:26.679256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-df7430ef-2d61-4eee-93eb-6df2c15ef6b2 req-c626e296-aa54-4bc0-afb9-611cd274fed9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:26.710258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:26.757301 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-df7430ef-2d61-4eee-93eb-6df2c15ef6b2 req-c626e296-aa54-4bc0-afb9-611cd274fed9 service nova] Creating event network-vif-deleted:0c4ecb55-48df-425b-b6d5-d6d52f4e6619 for instance c8fe5f81-b02e-4727-8069-39ae420e2b54 on n-h1-863052-1 Oct 31 14:28:26.771496 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-df7430ef-2d61-4eee-93eb-6df2c15ef6b2 req-c626e296-aa54-4bc0-afb9-611cd274fed9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130601 Oct 31 14:28:26.773483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2668/5073] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:26.794089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:26.794773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:26.818220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:26.818760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:26.822595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:26.829868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:26.832770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:26.835897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:27.150264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:27.151336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:27.178843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:27.180622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:27.181755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:27.183689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:27.184507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:27.189797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:27.504563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6a487cf-c12d-40b2-ba76-c5d85cafeef0 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1656 microversion: 2.1 time: 0.714984 Oct 31 14:28:27.506986 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2406/5074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:26 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1656 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:27.520672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:27.521589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:27.552269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:27.558123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:27.558999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:27.562598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:27.564566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:27.568589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:27.692311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:27.693255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:27.693921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:27.694659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lazy-loading 'fault' on Instance uuid c8fe5f81-b02e-4727-8069-39ae420e2b54 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:28:27.749076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:27.763715 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-edad6c65-cf81-4d17-a30f-d54c312cb7e0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.620159 Oct 31 14:28:27.764869 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2669/5075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:27 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:28.180487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:28.193192 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27c89f67-a5d0-47a7-812d-e5d35b1ed697 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 200 len: 1330 microversion: 2.1 time: 0.683139 Oct 31 14:28:28.197598 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2407/5076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:27 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 1330 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:28.536543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:28.537983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:28.550752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:28.554941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:28.555804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:28.556671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:28.559141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:28.561892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:28.774434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-82eed549-2854-4003-a13d-a66bc67f6ebb req-116e7afa-f467-4e79-88da-384317b842fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55ae80b-44c1-478f-9e0b-e6a3101622a2", "name": "network-vif-deleted", "tag": "674c3a79-8dcf-4521-8628-1eb09f678652"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:28.790417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-82eed549-2854-4003-a13d-a66bc67f6ebb req-116e7afa-f467-4e79-88da-384317b842fb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:28.793892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-82eed549-2854-4003-a13d-a66bc67f6ebb req-116e7afa-f467-4e79-88da-384317b842fb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:28.794841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-82eed549-2854-4003-a13d-a66bc67f6ebb req-116e7afa-f467-4e79-88da-384317b842fb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:28.823258 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-82eed549-2854-4003-a13d-a66bc67f6ebb req-116e7afa-f467-4e79-88da-384317b842fb service nova] Creating event network-vif-deleted:674c3a79-8dcf-4521-8628-1eb09f678652 for instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 on n-h2-863052-1 Oct 31 14:28:28.824673 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efd9ea33-9d27-4a68-8df7-a71f54d10e93 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 200 len: 1614 microversion: 2.1 time: 0.292610 Oct 31 14:28:28.825273 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2670/5077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:28 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 1614 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:28.841212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-82eed549-2854-4003-a13d-a66bc67f6ebb req-116e7afa-f467-4e79-88da-384317b842fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070349 Oct 31 14:28:28.843200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:28.844009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:28.844359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2408/5078] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:28.856257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:28.857021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:28.857625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:28.858534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:28.859283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:28.860440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:29.228119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:29.229046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:29.264603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:29.265114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:29.265561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:29.266342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:29.266800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:29.267224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:29.288702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:29.297915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:29.299568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9db00668-3b65-4cb6-b8d6-69d5beced6e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.473221 Oct 31 14:28:29.319602 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2671/5079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:28 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:29.344592 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 HTTP/1.1 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c8fe5f81-b02e-4727-8069-39ae420e2b54'} Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:29.354331 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:28:29.359899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.370760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:29.371698 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-969b05b4-3570-4f71-aa99-529ee6839e38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 404 len: 111 microversion: 2.1 time: 0.150413 Oct 31 14:28:29.372269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2409/5080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:29 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:29.390061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1d7ab15-6bfa-4978-8792-ab88650da8c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '.version_select at 0x7fe1064ce3a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:29.436103 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1d7ab15-6bfa-4978-8792-ab88650da8c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562422679" status: 202 len: 0 microversion: 2.1 time: 0.054443 Oct 31 14:28:29.443156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2672/5081] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562422679 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:28:29.852739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:29.853647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: c55ae80b-44c1-478f-9e0b-e6a3101622a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:29.868574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:29.870054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:29.871700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:29.876375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:29.877029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:29.877704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:29.901355 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] HTTP exception thrown: Instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 could not be found. Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Request method failure captured: Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 HTTP/1.1 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9teBs1GG0Wh2F7OR0V8_VaVxAoBr1mEtjxs5ud6sJQMkqlKQCAHhQv4zg2EI-L9cTmvfEMa1uBHvrScQPICuO3W3DbgR5w5WRLPSVt1kSvnqvD60r6uxnnYYrLFOfdIU5e-aQ-WfZ55Kwne_WWVoSZfIizK83gib1aJanYBFhetE7c Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: e9d4e87ba3fc468f84cd228ae3006076 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestServerMultinode-733672087 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9d4e87ba3fc468f84cd228ae3006076", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9d4e87ba3fc468f84cd228ae3006076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9d4e87ba3fc468f84cd228ae3006076"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9d4e87ba3fc468f84cd228ae3006076"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestServerMultinode-733672087 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: e9d4e87ba3fc468f84cd228ae3006076 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestServerMultinode-733672087 Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestServerMultinode-733672087-project-admin Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 0eaafbe9ed1846149b4d644f7cf2f1db Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestServerMultinode-733672087-project-admin Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 could not be found. Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c55ae80b-44c1-478f-9e0b-e6a3101622a2'} Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 could not be found. Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 could not be found. Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:29.903439 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 could not be found. Oct 31 14:28:29.910023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:29.914015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Returning 404 to user: Instance c55ae80b-44c1-478f-9e0b-e6a3101622a2 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:29.915436 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d61c837c-d28d-4d23-8648-f3e2774ac685 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2" status: 404 len: 111 microversion: 2.1 time: 0.067509 Oct 31 14:28:29.916578 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2410/5082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:29 2022] GET /compute/v2.1/servers/c55ae80b-44c1-478f-9e0b-e6a3101622a2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:29.926567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:29.927753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:29.944613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:29.946780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:29.947398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:29.949409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:29.950185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:29.951790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:30.004272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:28:30.214781 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be485958-fe7a-4389-9ee8-af2c062b314d tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 204 len: 0 microversion: 2.1 time: 0.292452 Oct 31 14:28:30.218264 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2673/5083] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:28:29 2022] DELETE /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:28:30.232463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:30.237058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:30.252591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:30.254788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:30.255419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:30.258036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:30.261024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:30.261595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:30.326658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:30.328278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:30.343014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:30.344268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:30.344879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:30.345764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:30.346422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:30.347014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:30.602099 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec24aa3a-cdeb-40b4-90e2-396367beb2fb tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1655 microversion: 2.1 time: 0.373539 Oct 31 14:28:30.603779 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2411/5084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:30 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1655 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:31.375193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:31.385419 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d4bfde8-4567-49a5-af65-462538fe7f53 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 1.062918 Oct 31 14:28:31.407429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2674/5085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:30 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:31.627456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:31.628721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:31.646559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:31.647359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:31.647988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:31.649787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:31.652928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:31.653590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:31.755704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:31.758295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:31.771137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:31.783288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:31.783844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:31.784610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:31.785078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:31.785507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:32.043649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lazy-loading 'services' on Instance uuid 7b9f19e0-c98f-48c1-896b-e02c143e1365 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:28:32.215787 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc1768a3-1fd2-46e0-b725-7032ce1d3d6e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments/2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9" status: 202 len: 0 microversion: 2.1 time: 0.469447 Oct 31 14:28:32.249332 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2675/5086] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:28:31 2022] DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments/2a33cfdb-c454-4fa2-a7f3-b4684cb5bef9 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:28:32.250668 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea929ac6-83f8-4500-871e-c7e9835b1c22 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1655 microversion: 2.1 time: 0.627892 Oct 31 14:28:32.258212 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2412/5087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:31 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1655 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:32.289403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:32.301204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:32.321116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:32.323562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:32.325185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:32.327913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:32.331807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:32.332133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:32.398716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b80520ef-eadb-4ba6-924a-5d93ee0ddfe3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142516 Oct 31 14:28:32.405401 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2676/5088] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:32 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:32.417986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:32.418991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:32.432135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:32.433250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:32.434580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:32.437673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:32.438928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:32.439550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:32.842320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:32.895834 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f82a2a23-c021-4076-9af4-752e0755d794 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1511 microversion: 2.1 time: 0.482044 Oct 31 14:28:32.897233 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2413/5089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:32 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:33.204737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7f3b223c-f690-4500-91ab-8d11c0c51892 req-460c5adc-becd-4ab2-8593-03ff3652a171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2", "name": "network-vif-deleted", "tag": "793d85c7-f0ca-4b2c-9614-4e84287ff41e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:33.222747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7f3b223c-f690-4500-91ab-8d11c0c51892 req-460c5adc-becd-4ab2-8593-03ff3652a171 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.223654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7f3b223c-f690-4500-91ab-8d11c0c51892 req-460c5adc-becd-4ab2-8593-03ff3652a171 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.224314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7f3b223c-f690-4500-91ab-8d11c0c51892 req-460c5adc-becd-4ab2-8593-03ff3652a171 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:33.252601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7f3b223c-f690-4500-91ab-8d11c0c51892 req-460c5adc-becd-4ab2-8593-03ff3652a171 service nova] Creating event network-vif-deleted:793d85c7-f0ca-4b2c-9614-4e84287ff41e for instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 on n-h1-863052-1 Oct 31 14:28:33.262930 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7f3b223c-f690-4500-91ab-8d11c0c51892 req-460c5adc-becd-4ab2-8593-03ff3652a171 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062729 Oct 31 14:28:33.268364 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2677/5090] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:33.280770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:33.281392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:33.299731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.300341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.307975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:33.308839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.311709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.314586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:33.411275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:33.413568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:33.427483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.430814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.431580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:33.433019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.434742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.435546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:33.514720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01d413ca-fd84-40aa-8835-b64c23ea5c81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107954 Oct 31 14:28:33.516835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2678/5091] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:33 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:33.622188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-920dbf3e-aabc-4b9b-9b68-2a13e07bd473 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 200 len: 1448 microversion: 2.1 time: 0.322842 Oct 31 14:28:33.623113 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2414/5092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:33 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 1448 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:33.926401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:33.927591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:33.949397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.949963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.952430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:33.955594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:33.956124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:33.956568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.503891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:34.518260 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7acf8ceb-ffdd-4c3a-99c7-98cd3b64aeff tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1488 microversion: 2.1 time: 0.598045 Oct 31 14:28:34.519204 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2679/5093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:33 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1488 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:34.535870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:34.539044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:34.555197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:34.556216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:34.560336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.565821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.566594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.569115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.570328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.572495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.576084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.582091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.583930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.585790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.586441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.588178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.684746 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-51b4dd68-5739-4dd0-a61c-8c6a26c9beb2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160230 Oct 31 14:28:34.685325 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2415/5094] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:34 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:34.695724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:28:34.700763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:34.706493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] [instance: d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:34.741343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.743782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.751096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.752375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.753325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.756762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.788275 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] HTTP exception thrown: Instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 could not be found. Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Request method failure captured: Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 HTTP/1.1 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9teBs1GG0Wh2F7OR0V8_VaVxAoBr1mEtjxs5ud6sJQMkqlKQCAHhQv4zg2EI-L9cTmvfEMa1uBHvrScQPICuO3W3DbgR5w5WRLPSVt1kSvnqvD60r6uxnnYYrLFOfdIU5e-aQ-WfZ55Kwne_WWVoSZfIizK83gib1aJanYBFhetE7c Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: e9d4e87ba3fc468f84cd228ae3006076 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestServerMultinode-733672087 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9d4e87ba3fc468f84cd228ae3006076", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9d4e87ba3fc468f84cd228ae3006076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9d4e87ba3fc468f84cd228ae3006076"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9d4e87ba3fc468f84cd228ae3006076"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestServerMultinode-733672087 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: e9d4e87ba3fc468f84cd228ae3006076 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestServerMultinode-733672087 Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestServerMultinode-733672087-project-admin Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 0eaafbe9ed1846149b4d644f7cf2f1db Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestServerMultinode-733672087-project-admin Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 could not be found. Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2'} Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 could not be found. Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 could not be found. Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:34.806005 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 could not be found. Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:28:34.811560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] Returning 404 to user: Instance d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:34.812921 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e25d536-cc8f-4c4b-b073-e748820e9901 tempest-TestServerMultinode-733672087 tempest-TestServerMultinode-733672087-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2" status: 404 len: 111 microversion: 2.1 time: 0.121911 Oct 31 14:28:34.826340 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2416/5095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:34 2022] GET /compute/v2.1/servers/d0e6fdff-a9e7-470a-aa6a-1c56c4b2eab2 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:34.869831 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b033236-92d3-4126-94a1-51d8f29c770e tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 204 len: 0 microversion: 2.1 time: 0.327326 Oct 31 14:28:34.871143 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2680/5096] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:28:34 2022] DELETE /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:28:34.879381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:34.880692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:34.893018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.895776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.897534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:34.899152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:34.899705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:34.900412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:35.552236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:35.565569 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-986657c4-a18e-4cd0-bc0d-899b672d7344 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1494 microversion: 2.1 time: 0.689915 Oct 31 14:28:35.566701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2417/5097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:34 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1494 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:35.701568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:35.705022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:35.718777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:35.719512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:35.720289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:35.721396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:35.722042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:35.722832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:35.792267 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ecbc91ed-089c-45b8-a4de-233567c0d808 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096559 Oct 31 14:28:35.792876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2681/5098] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:35 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:36.588803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:36.590343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:36.605633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:36.606324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:36.606872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:36.611207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:36.611894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:36.612426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:36.808312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:36.811355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:36.822706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:36.823672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:36.826505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:36.828548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:36.829296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:36.830325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:36.880095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7f5cc83-86ca-483e-971b-025f003b6ed6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076070 Oct 31 14:28:36.887077 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2682/5099] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:36 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:37.510501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:37.526519 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8156668-f83a-4c73-9557-a95b12b4e579 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1494 microversion: 2.1 time: 0.941470 Oct 31 14:28:37.537075 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2418/5100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:36 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1494 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:37.893237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:37.896333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:37.909742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:37.919893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:37.924096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:37.941802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:37.944622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:37.945363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:37.988899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:37.999771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-1d8c6d5f-8f6d-41ee-98f9-b45c754c331c req-ff1f1e6e-3fac-4d3f-a1e3-ab86d9d32d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44757522-00b6-4933-a586-d50f743122d6", "name": "network-vif-deleted", "tag": "16ba3822-f271-493a-9330-8f6a2ad7b538"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:38.015032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f61bb9bf-576b-49d4-a6d1-21f5d2fe0577 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124819 Oct 31 14:28:38.032611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1d8c6d5f-8f6d-41ee-98f9-b45c754c331c req-ff1f1e6e-3fac-4d3f-a1e3-ab86d9d32d0f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:38.034359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1d8c6d5f-8f6d-41ee-98f9-b45c754c331c req-ff1f1e6e-3fac-4d3f-a1e3-ab86d9d32d0f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:38.035236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1d8c6d5f-8f6d-41ee-98f9-b45c754c331c req-ff1f1e6e-3fac-4d3f-a1e3-ab86d9d32d0f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:38.043617 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2683/5101] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:37 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:38.070454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-1d8c6d5f-8f6d-41ee-98f9-b45c754c331c req-ff1f1e6e-3fac-4d3f-a1e3-ab86d9d32d0f service nova] Creating event network-vif-deleted:16ba3822-f271-493a-9330-8f6a2ad7b538 for instance 44757522-00b6-4933-a586-d50f743122d6 on n-h2-863052-1 Oct 31 14:28:38.092392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-1d8c6d5f-8f6d-41ee-98f9-b45c754c331c req-ff1f1e6e-3fac-4d3f-a1e3-ab86d9d32d0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095846 Oct 31 14:28:38.093390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2419/5102] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:38.563437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:38.564769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:38.593061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:38.593766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:38.599350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:38.600140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:38.600623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:38.601386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:38.676795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:38.678242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:38.678865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:38.686647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lazy-loading 'fault' on Instance uuid 44757522-00b6-4933-a586-d50f743122d6 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:28:38.842986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:38.857028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b037547-b539-47ff-bc4f-58036fcd64d8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 200 len: 1305 microversion: 2.1 time: 0.299089 Oct 31 14:28:38.857772 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2684/5103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:38 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 1305 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:39.048837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:39.051751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:39.063644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:39.075463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:39.076082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:39.077002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:39.077605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:39.078248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:39.145607 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22f37bbe-d189-4010-8ec4-40a2fb54942e tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102515 Oct 31 14:28:39.151629 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2420/5104] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:39 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:39.883959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:39.885440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:39.899218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:39.902048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:39.902592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:39.903377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:39.903902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:39.904370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:39.941327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 HTTP/1.1 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '44757522-00b6-4933-a586-d50f743122d6'} Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:39.946453 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:28:39.949832 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:39.951497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:39.952647 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df0477b1-4853-4edf-9cc6-c187c3900464 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 404 len: 111 microversion: 2.1 time: 0.075572 Oct 31 14:28:39.953967 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2685/5105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:39 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:40.161522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:40.164470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:40.176264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:40.177888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:40.180180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:40.181957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:40.187571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:40.188965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:40.214420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2015803416", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "59131716-609a-4aad-a08c-b9b43d9198d1"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:40.317728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] validate_networks() for [('59131716-609a-4aad-a08c-b9b43d9198d1', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:28:40.319820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be3711fc-371b-4899-9b32-01ecf2f5d770 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165210 Oct 31 14:28:40.321845 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2421/5106] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:40 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:41.332617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:41.335149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:41.371092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:41.374436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:41.377637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:41.380141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:41.380639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:41.384252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:41.467320 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e2e62cc-3bc5-4989-bdac-7792256139da tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138035 Oct 31 14:28:41.474070 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2422/5107] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:28:41 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:28:41.596576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:41.598374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:41.621636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:41.622561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:41.623188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:41.624330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:41.625044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:41.625787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:41.688629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:28:41.883985 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52c5ee45-2ad1-44a4-8f27-f7fc9fcdb6c5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 204 len: 0 microversion: 2.1 time: 0.296023 Oct 31 14:28:41.888256 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2423/5108] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:28:41 2022] DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:28:41.905487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:41.913356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:41.932179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:41.932179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:41.935543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:41.940250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:41.942002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:41.945567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:42.247228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:28:42.249312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:28:42.251188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:28:42.252388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:28:42.253338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:28:42.276319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:42.278939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:42.279443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:42.280212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:42.280680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:42.290712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:42.367488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:28:42.381242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Getting quotas for user 94fc01d8aea14ef985a01e3980227da3 and project 04c55e983216489986116d8136edafd6. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:28:42.428200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:28:42.438926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:28:42.582039 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1623455-d7a2-4de3-96b1-afb34ac5c2c8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.363248 Oct 31 14:28:42.587793 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2686/5109] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:28:42.599538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38155345-42aa-403f-afc8-ba9613e5d722 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:42.599953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38155345-42aa-403f-afc8-ba9613e5d722 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:42.681511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:42.704013 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f9aa46b-c141-474e-8337-56d84958e456 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1680 microversion: 2.1 time: 0.813277 Oct 31 14:28:42.704616 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2424/5110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:41 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1680 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:42.798550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-38155345-42aa-403f-afc8-ba9613e5d722 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:42.807318 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38155345-42aa-403f-afc8-ba9613e5d722 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1215 microversion: 2.1 time: 0.212312 Oct 31 14:28:42.811104 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2687/5111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:42 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:43.732500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:43.733043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:43.744086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:43.744590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:43.745110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:43.745753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:43.746238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:43.748380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:43.837187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6826c8f-6c05-45d6-bf49-9c306270efc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:43.837804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6826c8f-6c05-45d6-bf49-9c306270efc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:44.159968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6826c8f-6c05-45d6-bf49-9c306270efc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:44.168997 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6826c8f-6c05-45d6-bf49-9c306270efc6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1215 microversion: 2.1 time: 0.335540 Oct 31 14:28:44.172335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2688/5112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:43 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:28:45.075958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:45.089458 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae5010c4-e717-4aa1-8c94-82f980d4d803 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1680 microversion: 2.1 time: 1.359989 Oct 31 14:28:45.091578 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2425/5113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:43 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1680 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:45.768941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:45.769583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:45.772265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:45.784195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:45.784877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:45.785468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:45.786657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:45.787481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:45.788080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:45.951376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:45.965276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-beee7c39-75d5-449a-8b65-f6a5a77b0efa tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1273 microversion: 2.1 time: 0.768164 Oct 31 14:28:45.969516 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2689/5114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:45 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1273 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:46.116847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:46.117470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:46.130161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:46.136654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:46.137930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:46.141275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:46.143074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:46.146199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:46.470994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:46.473302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:46.491965 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8abd7000-97f5-4ec0-b2a2-cd7a84d2c1d3 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1613 microversion: 2.1 time: 0.379346 Oct 31 14:28:46.492552 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2426/5115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:46 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1613 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:46.996247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:47.001565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:47.035306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:47.051347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:47.052002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:47.052962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:47.053804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:47.054757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:47.265055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:47.274953 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b37cd46e-4a60-4a20-905a-c776aa6f6804 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1273 microversion: 2.1 time: 0.289145 Oct 31 14:28:47.289157 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2690/5116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:46 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:47.289987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fb7faed6-9297-4adb-a3ab-339c976d1df4 req-b53050d0-88c3-4352-aeb3-cf6f75536035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9f19e0-c98f-48c1-896b-e02c143e1365", "name": "network-vif-deleted", "tag": "427978b2-1627-4e5d-ac3c-9e4ddf1a18a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:47.314114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb7faed6-9297-4adb-a3ab-339c976d1df4 req-b53050d0-88c3-4352-aeb3-cf6f75536035 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:47.316332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb7faed6-9297-4adb-a3ab-339c976d1df4 req-b53050d0-88c3-4352-aeb3-cf6f75536035 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:47.317352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb7faed6-9297-4adb-a3ab-339c976d1df4 req-b53050d0-88c3-4352-aeb3-cf6f75536035 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:47.361359 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fb7faed6-9297-4adb-a3ab-339c976d1df4 req-b53050d0-88c3-4352-aeb3-cf6f75536035 service nova] Creating event network-vif-deleted:427978b2-1627-4e5d-ac3c-9e4ddf1a18a4 for instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 on n-h2-863052-1 Oct 31 14:28:47.372836 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fb7faed6-9297-4adb-a3ab-339c976d1df4 req-b53050d0-88c3-4352-aeb3-cf6f75536035 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092924 Oct 31 14:28:47.373961 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2427/5117] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:28:47.518818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:47.525277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:47.543014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:47.547269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:47.551844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:47.554958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:47.559322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:47.561017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:47.621474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:47.622206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:47.622949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:47.623858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lazy-loading 'fault' on Instance uuid 7b9f19e0-c98f-48c1-896b-e02c143e1365 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:28:47.761855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:47.778971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e98e5a91-7cde-4441-b347-19ade62a0cbd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 200 len: 1331 microversion: 2.1 time: 0.262511 Oct 31 14:28:47.782562 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2691/5118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:47 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 1331 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:48.313156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:48.314600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:48.324613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:48.325090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:48.325530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:48.332738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:48.336747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:48.337211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:48.558022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:48.570216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89f298be-8f51-4339-8676-08e753c98df1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1273 microversion: 2.1 time: 0.261190 Oct 31 14:28:48.571185 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2428/5119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:48 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:48.810048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:48.811970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:48.833601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:48.835059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:48.835950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:48.838415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:48.839120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:48.839760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:48.871472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 HTTP/1.1 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '7b9f19e0-c98f-48c1-896b-e02c143e1365'} Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:28:48.873068 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:28:48.877470 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23dea5fb-bcf0-4e68-8bdf-32accb4c234c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 404 len: 111 microversion: 2.1 time: 0.073306 Oct 31 14:28:48.879490 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2692/5120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:48 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:48.884180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7815e88-7abb-40d4-8d43-7af8c347b3bc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '.version_select at 0x7fe106851670>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:48.888718 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7815e88-7abb-40d4-8d43-7af8c347b3bc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [003a9747-ccdc-4070-9420-e4d492900acf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 14:28:49.600745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:49.602050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:49.620434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:49.622530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:49.623140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:49.624004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:49.632124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:49.633174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:49.896647 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7815e88-7abb-40d4-8d43-7af8c347b3bc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [003a9747-ccdc-4070-9420-e4d492900acf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50778. Oct 31 14:28:49.940037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7815e88-7abb-40d4-8d43-7af8c347b3bc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993467809" status: 202 len: 0 microversion: 2.1 time: 1.059543 Oct 31 14:28:49.943263 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2429/5121] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993467809 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:28:50.182461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:50.198031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fab7bfb-148b-4a8a-bda8-f22f36aeca8f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 0.594234 Oct 31 14:28:50.200831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2693/5122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:49 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:51.228859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:51.230551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:51.247961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:51.253867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:51.255363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:51.257458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:51.258003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:51.258624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:52.248553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:52.271863 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c622b7c4-456e-4c54-9227-8d8eb4085ccf tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 1.051430 Oct 31 14:28:52.273053 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2430/5123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:51 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:53.301683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:53.302358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:53.305315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:53.320624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:53.321131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:53.321574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:53.323852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:53.324361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:53.324814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:53.561751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-425f1942-f796-4934-b4cc-c64a4f8e6030 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: .version_select at 0x7fe1067e2a60>, body: {"keypair": {"name": "tempest-keypair-370683446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4CMQ7rcLwHHW/PN6PmypeHySoTNAmuZjni6Oqu4uSfULCQFcOhI7BWgtVijkMkBeniyxZBi9Af0yI6cN1K94LMOaKr1DC/1xkuMHZLIE5fel5PkExw3ZtVuEY6HxZqng=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:53.584541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:53.604396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-425f1942-f796-4934-b4cc-c64a4f8e6030 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:28:53.626266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-425f1942-f796-4934-b4cc-c64a4f8e6030 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:28:53.675726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-425f1942-f796-4934-b4cc-c64a4f8e6030 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118013 Oct 31 14:28:53.676565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2431/5124] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:28:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:28:53.897972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e010f3c4-983e-4ad1-96cc-812012693326 req-2ef75dba-3807-4198-be08-74d9d3c1fb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4469a03-80f9-48e7-a083-3d652ab27373", "tag": "cfe42200-29d2-4e61-a995-54278d4e82b6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:28:53.916939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e010f3c4-983e-4ad1-96cc-812012693326 req-2ef75dba-3807-4198-be08-74d9d3c1fb57 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:53.917652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e010f3c4-983e-4ad1-96cc-812012693326 req-2ef75dba-3807-4198-be08-74d9d3c1fb57 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:53.918475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e010f3c4-983e-4ad1-96cc-812012693326 req-2ef75dba-3807-4198-be08-74d9d3c1fb57 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:53.938739 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e010f3c4-983e-4ad1-96cc-812012693326 req-2ef75dba-3807-4198-be08-74d9d3c1fb57 service nova] Creating event network-changed:cfe42200-29d2-4e61-a995-54278d4e82b6 for instance b4469a03-80f9-48e7-a083-3d652ab27373 on n-h1-863052-1 Oct 31 14:28:53.970272 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e010f3c4-983e-4ad1-96cc-812012693326 req-2ef75dba-3807-4198-be08-74d9d3c1fb57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075905 Oct 31 14:28:53.971533 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2432/5125] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:28:54.168260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:54.316370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:54.325800 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f255e87e-fea2-41ed-96dd-bb3f4a44a533 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 1.029792 Oct 31 14:28:54.341984 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2694/5126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:53 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:55.350519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:55.351804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:55.367869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:55.368658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:55.369760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:55.370697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:55.382104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:55.382645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:56.446220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:56.518513 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8290852-6cbc-4fcb-9df6-8be608025272 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 1.172366 Oct 31 14:28:56.519329 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2433/5127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:55 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:57.547033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:57.547645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:57.557489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:57.567070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:57.567788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:57.568934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:57.569597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:57.570224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:58.196634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:58.204981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a569acd-2f68-4f09-8ec4-00ee4cd911ce tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 0.661821 Oct 31 14:28:58.219326 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2695/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:57 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:28:59.241096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:28:59.242524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:28:59.264508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:59.265806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:59.269398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:59.274249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:28:59.280225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:28:59.281436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:28:59.652885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:28:59.664907 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42030683-5a77-4833-9feb-0b3f527350c5 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 0.427927 Oct 31 14:28:59.668862 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2434/5129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:28:59 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:00.455264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1519402026", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed57bab-14ab-45b9-8b44-cc4a46a76802"}], "security_groups": [{"name": "tempest-securitygroup--1224175048"}], "key_name": "tempest-keypair-370683446", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:00.690015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:00.690740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:00.709917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:00.710451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:00.710915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:00.711645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:00.712111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:00.712546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:01.070223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:01.081983 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f40ea42-821d-4748-be35-692229dd45d6 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 0.396396 Oct 31 14:29:01.093976 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2435/5130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:00 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:01.367526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3367779f-b59e-44af-a92d-905ac702be9b req-6ea47190-1d7d-4cce-ad2a-19cddb98f346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4469a03-80f9-48e7-a083-3d652ab27373", "name": "network-vif-plugged", "status": "completed", "tag": "cfe42200-29d2-4e61-a995-54278d4e82b6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:01.387560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3367779f-b59e-44af-a92d-905ac702be9b req-6ea47190-1d7d-4cce-ad2a-19cddb98f346 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:01.388307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3367779f-b59e-44af-a92d-905ac702be9b req-6ea47190-1d7d-4cce-ad2a-19cddb98f346 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:01.389136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3367779f-b59e-44af-a92d-905ac702be9b req-6ea47190-1d7d-4cce-ad2a-19cddb98f346 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:01.401667 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3367779f-b59e-44af-a92d-905ac702be9b req-6ea47190-1d7d-4cce-ad2a-19cddb98f346 service nova] Creating event network-vif-plugged:cfe42200-29d2-4e61-a995-54278d4e82b6 for instance b4469a03-80f9-48e7-a083-3d652ab27373 on n-h1-863052-1 Oct 31 14:29:01.412142 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3367779f-b59e-44af-a92d-905ac702be9b req-6ea47190-1d7d-4cce-ad2a-19cddb98f346 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316084 Oct 31 14:29:01.419576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2436/5131] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:01.491521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] validate_networks() for [('0ed57bab-14ab-45b9-8b44-cc4a46a76802', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:29:02.124226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:02.126640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:02.156626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:02.157143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:02.157582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:02.159392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:02.161215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:02.162416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:02.716841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:02.735166 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b00287f0-46f5-4a51-8f95-98278fdbc4bb tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1315 microversion: 2.1 time: 0.631219 Oct 31 14:29:02.738682 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2437/5132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:02 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:03.408345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:29:03.408828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:29:03.409229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:29:03.409840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:29:03.410441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:29:03.427846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:03.432371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:03.433980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:03.435398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:03.441779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:03.450929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:03.502419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:03.509762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:03.546031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:29:03.553703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:29:03.649193 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a57a8e5-32f9-488d-bd82-7cdabc3a3e18 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.199379 Oct 31 14:29:03.650119 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2696/5133] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:29:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:29:03.661486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5ca552f-3c91-4c4e-bcf6-6390dfba9a88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:03.662114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5ca552f-3c91-4c4e-bcf6-6390dfba9a88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:03.671778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:03.768036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:03.768830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:03.781180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:03.782675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:03.783407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:03.784788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:03.786471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:03.788520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:03.843260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e5ca552f-3c91-4c4e-bcf6-6390dfba9a88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:03.861527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5ca552f-3c91-4c4e-bcf6-6390dfba9a88 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1241 microversion: 2.1 time: 0.204064 Oct 31 14:29:03.864745 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2438/5134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:03 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1241 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:04.764571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1813770802", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:04.850469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] validate_networks() for [('e276973d-883f-4e45-af10-726a6220780f', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:29:05.080720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:05.097628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53aabbf2-5483-40a5-bdfa-86589427513c tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1502 microversion: 2.1 time: 1.334641 Oct 31 14:29:05.117733 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2697/5135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:03 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1502 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:05.144887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:05.145939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:05.154592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:05.155801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:05.177901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:05.184967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:05.186550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:05.192198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:05.451123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:05.468509 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aed488cb-3b51-40c3-8e5c-5c641f6f38e9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1293 microversion: 2.1 time: 0.348797 Oct 31 14:29:05.469112 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2698/5136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:05 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1293 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:05.476892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:05.477429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:05.505620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:05.506409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:05.506986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:05.507836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:05.508429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:05.508981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:05.570034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lazy-loading 'flavor' on Instance uuid b4469a03-80f9-48e7-a083-3d652ab27373 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:29:05.732135 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3858440-e398-4bd5-8db0-c14d39960137 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "POST /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373/action" status: 202 len: 0 microversion: 2.1 time: 0.261734 Oct 31 14:29:05.754901 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2699/5137] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:29:05 2022] POST /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:29:05.775066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:05.778131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:05.797666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:05.803392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:05.804070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:05.806237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:05.807837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:05.810287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:06.259627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:06.268852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:29:06.270180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:29:06.270963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:29:06.271585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:29:06.272212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:29:06.281924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd2dbb04-f535-4fde-8e5c-46e962de8b04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1510 microversion: 2.1 time: 0.524061 Oct 31 14:29:06.282579 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2700/5138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:05 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:06.296434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:06.296938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:06.297395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:06.298107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:06.298637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:06.299033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:06.352081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Getting quotas for project f3b6cb0bce2e434faa4f2256965b22bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:06.363632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Getting quotas for user e777fb43bd264183a1b3ea4016b26302 and project f3b6cb0bce2e434faa4f2256965b22bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:06.395882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:29:06.400732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:29:06.471154 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-566642bf-5861-4f12-a4a5-03b8a2bc32e1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.956356 Oct 31 14:29:06.472223 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2439/5139] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:29:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:29:06.486232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-609a15f0-7683-47e0-b96f-e9b4fa972bba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:06.487477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-609a15f0-7683-47e0-b96f-e9b4fa972bba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:06.497840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:06.498806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:06.509856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:06.510703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:06.516085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:06.517048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:06.517795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:06.518425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:06.570112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-609a15f0-7683-47e0-b96f-e9b4fa972bba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:06.585830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-609a15f0-7683-47e0-b96f-e9b4fa972bba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1214 microversion: 2.1 time: 0.105612 Oct 31 14:29:06.602773 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2701/5140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:06 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:06.661917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:06.674861 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0400ae55-4ded-45f0-9e57-769a47b8c1f1 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1299 microversion: 2.1 time: 0.181720 Oct 31 14:29:06.675779 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2440/5141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:06 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:07.307163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:07.308496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:07.317756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:07.318534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:07.319207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:07.320134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:07.320795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:07.321428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:07.617241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:07.619258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:07.651643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:07.654398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:07.655041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:07.656504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:07.658907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:07.659961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:07.881362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:07.891204 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d98177e0-39b8-4340-8b1f-406610cad96d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1266 microversion: 2.1 time: 0.285869 Oct 31 14:29:07.911537 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2441/5142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:07 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:07.919232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:07.920245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:07.938530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:07.940315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:07.941279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:07.942445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:07.943440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:07.944364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:08.073296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:08.084112 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-55ed176c-c436-422e-a311-5fe8b5f18dfb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1299 microversion: 2.1 time: 0.171022 Oct 31 14:29:08.085430 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2442/5143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:07 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:08.380108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:08.402018 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f508c4d-1b61-4831-abc4-78ddd26b7b95 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1493 microversion: 2.1 time: 1.097126 Oct 31 14:29:08.405582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2702/5144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:07 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1493 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:08.432370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:08.433490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:08.447785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:08.448786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:08.450053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:08.455689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:08.458081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:08.460661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:08.552338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:29:08.784315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f79f3c41-6d09-4ff1-918c-4da94676d618 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 204 len: 0 microversion: 2.1 time: 0.356408 Oct 31 14:29:08.786029 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2443/5145] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:08 2022] DELETE /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:29:08.800123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:08.800819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:08.811962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:08.812579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:08.813176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:08.813939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:08.815492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:08.816313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:08.825990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:08.920621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:08.921308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:08.937980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:08.938553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:08.941370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:08.942038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:08.944182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:08.947373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:09.102525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:09.112133 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0cde0382-c22c-47a5-b44f-776c6d65e6bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1272 microversion: 2.1 time: 0.197927 Oct 31 14:29:09.112854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2444/5146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:08 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:09.128494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:09.129292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:09.139451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:09.142468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:09.142938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:09.143678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:09.144130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:09.148201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:09.457567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:09.467492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bb6ced1-bc6d-4539-a76b-eea86f9e60f0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.353389 Oct 31 14:29:09.469585 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2445/5147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:09 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:10.118822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:10.134359 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26fcf277-3bc0-413b-8227-5b0aca7ec9f2 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1499 microversion: 2.1 time: 1.342403 Oct 31 14:29:10.143089 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2703/5148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:08 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1499 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:10.145852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:10.146763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:10.169965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:10.174521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:10.175148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:10.176222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:10.176912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:10.178922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:10.414827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:10.425611 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1233d68f-c28e-483d-ab2d-fd8c043e9d80 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1272 microversion: 2.1 time: 0.292446 Oct 31 14:29:10.428616 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2446/5149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:10 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:10.498267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:10.500092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:10.507669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:10.508498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:10.509466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:10.510411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:10.511051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:10.511705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:11.165337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:11.166048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:11.180949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:11.181457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:11.181902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:11.182649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:11.183108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:11.183538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:11.217209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:11.284711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:11.295020 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62be6680-65fb-4e68-9b3f-246e4188ab46 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.803662 Oct 31 14:29:11.295996 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2704/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:10 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:11.452817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:11.453711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:11.476451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:11.476953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:11.477390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:11.478337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:11.478996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:11.479602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:11.806135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:11.835770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3f3532e-0cbd-4bb9-ba02-f902fabc18ad tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1272 microversion: 2.1 time: 0.374768 Oct 31 14:29:11.839209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2705/5151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:11 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:12.006258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fc01d8aea14ef985a01e3980227da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c55e983216489986116d8136edafd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:12.024688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-340122e1-b4b3-4447-9731-ba537f538ea3 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 200 len: 1499 microversion: 2.1 time: 0.863588 Oct 31 14:29:12.025279 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2447/5152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:11 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 1499 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:12.323245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:12.323860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:12.346268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:12.347014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:12.347753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:12.350017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:12.357083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:12.359506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:12.523961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-097c4308-5f27-4f19-aa72-8f4678f3af2c req-0071cc07-e281-404a-8438-5cdbfbb51af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4469a03-80f9-48e7-a083-3d652ab27373", "name": "network-vif-deleted", "tag": "cfe42200-29d2-4e61-a995-54278d4e82b6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:12.538297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-097c4308-5f27-4f19-aa72-8f4678f3af2c req-0071cc07-e281-404a-8438-5cdbfbb51af8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:12.538988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-097c4308-5f27-4f19-aa72-8f4678f3af2c req-0071cc07-e281-404a-8438-5cdbfbb51af8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:12.540241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-097c4308-5f27-4f19-aa72-8f4678f3af2c req-0071cc07-e281-404a-8438-5cdbfbb51af8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:12.558395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-097c4308-5f27-4f19-aa72-8f4678f3af2c req-0071cc07-e281-404a-8438-5cdbfbb51af8 service nova] Creating event network-vif-deleted:cfe42200-29d2-4e61-a995-54278d4e82b6 for instance b4469a03-80f9-48e7-a083-3d652ab27373 on n-h1-863052-1 Oct 31 14:29:12.567501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-097c4308-5f27-4f19-aa72-8f4678f3af2c req-0071cc07-e281-404a-8438-5cdbfbb51af8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396316 Oct 31 14:29:12.570048 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2706/5153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:12.869238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:12.870558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:12.892143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:12.893032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:12.895895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:12.899046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:12.900338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:12.902256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:12.939742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:12.952498 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d068b720-1cc3-4701-9474-90ff87012edd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.632489 Oct 31 14:29:12.955810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2448/5154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:12 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:13.057000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.057847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.068698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.069273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.071812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.072628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.073909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.075942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.109628 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 HTTP/1.1 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b4469a03-80f9-48e7-a083-3d652ab27373'} Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.112256 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.116660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.117168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.119242 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c7f1446-27dd-4d98-8748-b8ca6baabe5a tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 404 len: 111 microversion: 2.1 time: 0.065917 Oct 31 14:29:13.121708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2449/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.131804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.135615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.148325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.148827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.149259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.152868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.156159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.156904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.196453 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 HTTP/1.1 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b4469a03-80f9-48e7-a083-3d652ab27373'} Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.198059 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.201488 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f999a56-88a3-4aed-9fb1-4face763b325 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 404 len: 111 microversion: 2.1 time: 0.072001 Oct 31 14:29:13.209383 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2450/5156] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:13 2022] DELETE /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:13.214500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.215117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b4469a03-80f9-48e7-a083-3d652ab27373] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.238201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.239044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.240468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.241226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.241693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.243250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.275761 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 HTTP/1.1 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b4469a03-80f9-48e7-a083-3d652ab27373'} Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.277512 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b4469a03-80f9-48e7-a083-3d652ab27373 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.281177 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e494f9ad-db71-40e2-af3c-ac76b9b97748 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373" status: 404 len: 111 microversion: 2.1 time: 0.069466 Oct 31 14:29:13.281643 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2451/5157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/b4469a03-80f9-48e7-a083-3d652ab27373 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.300972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.301884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.323350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.325305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.326384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.327332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.328060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.333392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.371919 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 HTTP/1.1 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '44757522-00b6-4933-a586-d50f743122d6'} Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.375634 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.379528 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.381243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.385344 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b7ceb57-fde1-4057-8915-7f952538f773 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 404 len: 111 microversion: 2.1 time: 0.097800 Oct 31 14:29:13.386529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2452/5158] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:13 2022] DELETE /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.397967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.400090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 44757522-00b6-4933-a586-d50f743122d6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.425223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.426192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.430031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.431171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.432008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.433098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.455938 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 HTTP/1.1 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '44757522-00b6-4933-a586-d50f743122d6'} Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.458723 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. Oct 31 14:29:13.462447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.466124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance 44757522-00b6-4933-a586-d50f743122d6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.467306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e8f10e8-34f0-444f-8735-db35389b848f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6" status: 404 len: 111 microversion: 2.1 time: 0.076953 Oct 31 14:29:13.469302 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2453/5159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/44757522-00b6-4933-a586-d50f743122d6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:13.480932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:13.485312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.486470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.503198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.506392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.507227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.508268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:13.509725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.510305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.511308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.518139 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5557f11-9695-447d-bbd5-438f4c2ffc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.657237 Oct 31 14:29:13.530434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2707/5160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:12 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:13.555409 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 HTTP/1.1 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e87a78d9-dd4f-45b5-81f3-04824792b608'} Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.562563 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.566422 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.569567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.570646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b4593dc-72e8-4ccc-8735-a7f0d6dfc99b tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 404 len: 111 microversion: 2.1 time: 0.097014 Oct 31 14:29:13.571765 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2454/5161] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:13 2022] DELETE /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.579658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.580291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e87a78d9-dd4f-45b5-81f3-04824792b608] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.594246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.594723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.595168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.595889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.596532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.596778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.612347 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 HTTP/1.1 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e87a78d9-dd4f-45b5-81f3-04824792b608'} Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.614272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. Oct 31 14:29:13.618247 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.619843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance e87a78d9-dd4f-45b5-81f3-04824792b608 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.620922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ef51806-5022-48dc-8606-0d7255674c04 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608" status: 404 len: 111 microversion: 2.1 time: 0.045257 Oct 31 14:29:13.630149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.630797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.636578 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2708/5162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/e87a78d9-dd4f-45b5-81f3-04824792b608 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.637531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.639947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.640605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.641558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.642372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.643035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.674103 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e HTTP/1.1 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '96987382-4cff-4328-a1d9-b7108a21398e'} Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.675828 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6dfce619-4a5e-46d9-874e-e2b4b8c122f8 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 404 len: 111 microversion: 2.1 time: 0.051348 Oct 31 14:29:13.679333 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2455/5163] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:13 2022] DELETE /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:13.687376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.688211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: 96987382-4cff-4328-a1d9-b7108a21398e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.694704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.695378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.696005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.700923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.701602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.702286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.740340 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e HTTP/1.1 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '96987382-4cff-4328-a1d9-b7108a21398e'} Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.742618 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. Oct 31 14:29:13.747185 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.749393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance 96987382-4cff-4328-a1d9-b7108a21398e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.750633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce940270-5218-4014-9082-c60105f23cc0 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e" status: 404 len: 111 microversion: 2.1 time: 0.067738 Oct 31 14:29:13.751684 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2709/5164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/96987382-4cff-4328-a1d9-b7108a21398e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.760165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a216ee0a-ac02-4b4c-bf9a-4ab248112f0f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.761012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a216ee0a-ac02-4b4c-bf9a-4ab248112f0f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.767390 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a216ee0a-ac02-4b4c-bf9a-4ab248112f0f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a216ee0a-ac02-4b4c-bf9a-4ab248112f0f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 HTTP/1.1 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'ef73a994-0a4b-421e-b6d0-f9066985db18'} Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.769447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.772682 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.775410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a216ee0a-ac02-4b4c-bf9a-4ab248112f0f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.776571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a216ee0a-ac02-4b4c-bf9a-4ab248112f0f tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18" status: 404 len: 111 microversion: 2.1 time: 0.020427 Oct 31 14:29:13.785759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4814c6ce-f4b9-48f6-96e5-fc41acaeb743 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.786793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4814c6ce-f4b9-48f6-96e5-fc41acaeb743 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: ef73a994-0a4b-421e-b6d0-f9066985db18] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:13.788737 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2456/5165] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:13 2022] DELETE /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:13.793909 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4814c6ce-f4b9-48f6-96e5-fc41acaeb743 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4814c6ce-f4b9-48f6-96e5-fc41acaeb743 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 HTTP/1.1 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ef73a994-0a4b-421e-b6d0-f9066985db18'} Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:13.796163 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:13.799431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:13.799431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:13.799431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:13.799431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. Oct 31 14:29:13.799431 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:13.801306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4814c6ce-f4b9-48f6-96e5-fc41acaeb743 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance ef73a994-0a4b-421e-b6d0-f9066985db18 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:13.802486 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4814c6ce-f4b9-48f6-96e5-fc41acaeb743 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18" status: 404 len: 111 microversion: 2.1 time: 0.020693 Oct 31 14:29:13.803482 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2710/5166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/ef73a994-0a4b-421e-b6d0-f9066985db18 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:13.854817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2a372fc4-dc08-4e95-a490-f39e07a6e7e4 req-311daf15-8b21-4658-a52b-d2caec005da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf76455-be9a-486a-9d38-8396622560f3", "tag": "6b816bfc-a8a6-46e9-bc0d-44e1c057013b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:13.877079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a372fc4-dc08-4e95-a490-f39e07a6e7e4 req-311daf15-8b21-4658-a52b-d2caec005da3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:13.881644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a372fc4-dc08-4e95-a490-f39e07a6e7e4 req-311daf15-8b21-4658-a52b-d2caec005da3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:13.884321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a372fc4-dc08-4e95-a490-f39e07a6e7e4 req-311daf15-8b21-4658-a52b-d2caec005da3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:13.912781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2a372fc4-dc08-4e95-a490-f39e07a6e7e4 req-311daf15-8b21-4658-a52b-d2caec005da3 service nova] Creating event network-changed:6b816bfc-a8a6-46e9-bc0d-44e1c057013b for instance 3bf76455-be9a-486a-9d38-8396622560f3 on n-h2-863052-1 Oct 31 14:29:13.925482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2a372fc4-dc08-4e95-a490-f39e07a6e7e4 req-311daf15-8b21-4658-a52b-d2caec005da3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076718 Oct 31 14:29:13.929216 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2457/5167] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:29:13.978547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:13.979531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:14.014559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:14.017492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:14.018626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:14.022602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:14.023246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:14.024954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:14.549762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:14.551163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:14.567334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:14.568488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:14.569247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:14.570319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:14.571029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:14.578474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:15.262161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:15.275314 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d2cd151-d7d0-4b9b-89f7-abe413ae9d02 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 1.301184 Oct 31 14:29:15.288878 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2711/5168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:13 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:16.312943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:16.313562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:16.316677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:16.324244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:16.331762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:16.336925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:16.337511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:16.338352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:16.345175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:16.348853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:16.386207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:16.574761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:16.666074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:16.679783 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c99fa87-da8e-4bb9-b4ee-fb288bf198d6 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 2.135799 Oct 31 14:29:16.688957 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2458/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:14 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:16.769770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ece4d1d3-57de-45ef-b946-14c05c55b11c req-5bba7854-2c29-41bd-997d-f0e2a63e5e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ceeb4a1-0726-4cf2-a0ed-125f35a46906", "tag": "e6030399-d258-4c13-9428-023c81e6ec40"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:16.788435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ece4d1d3-57de-45ef-b946-14c05c55b11c req-5bba7854-2c29-41bd-997d-f0e2a63e5e37 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:16.789172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ece4d1d3-57de-45ef-b946-14c05c55b11c req-5bba7854-2c29-41bd-997d-f0e2a63e5e37 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:16.789997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ece4d1d3-57de-45ef-b946-14c05c55b11c req-5bba7854-2c29-41bd-997d-f0e2a63e5e37 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:16.813207 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ece4d1d3-57de-45ef-b946-14c05c55b11c req-5bba7854-2c29-41bd-997d-f0e2a63e5e37 service nova] Creating event network-changed:e6030399-d258-4c13-9428-023c81e6ec40 for instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 on n-h2-863052-1 Oct 31 14:29:16.826487 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ece4d1d3-57de-45ef-b946-14c05c55b11c req-5bba7854-2c29-41bd-997d-f0e2a63e5e37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067438 Oct 31 14:29:16.829883 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2459/5170] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:29:16.879917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:16.888646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec6ddce2-c524-4dc5-b531-e61813e18acd tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.588176 Oct 31 14:29:16.897836 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2712/5171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:16 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:17.712706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:17.714414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:17.727590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:17.735207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:17.735921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:17.737085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:17.737710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:17.738363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:17.922234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:17.923577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:17.939328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:17.948809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:17.949506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:17.950496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:17.954882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:17.955565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:18.663394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:18.685604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74ae3200-7caf-4809-8f43-2bef1acca699 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.976933 Oct 31 14:29:18.696241 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2460/5172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:17 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:19.362464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:19.379518 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4607a4bf-8129-4f6d-a077-ba4fe02bbd0b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 1.460434 Oct 31 14:29:19.383247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2713/5173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:17 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:19.636223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:19.636732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:19.649904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.650694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.651291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.663529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.664267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.664720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.690201 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 HTTP/1.1 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b7ace873-e45d-4ed2-97df-9bc10f77ea33'} Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:19.691930 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:19.695548 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-024c99fe-ff72-450a-a026-7df816abcde9 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 404 len: 111 microversion: 2.1 time: 0.061236 Oct 31 14:29:19.702796 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2461/5174] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:19 2022] DELETE /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:19.714069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:19.715017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: b7ace873-e45d-4ed2-97df-9bc10f77ea33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:19.719678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:19.721697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:19.730658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.734000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.737109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.738359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.739090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.741218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.747702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.748264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.748806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.749544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.750004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.759013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.773827 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 HTTP/1.1 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b7ace873-e45d-4ed2-97df-9bc10f77ea33'} Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.783804 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. Oct 31 14:29:19.787153 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.790705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance b7ace873-e45d-4ed2-97df-9bc10f77ea33 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:19.791847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85a8fcd5-886e-4669-9767-d4ff9f9ce2e1 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33" status: 404 len: 111 microversion: 2.1 time: 0.085350 Oct 31 14:29:19.792634 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2714/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:19 2022] GET /compute/v2.1/servers/b7ace873-e45d-4ed2-97df-9bc10f77ea33 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:19.801041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:19.801850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:19.829043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.831850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.833879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.836253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.842015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.843485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.875019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 HTTP/1.1 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e53bf1ac-12bb-40cc-a714-dfc6da9f55e0'} Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:19.876771 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.880051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.886995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:19.888141 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-054e2901-5854-4a28-bacf-c20b20949f5d tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 404 len: 111 microversion: 2.1 time: 0.091461 Oct 31 14:29:19.890457 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2715/5176] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:29:19 2022] DELETE /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:19.903815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:19.908179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] [instance: e53bf1ac-12bb-40cc-a714-dfc6da9f55e0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:19.923883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.924886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.925537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.927211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:19.930351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:19.931104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:19.972451 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] HTTP exception thrown: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Request method failure captured: Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 HTTP/1.1 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9pw4cYbIbw910hbngnZJfAtwPDSl3vROaM9_BYZV12bcMmEOKe1l9uQibh2RVL27ZfLpWgt186u59aoGkIrpzgBek-l3HG_HR1JABrNmgItSTsLQl09HOrtkEYurouoWdEamqy37-j-g31oUeqdMDIVkvVKrGIUToJM_KkM0mUzwBA Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04c55e983216489986116d8136edafd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04c55e983216489986116d8136edafd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04c55e983216489986116d8136edafd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 04c55e983216489986116d8136edafd6 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702615204 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 94fc01d8aea14ef985a01e3980227da3 Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1702615204-project Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e53bf1ac-12bb-40cc-a714-dfc6da9f55e0'} Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:29:19.974301 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. Oct 31 14:29:19.977718 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:29:19.986445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] Returning 404 to user: Instance e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:29:19.991450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-caa99ded-5325-4f32-80bd-a24d4e06b806 tempest-DeleteServersTestJSON-1702615204 tempest-DeleteServersTestJSON-1702615204-project] 10.222.0.27 "GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0" status: 404 len: 111 microversion: 2.1 time: 0.091604 Oct 31 14:29:19.992821 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2716/5177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:19 2022] GET /compute/v2.1/servers/e53bf1ac-12bb-40cc-a714-dfc6da9f55e0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:20.256368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:20.264793 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f11336af-3582-4b9e-a934-2f5d6134bc7b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.553585 Oct 31 14:29:20.280635 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2462/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:19 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:20.405106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:20.406505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:20.418262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:20.422213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:20.424450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:20.428097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:20.431783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:20.433793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:21.292694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:21.293969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:21.303943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:21.305041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:21.309368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:21.310361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:21.311126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:21.311755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:21.815291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:21.824731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96529d30-52c6-47fc-b4db-8b04834714bb tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 1.425075 Oct 31 14:29:21.825328 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2717/5179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:20 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:21.936125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:21.947032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dee91c99-350f-49ca-ae23-d27f42ebaf44 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.662416 Oct 31 14:29:21.965827 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2463/5180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:21 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:22.854007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:22.854704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:22.868499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:22.869178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:22.870088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:22.872576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:22.873207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:22.874603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:22.974898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:22.975525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:22.995373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:22.995882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:22.998556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:23.001403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:23.002077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:23.003157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:23.326385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:23.343601 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21df51be-d554-4c67-a45e-4e7bee43807d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.373984 Oct 31 14:29:23.348340 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2464/5181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:22 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:23.680518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:23.695450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a01cd7f4-0e28-4618-9dc7-b69f49b4d804 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.846692 Oct 31 14:29:23.698051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2718/5182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:22 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:24.371823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:24.373019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:24.385505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:24.394226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:24.395174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:24.395976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:24.396901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:24.397505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:24.398291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:24.727196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:24.727821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:24.741296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:24.742097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:24.742908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:24.744615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:24.745304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:24.746036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:25.286003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:25.302115 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f97720b9-9a51-4545-b547-70899ec0c48b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.581834 Oct 31 14:29:25.303257 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2719/5183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:24 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:25.311260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-808f6df3-3bbb-41a7-aa56-a141a7689e96 req-0c4b665e-3635-49d4-9b2f-bf72666dd0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf76455-be9a-486a-9d38-8396622560f3", "name": "network-vif-plugged", "status": "completed", "tag": "6b816bfc-a8a6-46e9-bc0d-44e1c057013b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:25.329301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-808f6df3-3bbb-41a7-aa56-a141a7689e96 req-0c4b665e-3635-49d4-9b2f-bf72666dd0ec service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:25.329788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-808f6df3-3bbb-41a7-aa56-a141a7689e96 req-0c4b665e-3635-49d4-9b2f-bf72666dd0ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:25.330254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-808f6df3-3bbb-41a7-aa56-a141a7689e96 req-0c4b665e-3635-49d4-9b2f-bf72666dd0ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:25.353777 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-808f6df3-3bbb-41a7-aa56-a141a7689e96 req-0c4b665e-3635-49d4-9b2f-bf72666dd0ec service nova] Creating event network-vif-plugged:6b816bfc-a8a6-46e9-bc0d-44e1c057013b for instance 3bf76455-be9a-486a-9d38-8396622560f3 on n-h2-863052-1 Oct 31 14:29:25.360352 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-808f6df3-3bbb-41a7-aa56-a141a7689e96 req-0c4b665e-3635-49d4-9b2f-bf72666dd0ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055088 Oct 31 14:29:25.360958 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2720/5184] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:25.749262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:25.758044 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c302e35-e7da-4aa1-b136-8e0506d78fac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 1.392818 Oct 31 14:29:25.768043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2465/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:24 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:26.332832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:26.360196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:26.400429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:26.401230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:26.401848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:26.402817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:26.403808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:26.404754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:26.626531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:26.636312 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b91db66-dbae-4610-ace5-966eb9270a9c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1367 microversion: 2.1 time: 0.313026 Oct 31 14:29:26.651886 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2721/5186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:26 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:26.786655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:26.787845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:26.796751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:26.797471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:26.798064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:26.798986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:26.799597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:26.800175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:27.135351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:27.153057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a42f1f14-c165-4cb4-929a-5d71c3414793 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.371622 Oct 31 14:29:27.154390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2466/5187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:26 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:27.472493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a458f625-fc67-4096-97ed-acb36313cb3b req-fa8c52d1-4187-467d-87e9-0090415040e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ceeb4a1-0726-4cf2-a0ed-125f35a46906", "name": "network-vif-plugged", "status": "completed", "tag": "e6030399-d258-4c13-9428-023c81e6ec40"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:27.484633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a458f625-fc67-4096-97ed-acb36313cb3b req-fa8c52d1-4187-467d-87e9-0090415040e4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:27.485427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a458f625-fc67-4096-97ed-acb36313cb3b req-fa8c52d1-4187-467d-87e9-0090415040e4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:27.486009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a458f625-fc67-4096-97ed-acb36313cb3b req-fa8c52d1-4187-467d-87e9-0090415040e4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:27.504646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a458f625-fc67-4096-97ed-acb36313cb3b req-fa8c52d1-4187-467d-87e9-0090415040e4 service nova] Creating event network-vif-plugged:e6030399-d258-4c13-9428-023c81e6ec40 for instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 on n-h2-863052-1 Oct 31 14:29:27.513255 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a458f625-fc67-4096-97ed-acb36313cb3b req-fa8c52d1-4187-467d-87e9-0090415040e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044716 Oct 31 14:29:27.514186 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2722/5188] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:27.663586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:27.665228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:27.676723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:27.677230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:27.677686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:27.678433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:27.678899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:27.686869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:28.179580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:28.180319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:28.199300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:28.199806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:28.200247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:28.203149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:28.203612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:28.205996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:28.676114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:28.695664 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21bbb71c-1cc8-436a-b309-6361e728f19d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1314 microversion: 2.1 time: 0.521292 Oct 31 14:29:28.706354 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2723/5189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:28 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:28.749392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:28.762467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9fbf714-a2f5-46c8-9ee3-7b3ddd23a08d tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1557 microversion: 2.1 time: 1.103895 Oct 31 14:29:28.768172 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2467/5190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:27 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1557 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:28.800288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:28.800858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:28.818902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:28.819702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:28.823937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:28.824828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:28.827983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:28.829329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:29.019977 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cadfe175-e0d2-4c48-a5d7-31a609c8827a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227138 Oct 31 14:29:29.021045 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2724/5191] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:29:28 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:29.727825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:29.728429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:29.739014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:29.739519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:29.740216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:29.740941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:29.741403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:29.741837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:30.671988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:30.687378 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81917e23-c7d6-46ee-8902-9553de187bbe tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1499 microversion: 2.1 time: 0.963301 Oct 31 14:29:30.687976 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2468/5192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:29 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1499 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:30.713548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:30.718656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:30.738835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:30.739526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:30.740935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:30.741808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:30.742498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:30.743077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:30.780928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lazy-loading 'flavor' on Instance uuid 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:29:30.824145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:30.906026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2f90f3a-9ab9-4b14-b561-a3b24da13adc tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "POST /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906/action" status: 200 len: 32 microversion: 2.1 time: 0.197991 Oct 31 14:29:30.907511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2725/5193] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:29:30 2022] POST /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:29:30.923089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:30.930047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:30.945638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:30.946567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:30.947255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:30.948221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:30.949039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:30.949695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:31.270069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:31.280518 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aeaa079e-0747-4987-9bfb-a06978135c9a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.367016 Oct 31 14:29:31.299276 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2469/5194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:30 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:32.308664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:32.309296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:32.323693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:32.324211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:32.324657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:32.325374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:32.325845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:32.326355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:33.399132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:33.420371 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40464bb9-bfac-4315-a16f-58e4e63b8fed tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 1.115937 Oct 31 14:29:33.421060 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2726/5195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:32 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:34.125796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e3100fb1-9e94-48c4-8a09-1d41f0424f9f req-9567edfb-e836-4fd8-93c2-22de20139d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf76455-be9a-486a-9d38-8396622560f3", "tag": "6b816bfc-a8a6-46e9-bc0d-44e1c057013b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:34.151804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e3100fb1-9e94-48c4-8a09-1d41f0424f9f req-9567edfb-e836-4fd8-93c2-22de20139d25 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:34.153053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e3100fb1-9e94-48c4-8a09-1d41f0424f9f req-9567edfb-e836-4fd8-93c2-22de20139d25 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:34.153714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e3100fb1-9e94-48c4-8a09-1d41f0424f9f req-9567edfb-e836-4fd8-93c2-22de20139d25 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:34.178478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e3100fb1-9e94-48c4-8a09-1d41f0424f9f req-9567edfb-e836-4fd8-93c2-22de20139d25 service nova] Creating event network-changed:6b816bfc-a8a6-46e9-bc0d-44e1c057013b for instance 3bf76455-be9a-486a-9d38-8396622560f3 on n-h2-863052-1 Oct 31 14:29:34.184184 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e3100fb1-9e94-48c4-8a09-1d41f0424f9f req-9567edfb-e836-4fd8-93c2-22de20139d25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064677 Oct 31 14:29:34.185934 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2470/5196] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:34.448288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:34.449016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:34.459695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:34.462869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:34.463425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:34.464521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:34.467589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:34.468267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:34.907630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:34.930230 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98362bb7-578f-4462-9054-fd73818c0aa4 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.487032 Oct 31 14:29:34.931083 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2727/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:34 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:35.960088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:35.961859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:35.976089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:35.977014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:35.977899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:35.978927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:35.980063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:35.981258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:36.460998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:36.471510 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b877baa4-aef4-4cb2-9e35-6522141a45b5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.517206 Oct 31 14:29:36.472958 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2471/5198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:35 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:37.503747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:37.504903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:37.524125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:37.526120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:37.526755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:37.530407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:37.531280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:37.532175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:37.938868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:37.956794 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6f97672-f4e4-4e29-8503-aefc3ae004ac tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.457775 Oct 31 14:29:37.957637 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2728/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:37 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:38.984342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:38.984969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:38.993365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:39.003755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:39.007553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:39.012002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:39.013062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:39.014436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:39.071702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:40.085261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:40.097742 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16adabb5-a421-49fd-a0bc-58e41701fcec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 1.116967 Oct 31 14:29:40.103142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2472/5200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:38 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:41.128453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:41.129067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:41.137556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:41.142745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:41.144635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:41.145551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:41.148100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:41.150765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:41.518072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:41.533048 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1503c6e7-daed-4d63-91a3-69609531b7da tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.407433 Oct 31 14:29:41.536389 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2729/5201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:41 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:42.562882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:42.564149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:42.571657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:42.572241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:42.572923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:42.573725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:42.574793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:42.575473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:42.930669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:42.940704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3488ebd-5cce-4d9f-a331-3d7e9964878e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.382190 Oct 31 14:29:42.959788 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2473/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:42 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:43.971209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:43.972382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:43.985350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:43.986737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:43.987423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:43.988338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:43.989107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:43.989931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:44.465921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:44.483029 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-637146ae-9668-45ba-a958-9fb7d107cd97 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.517399 Oct 31 14:29:44.500769 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2730/5203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:43 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:45.507958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:45.508572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:45.519243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:45.533023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:45.534004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:45.546095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:45.546865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:45.547467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:46.073737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:46.088798 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1b51bb2b-bb29-4a82-b0b6-7a6977b8a626 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.585624 Oct 31 14:29:46.102538 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2474/5204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:45 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:47.121698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:47.122562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:47.125538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=38 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:47.140634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:47.148757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:47.149283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:47.151575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:47.152876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:47.154235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:48.381301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f990afa6-6e47-41b6-b54d-470d79042504 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Action: 'create', calling method: .version_select at 0x7fe1068f7670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1639302903", "policies": ["affinity"]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:48.409658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f990afa6-6e47-41b6-b54d-470d79042504 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:48.422650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f990afa6-6e47-41b6-b54d-470d79042504 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:48.485138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:48.514017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dddda21c-9e35-49e0-8ce8-66be271a6887 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 1.399530 Oct 31 14:29:48.515298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2731/5205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:47 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:48.521040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f990afa6-6e47-41b6-b54d-470d79042504 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:48.526943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f990afa6-6e47-41b6-b54d-470d79042504 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:48.541674 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f990afa6-6e47-41b6-b54d-470d79042504 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.376383 Oct 31 14:29:48.542922 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2475/5206] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 31 14:29:48 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:29:48.556952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca72d678-9eec-4d64-a60e-73568ad3ab95 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Action: 'create', calling method: .version_select at 0x7fe106233d30>, body: {"server_group": {"name": "tempest-server-group-1855610329", "policies": ["affinity"]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:48.581699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-ca72d678-9eec-4d64-a60e-73568ad3ab95 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:48.588369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-ca72d678-9eec-4d64-a60e-73568ad3ab95 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:48.647514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-ca72d678-9eec-4d64-a60e-73568ad3ab95 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:48.655338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-ca72d678-9eec-4d64-a60e-73568ad3ab95 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:48.676123 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca72d678-9eec-4d64-a60e-73568ad3ab95 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.124792 Oct 31 14:29:48.677111 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2732/5207] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 31 14:29:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:29:48.687690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6098d691-eda3-49d0-a041-6e759410918f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Action: 'create', calling method: .version_select at 0x7fe10757af70>, body: {"server_group": {"name": "tempest-server-group-1855610329", "policies": ["affinity"]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:48.721735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6098d691-eda3-49d0-a041-6e759410918f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:48.730425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6098d691-eda3-49d0-a041-6e759410918f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:48.792484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6098d691-eda3-49d0-a041-6e759410918f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:48.800691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6098d691-eda3-49d0-a041-6e759410918f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:48.817927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6098d691-eda3-49d0-a041-6e759410918f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.134011 Oct 31 14:29:48.825762 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2476/5208] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 31 14:29:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:48.833197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b868d6e9-bd8f-4553-af24-cb5d848ba031 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:48.875003 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b868d6e9-bd8f-4553-af24-cb5d848ba031 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/70598d3d-08f2-4b25-bde7-d6df06c6f15c" status: 204 len: 0 microversion: 2.1 time: 0.047936 Oct 31 14:29:48.876448 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2733/5209] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:29:48 2022] DELETE /compute/v2.1/os-server-groups/70598d3d-08f2-4b25-bde7-d6df06c6f15c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:29:48.884487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b098b10-43f8-484c-ada4-5fa8d187d1d8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:48.902277 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b098b10-43f8-484c-ada4-5fa8d187d1d8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.021514 Oct 31 14:29:48.914640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aae953f8-c4a7-46ef-a2cd-1ac02d4cb029 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:48.918196 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2477/5210] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:29:48 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:48.953697 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aae953f8-c4a7-46ef-a2cd-1ac02d4cb029 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/71c27296-e2db-4b94-a237-6f3124fa0176" status: 204 len: 0 microversion: 2.1 time: 0.043443 Oct 31 14:29:48.954948 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2734/5211] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:29:48 2022] DELETE /compute/v2.1/os-server-groups/71c27296-e2db-4b94-a237-6f3124fa0176 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:29:48.963104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dcfd5509-3c17-44f2-817d-baedff468a46 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:48.974502 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dcfd5509-3c17-44f2-817d-baedff468a46 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.015195 Oct 31 14:29:48.983838 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2478/5212] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:29:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:48.988423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdc59665-6c48-4833-b904-3b7325ba39bb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Action: 'create', calling method: .version_select at 0x7fe10623d790>, body: {"server_group": {"name": "tempest-server-group-1733662436", "policies": ["affinity"]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:49.021715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fdc59665-6c48-4833-b904-3b7325ba39bb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:49.027993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fdc59665-6c48-4833-b904-3b7325ba39bb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:49.080385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fdc59665-6c48-4833-b904-3b7325ba39bb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:49.085975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fdc59665-6c48-4833-b904-3b7325ba39bb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:49.100077 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdc59665-6c48-4833-b904-3b7325ba39bb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.116073 Oct 31 14:29:49.101442 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2735/5213] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 31 14:29:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:49.111939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-821d7179-b57d-43bd-bf15-248100f19edc tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:49.174075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-821d7179-b57d-43bd-bf15-248100f19edc tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/94211cbb-fbf5-47f8-8a80-34152df92993" status: 204 len: 0 microversion: 2.1 time: 0.065835 Oct 31 14:29:49.178023 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2479/5214] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:29:49 2022] DELETE /compute/v2.1/os-server-groups/94211cbb-fbf5-47f8-8a80-34152df92993 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:29:49.183229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fc7794e-9722-4f95-99a6-342d654e6819 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:49.219728 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9fc7794e-9722-4f95-99a6-342d654e6819 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035318 Oct 31 14:29:49.232282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ded24ae-b418-4bc9-822a-3d2f414a2bba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Action: 'create', calling method: .version_select at 0x7fe107a19700>, body: {"server_group": {"name": "tempest-server-group-901093105", "policies": ["anti-affinity"]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:49.240667 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2736/5215] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:29:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:29:49.268717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7ded24ae-b418-4bc9-822a-3d2f414a2bba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:49.286550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7ded24ae-b418-4bc9-822a-3d2f414a2bba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:49.340583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:49.392655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7ded24ae-b418-4bc9-822a-3d2f414a2bba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:49.400838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7ded24ae-b418-4bc9-822a-3d2f414a2bba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_groups'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:49.430754 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ded24ae-b418-4bc9-822a-3d2f414a2bba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.202428 Oct 31 14:29:49.433516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2480/5216] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 31 14:29:49 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:49.443818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-217e94fc-cae4-4fe7-9b8e-08bc8e63c2d1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:49.485501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-217e94fc-cae4-4fe7-9b8e-08bc8e63c2d1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/05a8e3ea-c8ce-4cab-a666-5d017dfec10e" status: 204 len: 0 microversion: 2.1 time: 0.045589 Oct 31 14:29:49.490010 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2737/5217] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:29:49 2022] DELETE /compute/v2.1/os-server-groups/05a8e3ea-c8ce-4cab-a666-5d017dfec10e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:29:49.496007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5df1a855-b862-4cb6-be42-aa53c6d2047e tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:49.529781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5df1a855-b862-4cb6-be42-aa53c6d2047e tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020943 Oct 31 14:29:49.531815 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2481/5218] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:29:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:29:49.542550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:49.543424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:49.562007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:49.563333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:49.563962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:49.565531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:49.566822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:49.568351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:49.620719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-292585741", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "1ae9af3b-163c-4f9d-af66-051e22d215e7"}]}, "os:scheduler_hints": {"group": "ca616fb6-b203-4ceb-ab10-88c897a97190"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:49.712320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] validate_networks() for [('1ae9af3b-163c-4f9d-af66-051e22d215e7', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:29:49.975475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:49.985274 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ac2cdac-31fc-4b5b-b316-f416f7c65490 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.446820 Oct 31 14:29:49.986230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2738/5219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:49 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:50.926190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:29:50.927282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:29:50.928251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:29:50.929581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:29:50.930222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:29:50.980662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:50.981175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:50.982286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:50.985672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:50.986156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:50.986621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:51.011415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:51.012037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:51.025119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:51.029618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:51.030707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:51.035742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:51.036992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:51.037598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:51.062828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:51.079552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:51.126866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:29:51.141083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:29:51.271224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:51.284944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:51.393934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for project 8e968114190342e587921572e39899ff. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:29:51.408226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Getting quotas for user 3e3e45369619497396ac32526d422abb and project 8e968114190342e587921572e39899ff. Resources: {'server_group_members'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:29:51.518704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb9fd614-2095-452f-b56f-787782224e56 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901635 Oct 31 14:29:51.524446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2482/5220] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:29:51.553986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:51.567112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c90bad25-d4c2-45ec-8a9e-603241e47dba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:51.568452 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fe734d4-0975-4d0c-86e4-8957c303a09f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.560820 Oct 31 14:29:51.577387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c90bad25-d4c2-45ec-8a9e-603241e47dba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:51.583222 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2739/5221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:51 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:51.823966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c90bad25-d4c2-45ec-8a9e-603241e47dba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:51.833423 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c90bad25-d4c2-45ec-8a9e-603241e47dba tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1212 microversion: 2.1 time: 0.298262 Oct 31 14:29:51.834020 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2483/5222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:51 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1212 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:52.594969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:52.595591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:52.612552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:52.613070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:52.613527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:52.630628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:52.631285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:52.640549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:52.862297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:52.862916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:52.876816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:52.877323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:52.877764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:52.880742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:52.884231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:52.884954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:53.093320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:53.137737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e417661d-b427-4889-97f3-76bcbe61696b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.539757 Oct 31 14:29:53.138787 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2740/5223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:52 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:53.218661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:53.239176 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-11ed4ad1-37f1-48da-8f21-d345bdfb788f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1216 microversion: 2.1 time: 0.381775 Oct 31 14:29:53.250516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2484/5224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:52 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1216 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:54.165971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:54.166770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:54.182040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:54.187716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:54.188669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:54.188953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:54.189430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:54.189886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:54.275000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:54.275000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:54.288618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:54.289122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:54.292300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:54.293100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:54.293586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:54.294472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:54.491783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:54.505561 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5dc04847-6429-4e2a-b032-9b9d62da9980 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1270 microversion: 2.1 time: 0.237348 Oct 31 14:29:54.514215 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2485/5225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:54 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:54.521373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:54.538650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb10bdda-ca9a-4fb5-a613-d1dcd7f33d6c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.378800 Oct 31 14:29:54.561952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2741/5226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:54 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:55.533333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:55.534729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:55.547174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:55.548133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:55.548797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:55.549739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:55.550494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:55.551141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:55.570370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:55.571831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:55.592783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:55.593485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:55.594180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:55.595111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:55.596348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:55.599288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:55.999260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:56.015269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-87b61340-ceac-4bff-837b-e92ccc87e45b tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.486984 Oct 31 14:29:56.023398 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2486/5227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:55 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:56.206896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:56.220250 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d263e459-695f-4fe3-87fc-f9ec4d7562a3 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.652822 Oct 31 14:29:56.224333 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2742/5228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:55 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:29:57.055768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:57.060648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:57.076728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:57.079498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:57.080864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:57.083459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:57.084735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:57.085986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:57.254622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:57.257157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:57.269417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:57.274339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:57.278887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:57.280557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:57.283915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:57.312327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:57.505315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:57.516736 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f453dadd-2628-498f-9a79-4224e1a5202c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.475118 Oct 31 14:29:57.517330 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2487/5229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:57 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:57.574080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-77fa4a60-cffc-41bc-bf3b-0016ca82cb13 req-0eafb13e-3782-4a7f-bcc3-990220105401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11303bb6-0783-477b-8d3e-5b248d613a85", "tag": "c80e9462-b392-4f7a-a241-de5ecc04b11d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:29:57.599765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-77fa4a60-cffc-41bc-bf3b-0016ca82cb13 req-0eafb13e-3782-4a7f-bcc3-990220105401 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:57.600770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-77fa4a60-cffc-41bc-bf3b-0016ca82cb13 req-0eafb13e-3782-4a7f-bcc3-990220105401 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:57.601465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-77fa4a60-cffc-41bc-bf3b-0016ca82cb13 req-0eafb13e-3782-4a7f-bcc3-990220105401 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:57.628986 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-77fa4a60-cffc-41bc-bf3b-0016ca82cb13 req-0eafb13e-3782-4a7f-bcc3-990220105401 service nova] Creating event network-changed:c80e9462-b392-4f7a-a241-de5ecc04b11d for instance 11303bb6-0783-477b-8d3e-5b248d613a85 on n-h1-863052-1 Oct 31 14:29:57.635278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-77fa4a60-cffc-41bc-bf3b-0016ca82cb13 req-0eafb13e-3782-4a7f-bcc3-990220105401 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070184 Oct 31 14:29:57.636362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2488/5230] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:29:57.736876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:57.752185 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70eccf81-4223-4ec3-8cf5-fc528a94aa39 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.506492 Oct 31 14:29:57.753092 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2743/5231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:57 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:58.545447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:58.546353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:58.557765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:58.558397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:58.560298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:58.561467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:58.562129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:58.562793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:58.773779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:58.780013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:58.780634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:58.782919 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d768f7f-c100-498f-b0b0-fc5ce49e98b4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.247170 Oct 31 14:29:58.784927 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2489/5232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:58 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:58.788050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:58.790269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:58.791787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:58.792510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:58.792964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:58.793391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:58.959253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:29:58.967682 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-740978af-85e9-43cf-8bce-e1bbf45accd5 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.194727 Oct 31 14:29:58.968634 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2744/5233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:58 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:29:59.819713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:59.820350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:59.835796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:59.836508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:59.836990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:59.837740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:29:59.838230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:29:59.846188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:29:59.991898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:29:59.992801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:29:59.994907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:00.005970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:00.006502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:00.009628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:00.010422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:00.017935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:00.028437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:00.029917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a684f83-0c61-4013-9cbb-59125ebb7224 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.214600 Oct 31 14:30:00.030511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:00.033179 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2490/5234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:59 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:00.244019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:00.253785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b6b946c-a376-4a23-8555-d124affce06f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.266324 Oct 31 14:30:00.254788 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2745/5235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:29:59 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:01.057411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:01.059422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:01.069137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:01.072271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:01.072963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:01.073420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:01.074144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:01.075371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:01.075811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:01.277302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:01.278471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:01.286317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:01.287154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:01.287893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:01.289914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:01.290891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:01.292036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:01.305747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:01.451202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:01.480789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8663e207-86ab-4823-ab90-7faaf084a1fd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.423504 Oct 31 14:30:01.482802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2491/5236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:01 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:01.551981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:01.566277 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5164175-eeb6-475b-bd10-10fc952e475d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1505 microversion: 2.1 time: 0.292927 Oct 31 14:30:01.569143 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2746/5237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:01 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:02.505034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:02.505655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:02.507568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=40 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:02.513733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:02.514240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:02.514688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:02.515390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:02.515843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:02.516436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:02.593057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:02.594237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:02.597522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:02.603236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:02.603954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:02.604576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:02.605618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:02.607103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:02.607346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:02.768303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:02.780454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6e7d995-9b54-4dba-b327-5ddf4aa8fdd1 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.279242 Oct 31 14:30:02.781695 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2492/5238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:02 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:02.865635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:02.875589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87d67d7d-b547-4c97-9a62-d1b18658ba22 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1485 microversion: 2.1 time: 0.286712 Oct 31 14:30:02.894586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2747/5239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:02 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1485 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:03.011088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-593529231", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:03.101321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] validate_networks() for [('e276973d-883f-4e45-af10-726a6220780f', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:30:03.344969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-61e5a60b-0914-4982-b19e-a0513b5833ba req-9feb854a-b3ba-45ca-8de6-63bfbd8c2b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11303bb6-0783-477b-8d3e-5b248d613a85", "name": "network-vif-plugged", "status": "completed", "tag": "c80e9462-b392-4f7a-a241-de5ecc04b11d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:03.365747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-61e5a60b-0914-4982-b19e-a0513b5833ba req-9feb854a-b3ba-45ca-8de6-63bfbd8c2b24 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:03.367338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-61e5a60b-0914-4982-b19e-a0513b5833ba req-9feb854a-b3ba-45ca-8de6-63bfbd8c2b24 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:03.367789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-61e5a60b-0914-4982-b19e-a0513b5833ba req-9feb854a-b3ba-45ca-8de6-63bfbd8c2b24 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:03.380675 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-61e5a60b-0914-4982-b19e-a0513b5833ba req-9feb854a-b3ba-45ca-8de6-63bfbd8c2b24 service nova] Creating event network-vif-plugged:c80e9462-b392-4f7a-a241-de5ecc04b11d for instance 11303bb6-0783-477b-8d3e-5b248d613a85 on n-h1-863052-1 Oct 31 14:30:03.396099 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-61e5a60b-0914-4982-b19e-a0513b5833ba req-9feb854a-b3ba-45ca-8de6-63bfbd8c2b24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056064 Oct 31 14:30:03.396892 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2748/5240] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:03.805577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:03.806480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:03.825528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:03.827467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:03.829573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:03.831713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:03.833489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:03.834024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:03.891198 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0006a3cb-2ba4-43a5-ae4f-ec4efbf706a9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.092557 Oct 31 14:30:03.891800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2749/5241] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:30:03 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:03.914527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:03.915141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:03.929708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:03.930238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:03.930679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:03.932821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:03.936688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:03.937263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:04.063499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:30:04.065200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:30:04.065200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:30:04.065200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:30:04.072153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:30:04.110613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:04.111596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:04.112262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:04.114153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:04.115875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:04.116527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:04.140055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Getting quotas for project f3b6cb0bce2e434faa4f2256965b22bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:30:04.160389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Getting quotas for user e777fb43bd264183a1b3ea4016b26302 and project f3b6cb0bce2e434faa4f2256965b22bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:30:04.165503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:30:04.169536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:30:04.247738 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-beb11f19-1927-4d1d-b615-7068176c34bd tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.239959 Oct 31 14:30:04.256184 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2493/5242] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:30:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:30:04.263302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fcdd5aa6-fd34-48da-8b78-0fd60af3676a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:04.264988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fcdd5aa6-fd34-48da-8b78-0fd60af3676a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:04.402023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcdd5aa6-fd34-48da-8b78-0fd60af3676a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:04.416683 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fcdd5aa6-fd34-48da-8b78-0fd60af3676a tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1213 microversion: 2.1 time: 0.157389 Oct 31 14:30:04.431001 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2494/5243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:04 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:04.787079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:04.795999 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de510cdd-b533-4988-ab4d-1c316e25decd tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1312 microversion: 2.1 time: 0.890680 Oct 31 14:30:04.802790 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2750/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:03 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1312 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:05.471576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:05.473176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:05.477037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:05.498888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:05.500088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:05.500941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:05.501670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:05.503944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:05.506107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:05.668005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:05.690268 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43a6affe-f34a-4427-98bb-5ff321688ded tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1265 microversion: 2.1 time: 0.239666 Oct 31 14:30:05.693012 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2495/5245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:05 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:05.820503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:05.821882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:05.839915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:05.845313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:05.845843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:05.846731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:05.847205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:05.850118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.159591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:06.174543 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2815f47e-2eef-4b14-bcb3-a6f620bedfb9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1497 microversion: 2.1 time: 0.357935 Oct 31 14:30:06.175804 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2751/5246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:05 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1497 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:06.197425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d6a9a4b-73a7-4664-9066-9c1516a72fc8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:06.240372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.server_groups [None req-1d6a9a4b-73a7-4664-9066-9c1516a72fc8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Querying cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) for 1 instances {{(pid=120641) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 14:30:06.245448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d6a9a4b-73a7-4664-9066-9c1516a72fc8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.248984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d6a9a4b-73a7-4664-9066-9c1516a72fc8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.249444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d6a9a4b-73a7-4664-9066-9c1516a72fc8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.349186 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d6a9a4b-73a7-4664-9066-9c1516a72fc8 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ca616fb6-b203-4ceb-ab10-88c897a97190" status: 200 len: 222 microversion: 2.1 time: 0.155778 Oct 31 14:30:06.357370 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2496/5247] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:30:06 2022] GET /compute/v2.1/os-server-groups/ca616fb6-b203-4ceb-ab10-88c897a97190 => generated 222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:06.361567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:06.362072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:06.380666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.381168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.381611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.383008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.383511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.384153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.426461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:30:06.571718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-997be484-2788-4d1b-8a00-6062ab20d849 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 204 len: 0 microversion: 2.1 time: 0.209519 Oct 31 14:30:06.572344 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2752/5248] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:30:06 2022] DELETE /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:30:06.580736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:06.582016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:06.596027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.596786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.597473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.600827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.601492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.602230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.657504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:06.661535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:06.682246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.682246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.682246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:06.682246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:06.682246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:06.682246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:07.264368 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70efadac-a931-4fbe-bb0b-e65c2a1d8d68 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609595 Oct 31 14:30:07.267286 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2753/5249] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:30:06 2022] POST /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:30:07.282531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:07.284908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:07.311150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:07.315351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:07.316120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:07.319420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:07.322546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:07.338519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:07.359246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:07.395961 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17efbbdb-5c14-401e-9733-fba30ecf18b7 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1503 microversion: 2.1 time: 0.819019 Oct 31 14:30:07.399795 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2497/5250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:06 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1503 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:07.741360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:07.751928 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02909fa5-5ff8-430e-8fdc-f6632f1696fa tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.481786 Oct 31 14:30:07.752754 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2754/5251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:07 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:08.426121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:08.427558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:08.446418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:08.447148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:08.448180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:08.449437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:08.450740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:08.451369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:08.777278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:08.779550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:08.800532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:08.808361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:08.810005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:08.815296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:08.815904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:08.816371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:08.817188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:08.825885 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a391844b-d1ee-44bb-9e08-35435bf10fe9 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1503 microversion: 2.1 time: 0.407903 Oct 31 14:30:08.836538 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2498/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:08 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:09.397091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:09.415157 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86cf0e44-9109-41b9-89a6-fe9556ba1987 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.641607 Oct 31 14:30:09.427625 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2755/5253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:08 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:09.441064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-537040d7-5501-4bea-a483-e17c3dd0ec47 req-f5b220c7-bae4-45c9-bf59-5ff722061f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11303bb6-0783-477b-8d3e-5b248d613a85", "name": "network-vif-deleted", "tag": "c80e9462-b392-4f7a-a241-de5ecc04b11d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:09.454896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-537040d7-5501-4bea-a483-e17c3dd0ec47 req-f5b220c7-bae4-45c9-bf59-5ff722061f8f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:09.455583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-537040d7-5501-4bea-a483-e17c3dd0ec47 req-f5b220c7-bae4-45c9-bf59-5ff722061f8f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:09.456097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-537040d7-5501-4bea-a483-e17c3dd0ec47 req-f5b220c7-bae4-45c9-bf59-5ff722061f8f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:09.469021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=92 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:09.471528 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-537040d7-5501-4bea-a483-e17c3dd0ec47 req-f5b220c7-bae4-45c9-bf59-5ff722061f8f service nova] Creating event network-vif-deleted:c80e9462-b392-4f7a-a241-de5ecc04b11d for instance 11303bb6-0783-477b-8d3e-5b248d613a85 on n-h1-863052-1 Oct 31 14:30:09.485349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-537040d7-5501-4bea-a483-e17c3dd0ec47 req-f5b220c7-bae4-45c9-bf59-5ff722061f8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055604 Oct 31 14:30:09.486215 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2499/5254] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 31 14:30:09.764304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4bd25c60-b7dd-4df6-be84-1a131c4e7607 req-cd09ac5a-310f-478c-8b3b-22523955b4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80", "tag": "30ede8d4-5414-422c-b610-09890dc63544"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:09.793487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4bd25c60-b7dd-4df6-be84-1a131c4e7607 req-cd09ac5a-310f-478c-8b3b-22523955b4bd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:09.794780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4bd25c60-b7dd-4df6-be84-1a131c4e7607 req-cd09ac5a-310f-478c-8b3b-22523955b4bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:09.795397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4bd25c60-b7dd-4df6-be84-1a131c4e7607 req-cd09ac5a-310f-478c-8b3b-22523955b4bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:09.811070 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4bd25c60-b7dd-4df6-be84-1a131c4e7607 req-cd09ac5a-310f-478c-8b3b-22523955b4bd service nova] Creating event network-changed:30ede8d4-5414-422c-b610-09890dc63544 for instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 on n-h1-863052-1 Oct 31 14:30:09.816686 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4bd25c60-b7dd-4df6-be84-1a131c4e7607 req-cd09ac5a-310f-478c-8b3b-22523955b4bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063551 Oct 31 14:30:09.819009 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2756/5255] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:09.865575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:09.866334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:09.878883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:09.880385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:09.880987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:09.882131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:09.882773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:09.883366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:09.973858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:09.974648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:09.975230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:09.975843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lazy-loading 'fault' on Instance uuid 11303bb6-0783-477b-8d3e-5b248d613a85 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:30:10.051237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3e45369619497396ac32526d422abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e968114190342e587921572e39899ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:10.066878 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-118da4e9-92c9-4408-a73d-152cd1ec2d3f tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 200 len: 1302 microversion: 2.1 time: 0.205772 Oct 31 14:30:10.073696 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2500/5256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:09 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 1302 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:10.441899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:10.442636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:10.460342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:10.460846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:10.462074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:10.463456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:10.463930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:10.464439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:10.713268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:10.733959 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9fc346f2-7a61-43b1-8a20-72fe8e7c5759 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.295262 Oct 31 14:30:10.739055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2757/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:10 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:11.091187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.091825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:11.105123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.105678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.106134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.106892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.107357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.107795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.170659 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 HTTP/1.1 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '11303bb6-0783-477b-8d3e-5b248d613a85'} Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.172699 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.177114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.178257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.179264 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebb3ee55-6b76-4b81-885c-ecb3601357ac tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 404 len: 111 microversion: 2.1 time: 0.092268 Oct 31 14:30:11.180306 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2501/5258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:11 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:30:11.196052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70cc6f52-e640-4b7c-a0a8-e80ad115e88c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.227948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_groups [None req-70cc6f52-e640-4b7c-a0a8-e80ad115e88c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Querying cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) for 1 instances {{(pid=120640) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 14:30:11.234629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cc6f52-e640-4b7c-a0a8-e80ad115e88c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.235230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cc6f52-e640-4b7c-a0a8-e80ad115e88c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.236257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cc6f52-e640-4b7c-a0a8-e80ad115e88c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.266357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70cc6f52-e640-4b7c-a0a8-e80ad115e88c tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.073976 Oct 31 14:30:11.273650 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2758/5259] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:30:11 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:11.279394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9e2ce74-3599-4c66-bd25-e2b2ac545396 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.312500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.server_groups [None req-e9e2ce74-3599-4c66-bd25-e2b2ac545396 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Querying cell eeb84869-0594-4d8b-b4ff-3179511445e7(cell1) for 1 instances {{(pid=120641) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 14:30:11.313478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e2ce74-3599-4c66-bd25-e2b2ac545396 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.314152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e2ce74-3599-4c66-bd25-e2b2ac545396 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.314796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e2ce74-3599-4c66-bd25-e2b2ac545396 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.343898 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9e2ce74-3599-4c66-bd25-e2b2ac545396 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ca616fb6-b203-4ceb-ab10-88c897a97190" status: 200 len: 184 microversion: 2.1 time: 0.068637 Oct 31 14:30:11.351273 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2502/5260] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 31 14:30:11 2022] GET /compute/v2.1/os-server-groups/ca616fb6-b203-4ceb-ab10-88c897a97190 => generated 184 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:11.360497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.361100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:11.386294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.392180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.396064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.398971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.402969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.404166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.457662 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 HTTP/1.1 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '11303bb6-0783-477b-8d3e-5b248d613a85'} Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:30:11.460330 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.464658 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.477349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.478541 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c2228ac-1580-4bda-9092-078711a07216 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 404 len: 111 microversion: 2.1 time: 0.122640 Oct 31 14:30:11.482451 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2759/5261] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:30:11 2022] DELETE /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:30:11.488814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.490121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] [instance: 11303bb6-0783-477b-8d3e-5b248d613a85] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:11.503763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.506873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.507755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.509002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.510705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.512736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.553752 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 HTTP/1.1 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '11303bb6-0783-477b-8d3e-5b248d613a85'} Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.559701 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. Oct 31 14:30:11.564438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.567485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance 11303bb6-0783-477b-8d3e-5b248d613a85 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.571221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52986ee6-508e-4d3d-93bf-9822c82b7e98 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85" status: 404 len: 111 microversion: 2.1 time: 0.087293 Oct 31 14:30:11.576194 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2503/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:11 2022] GET /compute/v2.1/servers/11303bb6-0783-477b-8d3e-5b248d613a85 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:30:11.588039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9eb6384c-cd79-4950-b9b2-1cfc0a2a83d3 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.616007 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9eb6384c-cd79-4950-b9b2-1cfc0a2a83d3 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance group 05a8e3ea-c8ce-4cab-a666-5d017dfec10e could not be found. Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9eb6384c-cd79-4950-b9b2-1cfc0a2a83d3 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-server-groups/05a8e3ea-c8ce-4cab-a666-5d017dfec10e HTTP/1.1 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance group 05a8e3ea-c8ce-4cab-a666-5d017dfec10e could not be found. Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '05a8e3ea-c8ce-4cab-a666-5d017dfec10e'} Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 05a8e3ea-c8ce-4cab-a666-5d017dfec10e could not be found. Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 05a8e3ea-c8ce-4cab-a666-5d017dfec10e could not be found. Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.623522 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 05a8e3ea-c8ce-4cab-a666-5d017dfec10e could not be found. Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9eb6384c-cd79-4950-b9b2-1cfc0a2a83d3 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance group 05a8e3ea-c8ce-4cab-a666-5d017dfec10e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.627434 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9eb6384c-cd79-4950-b9b2-1cfc0a2a83d3 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/05a8e3ea-c8ce-4cab-a666-5d017dfec10e" status: 404 len: 117 microversion: 2.1 time: 0.049108 Oct 31 14:30:11.630988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2760/5263] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:30:11 2022] DELETE /compute/v2.1/os-server-groups/05a8e3ea-c8ce-4cab-a666-5d017dfec10e => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:30:11.634637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5ae0950-0d05-47e5-933f-fd7b927bf0d4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.650547 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a5ae0950-0d05-47e5-933f-fd7b927bf0d4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance group 94211cbb-fbf5-47f8-8a80-34152df92993 could not be found. Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5ae0950-0d05-47e5-933f-fd7b927bf0d4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-server-groups/94211cbb-fbf5-47f8-8a80-34152df92993 HTTP/1.1 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance group 94211cbb-fbf5-47f8-8a80-34152df92993 could not be found. Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '94211cbb-fbf5-47f8-8a80-34152df92993'} Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 94211cbb-fbf5-47f8-8a80-34152df92993 could not be found. Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 94211cbb-fbf5-47f8-8a80-34152df92993 could not be found. Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.653085 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 94211cbb-fbf5-47f8-8a80-34152df92993 could not be found. Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5ae0950-0d05-47e5-933f-fd7b927bf0d4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance group 94211cbb-fbf5-47f8-8a80-34152df92993 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5ae0950-0d05-47e5-933f-fd7b927bf0d4 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/94211cbb-fbf5-47f8-8a80-34152df92993" status: 404 len: 117 microversion: 2.1 time: 0.023468 Oct 31 14:30:11.661335 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2504/5264] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:30:11 2022] DELETE /compute/v2.1/os-server-groups/94211cbb-fbf5-47f8-8a80-34152df92993 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:30:11.697622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0af5c0bf-82e5-42ce-8049-c760fb935646 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.718197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0af5c0bf-82e5-42ce-8049-c760fb935646 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance group 71c27296-e2db-4b94-a237-6f3124fa0176 could not be found. Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0af5c0bf-82e5-42ce-8049-c760fb935646 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-server-groups/71c27296-e2db-4b94-a237-6f3124fa0176 HTTP/1.1 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance group 71c27296-e2db-4b94-a237-6f3124fa0176 could not be found. Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '71c27296-e2db-4b94-a237-6f3124fa0176'} Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 71c27296-e2db-4b94-a237-6f3124fa0176 could not be found. Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 71c27296-e2db-4b94-a237-6f3124fa0176 could not be found. Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.721627 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.726766 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.726766 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.726766 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.726766 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.726766 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 71c27296-e2db-4b94-a237-6f3124fa0176 could not be found. Oct 31 14:30:11.726766 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.733968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0af5c0bf-82e5-42ce-8049-c760fb935646 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance group 71c27296-e2db-4b94-a237-6f3124fa0176 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.736731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0af5c0bf-82e5-42ce-8049-c760fb935646 tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/71c27296-e2db-4b94-a237-6f3124fa0176" status: 404 len: 117 microversion: 2.1 time: 0.072786 Oct 31 14:30:11.749547 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2761/5265] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:30:11 2022] DELETE /compute/v2.1/os-server-groups/71c27296-e2db-4b94-a237-6f3124fa0176 => generated 117 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:30:11.753502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e32b2fe5-2031-4894-b945-daf96d858bdb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.772278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e32b2fe5-2031-4894-b945-daf96d858bdb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] HTTP exception thrown: Instance group 70598d3d-08f2-4b25-bde7-d6df06c6f15c could not be found. Oct 31 14:30:11.773302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.774263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e32b2fe5-2031-4894-b945-daf96d858bdb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Request method failure captured: Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-server-groups/70598d3d-08f2-4b25-bde7-d6df06c6f15c HTTP/1.1 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9vbT9RLTnkcdWh69MMa9bt3fmqov2kYxg8fT6KSR-t7o6uxMHTXrXtcxJrh7XR0SLnuHToFrEQ87-4UFFIgfhcUny_14J2nvAD8FOSCEuc7Oy9D7-uPzo9GWaJzGOanYpDjm2hlHgFnTogiZOIKOyfMbVIgQfMucIH_XM9SsLvWgFU Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e968114190342e587921572e39899ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e968114190342e587921572e39899ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e968114190342e587921572e39899ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 8e968114190342e587921572e39899ff Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerGroupTestJSON-1479469015 Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3e3e45369619497396ac32526d422abb Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerGroupTestJSON-1479469015-project Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance group 70598d3d-08f2-4b25-bde7-d6df06c6f15c could not be found. Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '70598d3d-08f2-4b25-bde7-d6df06c6f15c'} Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 70598d3d-08f2-4b25-bde7-d6df06c6f15c could not be found. Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 70598d3d-08f2-4b25-bde7-d6df06c6f15c could not be found. Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.786956 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:11.792043 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:11.792043 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:11.792043 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:11.792043 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:11.792043 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 70598d3d-08f2-4b25-bde7-d6df06c6f15c could not be found. Oct 31 14:30:11.792043 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:11.798874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e32b2fe5-2031-4894-b945-daf96d858bdb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Returning 404 to user: Instance group 70598d3d-08f2-4b25-bde7-d6df06c6f15c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:11.801186 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e32b2fe5-2031-4894-b945-daf96d858bdb tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/70598d3d-08f2-4b25-bde7-d6df06c6f15c" status: 404 len: 117 microversion: 2.1 time: 0.053031 Oct 31 14:30:11.803288 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2505/5266] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:30:11 2022] DELETE /compute/v2.1/os-server-groups/70598d3d-08f2-4b25-bde7-d6df06c6f15c => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:30:11.814604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.816424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.821118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.823090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:11.824179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:11.825364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:11.825948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-668f38a0-217c-496c-87a3-0036e6e4555e tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:11.949422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-668f38a0-217c-496c-87a3-0036e6e4555e tempest-ServerGroupTestJSON-1479469015 tempest-ServerGroupTestJSON-1479469015-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ca616fb6-b203-4ceb-ab10-88c897a97190" status: 204 len: 0 microversion: 2.1 time: 0.136733 Oct 31 14:30:11.956620 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2506/5267] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:30:11 2022] DELETE /compute/v2.1/os-server-groups/ca616fb6-b203-4ceb-ab10-88c897a97190 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:30:12.646034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:12.660921 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c380754e-8994-4b8d-8f9e-7ad1a04ee030 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.899899 Oct 31 14:30:12.682574 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2762/5268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:11 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:13.706229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:13.706843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:13.763887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:13.764894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:13.772340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:13.803256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:13.803976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:13.815325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:14.128471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:14.332894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:14.344427 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b2e69b8-3da6-4e52-9b24-c6e08227f554 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.653042 Oct 31 14:30:14.345063 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2507/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:13 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:15.377301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:15.380144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:15.404827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:15.405575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:15.406402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:15.407505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:15.410964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:15.411650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:15.984699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:15.995222 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cafbefde-1474-46d6-99e8-2e107f7088e8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.626034 Oct 31 14:30:15.995828 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2763/5270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:15 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:17.026758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:17.027918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:17.030117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:17.049941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:17.050685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:17.051297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:17.052220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:17.055944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:17.056838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:17.556502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:17.566803 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe999e07-e193-4d70-8638-e3561adf2b8f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.544340 Oct 31 14:30:17.567403 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2508/5271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:17 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:17.903597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e5edf74a-e051-4537-8b52-87e33d6ac34a req-1dff6e61-77d7-44c8-855c-f8f9d41c502c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80", "name": "network-vif-plugged", "status": "completed", "tag": "30ede8d4-5414-422c-b610-09890dc63544"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:17.926098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e5edf74a-e051-4537-8b52-87e33d6ac34a req-1dff6e61-77d7-44c8-855c-f8f9d41c502c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:17.927617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e5edf74a-e051-4537-8b52-87e33d6ac34a req-1dff6e61-77d7-44c8-855c-f8f9d41c502c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:17.929356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e5edf74a-e051-4537-8b52-87e33d6ac34a req-1dff6e61-77d7-44c8-855c-f8f9d41c502c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:17.962482 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e5edf74a-e051-4537-8b52-87e33d6ac34a req-1dff6e61-77d7-44c8-855c-f8f9d41c502c service nova] Creating event network-vif-plugged:30ede8d4-5414-422c-b610-09890dc63544 for instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 on n-h1-863052-1 Oct 31 14:30:17.974676 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e5edf74a-e051-4537-8b52-87e33d6ac34a req-1dff6e61-77d7-44c8-855c-f8f9d41c502c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073888 Oct 31 14:30:17.977336 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2764/5272] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:30:18.597901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:18.598711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:18.608287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:18.626355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:18.627022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:18.627873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:18.630779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:18.631312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:19.143377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:19.162551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4720fb9-ea38-40bc-86ba-40c958a37ced tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1313 microversion: 2.1 time: 0.559204 Oct 31 14:30:19.163478 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2509/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:18 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:20.196345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:20.197066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:20.205247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:20.205747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:20.206205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:20.207077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:20.207545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:20.207978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:20.238255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:20.667247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:20.676690 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a78a73b-43af-4879-bed7-3db54219f8ec tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1498 microversion: 2.1 time: 0.487702 Oct 31 14:30:20.680283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2765/5274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:20 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1498 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:20.714109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:20.718571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:20.739136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:20.739988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:20.740674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:20.741607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:20.742311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:20.742938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:20.773467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lazy-loading 'flavor' on Instance uuid 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:30:20.959623 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5847d06-3304-406b-83ab-0396f0ebe27f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "POST /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80/action" status: 200 len: 32 microversion: 2.1 time: 0.249115 Oct 31 14:30:20.961390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2510/5275] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:30:20 2022] POST /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:30:20.974083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:20.974735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:20.983488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:20.985330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:20.986483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:20.988573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:20.989047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:20.989852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:21.311760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:21.322720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20fea183-45f7-46c1-a40c-154b64833368 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.353644 Oct 31 14:30:21.340702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2766/5276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:20 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:22.232197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:22.234659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:22.242193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.242674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.243112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.243829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.244281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.244704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.348756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:22.349434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:22.365027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.367600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.368830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.369621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.372151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.372868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.438012 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Invalid volume: volume dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 is already attached to instances: 3bf76455-be9a-486a-9d38-8396622560f3 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments HTTP/1.1 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 74 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: {"volumeAttachment": {"volumeId": "dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0"}} Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid volume: volume dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 is already attached to instances: 3bf76455-be9a-486a-9d38-8396622560f3 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '3bf76455-be9a-486a-9d38-8396622560f3', 'body': {'volumeAttachment': {'volumeId': 'dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0'}}} Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 is already attached to instances: 3bf76455-be9a-486a-9d38-8396622560f3 Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:30:22.440447 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 is already attached to instances: 3bf76455-be9a-486a-9d38-8396622560f3 Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 is already attached to instances: 3bf76455-be9a-486a-9d38-8396622560f3 Oct 31 14:30:22.444519 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:30:22.446829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 400 to user: Invalid volume: volume dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 is already attached to instances: 3bf76455-be9a-486a-9d38-8396622560f3 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:22.447841 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47798af6-0593-40dc-9b27-e35a986e4982 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221039 Oct 31 14:30:22.466848 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2511/5277] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:30:22 2022] POST /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 174 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:30:22.547946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:22.548461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:22.558118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.559173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.560546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.561697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.562991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.564196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.743630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lazy-loading 'services' on Instance uuid 3bf76455-be9a-486a-9d38-8396622560f3 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:30:22.845638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:22.862270 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e42f83d-a3a5-4d22-80cd-4fe6305cdb25 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments/dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0" status: 202 len: 0 microversion: 2.1 time: 0.318080 Oct 31 14:30:22.862516 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6e6d182-d7d0-4f37-b0a7-3ff0c3f5c9ff tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.517351 Oct 31 14:30:22.863336 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2512/5278] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:30:22 2022] DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments/dbebeb0d-34a1-4a5e-933b-5ad2c2adddc0 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:30:22.873357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:22.881605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:22.882309 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2767/5279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:22 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:22.906821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.907602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.908254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.920837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:22.921510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:22.922041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:22.967907 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0bb733c6-f798-44fb-b736-0f85a5c2e5d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099904 Oct 31 14:30:22.969317 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2513/5280] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:22 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:23.890151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:23.891389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:23.898214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:23.907702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:23.908373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:23.909296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:23.909908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:23.910529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:23.982506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:23.985669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:24.012415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:24.013449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:24.016578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:24.019670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:24.021074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:24.022121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:24.118606 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3394dfb8-c5ed-4fd0-b12f-2bd841a36f42 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141287 Oct 31 14:30:24.119692 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2514/5281] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:23 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:30:24.227448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:24.236389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b10544d-56ef-43b4-ba59-493ab23200d1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.351325 Oct 31 14:30:24.236973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2768/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:23 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:25.132068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:25.134827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:25.171343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:25.176727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:25.177394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:25.181220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:25.182292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:25.184085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:25.260496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:25.261030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:25.277679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f7a58f1-c65b-46fe-bba6-bcfc4d69398b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149769 Oct 31 14:30:25.284525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:25.286551 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2515/5283] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:25 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:25.287593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:25.289235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:25.291141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:25.292058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:25.294646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:25.743583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:25.756868 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cddb1d1-2afe-47b8-8720-194649eadc3d tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.500669 Oct 31 14:30:25.774200 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2769/5284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:25 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:26.300195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:26.302940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:26.315894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:26.321063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:26.322133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:26.323146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:26.323801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:26.324385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:26.407745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b2c958f-4fe1-42af-b236-8f78a4133319 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113679 Oct 31 14:30:26.411624 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2516/5285] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:26 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:26.787169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:26.788391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:26.799052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:26.808282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:26.808956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:26.809875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:26.810645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:26.811233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:27.405475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:27.423113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:27.424992 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0501d84-b24b-406e-ae45-d44738d702ba tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.642942 Oct 31 14:30:27.425538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:27.430846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2770/5286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:26 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:27.451169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:27.451938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:27.452556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:27.453488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:27.454098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:27.454713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:27.544186 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6db95ce3-cb79-4482-8391-0434b9fb1bb6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124971 Oct 31 14:30:27.554454 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2517/5287] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:27 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:30:28.456182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:28.457642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:28.481832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:28.487839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:28.489575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:28.493228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:28.501334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:28.502039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:28.567940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:28.570198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:28.597844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:28.605085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:28.605776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:28.606715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:28.612890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:28.613349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:28.721428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:28.776112 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15ddcd7e-3901-4224-89be-dfbd04d3f604 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213546 Oct 31 14:30:28.794309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2518/5288] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:28 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:30:28.934314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:28.949740 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08e62843-c649-4c00-917d-2b86f4c05cf7 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.497514 Oct 31 14:30:28.954224 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2771/5289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:28 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:29.806487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:29.809377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:29.828471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:29.838556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:29.839025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:29.840314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:29.840805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:29.841216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:29.965467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-13aef85a-922e-423e-8643-384f3753a69c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161150 Oct 31 14:30:29.966383 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2519/5290] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:29 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:29.993044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:29.996659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:30.020681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:30.021417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:30.022014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:30.023132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:30.024212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:30.024795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:30.977992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:30.981926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:30.995560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:31.001805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:31.002571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:31.003506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:31.011061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:31.011810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:31.130946 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4f4b746-41a3-4d0c-bc67-cb22c8e167a5 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156937 Oct 31 14:30:31.148734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2520/5291] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:30 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:30:31.535313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:31.553481 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8b9d099-b6b2-4a40-a704-78b9ba13f33b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 1.565002 Oct 31 14:30:31.561548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2772/5292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:29 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:32.164637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:32.183373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:32.233018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:32.234000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:32.234660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:32.235676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:32.274555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:32.275062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:32.391547 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-323b14db-8243-46cc-af95-64fcbdba19de tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234473 Oct 31 14:30:32.401390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2521/5293] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:32 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:32.578004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:32.578733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:32.598282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:32.599055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:32.599649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:32.603544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:32.604893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:32.605501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:33.409100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:33.411596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:33.427593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:33.437007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:33.447184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:33.457295 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55be887e-2412-43af-97b6-f92c6a13e46e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.884179 Oct 31 14:30:33.459762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:33.460814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:33.461439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:33.465813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:33.469675 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2773/5294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:32 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:33.590375 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f51bd11-2763-454e-b3dc-bdc4806eca1b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.182230 Oct 31 14:30:33.591647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2522/5295] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:30:33 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:30:33.760394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:33.761677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:33.766612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:33.772881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:33.774700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:33.776288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:33.777822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:33.778688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:33.779351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:33.822854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:30:34.173456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a5dc4ee-c90d-4baf-b002-cefe556b95af tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 204 len: 0 microversion: 2.1 time: 0.417586 Oct 31 14:30:34.182586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2774/5296] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:30:33 2022] DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:30:34.195309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:34.199106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:34.253367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:34.255477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:34.257763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:34.263613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:34.266426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:34.267462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:34.528749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:34.529477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:34.548734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:34.551605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:34.559259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:34.560257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:34.567482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:34.568164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:35.769231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:35.780212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca0aea0e-b4c7-47c1-aa52-dcdc76896b67 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1682 microversion: 2.1 time: 1.594958 Oct 31 14:30:35.805300 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2523/5297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:34 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1682 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:36.667033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:36.676631 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25f42826-3d36-4f7f-9bec-90b7d2c1136e tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 2.195036 Oct 31 14:30:36.681792 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2775/5298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:34 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:36.824240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:36.825414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:36.837401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:36.842132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:36.842850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:36.845239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:36.846586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:36.854564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:36.856374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:37.712483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:37.713120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:37.728410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:37.734921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:37.759144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:37.760381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:37.769906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:37.775320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:38.133582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:38.145240 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2becab5f-47a2-4ea1-9e80-f99fb8391ab2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1682 microversion: 2.1 time: 1.324967 Oct 31 14:30:38.159988 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2524/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:36 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1682 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:38.253310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:38.263027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adc257a1-2923-44fd-a70f-89a7524e46f8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.557549 Oct 31 14:30:38.267283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2776/5300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:37 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:39.172731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:39.173356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:39.189291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:39.189802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:39.190287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:39.191017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:39.204315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:39.207135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:39.722524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:39.734928 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42be99f9-87ff-45ae-8c2c-c8139083408c tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 200 len: 1614 microversion: 2.1 time: 0.566111 Oct 31 14:30:39.745670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2525/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:39 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 1614 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:39.754660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:39.756530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:39.783507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:39.786746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:39.787496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:39.788466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:39.789205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:39.790597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:40.194934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8be92573-3b4c-4975-b32a-74ea1eabe55d req-38a7bb69-31e8-4139-8f0c-3442aafa9eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf76455-be9a-486a-9d38-8396622560f3", "name": "network-vif-deleted", "tag": "6b816bfc-a8a6-46e9-bc0d-44e1c057013b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:40.229056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8be92573-3b4c-4975-b32a-74ea1eabe55d req-38a7bb69-31e8-4139-8f0c-3442aafa9eeb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:40.229926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8be92573-3b4c-4975-b32a-74ea1eabe55d req-38a7bb69-31e8-4139-8f0c-3442aafa9eeb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:40.231576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8be92573-3b4c-4975-b32a-74ea1eabe55d req-38a7bb69-31e8-4139-8f0c-3442aafa9eeb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:40.291826 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8be92573-3b4c-4975-b32a-74ea1eabe55d req-38a7bb69-31e8-4139-8f0c-3442aafa9eeb service nova] Creating event network-vif-deleted:6b816bfc-a8a6-46e9-bc0d-44e1c057013b for instance 3bf76455-be9a-486a-9d38-8396622560f3 on n-h2-863052-1 Oct 31 14:30:40.308923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8be92573-3b4c-4975-b32a-74ea1eabe55d req-38a7bb69-31e8-4139-8f0c-3442aafa9eeb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.051008 Oct 31 14:30:40.323847 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2777/5302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:41.298930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:41.300900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:41.313612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:41.325822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:41.337790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:41.338844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:41.339323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:41.339749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:41.390645 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 HTTP/1.1 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '3bf76455-be9a-486a-9d38-8396622560f3'} Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:30:41.392332 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:30:41.396434 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:30:41.397822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:30:41.398913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b32db5a4-8787-4501-aed5-605287342d95 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 404 len: 111 microversion: 2.1 time: 0.637636 Oct 31 14:30:41.402188 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2778/5303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:40 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 111 bytes in 642 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:30:41.412266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6769b2da-5bb0-431f-94b6-59791400cb38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '.version_select at 0x7fe1062784c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:41.467674 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6769b2da-5bb0-431f-94b6-59791400cb38 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-370683446" status: 202 len: 0 microversion: 2.1 time: 0.061146 Oct 31 14:30:41.468680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2779/5304] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-370683446 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:30:41.477166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:41.493336 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2393e32-fa4c-4a82-a1ea-1312f34583a1 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 1.739638 Oct 31 14:30:41.513918 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2526/5305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:39 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:42.518227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:42.519536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:42.533736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:42.536374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:42.537042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:42.540875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:42.541625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:42.542349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:43.061808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:43.071997 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ee9a238-146a-4a9b-9202-ca211e083c10 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.557718 Oct 31 14:30:43.072962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2780/5306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:42 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:43.645853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5fdb6e9d-b426-4d0e-adc3-47bc8f649701 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: .version_select at 0x7fe107afcca0>, body: {"keypair": {"name": "tempest-keypair-1672438749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Xx0Y+hZ5XGbWqjbQF7nKACgaPTz2YdDo1Uv3BZ9VDJCJYCLvAB20Q3LTPUJXYkfJIBbKnW8sWD6Lvxg57kZyLFS3mPAasYNkjBnKbm4unNtgs6PrVA9wxicUdo4f4VA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:43.676149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5fdb6e9d-b426-4d0e-adc3-47bc8f649701 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:30:43.699344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-5fdb6e9d-b426-4d0e-adc3-47bc8f649701 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:30:43.790390 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5fdb6e9d-b426-4d0e-adc3-47bc8f649701 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156773 Oct 31 14:30:43.798531 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2527/5307] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:30:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:44.108917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:44.111524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:44.132859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:44.133703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:44.134517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:44.135406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:44.136752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:44.137340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:44.827167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:44.845024 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb4ac49c-a572-4fd1-8df7-c34956fb43b0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.748800 Oct 31 14:30:44.862594 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2781/5308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:44 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:45.874507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:45.875819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:45.886956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:45.891482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:45.892233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:45.893208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:45.903763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:45.904662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:46.357608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:46.366284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92124d95-e606-44ff-a6db-27cc3d2ebb8b tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.495957 Oct 31 14:30:46.366884 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2528/5309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:45 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:47.398673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:47.399323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:47.419171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:47.419674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:47.420121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:47.420842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:47.421301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:47.421732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:48.059466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615627686", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed57bab-14ab-45b9-8b44-cc4a46a76802"}], "security_groups": [{"name": "tempest-securitygroup--1709780761"}], "key_name": "tempest-keypair-1672438749", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:48.339040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] validate_networks() for [('0ed57bab-14ab-45b9-8b44-cc4a46a76802', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:30:48.775770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:48.779003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:48.789598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e4ff1948-cdad-40c8-b178-bd9c7fde8e5c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 1.391917 Oct 31 14:30:48.792414 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2782/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:47 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:49.263736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:30:49.265064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:30:49.266808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:30:49.269535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:30:49.272634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:30:49.288655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:49.289933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:49.298215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:49.300677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:49.301512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:49.302256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:49.343186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:30:49.350793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Getting quotas for user 18afbe74ab5c426087d0e4635b3c38ea and project 722078c8963b46b890d3a73abde4a1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:30:49.374048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:30:49.382520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:30:49.482408 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-baa672a3-3002-409b-9935-05917b66a2a6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.426663 Oct 31 14:30:49.485251 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2529/5311] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:30:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:30:49.497245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2793eeb1-aa27-4760-88aa-9565a3ffe490 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:49.498481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2793eeb1-aa27-4760-88aa-9565a3ffe490 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:49.815458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:49.816008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:49.833666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:49.834197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:49.834656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:49.835377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:49.835841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:49.836271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:50.019993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2793eeb1-aa27-4760-88aa-9565a3ffe490 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:50.030117 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2793eeb1-aa27-4760-88aa-9565a3ffe490 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1241 microversion: 2.1 time: 0.539280 Oct 31 14:30:50.036519 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2783/5312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:49 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1241 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:50.287769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:50.302350 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89f09751-6c52-42c4-ad6e-81b1ddfd11d8 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1484 microversion: 2.1 time: 0.490824 Oct 31 14:30:50.314193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2530/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:49 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1484 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:50.327912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:50.328629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:50.355178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:50.356034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:50.356626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:50.357481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:50.358203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:50.358993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:50.599772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6cf9e1c-d652-495b-887d-c084280d1fc2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "POST /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80/action" status: 202 len: 0 microversion: 2.1 time: 0.276435 Oct 31 14:30:50.604688 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2784/5314] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:30:50 2022] POST /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:30:50.612453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:50.613070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:50.633272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:50.633850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:50.634341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:50.641112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:50.641667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:50.642283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:51.079458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:51.080189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:51.105267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:51.105695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:51.106143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:51.107046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:51.107508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:51.109316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:51.563200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:51.576788 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c184e13-c39c-43b4-9c7a-028e4ae29881 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1237 microversion: 2.1 time: 0.516604 Oct 31 14:30:51.578089 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2785/5315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:51 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1237 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:51.603885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:51.617776 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-540c2692-03f5-4226-9609-a6d40b74535c tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1492 microversion: 2.1 time: 1.009190 Oct 31 14:30:51.630825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2531/5316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:50 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1492 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:52.608660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:52.609941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:52.639424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:52.639927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:52.649189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:52.651742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:52.652450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:52.653679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:52.654996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:52.656596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:52.685322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:52.686342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:52.687374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:52.690290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:52.691475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:52.693761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:52.855940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:52.864881 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5a8b1bf-553e-4c9f-9dec-308cd68d8391 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1299 microversion: 2.1 time: 0.261376 Oct 31 14:30:52.884338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2786/5317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:52 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:53.359791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:53.368103 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00eaedf8-14fa-4411-98d4-7439701610e0 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1492 microversion: 2.1 time: 0.719795 Oct 31 14:30:53.382553 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2532/5318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:52 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1492 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:53.894640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:53.895267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:53.911204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:53.911717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:53.912153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:53.912879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:53.913323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:53.913754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:54.114723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:54.123472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bd92fb8-8940-47b3-b9cb-c71ed3a37e9b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1299 microversion: 2.1 time: 0.232916 Oct 31 14:30:54.137161 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2787/5319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:53 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:54.403896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:54.404556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:54.413339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:54.413844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:54.414343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:54.415063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:54.415524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:54.415960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:54.692130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:54.701768 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d54797a5-645d-49d4-a323-c77858ce8c65 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1492 microversion: 2.1 time: 0.307392 Oct 31 14:30:54.705006 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2533/5320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:54 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1492 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:54.943984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1245065067", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "0280458f-82ad-49fa-b52b-71a047d1afe2"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:55.094463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] validate_networks() for [('0280458f-82ad-49fa-b52b-71a047d1afe2', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:30:55.153106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:55.153768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:55.164326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:55.164834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:55.169237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:55.170552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:55.171234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:55.173659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:55.749733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:55.762155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da122315-0c41-443d-8c30-9c1934250781 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.615018 Oct 31 14:30:55.767768 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2534/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:55 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:55.807539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:55.808580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:55.815482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:55.816178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:55.816785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:55.817682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:55.818652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:55.819258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.237986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:56.280104 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3a3b19b-5083-433a-b235-1b10a9a424cf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1498 microversion: 2.1 time: 0.502807 Oct 31 14:30:56.281249 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2535/5322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:55 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:56.321390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:56.326066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:56.344967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:56.347615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:56.349611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.350885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:56.351578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:56.354862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.426692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:30:56.434021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:56.554947 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02157351-7756-4969-bbd2-5b1379f7e174 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 204 len: 0 microversion: 2.1 time: 0.238012 Oct 31 14:30:56.556667 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2536/5323] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:30:56 2022] DELETE /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:30:56.578290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:56.581469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:56.595277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:56.596989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:56.599329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.600325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:56.601011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:56.601958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.894712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:30:56.895771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:30:56.896510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:30:56.897178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:30:56.899713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:30:56.926684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:56.930547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:56.931848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.939308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:56.944624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:56.952699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:56.954100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:56.957821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8471f7c-2532-4109-b3e8-af520f775b12 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.395394 Oct 31 14:30:56.969964 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2537/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:56 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:56.976329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:56.987962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:56.996404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:57.001561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:57.004301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:57.005177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:57.010719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:57.011424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:57.024983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Getting quotas for project 04d696d3e68447c98c7224b0bee77835. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:30:57.034724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Getting quotas for user ef045f06c56e4e558b6b9a648ff7d87d and project 04d696d3e68447c98c7224b0bee77835. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:30:57.074782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:30:57.077134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:30:57.167446 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3281da9b-3fd7-45fb-945b-8065811cf1f7 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.546040 Oct 31 14:30:57.182335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2788/5325] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:30:57.195432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe049d93-4fe2-428f-a4ec-108f462cd7eb tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:57.196408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe049d93-4fe2-428f-a4ec-108f462cd7eb tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:57.324741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe049d93-4fe2-428f-a4ec-108f462cd7eb tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:57.345170 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe049d93-4fe2-428f-a4ec-108f462cd7eb tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1228 microversion: 2.1 time: 0.154789 Oct 31 14:30:57.345785 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2789/5326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:57 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1228 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:57.493110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:57.505569 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46f6bb78-17d7-4512-8cf3-56ca644f7366 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.534033 Oct 31 14:30:57.508985 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2538/5327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:56 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:57.714687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-131202b8-acd5-4362-a04c-ce0bfa2c5d35 req-1205bbf4-afa1-4434-9a30-1acb8226fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b45536d-f277-4680-8c41-b34b045b4a5b", "tag": "bc003b2f-671d-4260-88fc-a4fb53734933"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:30:57.754949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-131202b8-acd5-4362-a04c-ce0bfa2c5d35 req-1205bbf4-afa1-4434-9a30-1acb8226fa4a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:57.755542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-131202b8-acd5-4362-a04c-ce0bfa2c5d35 req-1205bbf4-afa1-4434-9a30-1acb8226fa4a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:57.757755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-131202b8-acd5-4362-a04c-ce0bfa2c5d35 req-1205bbf4-afa1-4434-9a30-1acb8226fa4a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:57.796874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-131202b8-acd5-4362-a04c-ce0bfa2c5d35 req-1205bbf4-afa1-4434-9a30-1acb8226fa4a service nova] Creating event network-changed:bc003b2f-671d-4260-88fc-a4fb53734933 for instance 5b45536d-f277-4680-8c41-b34b045b4a5b on n-h1-863052-1 Oct 31 14:30:57.836385 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-131202b8-acd5-4362-a04c-ce0bfa2c5d35 req-1205bbf4-afa1-4434-9a30-1acb8226fa4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125116 Oct 31 14:30:57.839091 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2790/5328] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:30:57.986678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:57.987571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:58.001690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:58.006845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:58.007767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:58.008502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:58.008960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:58.009387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:58.368595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:58.370062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:58.399336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:58.405204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:58.412748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:58.413534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:58.414023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:58.414497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:58.463929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:58.479533 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b303db9-0ce9-421f-b9d3-bf68c933db59 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.496139 Oct 31 14:30:58.483415 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2539/5329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:57 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:30:58.533184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:58.534245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:58.547659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:58.548532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:58.551075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:58.564526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:58.566143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:58.566952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:58.652195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:58.663614 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70d0c1c9-4aff-4416-81a1-03aa5b00f302 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1224 microversion: 2.1 time: 0.299429 Oct 31 14:30:58.664404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2791/5330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:58 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1224 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:58.927566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:30:58.939722 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f1918c2-70b2-492f-a7eb-1032db1cce32 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.411060 Oct 31 14:30:58.940431 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2540/5331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:58 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:30:59.511795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:59.512421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:59.521282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:59.521783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:59.522254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:59.522959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:59.523422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:59.537994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:59.690273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:30:59.690829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:30:59.694750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:59.697716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:59.718042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:59.720038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:59.720494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:30:59.721227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:30:59.721683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:30:59.722106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:00.053783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:00.063827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d09c240-f515-4d0e-9631-8dfa13735715 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1286 microversion: 2.1 time: 0.379571 Oct 31 14:31:00.074382 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2541/5332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:59 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1286 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:00.092886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:00.093620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:00.116674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:00.120945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:00.122075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:00.126193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:00.128528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:00.129730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:00.249809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:00.261095 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c2c864d-eceb-4fbf-bb8e-7e8967ec8adf tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.753094 Oct 31 14:31:00.263136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2792/5333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:30:59 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:01.087004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:01.089168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:01.103355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:01.105509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:01.106249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:01.111809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:01.112619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:01.113303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:01.178544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:01.192617 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad71a14d-c8c5-40d8-935b-045aa3611396 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 1.116616 Oct 31 14:31:01.193213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2542/5334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:00 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:01.295410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:01.297035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:01.311306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:01.314804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:01.315427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:01.317659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:01.321107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:01.321818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:01.417858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:01.434772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41a52c1c-2a40-47c9-89a0-88627b48b616 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1286 microversion: 2.1 time: 0.346543 Oct 31 14:31:01.451320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2793/5335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:01 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1286 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:01.992272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:02.003622 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca041ce6-7f9e-447e-9a5a-4342fcbbaa00 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1504 microversion: 2.1 time: 0.718287 Oct 31 14:31:02.009431 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2543/5336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:01 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1504 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:02.220027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:02.220635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:02.242856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:02.244546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:02.245681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:02.248349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:02.251559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:02.256951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:02.459933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:02.461204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:02.479118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:02.479630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:02.480076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:02.480803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:02.481263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:02.481695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:02.982629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:02.991592 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dc6bbf4b-04b5-40e2-8ae2-b260ae9811db tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.535351 Oct 31 14:31:02.994858 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2544/5337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:02 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:03.001179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f6c63cac-0423-49b9-a00b-267ef7be6c6e req-1d18a0f5-39b3-41f2-9228-5b40059703db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80", "name": "network-vif-deleted", "tag": "30ede8d4-5414-422c-b610-09890dc63544"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:03.033143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f6c63cac-0423-49b9-a00b-267ef7be6c6e req-1d18a0f5-39b3-41f2-9228-5b40059703db service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:03.034050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f6c63cac-0423-49b9-a00b-267ef7be6c6e req-1d18a0f5-39b3-41f2-9228-5b40059703db service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:03.035711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f6c63cac-0423-49b9-a00b-267ef7be6c6e req-1d18a0f5-39b3-41f2-9228-5b40059703db service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:03.055500 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f6c63cac-0423-49b9-a00b-267ef7be6c6e req-1d18a0f5-39b3-41f2-9228-5b40059703db service nova] Creating event network-vif-deleted:30ede8d4-5414-422c-b610-09890dc63544 for instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 on n-h1-863052-1 Oct 31 14:31:03.061969 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f6c63cac-0423-49b9-a00b-267ef7be6c6e req-1d18a0f5-39b3-41f2-9228-5b40059703db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065551 Oct 31 14:31:03.063153 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2545/5338] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:03.069278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:03.069992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:03.078007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:03.078772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:03.079376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:03.080379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:03.080994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:03.081731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:03.133640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:03.134154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:03.134630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:03.135620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lazy-loading 'fault' on Instance uuid 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:31:03.149406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:03.163121 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a846e133-36db-4abd-8a47-c52f73574d2b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.947209 Oct 31 14:31:03.164399 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2794/5339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:02 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:03.192162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:03.226579 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5be396e7-3b8f-42d1-97df-d2eb7775878f tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 200 len: 1303 microversion: 2.1 time: 0.161815 Oct 31 14:31:03.231994 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2546/5340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:03 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:03.751002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-bb264211-2816-428d-a5ba-6fbc0cfd9bde req-cc042ac1-b168-4b20-8b18-c48a97e1ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f15aea-b676-4c7b-be1a-dac58cc94dbe", "tag": "1f0e833c-2262-4f09-a33e-bbcfbf5fe7f0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:03.768883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb264211-2816-428d-a5ba-6fbc0cfd9bde req-cc042ac1-b168-4b20-8b18-c48a97e1ae12 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:03.769637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb264211-2816-428d-a5ba-6fbc0cfd9bde req-cc042ac1-b168-4b20-8b18-c48a97e1ae12 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:03.770334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb264211-2816-428d-a5ba-6fbc0cfd9bde req-cc042ac1-b168-4b20-8b18-c48a97e1ae12 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:03.786981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-bb264211-2816-428d-a5ba-6fbc0cfd9bde req-cc042ac1-b168-4b20-8b18-c48a97e1ae12 service nova] Creating event network-changed:1f0e833c-2262-4f09-a33e-bbcfbf5fe7f0 for instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe on n-h2-863052-1 Oct 31 14:31:03.796896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-bb264211-2816-428d-a5ba-6fbc0cfd9bde req-cc042ac1-b168-4b20-8b18-c48a97e1ae12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053131 Oct 31 14:31:03.798739 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2795/5341] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:04.017096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:04.018099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:04.045623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.047720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.048205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.048909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.049369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.049805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.188472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:04.189355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:04.200397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:04.205731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.206683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.207079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.207802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.208273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.208705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.329640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:04.339533 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31e5c8b9-49d8-4856-9a8f-6391e88f6c62 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.326294 Oct 31 14:31:04.343434 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2547/5342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:04 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:04.354660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:04.355559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:04.367873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.371149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.371933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.374372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.375247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.376353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.397499 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] HTTP exception thrown: Instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 could not be found. Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Request method failure captured: Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 HTTP/1.1 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9uwIxx0PKi9avISNa_TdjI3SQGa1W0BBca5O2iom6SB_wmjv73xdQwdpKmPst5_eGDSIAGjU3PEvs4xMAgnzrWL1hwYGd2o6wn30cgknc0AUpI8M9TepUXqFN_B0xeIycECg4TeJ_8azz2bdPCEtqZpObUSnzOHYdteEvjq8clIfVw Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: f3b6cb0bce2e434faa4f2256965b22bd Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueTestJSON-1043860137 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3b6cb0bce2e434faa4f2256965b22bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3b6cb0bce2e434faa4f2256965b22bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3b6cb0bce2e434faa4f2256965b22bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3b6cb0bce2e434faa4f2256965b22bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueTestJSON-1043860137 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: f3b6cb0bce2e434faa4f2256965b22bd Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueTestJSON-1043860137 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueTestJSON-1043860137-project Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e777fb43bd264183a1b3ea4016b26302 Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueTestJSON-1043860137-project Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 could not be found. Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80'} Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 could not be found. Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 could not be found. Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:04.399660 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 could not be found. Oct 31 14:31:04.403537 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:04.405778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Returning 404 to user: Instance 3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:31:04.406966 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42bbdbf2-8192-40f3-baa9-6416c787c884 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80" status: 404 len: 111 microversion: 2.1 time: 0.062247 Oct 31 14:31:04.407721 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2548/5343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:04 2022] GET /compute/v2.1/servers/3c8a2a42-6183-4d9f-92e2-3d55f7b2fc80 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:31:04.416196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:04.416952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:04.423409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.424178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.424825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.425733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.426945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.427600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.478605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:31:04.612301 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4649493-4c39-4bd5-b28d-0a6856f433eb tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 204 len: 0 microversion: 2.1 time: 0.199188 Oct 31 14:31:04.615733 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2549/5344] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:31:04 2022] DELETE /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:31:04.637321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:04.637321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:04.641750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.642398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.643012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.643661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:04.644323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:04.644958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:04.684389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:04.694496 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f25c1e68-652e-436c-99e3-e33c8a41fb78 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.510794 Oct 31 14:31:04.714645 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2796/5345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:04 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:04.856621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:04.871316 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f315c46-8219-4dd5-a0e5-223df2a93f58 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1491 microversion: 2.1 time: 0.249257 Oct 31 14:31:04.872174 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2550/5346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:04 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1491 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:05.365162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:05.365798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:05.376279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:05.376785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:05.377230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:05.377949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:05.387942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:05.388416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:05.588909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:05.597896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40703112-d079-4344-8b5e-92596aa238a8 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.237593 Oct 31 14:31:05.608681 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2797/5347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:05 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:05.726628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:05.727537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:05.741062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:05.741851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:05.742851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:05.744151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:05.745381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:05.746457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:05.760495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:05.894894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:05.895950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:05.904729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:05.912264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:05.912952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:05.913925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:05.914557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:05.915137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:06.030992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:06.045347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7d11eb6-7372-4d58-b07c-1e887875bb81 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.323767 Oct 31 14:31:06.054473 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2551/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:05 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:06.201415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:06.212490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bd270f7-b80c-40f4-8de4-ed1bfcd62414 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1491 microversion: 2.1 time: 0.321342 Oct 31 14:31:06.214056 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2798/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:05 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1491 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:06.621438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:06.622066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:06.630876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:06.631410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:06.632038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:06.633067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:06.633693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:06.634282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:06.807866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:06.818323 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-38354448-dac4-4d39-8884-aa8b054c8593 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.201179 Oct 31 14:31:06.818929 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2552/5350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:06 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:07.075350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:07.077453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:07.089882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:07.091854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.093159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.093881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:07.097162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.098222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.098887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:07.241049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:07.242007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:07.244996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:07.257074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.258892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.260849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:07.261850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.263056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.264508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:07.320012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:07.334798 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73335730-d704-4e9f-8c4a-654ddda1b7fc tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.268126 Oct 31 14:31:07.335400 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2799/5351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:07 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:07.542262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8fbff800-1622-418c-81b7-d483536d69dc req-2741e78a-5f25-4469-b410-79600090072f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b45536d-f277-4680-8c41-b34b045b4a5b", "name": "network-vif-plugged", "status": "completed", "tag": "bc003b2f-671d-4260-88fc-a4fb53734933"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:07.560783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:07.562778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8fbff800-1622-418c-81b7-d483536d69dc req-2741e78a-5f25-4469-b410-79600090072f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.570397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8fbff800-1622-418c-81b7-d483536d69dc req-2741e78a-5f25-4469-b410-79600090072f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.571097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8fbff800-1622-418c-81b7-d483536d69dc req-2741e78a-5f25-4469-b410-79600090072f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:07.589692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:07.599962 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8fbff800-1622-418c-81b7-d483536d69dc req-2741e78a-5f25-4469-b410-79600090072f service nova] Creating event network-vif-plugged:bc003b2f-671d-4260-88fc-a4fb53734933 for instance 5b45536d-f277-4680-8c41-b34b045b4a5b on n-h1-863052-1 Oct 31 14:31:07.601908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d57d1dac-8992-40ab-97fd-90de4969a869 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1491 microversion: 2.1 time: 0.365949 Oct 31 14:31:07.604323 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2553/5352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:07 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1491 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:07.616638 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8fbff800-1622-418c-81b7-d483536d69dc req-2741e78a-5f25-4469-b410-79600090072f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078912 Oct 31 14:31:07.617800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2800/5353] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:31:07.849898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:07.850772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:07.863215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.864914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.868655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:07.871454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:07.872196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:07.872854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:08.049775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:08.064591 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea9e86d1-7f21-4099-a2d7-b2e53dd81088 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.218735 Oct 31 14:31:08.065948 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2554/5354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:07 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:08.363516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:08.364613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:08.384464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:08.385553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:08.386003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:08.386757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:08.387223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:08.387659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:08.629241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:08.630487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:08.638492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:08.639212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:08.639945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:08.641025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:08.641757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:08.642459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:08.801755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:08.809560 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12c08453-948d-4ddf-b294-fb2ea668be09 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1367 microversion: 2.1 time: 0.450158 Oct 31 14:31:08.812587 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2801/5355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:08 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:08.873975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e777fb43bd264183a1b3ea4016b26302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b6cb0bce2e434faa4f2256965b22bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:08.883893 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb12753b-b9cc-4d0b-81b7-3741503e6319 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 200 len: 1491 microversion: 2.1 time: 0.258835 Oct 31 14:31:08.885134 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2555/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:08 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 1491 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:08.993358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a5eaf348-43d1-42dc-ae5e-0ce23196c422 req-46f4605c-82d9-4c4c-a5ac-00966447f5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ceeb4a1-0726-4cf2-a0ed-125f35a46906", "name": "network-vif-deleted", "tag": "e6030399-d258-4c13-9428-023c81e6ec40"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:09.011777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a5eaf348-43d1-42dc-ae5e-0ce23196c422 req-46f4605c-82d9-4c4c-a5ac-00966447f5ec service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.014769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a5eaf348-43d1-42dc-ae5e-0ce23196c422 req-46f4605c-82d9-4c4c-a5ac-00966447f5ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.015465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a5eaf348-43d1-42dc-ae5e-0ce23196c422 req-46f4605c-82d9-4c4c-a5ac-00966447f5ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.036364 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a5eaf348-43d1-42dc-ae5e-0ce23196c422 req-46f4605c-82d9-4c4c-a5ac-00966447f5ec service nova] Creating event network-vif-deleted:e6030399-d258-4c13-9428-023c81e6ec40 for instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 on n-h2-863052-1 Oct 31 14:31:09.044973 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a5eaf348-43d1-42dc-ae5e-0ce23196c422 req-46f4605c-82d9-4c4c-a5ac-00966447f5ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055553 Oct 31 14:31:09.045778 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2802/5357] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:31:09.090952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:09.091681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:09.098067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.098695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.099208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.099987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.100658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.101315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.419203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:09.427762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16716bff-4c24-488e-b266-b2ee448c6191 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.341412 Oct 31 14:31:09.442618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2556/5358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:09 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:09.841422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:09.842686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:09.857426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.860888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.861456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.864100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.864515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.871245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.909566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:09.911768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] [instance: 1ceeb4a1-0726-4cf2-a0ed-125f35a46906] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:09.922388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.923127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.923946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.924859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:09.925583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:09.926243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:09.945486 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] HTTP exception thrown: Instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 could not be found. Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Request method failure captured: Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 HTTP/1.1 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9uwIxx0PKi9avISNa_TdjI3SQGa1W0BBca5O2iom6SB_wmjv73xdQwdpKmPst5_eGDSIAGjU3PEvs4xMAgnzrWL1hwYGd2o6wn30cgknc0AUpI8M9TepUXqFN_B0xeIycECg4TeJ_8azz2bdPCEtqZpObUSnzOHYdteEvjq8clIfVw Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: f3b6cb0bce2e434faa4f2256965b22bd Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueTestJSON-1043860137 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3b6cb0bce2e434faa4f2256965b22bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3b6cb0bce2e434faa4f2256965b22bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3b6cb0bce2e434faa4f2256965b22bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3b6cb0bce2e434faa4f2256965b22bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueTestJSON-1043860137 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: f3b6cb0bce2e434faa4f2256965b22bd Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueTestJSON-1043860137 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerRescueTestJSON-1043860137-project Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e777fb43bd264183a1b3ea4016b26302 Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueTestJSON-1043860137-project Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 could not be found. Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '1ceeb4a1-0726-4cf2-a0ed-125f35a46906'} Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 could not be found. Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 could not be found. Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:09.947795 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 could not be found. Oct 31 14:31:09.952323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:09.952979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] Returning 404 to user: Instance 1ceeb4a1-0726-4cf2-a0ed-125f35a46906 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:31:09.954656 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-527612dd-240b-4502-950a-c64284ec48f2 tempest-ServerRescueTestJSON-1043860137 tempest-ServerRescueTestJSON-1043860137-project] 10.222.0.27 "GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906" status: 404 len: 111 microversion: 2.1 time: 0.049161 Oct 31 14:31:09.957235 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2557/5359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:09 2022] GET /compute/v2.1/servers/1ceeb4a1-0726-4cf2-a0ed-125f35a46906 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:31:10.190756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:10.193050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:10.205965 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef949e47-71b6-4051-afcd-9bee8c8947e6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1557 microversion: 2.1 time: 0.373244 Oct 31 14:31:10.216367 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2803/5360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:09 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1557 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:10.232727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:10.233464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:10.243620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:10.245272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:10.246044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:10.247420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:10.248129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:10.248842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:10.415346 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1367e8b6-3d42-4d98-91ca-abcfee1ae01f tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188522 Oct 31 14:31:10.424277 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2558/5361] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 14:31:10 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:10.451788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:10.452394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:10.467380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:10.468084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:10.469230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:10.470139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:10.470792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:10.471371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:10.703132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:10.715372 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b130c35-8bfd-4193-b14d-5f11c9cf041c tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.267354 Oct 31 14:31:10.717281 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2804/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:10 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:11.742409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:11.743117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:11.755407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:11.756008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:11.756453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:11.762945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:11.763568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:11.764082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:12.104279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4e61d418-e9e8-42e0-a7f8-e6e939e4eb29 req-2241283a-2d1f-46d7-a748-d82ebcf71f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f15aea-b676-4c7b-be1a-dac58cc94dbe", "name": "network-vif-plugged", "status": "completed", "tag": "1f0e833c-2262-4f09-a33e-bbcfbf5fe7f0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:12.130322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4e61d418-e9e8-42e0-a7f8-e6e939e4eb29 req-2241283a-2d1f-46d7-a748-d82ebcf71f79 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:12.132128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4e61d418-e9e8-42e0-a7f8-e6e939e4eb29 req-2241283a-2d1f-46d7-a748-d82ebcf71f79 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:12.133566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4e61d418-e9e8-42e0-a7f8-e6e939e4eb29 req-2241283a-2d1f-46d7-a748-d82ebcf71f79 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:12.158690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:12.170121 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e362da9-3c21-45b7-92f3-a65a75b42bef tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.430949 Oct 31 14:31:12.172236 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4e61d418-e9e8-42e0-a7f8-e6e939e4eb29 req-2241283a-2d1f-46d7-a748-d82ebcf71f79 service nova] Creating event network-vif-plugged:1f0e833c-2262-4f09-a33e-bbcfbf5fe7f0 for instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe on n-h2-863052-1 Oct 31 14:31:12.174480 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2559/5363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:11 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:12.186418 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4e61d418-e9e8-42e0-a7f8-e6e939e4eb29 req-2241283a-2d1f-46d7-a748-d82ebcf71f79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086136 Oct 31 14:31:12.188918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2805/5364] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:13.044277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-57c2642e-e4bb-4ee6-b826-94878572b509 req-fea4946b-d50b-4758-856c-9d51d0d099ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b45536d-f277-4680-8c41-b34b045b4a5b", "tag": "bc003b2f-671d-4260-88fc-a4fb53734933"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:13.063223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-57c2642e-e4bb-4ee6-b826-94878572b509 req-fea4946b-d50b-4758-856c-9d51d0d099ec service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:13.063757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-57c2642e-e4bb-4ee6-b826-94878572b509 req-fea4946b-d50b-4758-856c-9d51d0d099ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:13.066118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-57c2642e-e4bb-4ee6-b826-94878572b509 req-fea4946b-d50b-4758-856c-9d51d0d099ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:13.087141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-57c2642e-e4bb-4ee6-b826-94878572b509 req-fea4946b-d50b-4758-856c-9d51d0d099ec service nova] Creating event network-changed:bc003b2f-671d-4260-88fc-a4fb53734933 for instance 5b45536d-f277-4680-8c41-b34b045b4a5b on n-h1-863052-1 Oct 31 14:31:13.099016 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-57c2642e-e4bb-4ee6-b826-94878572b509 req-fea4946b-d50b-4758-856c-9d51d0d099ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058979 Oct 31 14:31:13.108000 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2560/5365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:13.198334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:13.199058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:13.210229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:13.211257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:13.212070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:13.213155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:13.213771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:13.214858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:13.462135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:13.474579 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2fb07460-5435-4bf0-bdbc-19e810c425e5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1328 microversion: 2.1 time: 0.281444 Oct 31 14:31:13.480553 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2806/5366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:13 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:14.509755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:14.511559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:14.524891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:14.529068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:14.529757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:14.531923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:14.533820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:14.535544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:15.039007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:15.049781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-753ad71e-ef6a-49ea-ae0f-dfabf89a6300 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1527 microversion: 2.1 time: 0.546626 Oct 31 14:31:15.054075 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2561/5367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:14 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1527 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:15.079742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:15.082649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:15.104554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:15.105061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:15.105504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:15.108616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:15.109436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:15.110020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:15.529025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:15.560643 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43fc9bd4-955b-4abd-bca6-46bb8c585a8f tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1527 microversion: 2.1 time: 0.471325 Oct 31 14:31:15.561323 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2807/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:15 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1527 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:15.807215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:15.807921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:15.818844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:15.820744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:15.822690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:15.823733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:15.824987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:15.825585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:15.846555 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] HTTP exception thrown: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Request method failure captured: Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe HTTP/1.1 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9weiRde9xNz_YEMWWwbfxN3NnhoNnak_JTL_uhF7QZJ8t-u_t8ySO4hbPBZUZZgNXSc0kztP2GRzMte9ruPvkIvIEyATMhdeRCoZJb8XF8xuszJ99ozVbMQm8dSE7I_ehnTXLMvPF5elV5sLpEK87aF7jo1_Z90djVdusVFhULxSv0 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: aafcd612ffd944f8aff525010e6fc15f Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-817322866 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aafcd612ffd944f8aff525010e6fc15f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aafcd612ffd944f8aff525010e6fc15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aafcd612ffd944f8aff525010e6fc15f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aafcd612ffd944f8aff525010e6fc15f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-817322866 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: aafcd612ffd944f8aff525010e6fc15f Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-817322866 Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestMultiTenantJSON-817322866-project Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4d32ade2031d4bb99b117487c85c9cad Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-817322866-project Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd9f15aea-b676-4c7b-be1a-dac58cc94dbe'} Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:31:15.849721 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:15.854478 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:15.856218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Returning 404 to user: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:31:15.857259 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-593f8f68-5fcf-4c7d-9741-02a97f152ffa tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 404 len: 111 microversion: 2.1 time: 0.277642 Oct 31 14:31:15.863087 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2562/5369] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:31:15 2022] DELETE /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:31:15.868265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:15.869528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:15.876445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:15.877075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:15.877754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:15.879176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:15.879800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:15.880462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.114945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:16.123436 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22468206-6fe6-46d4-b86e-51ed7fe0d5b5 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1527 microversion: 2.1 time: 0.259481 Oct 31 14:31:16.124726 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2808/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:15 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1527 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:16.148784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Action: 'update', calling method: >, body: {"server": {"name": "d9f15aea-b676-4c7b-be1a-dac58cc94dbe_new"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:16.151643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:16.159516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:16.160251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:16.161247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.162120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:16.162746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:16.163324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.183315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] HTTP exception thrown: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Request method failure captured: Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: request: PUT /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe HTTP/1.1 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 64 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9weiRde9xNz_YEMWWwbfxN3NnhoNnak_JTL_uhF7QZJ8t-u_t8ySO4hbPBZUZZgNXSc0kztP2GRzMte9ruPvkIvIEyATMhdeRCoZJb8XF8xuszJ99ozVbMQm8dSE7I_ehnTXLMvPF5elV5sLpEK87aF7jo1_Z90djVdusVFhULxSv0 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: aafcd612ffd944f8aff525010e6fc15f Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-817322866 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aafcd612ffd944f8aff525010e6fc15f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aafcd612ffd944f8aff525010e6fc15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aafcd612ffd944f8aff525010e6fc15f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aafcd612ffd944f8aff525010e6fc15f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-817322866 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: aafcd612ffd944f8aff525010e6fc15f Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-817322866 Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestMultiTenantJSON-817322866-project Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4d32ade2031d4bb99b117487c85c9cad Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-817322866-project Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: {"server": {"name": "d9f15aea-b676-4c7b-be1a-dac58cc94dbe_new"}} Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd9f15aea-b676-4c7b-be1a-dac58cc94dbe', 'body': {'server': {'name': 'd9f15aea-b676-4c7b-be1a-dac58cc94dbe_new'}}} Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:31:16.185394 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] Returning 404 to user: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb32259d-9311-4c9f-acc7-4132dceb4dca tempest-ServersNegativeTestMultiTenantJSON-817322866 tempest-ServersNegativeTestMultiTenantJSON-817322866-project] 10.222.0.27 "PUT /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 404 len: 111 microversion: 2.1 time: 0.045183 Oct 31 14:31:16.190521 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2563/5371] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:31:16 2022] PUT /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:31:16.201278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:16.202624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:16.211754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:16.212242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:16.213259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.214134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:16.214704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:16.215024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.259308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:31:16.382563 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc080d45-ed2b-4556-b2d3-b6dda285a74e tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 204 len: 0 microversion: 2.1 time: 0.187794 Oct 31 14:31:16.384004 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2809/5372] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:31:16 2022] DELETE /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:31:16.397822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:16.399705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:16.412109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:16.413066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:16.413518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.414446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:16.415192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:16.416438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:16.772775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:16.785900 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c6e4464-25fc-4af1-b342-bb34c9f13b74 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1533 microversion: 2.1 time: 0.397149 Oct 31 14:31:16.787642 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2564/5373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:16 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1533 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:17.818683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:17.819495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:17.826680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:17.828214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:17.828877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:17.829783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:17.830509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:17.831288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:18.124591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:18.177850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d73c774-752d-4fff-b887-4aeee9bfe4a0 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1533 microversion: 2.1 time: 0.365229 Oct 31 14:31:18.202312 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2810/5374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:17 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1533 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:19.137582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-41d5e8c2-4473-4735-9315-8d9ffa999618 req-69e7a34c-910b-4a34-a873-ec82640952f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f15aea-b676-4c7b-be1a-dac58cc94dbe", "name": "network-vif-deleted", "tag": "1f0e833c-2262-4f09-a33e-bbcfbf5fe7f0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:19.167971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-41d5e8c2-4473-4735-9315-8d9ffa999618 req-69e7a34c-910b-4a34-a873-ec82640952f5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:19.170041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-41d5e8c2-4473-4735-9315-8d9ffa999618 req-69e7a34c-910b-4a34-a873-ec82640952f5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:19.170694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-41d5e8c2-4473-4735-9315-8d9ffa999618 req-69e7a34c-910b-4a34-a873-ec82640952f5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:19.188964 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-41d5e8c2-4473-4735-9315-8d9ffa999618 req-69e7a34c-910b-4a34-a873-ec82640952f5 service nova] Creating event network-vif-deleted:1f0e833c-2262-4f09-a33e-bbcfbf5fe7f0 for instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe on n-h2-863052-1 Oct 31 14:31:19.196184 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-41d5e8c2-4473-4735-9315-8d9ffa999618 req-69e7a34c-910b-4a34-a873-ec82640952f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062637 Oct 31 14:31:19.197373 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2565/5375] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:19.224883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:19.226416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:19.252361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:19.253091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:19.253710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:19.254843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:19.255458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:19.257234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:19.429712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef045f06c56e4e558b6b9a648ff7d87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d696d3e68447c98c7224b0bee77835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:19.442021 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-596d2d95-5adc-454e-845e-231eac495a47 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 200 len: 1313 microversion: 2.1 time: 0.220320 Oct 31 14:31:19.458713 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2811/5376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:19 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:20.467571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:20.468929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] [instance: d9f15aea-b676-4c7b-be1a-dac58cc94dbe] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:20.482682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:20.484907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:20.486258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:20.487761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:20.489614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:20.492232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:20.529624 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] HTTP exception thrown: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Request method failure captured: Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe HTTP/1.1 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9wMQ9DEEVTNwNMzEu10WRLUTy6z9cZnJrUh_xZTZ13m26CpOUeJZwG4C1TzvPSgwc1F9nHH8bt7fzoJR7d1cq7v_j3W_0HL42Pkdk0rHiZcrxV_bT9MvDqj-_BsxVjoiiaQi9MDDyVxepL0JfM0TavD5_i8bldUnruFwRYpb4gQf9E Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 04d696d3e68447c98c7224b0bee77835 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1015532341 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04d696d3e68447c98c7224b0bee77835", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04d696d3e68447c98c7224b0bee77835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04d696d3e68447c98c7224b0bee77835"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04d696d3e68447c98c7224b0bee77835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1015532341 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 04d696d3e68447c98c7224b0bee77835 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1015532341 Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1015532341-project Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: ef045f06c56e4e558b6b9a648ff7d87d Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1015532341-project Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd9f15aea-b676-4c7b-be1a-dac58cc94dbe'} Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:20.536671 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. Oct 31 14:31:20.541345 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:31:20.547482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] Returning 404 to user: Instance d9f15aea-b676-4c7b-be1a-dac58cc94dbe could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:31:20.548469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32ac9913-e1d5-496a-b325-9cda8e257117 tempest-ServersNegativeTestMultiTenantJSON-1015532341 tempest-ServersNegativeTestMultiTenantJSON-1015532341-project] 10.222.0.27 "GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe" status: 404 len: 111 microversion: 2.1 time: 0.087042 Oct 31 14:31:20.553816 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2566/5377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:20 2022] GET /compute/v2.1/servers/d9f15aea-b676-4c7b-be1a-dac58cc94dbe => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:31:28.587635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1789071664", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:28.666347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:31:29.437436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:29.705342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:31:29.706095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:31:29.706453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:31:29.707003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:31:29.707513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:31:29.727175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:29.734745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:29.735318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:29.738229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:29.739070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:29.742643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:29.831761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:31:29.856758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:31:29.912000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:31:29.914756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:31:30.080951 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-181d858d-339b-415f-808c-8bc68905ab5e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734054 Oct 31 14:31:30.084994 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2812/5378] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:31:30.108872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ca73b7c-c03d-4662-be29-21b05cdd63f0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:30.109731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0ca73b7c-c03d-4662-be29-21b05cdd63f0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:30.344712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0ca73b7c-c03d-4662-be29-21b05cdd63f0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:30.357772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ca73b7c-c03d-4662-be29-21b05cdd63f0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1193 microversion: 2.1 time: 0.258080 Oct 31 14:31:30.360119 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2567/5379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:30 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1193 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:31.390335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:31.391181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:31.414188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:31.416707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:31.417417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:31.419022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:31.421102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:31.423271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:31.692615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:31.704562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dacd79c9-be0b-4346-a789-9018d62ae935 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1189 microversion: 2.1 time: 0.319416 Oct 31 14:31:31.706675 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2813/5380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:31 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1189 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:32.732350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:32.733014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:32.751500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=69 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:32.753999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:32.754734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:32.762913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:32.763981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:32.764632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:32.765235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:33.065970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:33.080952 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3c156bb-b475-4238-a51b-7ffe62315e20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1251 microversion: 2.1 time: 0.352421 Oct 31 14:31:33.095825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2568/5381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:32 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1251 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:34.107306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:34.107859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:34.127445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:34.128058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:34.128702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:34.131680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:34.132248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:34.132697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:34.685828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:34.725193 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41815466-77b9-4421-ba8f-6fb765af5b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1293 microversion: 2.1 time: 0.621873 Oct 31 14:31:34.767930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2814/5382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:34 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1293 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:35.749520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:35.750872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:35.762490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:35.763299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:35.763999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:35.783406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:35.784208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:35.784834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:35.849832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-71c767c4-4e36-447b-a796-9844fe616ff1 req-93fb7e5e-4eca-43d4-a3ff-63d8f4bca6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc69337-faca-468c-825f-80e06b29c596", "tag": "4442e908-89f5-464b-967e-51bf8dde8b3f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:35.864059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:35.893406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-71c767c4-4e36-447b-a796-9844fe616ff1 req-93fb7e5e-4eca-43d4-a3ff-63d8f4bca6b7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:35.894136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-71c767c4-4e36-447b-a796-9844fe616ff1 req-93fb7e5e-4eca-43d4-a3ff-63d8f4bca6b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:35.895430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-71c767c4-4e36-447b-a796-9844fe616ff1 req-93fb7e5e-4eca-43d4-a3ff-63d8f4bca6b7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:35.935970 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-71c767c4-4e36-447b-a796-9844fe616ff1 req-93fb7e5e-4eca-43d4-a3ff-63d8f4bca6b7 service nova] Creating event network-changed:4442e908-89f5-464b-967e-51bf8dde8b3f for instance 5dc69337-faca-468c-825f-80e06b29c596 on n-h2-863052-1 Oct 31 14:31:35.946897 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-71c767c4-4e36-447b-a796-9844fe616ff1 req-93fb7e5e-4eca-43d4-a3ff-63d8f4bca6b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104543 Oct 31 14:31:35.947784 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2815/5383] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:36.701754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:36.737630 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86f69ba8-521e-422d-9510-3bd9da27f0cc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1293 microversion: 2.1 time: 0.991881 Oct 31 14:31:36.741948 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2569/5384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:35 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1293 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:37.765505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:37.766404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:37.780367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:37.781108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:37.785736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:37.786668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:37.787334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:37.787956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:38.478243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:38.496203 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e531f4fa-e961-48b5-ab39-350c2cdc5815 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1293 microversion: 2.1 time: 0.736168 Oct 31 14:31:38.497449 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2816/5385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:37 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1293 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:39.524900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:39.527509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:39.533173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=36 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:39.536196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:39.537282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:39.537981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:39.538943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:39.540492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:39.541156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:39.967958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:39.979858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2eeaf604-370d-4d84-8e15-c484f8fb9b4f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1293 microversion: 2.1 time: 0.460477 Oct 31 14:31:39.980450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2570/5386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:39 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1293 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:31:41.014046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:41.015361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:41.020704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:41.021824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:41.036988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:41.043039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:41.045249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:41.047935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:41.060081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:41.060942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:41.061626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:41.298293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32c98b4d-3b24-48ea-954e-17c366faf9d1 tempest-ComputeTenantNetworksTest-1035065533 tempest-ComputeTenantNetworksTest-1035065533-project] Calling method '.version_select at 0x7fe1075ccaf0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:41.334261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:41.349618 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c393fd0c-7572-4d58-8902-16512b0fdbb5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1293 microversion: 2.1 time: 0.341225 Oct 31 14:31:41.350747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2817/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:41 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:41.502934 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32c98b4d-3b24-48ea-954e-17c366faf9d1 tempest-ComputeTenantNetworksTest-1035065533 tempest-ComputeTenantNetworksTest-1035065533-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.474259 Oct 31 14:31:41.503899 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2571/5388] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:31:41 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:41.515073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9901d806-0823-4042-80d4-acc77f0055d1 tempest-ComputeTenantNetworksTest-1035065533 tempest-ComputeTenantNetworksTest-1035065533-project] Calling method '.version_select at 0x7fe1061e7790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:41.668853 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9901d806-0823-4042-80d4-acc77f0055d1 tempest-ComputeTenantNetworksTest-1035065533 tempest-ComputeTenantNetworksTest-1035065533-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/2f9f5368-20d7-4f4f-b4df-f43607fdb324" status: 200 len: 139 microversion: 2.1 time: 0.157799 Oct 31 14:31:41.675720 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2818/5389] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 14:31:41 2022] GET /compute/v2.1/os-tenant-networks/2f9f5368-20d7-4f4f-b4df-f43607fdb324 => generated 139 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:42.228444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5fb23357-b3da-48b8-8e9b-aa60ab727129 req-30d122fa-098c-42b2-8b25-4baef4eb7e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc69337-faca-468c-825f-80e06b29c596", "name": "network-vif-plugged", "status": "completed", "tag": "4442e908-89f5-464b-967e-51bf8dde8b3f"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:42.247642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5fb23357-b3da-48b8-8e9b-aa60ab727129 req-30d122fa-098c-42b2-8b25-4baef4eb7e42 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:42.250973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5fb23357-b3da-48b8-8e9b-aa60ab727129 req-30d122fa-098c-42b2-8b25-4baef4eb7e42 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:42.251481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5fb23357-b3da-48b8-8e9b-aa60ab727129 req-30d122fa-098c-42b2-8b25-4baef4eb7e42 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:42.270478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5fb23357-b3da-48b8-8e9b-aa60ab727129 req-30d122fa-098c-42b2-8b25-4baef4eb7e42 service nova] Creating event network-vif-plugged:4442e908-89f5-464b-967e-51bf8dde8b3f for instance 5dc69337-faca-468c-825f-80e06b29c596 on n-h2-863052-1 Oct 31 14:31:42.277338 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5fb23357-b3da-48b8-8e9b-aa60ab727129 req-30d122fa-098c-42b2-8b25-4baef4eb7e42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053942 Oct 31 14:31:42.277953 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2572/5390] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:31:42.385442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:42.386732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:42.403602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:42.404282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:42.404909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:42.405765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:42.406408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:42.407173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:42.716980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:42.724702 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d864f93f-8a24-482d-a36f-18b12f95676c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1293 microversion: 2.1 time: 0.344924 Oct 31 14:31:42.729563 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2819/5391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:42 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1293 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:43.753045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:43.753749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:43.769610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:43.770376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:43.771034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:43.771755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:43.772194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:43.772618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:43.986609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:44.010735 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eef0574a-79f7-4be2-abfb-9db486779064 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1474 microversion: 2.1 time: 0.250079 Oct 31 14:31:44.010735 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2573/5392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:43 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1474 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:44.190561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1134438586", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:44.315203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:31:44.866639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:31:44.870610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:31:44.870610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:31:44.870610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:31:44.870610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:31:44.879801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:44.880589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:44.881636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:44.882771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:44.884082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:44.884936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:44.905859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:31:44.911536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:31:44.927594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:31:44.930359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 588bd85f-dfae-486f-b6f0-b24c34876896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:31:44.990611 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9554f35c-c909-42ef-bd34-1a125dd7811c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804611 Oct 31 14:31:44.991800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2820/5393] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:31:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:31:45.004057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e733455-185c-4473-837a-c249215fc509 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:45.004617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e733455-185c-4473-837a-c249215fc509 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 588bd85f-dfae-486f-b6f0-b24c34876896] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:45.065429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e733455-185c-4473-837a-c249215fc509 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 588bd85f-dfae-486f-b6f0-b24c34876896] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:31:45.438915 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e733455-185c-4473-837a-c249215fc509 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896" status: 204 len: 0 microversion: 2.1 time: 0.439164 Oct 31 14:31:45.440043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2574/5394] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:31:44 2022] DELETE /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:31:45.452790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3658f53-023f-4a94-901d-bf02884a358a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:45.453411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3658f53-023f-4a94-901d-bf02884a358a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 588bd85f-dfae-486f-b6f0-b24c34876896] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:45.888327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a3658f53-023f-4a94-901d-bf02884a358a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3658f53-023f-4a94-901d-bf02884a358a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 HTTP/1.1 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '588bd85f-dfae-486f-b6f0-b24c34876896'} Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 588bd85f-dfae-486f-b6f0-b24c34876896 Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:45.897389 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:31:45.902518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3658f53-023f-4a94-901d-bf02884a358a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:31:45.905020 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3658f53-023f-4a94-901d-bf02884a358a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896" status: 404 len: 111 microversion: 2.1 time: 0.454237 Oct 31 14:31:45.905020 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2821/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:45 2022] GET /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 => generated 111 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:31:46.105927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1122179221", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:46.200499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:31:46.529360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:46.529931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:46.542290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:46.542786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:46.543221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:46.543923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:46.544377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:46.544802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:46.602642 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-391d10ec-dcc2-419f-94d5-5b9b26ebeaa8 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/ips" status: 200 len: 149 microversion: 2.1 time: 0.076595 Oct 31 14:31:46.603636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2822/5396] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:31:46 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/ips => generated 149 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:31:47.263586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:31:47.264223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:31:47.264708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:31:47.265173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:31:47.265594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:31:47.298217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:47.315018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:47.315481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:47.316310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:47.316772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:47.317199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:47.413057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:31:47.432059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:31:47.458927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:31:47.472678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:31:47.615198 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d875375-1dd0-4d3d-8f8f-ace9a3d2b6bb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513635 Oct 31 14:31:47.616550 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2575/5397] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:31:47.633398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d92e4096-6b87-4d6a-8ba0-cce2aaad5ad0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:47.634265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d92e4096-6b87-4d6a-8ba0-cce2aaad5ad0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:47.798749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d92e4096-6b87-4d6a-8ba0-cce2aaad5ad0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:47.826828 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d92e4096-6b87-4d6a-8ba0-cce2aaad5ad0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1221 microversion: 2.1 time: 0.196979 Oct 31 14:31:47.830648 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2823/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:47 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1221 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:48.868018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:48.873072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:48.896222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:48.898748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:48.901119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:48.909676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:48.912105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:48.913936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:49.138037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:49.149599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de33020b-6c95-4ae6-89f4-6f0ea1dfedf2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1225 microversion: 2.1 time: 0.292614 Oct 31 14:31:49.150834 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2576/5399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:48 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1225 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:50.175329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:50.176051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:50.190790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:50.191330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:50.191789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:50.194693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:50.195185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:50.196209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:50.368792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:50.382578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efdd67f7-8270-41c5-b356-d731e5d6d96b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1279 microversion: 2.1 time: 0.208878 Oct 31 14:31:50.384128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2824/5400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:50 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:50.631057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6d403db-f70f-4535-9dcb-21426555704b"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:50.634802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:50.648270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:50.651721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:50.653476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:50.657457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:50.658194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:50.659270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:51.212936 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7b911db-79b8-4e87-b4b1-c4bfe29373f2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "POST /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586519 Oct 31 14:31:51.230195 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2577/5401] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:31:50 2022] POST /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:31:51.408065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:51.408687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:51.425163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:51.425683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:51.426130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:51.432392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:51.433143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:51.436856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:51.684952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:51.693003 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb66abf6-5121-4881-858b-f65c4cd93296 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1279 microversion: 2.1 time: 0.289104 Oct 31 14:31:51.693571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2825/5402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:51 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:52.720634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:52.721755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:52.745595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:52.750547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:52.753630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:52.755439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:52.759358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:52.760047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:53.139040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:53.150504 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0faa6354-b839-4c01-b0e4-47353cc32808 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.433429 Oct 31 14:31:53.152805 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2578/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:52 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:54.176518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:54.177130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:54.202908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:54.203553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:54.204019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:54.208415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:54.208927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:54.209364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:54.897470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:55.891572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:55.902252 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-affabbaa-d2ac-4432-8d71-bdbd95ebc9a9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 1.730216 Oct 31 14:31:55.902849 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2826/5404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:54 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:56.925688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:56.930143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:56.963952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:56.965965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:56.967865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:56.969168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:56.972181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:56.972851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:57.209908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:57.228080 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8cb938bf-a1d6-4f47-8630-419a7da6e4d0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.306259 Oct 31 14:31:57.230792 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2579/5405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:56 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:57.727587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-496a6263-4985-41cd-a0c5-c3b5f8425ae1 req-a5572715-95ae-4ce8-aeb2-8d28cdf3fc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caaa0a9a-8142-4aee-a1ab-69ec14270bc7", "tag": "649f78e8-7bdc-472a-a002-8f2a6f859eaa"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:57.764572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-496a6263-4985-41cd-a0c5-c3b5f8425ae1 req-a5572715-95ae-4ce8-aeb2-8d28cdf3fc04 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:57.765167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-496a6263-4985-41cd-a0c5-c3b5f8425ae1 req-a5572715-95ae-4ce8-aeb2-8d28cdf3fc04 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:57.767867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-496a6263-4985-41cd-a0c5-c3b5f8425ae1 req-a5572715-95ae-4ce8-aeb2-8d28cdf3fc04 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:57.794303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-496a6263-4985-41cd-a0c5-c3b5f8425ae1 req-a5572715-95ae-4ce8-aeb2-8d28cdf3fc04 service nova] Creating event network-changed:649f78e8-7bdc-472a-a002-8f2a6f859eaa for instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 on n-h2-863052-1 Oct 31 14:31:57.826000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-496a6263-4985-41cd-a0c5-c3b5f8425ae1 req-a5572715-95ae-4ce8-aeb2-8d28cdf3fc04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085588 Oct 31 14:31:57.827100 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2827/5406] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:31:58.254654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:58.255743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:58.258063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:58.259374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:58.279866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:58.283565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:58.286985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:58.287764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:58.288245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:58.292781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:58.539282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:58.549267 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a33f4d4-8c32-448f-b197-5933fd09522a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.299668 Oct 31 14:31:58.550587 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2580/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:58 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:31:58.813198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:59.420096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6707802-4749-4a29-93d5-31f0333e45f0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'create', calling method: .version_select at 0x7fe107418550>, body: {"keypair": {"name": "tempest-keypair-458919210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuD8hyWR4EKtAMnYmBB6pSuBRMPQB9GZFKj5/kRuzsFvMY4MOu1EiX7aBs0zol2amXecQhYMBibTvBaD95tNTlYtclXZEqXzourBtJsWpul6AT3S12ttRwOvPEo5FI42Q=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:31:59.462202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f6707802-4749-4a29-93d5-31f0333e45f0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for project b20b14e27a7348b786b017e067a9bece. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:31:59.485866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f6707802-4749-4a29-93d5-31f0333e45f0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for user 9362cc6b2b5342e1b9f02c433bbb731b and project b20b14e27a7348b786b017e067a9bece. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:31:59.526919 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6707802-4749-4a29-93d5-31f0333e45f0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.720881 Oct 31 14:31:59.527827 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2828/5408] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:31:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 724 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 31 14:31:59.581979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:31:59.583786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:31:59.598561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:59.600623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:59.603098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:59.603984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:31:59.605627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:31:59.607174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:31:59.921133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:31:59.934114 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0554a03c-676f-4803-b661-b815a201c33c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.360776 Oct 31 14:31:59.934742 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2581/5409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:31:59 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:00.962144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:00.963407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:00.972914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:00.972914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:00.973140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:00.973822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:00.974310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:00.975165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:01.033682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=61 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:01.640014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:01.649295 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62567c20-8168-4325-9a1f-58dd137527ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.692257 Oct 31 14:32:01.659307 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2829/5410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:00 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:02.690697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:02.691463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:02.705439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:02.705935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:02.706405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:02.723397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:02.723891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:02.724334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:02.810630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:02.842216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-582375598", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0dff37-70d3-4bfe-bb68-150fb3501d95"}], "security_groups": [{"name": "tempest-securitygroup--1339161249"}], "key_name": "tempest-keypair-458919210", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:03.076242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] validate_networks() for [('8d0dff37-70d3-4bfe-bb68-150fb3501d95', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:03.167222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:03.184683 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00eae31b-1d1c-4bbc-bfd3-3a98136adf1b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.505516 Oct 31 14:32:03.185286 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2582/5411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:02 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:03.724138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:03.724775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:03.725327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:03.728047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:03.728486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:03.740970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:03.741192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:03.742145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:03.743078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:03.743698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:03.744400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:03.767420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for project b20b14e27a7348b786b017e067a9bece. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:03.775064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for user 9362cc6b2b5342e1b9f02c433bbb731b and project b20b14e27a7348b786b017e067a9bece. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:03.790420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:03.793161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:03.914283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfdbaf42-db86-4c07-adb0-4455d02cbc80 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.075814 Oct 31 14:32:03.927962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2830/5412] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:32:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:32:03.933209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ed8cf17-1afa-49d9-9b68-faad04b2b752 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:03.935130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ed8cf17-1afa-49d9-9b68-faad04b2b752 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:04.031673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ed8cf17-1afa-49d9-9b68-faad04b2b752 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:04.054017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ed8cf17-1afa-49d9-9b68-faad04b2b752 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:04.056247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ed8cf17-1afa-49d9-9b68-faad04b2b752 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:04.070253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ed8cf17-1afa-49d9-9b68-faad04b2b752 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1280 microversion: 2.20 time: 0.140599 Oct 31 14:32:04.087055 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2583/5413] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:03 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:04.221243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:04.221877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:04.248967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:04.252363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:04.254443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:04.257063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:04.258695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:04.259352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:04.516865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:04.527785 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cc1e92e-50e5-4cd6-b0eb-6372f4c0fcc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.319738 Oct 31 14:32:04.528960 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2831/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:04 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:04.553074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-db9dc9b2-7a40-4e94-8918-811be1f2f801 req-7b6d8775-f29c-462a-9e24-bf64030d77ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaa0a9a-8142-4aee-a1ab-69ec14270bc7", "name": "network-vif-plugged", "status": "completed", "tag": "649f78e8-7bdc-472a-a002-8f2a6f859eaa"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:04.576128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-db9dc9b2-7a40-4e94-8918-811be1f2f801 req-7b6d8775-f29c-462a-9e24-bf64030d77ce service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:04.576128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-db9dc9b2-7a40-4e94-8918-811be1f2f801 req-7b6d8775-f29c-462a-9e24-bf64030d77ce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:04.576436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-db9dc9b2-7a40-4e94-8918-811be1f2f801 req-7b6d8775-f29c-462a-9e24-bf64030d77ce service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:04.621595 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-db9dc9b2-7a40-4e94-8918-811be1f2f801 req-7b6d8775-f29c-462a-9e24-bf64030d77ce service nova] Creating event network-vif-plugged:649f78e8-7bdc-472a-a002-8f2a6f859eaa for instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 on n-h2-863052-1 Oct 31 14:32:04.627981 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-db9dc9b2-7a40-4e94-8918-811be1f2f801 req-7b6d8775-f29c-462a-9e24-bf64030d77ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080285 Oct 31 14:32:04.629170 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2584/5415] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:05.099211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:05.099894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:05.117785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:05.118321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:05.118771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:05.119489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:05.119952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:05.120391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:05.210281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:05.221493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:05.223775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:05.225204 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76fbf156-fcf7-4a96-986f-a979a751d302 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1276 microversion: 2.20 time: 0.130082 Oct 31 14:32:05.239118 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2832/5416] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:05 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:05.563885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:05.565912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:05.593192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:05.594055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:05.594827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:05.596584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:05.597782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:05.599548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:05.987290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:06.000665 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30db6f5c-4b55-458d-9f58-66d911099e2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1321 microversion: 2.1 time: 0.442634 Oct 31 14:32:06.014506 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2585/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:05 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:06.259912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:06.260880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:06.268230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:06.268807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:06.269322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:06.270256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:06.270849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:06.271407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:06.344070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:06.353229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:06.354726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:06.356000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00735eed-99d9-4ff8-843f-1ab773b852ce tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1338 microversion: 2.20 time: 0.100496 Oct 31 14:32:06.356573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2833/5418] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:06 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:32:06.573883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-991152434", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7873628f-dcde-4e2e-bd0f-81782a012eb5"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:06.638114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] validate_networks() for [('7873628f-dcde-4e2e-bd0f-81782a012eb5', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:07.024657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:07.025283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:07.032198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.032700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.033150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.034022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.034515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.035083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.208297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:07.217957 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdd6eaff-1b8b-4d34-8866-a4b239e8834b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1502 microversion: 2.1 time: 0.196966 Oct 31 14:32:07.219245 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2834/5419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:07 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:07.243774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:07.244400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:07.252252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.252906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.253351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.254061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.254721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.255152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.322115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:07.323007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:07.323694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:07.324308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:07.324926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:07.335884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.336665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.337310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.338460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.339342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.340064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.362881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Getting quotas for project 61d50bff391949ca87e5c4dc42980166. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:07.372982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Getting quotas for user 4abe13a4852a47db9bad6d7e5e7832a7 and project 61d50bff391949ca87e5c4dc42980166. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:07.395786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:07.403662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:07.471430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:07.483722 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-580d76fa-9d2c-459a-9f72-0e8bd377947d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1502 microversion: 2.1 time: 0.245433 Oct 31 14:32:07.495606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2835/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:07 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:07.519856 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-595da414-3710-446b-9fd0-06acddbb1940 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949882 Oct 31 14:32:07.521099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:07.521859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:07.525385 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2586/5421] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:32:07.533292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:07.536119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:07.544923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.545756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.546460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.547008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.547128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.547822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.548005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.548724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.549014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.549629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.549941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.550424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.622592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:32:07.792190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:07.801429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:07.802941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:07.804343 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-171d3735-8699-4547-b912-b978c7b67e1f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1406 microversion: 2.20 time: 0.301804 Oct 31 14:32:07.805468 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2836/5422] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:07 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:07.811137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56461e1d-a8f9-49fb-aa42-91aba7a4c98e tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:07.811996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56461e1d-a8f9-49fb-aa42-91aba7a4c98e tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:07.821423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:07.855598 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a01ccee-7321-4571-a3cf-76b9da3f706b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 204 len: 0 microversion: 2.1 time: 0.328265 Oct 31 14:32:07.856734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2587/5423] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:07 2022] DELETE /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:07.867759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:07.869113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:07.898715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.901515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.904274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.905382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:07.906554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:07.907361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:07.942270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-56461e1d-a8f9-49fb-aa42-91aba7a4c98e tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:07.959764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56461e1d-a8f9-49fb-aa42-91aba7a4c98e tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1213 microversion: 2.1 time: 0.152874 Oct 31 14:32:07.961173 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2837/5424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:07 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:08.140106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-826245e1-2825-4bbf-8306-74ce776fa077 req-96730300-2b5d-4d64-bfae-ae05be332367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:08.157800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-826245e1-2825-4bbf-8306-74ce776fa077 req-96730300-2b5d-4d64-bfae-ae05be332367 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:08.158706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-826245e1-2825-4bbf-8306-74ce776fa077 req-96730300-2b5d-4d64-bfae-ae05be332367 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:08.159373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-826245e1-2825-4bbf-8306-74ce776fa077 req-96730300-2b5d-4d64-bfae-ae05be332367 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:08.170957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:08.182403 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-114a767e-46b2-4099-bb2a-0b9f88742bcb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1508 microversion: 2.1 time: 0.320891 Oct 31 14:32:08.185543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2588/5425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:07 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:08.192450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-826245e1-2825-4bbf-8306-74ce776fa077 req-96730300-2b5d-4d64-bfae-ae05be332367 service nova] Creating event network-changed:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:32:08.201683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-826245e1-2825-4bbf-8306-74ce776fa077 req-96730300-2b5d-4d64-bfae-ae05be332367 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065277 Oct 31 14:32:08.202953 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2838/5426] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:08.832754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:08.834091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:08.852683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:08.853181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:08.853620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:08.854376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:08.854829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:08.855450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:08.989882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:08.992053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:08.999642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.000510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.004982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.005749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.006250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.006858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.088388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:09.089585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:09.102126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98348ee9-b47f-4750-a0cd-f27b2fe61ad1 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1209 microversion: 2.1 time: 0.117695 Oct 31 14:32:09.103095 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2839/5427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:08 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:09.118756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:09.120443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:09.121609 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fec76352-719a-4813-a38b-654345d39d0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1406 microversion: 2.20 time: 0.292919 Oct 31 14:32:09.122385 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2589/5428] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:08 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:09.210932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:09.211908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:09.218829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.219768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.220370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.221448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.223834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.224460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.408874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:09.409677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:09.416735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.417605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.418251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.419199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.419836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.420419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.622081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lazy-loading 'services' on Instance uuid 5b45536d-f277-4680-8c41-b34b045b4a5b {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:32:09.662038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:09.666796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c59953d-e3bb-41aa-b421-1ea9b6be975e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1508 microversion: 2.1 time: 0.461929 Oct 31 14:32:09.670310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2840/5429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:09 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:09.810035 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-864bb82d-c9f6-48c7-a18c-db7711f7bcc9 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments/d6d403db-f70f-4535-9dcb-21426555704b" status: 202 len: 0 microversion: 2.1 time: 0.405844 Oct 31 14:32:09.813140 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2590/5430] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:32:09 2022] DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments/d6d403db-f70f-4535-9dcb-21426555704b => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:32:09.827802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:09.837561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:09.857446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.857996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.858724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.859906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:09.860606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:09.861346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:09.904170 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a55e15ce-c9ca-4d5e-9456-10df7cea70c0 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086378 Oct 31 14:32:09.905611 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2841/5431] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:09 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:10.123939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d47f61fe-7730-4c4c-862a-ddf4830b0244 req-5d35d490-8da8-4e77-910d-48e3ca37c9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaa0a9a-8142-4aee-a1ab-69ec14270bc7", "name": "network-vif-deleted", "tag": "649f78e8-7bdc-472a-a002-8f2a6f859eaa"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:10.141661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:10.142598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:10.143896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:10.168831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d47f61fe-7730-4c4c-862a-ddf4830b0244 req-5d35d490-8da8-4e77-910d-48e3ca37c9a3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.169636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d47f61fe-7730-4c4c-862a-ddf4830b0244 req-5d35d490-8da8-4e77-910d-48e3ca37c9a3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.169799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d47f61fe-7730-4c4c-862a-ddf4830b0244 req-5d35d490-8da8-4e77-910d-48e3ca37c9a3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.176529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.178762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.181602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.182618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.184445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.186638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.219693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d47f61fe-7730-4c4c-862a-ddf4830b0244 req-5d35d490-8da8-4e77-910d-48e3ca37c9a3 service nova] Creating event network-vif-deleted:649f78e8-7bdc-472a-a002-8f2a6f859eaa for instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 on n-h2-863052-1 Oct 31 14:32:10.232688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d47f61fe-7730-4c4c-862a-ddf4830b0244 req-5d35d490-8da8-4e77-910d-48e3ca37c9a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117079 Oct 31 14:32:10.234881 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2591/5432] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:10.244394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:10.245689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:10.253740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.254706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.255444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.256319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.257319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.257916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.360665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:10.372527 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12cafa19-d18e-4def-870f-9de157c3517c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1265 microversion: 2.1 time: 0.244137 Oct 31 14:32:10.380334 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2842/5433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:10 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:10.671004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:10.680072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:10.684517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:10.687306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebe56466-c2d2-45cd-a469-19bc472d1c8d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1406 microversion: 2.20 time: 0.448041 Oct 31 14:32:10.690114 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2592/5434] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:10 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:10.697589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:10.698465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:10.707033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.709562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.710696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.712724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.714859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.715578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.799261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.799774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.800206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.811801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lazy-loading 'fault' on Instance uuid caaa0a9a-8142-4aee-a1ab-69ec14270bc7 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:32:10.899617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:10.913438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2e7c530-a77b-4973-9e4e-cbc1e5474d80 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 200 len: 1311 microversion: 2.1 time: 0.220250 Oct 31 14:32:10.914767 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2843/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:10 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:10.917870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:10.921172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:10.930116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.930637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.936456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:10.937487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:10.938196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:10.947352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:11.010287 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35021fda-1ced-4700-88c9-6bb33bfe81a7 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096984 Oct 31 14:32:11.016052 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2593/5436] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:10 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:11.396134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:11.396891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:11.424294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:11.428203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:11.430677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:11.433624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:11.434512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:11.439432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:11.720193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:11.720756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:11.737058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:11.739572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:11.740038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:11.741690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:11.742183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:11.742620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:11.801708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:11.816840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acd054e4-f1af-44e8-aa9c-3ade862d80bb tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.424888 Oct 31 14:32:11.817789 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2844/5437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:11 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:11.937973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:11.939029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:11.960475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:11.960986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:11.961432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:11.962152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:11.965996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:11.966478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:12.005244 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 HTTP/1.1 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'caaa0a9a-8142-4aee-a1ab-69ec14270bc7'} Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:12.007315 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:12.013602 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d74e84b8-a071-41fb-bbad-94b90a224107 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 404 len: 111 microversion: 2.1 time: 0.075458 Oct 31 14:32:12.017615 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2845/5438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:11 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:12.028512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:12.031047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:12.037447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:12.044380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:12.044892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:12.045343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:12.046067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:12.046568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:12.047015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:12.055026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:12.057965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:12.059848 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3df1ba2d-8233-4642-a86b-1c27a34d5ee1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1406 microversion: 2.20 time: 0.344084 Oct 31 14:32:12.062363 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2594/5439] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:11 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:12.070568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c19b367c-5c21-43c6-947c-d1fcdd328907 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: .version_select at 0x7fe107eba3a0>, body: {"keypair": {"name": "tempest-key-1560065527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9FWgFfRtSrZvpNLxkv0jaQHSFxhHlWtuswXDiPyatMyZ8TE2ocxVQa2/MZIJXqDOa8JzARYtTDnRnUe8nQK/64hBcq4nF8oRZyvvA0tH34WnChk06Xgb6RsmMWtahhYQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:12.110388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c19b367c-5c21-43c6-947c-d1fcdd328907 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:12.124923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c19b367c-5c21-43c6-947c-d1fcdd328907 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:12.136116 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49d6852f-5680-4cbf-8619-0d5e8bbdc7ca tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117085 Oct 31 14:32:12.142552 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2846/5440] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:12 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:12.175565 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c19b367c-5c21-43c6-947c-d1fcdd328907 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.111850 Oct 31 14:32:12.176836 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2595/5441] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:32:12 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:12.188210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d336f65d-c655-4b10-b1d0-a104ae155bd9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '.version_select at 0x7fe10fb58ee0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:12.192900 n-d-863052-1 devstack@n-api.service[120640]: WARNING oslo_db.sqlalchemy.utils [None req-d336f65d-c655-4b10-b1d0-a104ae155bd9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 14:32:12.204080 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d336f65d-c655-4b10-b1d0-a104ae155bd9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.019807 Oct 31 14:32:12.205803 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2847/5442] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:32:12 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:12.366609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1429687463", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-key-1560065527", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:12.438619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:12.757965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2a0f5c7d-f1ee-4d85-9030-a11f3bbf75c1 req-5349c145-6441-49d7-92d8-1e9bbe138f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c2e73b-5098-4674-b2f8-d483c7c1a8f8", "tag": "b8f728e7-e21e-448d-8664-8e7324632e74"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:12.773728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2a0f5c7d-f1ee-4d85-9030-a11f3bbf75c1 req-5349c145-6441-49d7-92d8-1e9bbe138f5c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:12.777194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2a0f5c7d-f1ee-4d85-9030-a11f3bbf75c1 req-5349c145-6441-49d7-92d8-1e9bbe138f5c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:12.777682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2a0f5c7d-f1ee-4d85-9030-a11f3bbf75c1 req-5349c145-6441-49d7-92d8-1e9bbe138f5c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:12.797946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2a0f5c7d-f1ee-4d85-9030-a11f3bbf75c1 req-5349c145-6441-49d7-92d8-1e9bbe138f5c service nova] Creating event network-changed:b8f728e7-e21e-448d-8664-8e7324632e74 for instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 on n-h2-863052-1 Oct 31 14:32:12.808159 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2a0f5c7d-f1ee-4d85-9030-a11f3bbf75c1 req-5349c145-6441-49d7-92d8-1e9bbe138f5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053793 Oct 31 14:32:12.808797 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2848/5443] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:32:12.843010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:12.844169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:12.857598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:12.858510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:12.859140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:12.860034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:12.865341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:12.866420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.139696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:13.151566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0deb7ccf-d2a5-4246-9fb5-16a08ddef9f9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.313412 Oct 31 14:32:13.152165 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2849/5444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:12 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:13.166454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:13.167362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:13.184869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.185636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.186302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.187329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.187978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.188566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.193137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:13.338787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:13.339308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:13.339777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:13.340257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:13.340735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:13.351452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.352060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.352590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.353512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.354224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.354838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.376631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:13.384527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:13.401039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:13.403844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:13.516452 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d23988b9-ed0c-4623-9b40-0d069a5d112c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154844 Oct 31 14:32:13.526592 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2596/5445] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:32:13.531789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:13.536540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:13.574225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.574727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.575165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.575879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.576332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.576751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.587950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:13.610134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:13.613743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:13.618039 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ecc8968-1a51-45d1-9dd6-f722a8639e0b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1406 microversion: 2.20 time: 0.462995 Oct 31 14:32:13.618691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2850/5446] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:13 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:13.631695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-246dd33e-ca9c-4141-8bd6-f326416d0bba tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:13.636239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-246dd33e-ca9c-4141-8bd6-f326416d0bba tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:13.666047 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5baf69c-854b-4d90-979f-df8b6f7a2c26 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137885 Oct 31 14:32:13.667168 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2597/5447] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:13 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:13.739419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-246dd33e-ca9c-4141-8bd6-f326416d0bba tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:13.747270 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-246dd33e-ca9c-4141-8bd6-f326416d0bba tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1229 microversion: 2.1 time: 0.123900 Oct 31 14:32:13.758206 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2851/5448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:13 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:13.770804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-104fd52f-dcbb-4230-96f5-460879d84e33 req-5c260264-568c-4125-ba43-3d5579d598e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:13.785316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-104fd52f-dcbb-4230-96f5-460879d84e33 req-5c260264-568c-4125-ba43-3d5579d598e8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:13.785849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-104fd52f-dcbb-4230-96f5-460879d84e33 req-5c260264-568c-4125-ba43-3d5579d598e8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:13.786447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-104fd52f-dcbb-4230-96f5-460879d84e33 req-5c260264-568c-4125-ba43-3d5579d598e8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:13.801877 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-104fd52f-dcbb-4230-96f5-460879d84e33 req-5c260264-568c-4125-ba43-3d5579d598e8 service nova] Creating event network-vif-plugged:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:32:13.810756 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-104fd52f-dcbb-4230-96f5-460879d84e33 req-5c260264-568c-4125-ba43-3d5579d598e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042637 Oct 31 14:32:13.811972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2598/5449] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:14.175554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:14.176178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:14.178078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:14.185480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.185998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.186461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.187206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.187696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.188131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.323876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:14.331965 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-369862b5-c163-45ce-a01b-9ce26ba42585 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.160363 Oct 31 14:32:14.332544 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2852/5450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:14 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:14.646243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:14.648266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:14.654897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.655517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.656197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.657000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.657550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.658215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.682243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:14.685624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:14.707468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.710270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.712099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.719388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.720029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.720475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.764225 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c827e40-10d1-411f-b0ed-7d954c6728d6 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088708 Oct 31 14:32:14.765147 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2853/5451] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:14 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:32:14.777884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:14.778774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:14.785888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.786519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.786960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.787753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:14.788314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:14.788737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:14.842055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:14.855484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:14.857209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:14.858557 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15ebc421-0f8d-4dc1-aa5a-9f19e97f3470 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1406 microversion: 2.20 time: 0.216679 Oct 31 14:32:14.859322 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2599/5452] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:14 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:14.873150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:14.885321 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca0d1a53-af7e-4f98-b89e-57a42683ce84 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1281 microversion: 2.1 time: 0.113655 Oct 31 14:32:14.890831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2854/5453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:14 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:15.356434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:15.357121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:15.368319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.370841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.379289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.380623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.381344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.382047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.566643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:15.575349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f74210d1-6d5e-4286-906f-a2b7721e692a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.223575 Oct 31 14:32:15.587167 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2600/5454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:15 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:15.777765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:15.781135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:15.790272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.791045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.791696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.793825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.794586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.795194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.848921 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e26a8db-e470-4c27-912d-8d0299db7749 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075333 Oct 31 14:32:15.854426 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2855/5455] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:15 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:15.885881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:15.887325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:15.894996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.895812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.896463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.897579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.899818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.900476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.910943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:15.911583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:15.931833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.932352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.933437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:15.933580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:15.934000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:15.934492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:16.080850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:16.089450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31cb2f2f-4d3f-4520-a4ca-d9e759e7f6bd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1287 microversion: 2.1 time: 0.182862 Oct 31 14:32:16.093406 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2856/5456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:15 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:16.121031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:16.133731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:16.135688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:16.137288 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c29e8b87-e0fd-4183-be2a-f9b9753418a1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1597 microversion: 2.20 time: 0.256955 Oct 31 14:32:16.138597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2601/5457] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:15 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1597 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:16.163813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:16.164572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:16.170886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:16.171376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:16.172000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:16.172872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:16.173493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:16.174098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:16.406083 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da0c5249-e5ca-44f7-9c6c-ac6140862d68 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.246163 Oct 31 14:32:16.407100 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2857/5458] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:32:16 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:32:16.599238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:16.602359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:16.616885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:16.617733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:16.619073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:16.621956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:16.623380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:16.624002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:16.653465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:16.862541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:16.872440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:16.937451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:16.945573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:16.949968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:16.952920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:16.953589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:16.957520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.051265 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-306ee720-42b8-401f-944c-115c5f14374a tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.193656 Oct 31 14:32:17.051867 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2858/5459] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 14:32:16 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:32:17.118579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:17.119124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:17.130574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.134990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.137617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.142325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.143164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.153256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.232414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:17.245961 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25f9a5b0-8995-4587-8f6d-48116d8fdb7d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.650614 Oct 31 14:32:17.248626 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2602/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:16 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:17.261351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:17.262681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:17.270670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.271452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.272158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.273069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.273691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.274301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.331482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:32:17.495071 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4cd37b99-a5cc-4e67-8108-26c6d1405337 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 204 len: 0 microversion: 2.1 time: 0.243951 Oct 31 14:32:17.496656 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2603/5461] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:17 2022] DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:17.510677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:17.511680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:17.518714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.519484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.520091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.520973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.521580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.523135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.596128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:17.607634 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b637f50-bd85-47e2-92ea-92b99fb39a3a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1329 microversion: 2.1 time: 0.492327 Oct 31 14:32:17.608964 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2859/5462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:17 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1329 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:17.753123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ba1667a7-6c6f-45e1-8ba1-5c78a7d4679c req-4747fb81-1ee1-43ab-8189-d4dcdb80cbed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c68e14-fb6c-41f3-933a-2b8a37442479", "tag": "fa58abf0-7def-4d4e-b769-4ad65644fde0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:17.766428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ba1667a7-6c6f-45e1-8ba1-5c78a7d4679c req-4747fb81-1ee1-43ab-8189-d4dcdb80cbed service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:17.767190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ba1667a7-6c6f-45e1-8ba1-5c78a7d4679c req-4747fb81-1ee1-43ab-8189-d4dcdb80cbed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:17.767830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ba1667a7-6c6f-45e1-8ba1-5c78a7d4679c req-4747fb81-1ee1-43ab-8189-d4dcdb80cbed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:17.781278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ba1667a7-6c6f-45e1-8ba1-5c78a7d4679c req-4747fb81-1ee1-43ab-8189-d4dcdb80cbed service nova] Creating event network-changed:fa58abf0-7def-4d4e-b769-4ad65644fde0 for instance d0c68e14-fb6c-41f3-933a-2b8a37442479 on n-h2-863052-1 Oct 31 14:32:17.788640 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ba1667a7-6c6f-45e1-8ba1-5c78a7d4679c req-4747fb81-1ee1-43ab-8189-d4dcdb80cbed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039882 Oct 31 14:32:17.789896 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2860/5463] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:17.862426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:17.879263 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d43ad13-fb31-4117-93cf-04787231afac tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1681 microversion: 2.1 time: 0.378196 Oct 31 14:32:17.879854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2604/5464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:17 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1681 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:18.138737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-969611ee-cd24-4753-a796-795444eadba2 req-68ba1a52-9443-4090-8775-471114a8a9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:18.148565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-969611ee-cd24-4753-a796-795444eadba2 req-68ba1a52-9443-4090-8775-471114a8a9e3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.149053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-969611ee-cd24-4753-a796-795444eadba2 req-68ba1a52-9443-4090-8775-471114a8a9e3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.149491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-969611ee-cd24-4753-a796-795444eadba2 req-68ba1a52-9443-4090-8775-471114a8a9e3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.160923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-969611ee-cd24-4753-a796-795444eadba2 req-68ba1a52-9443-4090-8775-471114a8a9e3 service nova] Creating event network-changed:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:32:18.166842 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-969611ee-cd24-4753-a796-795444eadba2 req-68ba1a52-9443-4090-8775-471114a8a9e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 Oct 31 14:32:18.167955 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2861/5465] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:18.226011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-81148c80-d8c2-47f6-aa90-bbf3f623c338 req-4ed0a832-6c78-4818-9080-a0b84816e307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c2e73b-5098-4674-b2f8-d483c7c1a8f8", "name": "network-vif-plugged", "status": "completed", "tag": "b8f728e7-e21e-448d-8664-8e7324632e74"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:18.246276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-81148c80-d8c2-47f6-aa90-bbf3f623c338 req-4ed0a832-6c78-4818-9080-a0b84816e307 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.247634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-81148c80-d8c2-47f6-aa90-bbf3f623c338 req-4ed0a832-6c78-4818-9080-a0b84816e307 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.248314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-81148c80-d8c2-47f6-aa90-bbf3f623c338 req-4ed0a832-6c78-4818-9080-a0b84816e307 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.261752 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-81148c80-d8c2-47f6-aa90-bbf3f623c338 req-4ed0a832-6c78-4818-9080-a0b84816e307 service nova] Creating event network-vif-plugged:b8f728e7-e21e-448d-8664-8e7324632e74 for instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 on n-h2-863052-1 Oct 31 14:32:18.268980 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-81148c80-d8c2-47f6-aa90-bbf3f623c338 req-4ed0a832-6c78-4818-9080-a0b84816e307 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047742 Oct 31 14:32:18.269868 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2605/5466] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:32:18.273243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:18.274035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:18.280920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.281597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.282098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.283245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.283970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.284786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.477184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:18.490930 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30c24865-4abc-4050-89d0-5a553f64a2c6 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.221956 Oct 31 14:32:18.491842 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2862/5467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:18 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:18.631577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:18.632348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:18.639948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.640889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.641575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.642565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.643248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.643833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.903295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:18.904196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:18.920155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.920658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.921100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.921807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:18.922285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:18.922714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:18.953097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:18.962914 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c2df7b7-5d64-4872-8988-bdf45eb3b26b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1329 microversion: 2.1 time: 0.335706 Oct 31 14:32:18.978945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2606/5468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:18 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1329 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:19.498100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:19.508027 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b34257f9-ee3a-46ae-9f33-7fcee88ebd41 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1681 microversion: 2.1 time: 0.608702 Oct 31 14:32:19.514282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:19.515625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:19.523225 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2863/5469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:18 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1681 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:19.528451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:19.533659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:19.534528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:19.536153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:19.538747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:19.539516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:19.789007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:19.798571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2afa8546-b4e7-48d0-8a88-323ac51483be tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1313 microversion: 2.1 time: 0.288506 Oct 31 14:32:19.799960 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2607/5470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:19 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:19.988953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:19.989570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:20.002190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:20.002614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:20.003046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:20.003944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:20.004567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:20.007933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:20.536135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:20.537324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:20.549166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:20.563672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:20.567836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:20.568888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:20.569567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:20.570457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:20.740691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:20.755805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-846f835a-291c-486c-ae85-7dcb80d7b957 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1329 microversion: 2.1 time: 0.771459 Oct 31 14:32:20.757351 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2864/5471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:19 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1329 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:20.825715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:20.826645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:20.838824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:20.839418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:20.839886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:20.840632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:20.841090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:20.841521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:20.901620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18afbe74ab5c426087d0e4635b3c38ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722078c8963b46b890d3a73abde4a1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:20.910185 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af82de88-7b90-4d9d-9138-cac6f5dc66db tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 200 len: 1681 microversion: 2.1 time: 0.377957 Oct 31 14:32:20.923826 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2608/5472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:20 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 1681 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:21.181985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:21.192671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43e6be99-8ce8-4627-85d3-97c5d4853d31 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1495 microversion: 2.1 time: 0.371579 Oct 31 14:32:21.198633 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2865/5473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:20 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1495 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:21.425478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ff30b69f-e136-42b2-bb23-0bc287bbd867 req-5c45b802-0f82-4e8e-843d-71ace37fab3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b45536d-f277-4680-8c41-b34b045b4a5b", "name": "network-vif-deleted", "tag": "bc003b2f-671d-4260-88fc-a4fb53734933"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:21.443399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ff30b69f-e136-42b2-bb23-0bc287bbd867 req-5c45b802-0f82-4e8e-843d-71ace37fab3a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.445086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ff30b69f-e136-42b2-bb23-0bc287bbd867 req-5c45b802-0f82-4e8e-843d-71ace37fab3a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.445846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ff30b69f-e136-42b2-bb23-0bc287bbd867 req-5c45b802-0f82-4e8e-843d-71ace37fab3a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:21.487840 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ff30b69f-e136-42b2-bb23-0bc287bbd867 req-5c45b802-0f82-4e8e-843d-71ace37fab3a service nova] Creating event network-vif-deleted:bc003b2f-671d-4260-88fc-a4fb53734933 for instance 5b45536d-f277-4680-8c41-b34b045b4a5b on n-h1-863052-1 Oct 31 14:32:21.499727 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ff30b69f-e136-42b2-bb23-0bc287bbd867 req-5c45b802-0f82-4e8e-843d-71ace37fab3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074777 Oct 31 14:32:21.503902 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2609/5474] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:21.757665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:21.758223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:21.764370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.764882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.765315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:21.766012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.766491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.767124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:21.784292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:21.785167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:21.798546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:32:21.809298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.810227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.812922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:21.813783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.814419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.816144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:21.910475 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61a27955-b4ae-4dd2-a37d-660c8a82a1c3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 204 len: 0 microversion: 2.1 time: 0.156014 Oct 31 14:32:21.913886 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2866/5475] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:21 2022] DELETE /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:21.927316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:21.928022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:21.940185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.940681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.941318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:21.942235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:21.942856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:21.943520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:22.165884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:22.167220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:22.174611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:22.180467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2aa87a53-8333-409f-a94d-7bbe6d564023 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1501 microversion: 2.1 time: 0.260726 Oct 31 14:32:22.182196 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2867/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:21 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:22.184963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b4d5203-f2d5-4e82-b3b1-ed25bde1f2fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1329 microversion: 2.1 time: 0.403383 Oct 31 14:32:22.185914 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2610/5477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:21 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1329 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:22.189519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:22.190718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:22.203523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:22.204491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:22.205632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:22.206900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:22.208102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:22.209209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:22.233671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b HTTP/1.1 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '5b45536d-f277-4680-8c41-b34b045b4a5b'} Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:22.235400 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a8312da-0bb8-45ad-b982-763091377d69 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 404 len: 111 microversion: 2.1 time: 0.053447 Oct 31 14:32:22.242223 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2868/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:22 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:22.247647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3719f6fc-bf02-49dd-9fd2-74e06314eea4 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '.version_select at 0x7fe1078a0f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:22.280884 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3719f6fc-bf02-49dd-9fd2-74e06314eea4 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672438749" status: 202 len: 0 microversion: 2.1 time: 0.037873 Oct 31 14:32:22.293612 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2611/5479] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 14:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672438749 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:32:22.714276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b4615443-b6b6-4bf2-a6f7-73f7b31465f5 req-a5b958d3-0902-4c28-a940-49d946cdce8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c68e14-fb6c-41f3-933a-2b8a37442479", "name": "network-vif-plugged", "status": "completed", "tag": "fa58abf0-7def-4d4e-b769-4ad65644fde0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:22.734137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b4615443-b6b6-4bf2-a6f7-73f7b31465f5 req-a5b958d3-0902-4c28-a940-49d946cdce8c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:22.734692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b4615443-b6b6-4bf2-a6f7-73f7b31465f5 req-a5b958d3-0902-4c28-a940-49d946cdce8c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:22.735066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b4615443-b6b6-4bf2-a6f7-73f7b31465f5 req-a5b958d3-0902-4c28-a940-49d946cdce8c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:22.753390 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b4615443-b6b6-4bf2-a6f7-73f7b31465f5 req-a5b958d3-0902-4c28-a940-49d946cdce8c service nova] Creating event network-vif-plugged:fa58abf0-7def-4d4e-b769-4ad65644fde0 for instance d0c68e14-fb6c-41f3-933a-2b8a37442479 on n-h2-863052-1 Oct 31 14:32:22.758983 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b4615443-b6b6-4bf2-a6f7-73f7b31465f5 req-a5b958d3-0902-4c28-a940-49d946cdce8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048425 Oct 31 14:32:22.759580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2869/5480] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:32:23.209948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:23.211794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:23.212199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:23.212562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:23.220744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:23.221670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:23.222634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:23.223483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:23.224645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:23.225849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:23.228839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:23.229354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:23.229799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:23.230556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:23.231021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:23.231459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:23.366806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:23.396073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=18 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:23.465520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:23.478279 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fc4197c2-b707-44fa-8e34-8228d2a2aa9c tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1501 microversion: 2.1 time: 0.271113 Oct 31 14:32:23.481548 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2612/5481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:23 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1501 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:23.489284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:23.501709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-179dae51-07f0-4c59-9600-4ce71a1cacdb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1329 microversion: 2.1 time: 0.294002 Oct 31 14:32:23.502324 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2870/5482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:23 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1329 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:24.092342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d789ea2d-d026-4e17-8dff-fd0f1ada1a8f req-fd785e13-adc3-48d6-9637-cae9993054d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c2e73b-5098-4674-b2f8-d483c7c1a8f8", "name": "network-vif-deleted", "tag": "b8f728e7-e21e-448d-8664-8e7324632e74"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:24.166081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d789ea2d-d026-4e17-8dff-fd0f1ada1a8f req-fd785e13-adc3-48d6-9637-cae9993054d5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.166081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d789ea2d-d026-4e17-8dff-fd0f1ada1a8f req-fd785e13-adc3-48d6-9637-cae9993054d5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.166081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d789ea2d-d026-4e17-8dff-fd0f1ada1a8f req-fd785e13-adc3-48d6-9637-cae9993054d5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.166081 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d789ea2d-d026-4e17-8dff-fd0f1ada1a8f req-fd785e13-adc3-48d6-9637-cae9993054d5 service nova] Creating event network-vif-deleted:b8f728e7-e21e-448d-8664-8e7324632e74 for instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 on n-h2-863052-1 Oct 31 14:32:24.242402 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d789ea2d-d026-4e17-8dff-fd0f1ada1a8f req-fd785e13-adc3-48d6-9637-cae9993054d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080982 Oct 31 14:32:24.242402 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2613/5483] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:24.507639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:24.508398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:24.513109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=14 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:24.519913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.520663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.521370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.523026 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.523946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.525042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.526115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:24.527557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:24.556481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.558146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.558822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.560532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.561319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.561922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.599455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.605629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.606366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.608012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lazy-loading 'fault' on Instance uuid a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:32:24.682566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:24.708748 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f804d799-3d5d-4504-9e85-33558652efe9 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 200 len: 1303 microversion: 2.1 time: 0.206846 Oct 31 14:32:24.723183 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2871/5484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:24 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:24.763773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:24.776970 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-934d51e0-bffa-4241-bb6e-9b67bc4c40b2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1510 microversion: 2.1 time: 0.255698 Oct 31 14:32:24.794440 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2614/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:24 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:24.801468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:24.802347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:24.810218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.810938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.811565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:24.812507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:24.813143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:24.813674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.087866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:25.096416 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1821619-29e9-4ded-a475-321744e9e09b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1510 microversion: 2.1 time: 0.299455 Oct 31 14:32:25.097101 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2872/5486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:24 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:25.119197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:25.120162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:25.127459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:25.128115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:25.128693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.129662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:25.130475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:25.131044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.191821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:32:25.334390 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca4c0701-899f-4701-994f-c7e2f434d7c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 204 len: 0 microversion: 2.1 time: 0.218836 Oct 31 14:32:25.336548 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2615/5487] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:25 2022] DELETE /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:25.344887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:25.345440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:25.353364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:25.354057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:25.354694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.355890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:25.356504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:25.357092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.538766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:25.552555 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b87cedf7-0d72-4cb1-bf3f-59687c02de79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1516 microversion: 2.1 time: 0.211659 Oct 31 14:32:25.554386 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2873/5488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:25 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:25.737058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:25.738650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: a9c2e73b-5098-4674-b2f8-d483c7c1a8f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:25.754829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:25.757469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:25.768076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.768076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:25.769175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:25.769175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:25.784793 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] HTTP exception thrown: Instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 could not be found. Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Request method failure captured: Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 HTTP/1.1 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xj7HHVKjp5HPquLqFNB2GWeiTYMcaP8GfSUXK-IBCqdwxQR61HmTQb6mLdeF0E3hFi0ew4BhwYoBXtyjCR-Q13b6HWMk2hsORoLG8oK-HGvI8IPvrLhC1-GaDZqHMzTz4E6idjbKZLe0W2MmdcP7R_fu8CaF449pk_CTAE_jGxQIs Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 61d50bff391949ca87e5c4dc42980166 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesActionsTest-509275509 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61d50bff391949ca87e5c4dc42980166", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61d50bff391949ca87e5c4dc42980166"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61d50bff391949ca87e5c4dc42980166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61d50bff391949ca87e5c4dc42980166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesActionsTest-509275509 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 61d50bff391949ca87e5c4dc42980166 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesActionsTest-509275509 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesActionsTest-509275509-project Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4abe13a4852a47db9bad6d7e5e7832a7 Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesActionsTest-509275509-project Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 could not be found. Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a9c2e73b-5098-4674-b2f8-d483c7c1a8f8'} Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 could not be found. Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 could not be found. Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:25.786655 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 could not be found. Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Returning 404 to user: Instance a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f81ae96-956d-481b-94c1-198abe69dd5a tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8" status: 404 len: 111 microversion: 2.1 time: 0.056669 Oct 31 14:32:25.791136 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2616/5489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:25 2022] GET /compute/v2.1/servers/a9c2e73b-5098-4674-b2f8-d483c7c1a8f8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:25.950023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1842095783", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7873628f-dcde-4e2e-bd0f-81782a012eb5"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:26.007836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] validate_networks() for [('7873628f-dcde-4e2e-bd0f-81782a012eb5', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:26.576427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:26.577057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:26.586001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:26.587326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:26.587980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:26.589029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:26.589699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:26.590348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:26.715083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:26.716686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:26.717616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:26.718486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:26.719425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:26.734141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:26.737147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:26.737699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:26.740647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:26.743617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:26.744093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:26.783949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Getting quotas for project 61d50bff391949ca87e5c4dc42980166. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:26.797471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Getting quotas for user 4abe13a4852a47db9bad6d7e5e7832a7 and project 61d50bff391949ca87e5c4dc42980166. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:26.831615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:26.834037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:26.854972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:26.873285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:26.882967 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fcf648d8-3d74-42c1-a8b6-a85da7f3eeed tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1516 microversion: 2.1 time: 0.310536 Oct 31 14:32:26.885752 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2617/5490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:26 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:26.956454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5671722b-5ef2-4f6d-9fb2-4fc0bf4998ef tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010266 Oct 31 14:32:26.957156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2874/5491] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:32:26.968677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81388a5e-5d73-4310-9958-faa63de174fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:26.969566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81388a5e-5d73-4310-9958-faa63de174fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:27.097119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-81388a5e-5d73-4310-9958-faa63de174fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:27.106438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81388a5e-5d73-4310-9958-faa63de174fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1214 microversion: 2.1 time: 0.141420 Oct 31 14:32:27.124811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2618/5492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:26 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:27.679159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5bb3d394-ef03-440a-a126-33610a4c09ad req-fdf4636d-fdfe-4519-8ff4-b3bb16653c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c68e14-fb6c-41f3-933a-2b8a37442479", "name": "network-vif-deleted", "tag": "fa58abf0-7def-4d4e-b769-4ad65644fde0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:27.710228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:27.710801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:27.717705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.732946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.733657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:27.735086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.735086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.735369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:27.740557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5bb3d394-ef03-440a-a126-33610a4c09ad req-fdf4636d-fdfe-4519-8ff4-b3bb16653c6e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.741294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5bb3d394-ef03-440a-a126-33610a4c09ad req-fdf4636d-fdfe-4519-8ff4-b3bb16653c6e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.741747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5bb3d394-ef03-440a-a126-33610a4c09ad req-fdf4636d-fdfe-4519-8ff4-b3bb16653c6e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:27.772735 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5bb3d394-ef03-440a-a126-33610a4c09ad req-fdf4636d-fdfe-4519-8ff4-b3bb16653c6e service nova] Creating event network-vif-deleted:fa58abf0-7def-4d4e-b769-4ad65644fde0 for instance d0c68e14-fb6c-41f3-933a-2b8a37442479 on n-h2-863052-1 Oct 31 14:32:27.775428 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b HTTP/1.1 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '5b45536d-f277-4680-8c41-b34b045b4a5b'} Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:27.779083 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.784040 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.787389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:27.789222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ce46305-e74e-40a2-becc-79072c0b4095 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 404 len: 111 microversion: 2.1 time: 0.083469 Oct 31 14:32:27.790355 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2619/5493] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:27 2022] DELETE /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:32:27.791004 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5bb3d394-ef03-440a-a126-33610a4c09ad req-fdf4636d-fdfe-4519-8ff4-b3bb16653c6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115368 Oct 31 14:32:27.791918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2875/5494] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:27.802590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:27.803609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 5b45536d-f277-4680-8c41-b34b045b4a5b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:27.806598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:27.817446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.819230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.820322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:27.821199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.830642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.831573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:27.859692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b HTTP/1.1 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '5b45536d-f277-4680-8c41-b34b045b4a5b'} Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:27.873546 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. Oct 31 14:32:27.880869 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:27.883819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 5b45536d-f277-4680-8c41-b34b045b4a5b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:27.886317 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c75ffcf-5902-49a5-b59d-20764a87a6b2 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b" status: 404 len: 111 microversion: 2.1 time: 0.089977 Oct 31 14:32:27.887784 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2620/5495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:27 2022] GET /compute/v2.1/servers/5b45536d-f277-4680-8c41-b34b045b4a5b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:27.910452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:27.911159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:27.926277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.927033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.927635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:27.929096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:27.929736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:27.930526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:28.040087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:28.040595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:28.041041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:28.041503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lazy-loading 'fault' on Instance uuid d0c68e14-fb6c-41f3-933a-2b8a37442479 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:32:28.130391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:28.131065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:28.158207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:28.173595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:28.174765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e9331de-c0f8-4652-bc27-bff42c74adde tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 200 len: 1319 microversion: 2.1 time: 0.264220 Oct 31 14:32:28.175149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:28.175748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:28.178042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:28.178927 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2876/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:27 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:28.179575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:28.180150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:28.263619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:28.352266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:28.374010 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-884cfe51-bfde-43ec-8c9c-9e537b520c6b tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1210 microversion: 2.1 time: 0.236359 Oct 31 14:32:28.375712 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2621/5497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:28 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1210 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:29.204261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:29.206118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:29.218461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:29.219247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:29.219841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:29.220852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:29.221478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:29.223386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:29.241850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 HTTP/1.1 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'd0c68e14-fb6c-41f3-933a-2b8a37442479'} Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:29.244112 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:32:29.248049 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:29.254429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:29.255709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce4f1f98-0392-4217-9c9a-f457b27ed0c8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 404 len: 111 microversion: 2.1 time: 0.058323 Oct 31 14:32:29.268165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d853bfc9-e29a-42f1-afec-15f9256b18dc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '.version_select at 0x7fe1079798b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:29.274426 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2877/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:29 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:29.314009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d853bfc9-e29a-42f1-afec-15f9256b18dc tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-1560065527" status: 202 len: 0 microversion: 2.1 time: 0.052366 Oct 31 14:32:29.314668 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2622/5499] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 31 14:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1560065527 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:32:29.413728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-936907983", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:29.425105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:29.425942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:29.437268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:29.438226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:29.439023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:29.440514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:29.441167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:29.441763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:29.517158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:29.604430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:29.620857 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fedc181e-9db9-4aee-ab45-bb164b2e4686 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1272 microversion: 2.1 time: 0.223624 Oct 31 14:32:29.624746 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2878/5500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:29 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:30.130506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:30.132129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:30.132797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:30.133368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:30.134156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:30.145776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:30.146648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:30.147811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:30.148725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:30.149346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:30.150033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:30.175026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:30.181488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:30.197194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:30.200199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:30.318290 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-759d6f19-5f4f-47ad-afd6-361bbfbfbc51 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905773 Oct 31 14:32:30.322051 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2623/5501] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:32:30.330955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3c0047b-cf96-4938-b9d4-8e54a7cd1ca9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:30.333125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3c0047b-cf96-4938-b9d4-8e54a7cd1ca9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:30.577273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3c0047b-cf96-4938-b9d4-8e54a7cd1ca9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:30.600895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3c0047b-cf96-4938-b9d4-8e54a7cd1ca9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1208 microversion: 2.1 time: 0.273450 Oct 31 14:32:30.620820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2879/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:30 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1208 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:30.649326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:30.650453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:30.663911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:30.664656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:30.666211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:30.667469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:30.668266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:30.669146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:31.089657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:31.111940 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c70f65a-cbcc-47ff-9eee-9395caf0e6e8 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1314 microversion: 2.1 time: 0.469797 Oct 31 14:32:31.122842 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2624/5503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:30 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:31.648016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:31.648545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:31.663797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:31.665652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:31.666101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:31.668296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:31.670081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:31.671047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:31.828309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:31.843032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ca06506-7c19-427b-983e-df7f95175d6d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1204 microversion: 2.1 time: 0.197047 Oct 31 14:32:31.863836 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2880/5504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:31 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1204 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:31.882110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-1813dc7c-6552-4dfb-b161-00717cb54d45 req-ba9f4bf4-258d-44d1-8065-acf87153f161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39be1db5-17eb-4faa-95d4-3712a60a99b0", "tag": "4be51061-acf1-44f3-abaa-641bad7f8df1"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:31.910133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1813dc7c-6552-4dfb-b161-00717cb54d45 req-ba9f4bf4-258d-44d1-8065-acf87153f161 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:31.910735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1813dc7c-6552-4dfb-b161-00717cb54d45 req-ba9f4bf4-258d-44d1-8065-acf87153f161 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:31.914564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1813dc7c-6552-4dfb-b161-00717cb54d45 req-ba9f4bf4-258d-44d1-8065-acf87153f161 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:31.948515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-1813dc7c-6552-4dfb-b161-00717cb54d45 req-ba9f4bf4-258d-44d1-8065-acf87153f161 service nova] Creating event network-changed:4be51061-acf1-44f3-abaa-641bad7f8df1 for instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 on n-h1-863052-1 Oct 31 14:32:31.954313 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-1813dc7c-6552-4dfb-b161-00717cb54d45 req-ba9f4bf4-258d-44d1-8065-acf87153f161 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078886 Oct 31 14:32:31.955509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2625/5505] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:32.141780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:32.142421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:32.152092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:32.152587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:32.154314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:32.155041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:32.155502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:32.155936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:32.790902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:32.799850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1576521e-1d45-4acf-a1b6-6e22b1d227e5 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1314 microversion: 2.1 time: 0.663002 Oct 31 14:32:32.816769 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2881/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:32 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:32.869760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:32.870332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:32.886104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:32.886634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:32.886980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:32.888272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:32.889177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:32.889758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:32.997772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:33.009272 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb888ba2-a97b-4a54-afe8-0c118f2e886f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1266 microversion: 2.1 time: 0.144384 Oct 31 14:32:33.024316 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2626/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:32 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:33.676799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:33.677308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:33.687711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.688208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.688645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.689350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.689803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.690249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.731510 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 HTTP/1.1 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '3bf76455-be9a-486a-9d38-8396622560f3'} Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:33.733160 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.737645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:33.747054 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bf4c03c-9aca-4351-a5e5-3ecdd99d5c8b tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 404 len: 111 microversion: 2.1 time: 0.074013 Oct 31 14:32:33.747681 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2882/5508] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:33 2022] DELETE /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:33.756617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:33.757442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 3bf76455-be9a-486a-9d38-8396622560f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:33.765176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.768132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.768751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.770666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.774432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.775271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.817539 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.824560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:33.825250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 HTTP/1.1 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3bf76455-be9a-486a-9d38-8396622560f3'} Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:33.825409 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. Oct 31 14:32:33.830031 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.831921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 3bf76455-be9a-486a-9d38-8396622560f3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:33.837932 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d99def2-4bf4-45cb-9e8f-5c1e4ab788ea tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3" status: 404 len: 111 microversion: 2.1 time: 0.085344 Oct 31 14:32:33.839410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.840126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.840391 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2627/5509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:33 2022] GET /compute/v2.1/servers/3bf76455-be9a-486a-9d38-8396622560f3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:33.842312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.843140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.848838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.851342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:33.851539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.855384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:33.871114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.877787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.878848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.881287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.886936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.888052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.917466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 HTTP/1.1 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c8fe5f81-b02e-4727-8069-39ae420e2b54'} Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:33.923109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:33.927631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:33.932164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:33.935086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c17f67c-babf-4185-a1bc-1fde930bf435 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 404 len: 111 microversion: 2.1 time: 0.089767 Oct 31 14:32:33.936302 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2628/5510] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:33 2022] DELETE /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:33.951404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:33.952696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: c8fe5f81-b02e-4727-8069-39ae420e2b54] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:33.959671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.960573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.961196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:33.962081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:33.962713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:33.963305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:34.002735 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 HTTP/1.1 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c8fe5f81-b02e-4727-8069-39ae420e2b54'} Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:34.008520 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. Oct 31 14:32:34.013136 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:34.015612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance c8fe5f81-b02e-4727-8069-39ae420e2b54 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:34.016607 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f227247-e37a-418f-93f6-13e5f52702ce tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54" status: 404 len: 111 microversion: 2.1 time: 0.075406 Oct 31 14:32:34.020869 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2629/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:33 2022] GET /compute/v2.1/servers/c8fe5f81-b02e-4727-8069-39ae420e2b54 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:34.038731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:34.039531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:34.052490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:34.054768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:34.055516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:34.057128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:34.060850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:34.062697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:34.184638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:34.195691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f75c28e-2c56-4d10-9a84-a2a14b655b69 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1314 microversion: 2.1 time: 0.372976 Oct 31 14:32:34.199126 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2883/5512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:33 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:34.423913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:34.434533 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c90900b1-4d22-4839-a266-0c7389847cd1 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1308 microversion: 2.1 time: 0.401369 Oct 31 14:32:34.435853 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2630/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:34 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:35.230758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:35.232586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:35.247043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:35.252083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:35.263947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:35.264990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:35.267304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:35.267959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:35.460946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:35.462387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:35.473190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:35.474477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:35.475887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:35.476895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:35.478694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:35.479494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:35.688077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:35.723671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4709b498-a547-4e35-a38b-2a190f145bfc tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1314 microversion: 2.1 time: 0.497197 Oct 31 14:32:35.734565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2884/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:35 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:35.742937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9d1db7fe-bbd2-4b81-a775-e1fe8c33f37e req-36bc8b23-69d5-4ffa-885e-143c437632e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cd68ae-a2b5-4daf-981a-a371c16932f4", "tag": "ecaebdd2-683a-4e90-ae1d-0cb4eebcc855"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:35.762484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d1db7fe-bbd2-4b81-a775-e1fe8c33f37e req-36bc8b23-69d5-4ffa-885e-143c437632e3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:35.763877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d1db7fe-bbd2-4b81-a775-e1fe8c33f37e req-36bc8b23-69d5-4ffa-885e-143c437632e3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:35.764551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9d1db7fe-bbd2-4b81-a775-e1fe8c33f37e req-36bc8b23-69d5-4ffa-885e-143c437632e3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:35.781327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:35.789214 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aec6e5fa-1675-4a63-9509-55026c2eb461 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1308 microversion: 2.1 time: 0.333382 Oct 31 14:32:35.789796 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2631/5515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:35 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:35.795454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9d1db7fe-bbd2-4b81-a775-e1fe8c33f37e req-36bc8b23-69d5-4ffa-885e-143c437632e3 service nova] Creating event network-changed:ecaebdd2-683a-4e90-ae1d-0cb4eebcc855 for instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 on n-h2-863052-1 Oct 31 14:32:35.808683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9d1db7fe-bbd2-4b81-a775-e1fe8c33f37e req-36bc8b23-69d5-4ffa-885e-143c437632e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072451 Oct 31 14:32:35.810149 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2885/5516] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:36.762668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:36.763860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:36.780088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:36.781243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:36.781955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:36.783066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:36.783792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:36.784405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:36.815532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:36.816312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:36.823271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:36.825666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:36.826607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:36.829536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:36.829536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:36.829536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:36.830349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:37.027906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:37.036641 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7d0fce6-6188-465f-a8ae-870b541407fd tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1314 microversion: 2.1 time: 0.279570 Oct 31 14:32:37.038662 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2632/5517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:36 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:37.080541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:37.095588 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dec5b6fe-7d3e-4df8-a869-b07dcfd0e376 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1308 microversion: 2.1 time: 0.283721 Oct 31 14:32:37.097186 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2886/5518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:36 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:37.820288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ce6312ae-15f7-439c-854f-a10d39e2c38b req-cdf57b3a-27ad-4b45-a484-f22c46d16c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39be1db5-17eb-4faa-95d4-3712a60a99b0", "name": "network-vif-plugged", "status": "completed", "tag": "4be51061-acf1-44f3-abaa-641bad7f8df1"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:37.835032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ce6312ae-15f7-439c-854f-a10d39e2c38b req-cdf57b3a-27ad-4b45-a484-f22c46d16c37 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:37.835804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ce6312ae-15f7-439c-854f-a10d39e2c38b req-cdf57b3a-27ad-4b45-a484-f22c46d16c37 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:37.836391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ce6312ae-15f7-439c-854f-a10d39e2c38b req-cdf57b3a-27ad-4b45-a484-f22c46d16c37 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:37.863707 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ce6312ae-15f7-439c-854f-a10d39e2c38b req-cdf57b3a-27ad-4b45-a484-f22c46d16c37 service nova] Creating event network-vif-plugged:4be51061-acf1-44f3-abaa-641bad7f8df1 for instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 on n-h1-863052-1 Oct 31 14:32:37.877295 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ce6312ae-15f7-439c-854f-a10d39e2c38b req-cdf57b3a-27ad-4b45-a484-f22c46d16c37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060460 Oct 31 14:32:37.878593 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2633/5519] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:38.060552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:38.061881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:38.077683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.080030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.082629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.083848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.085050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.088125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.121907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:38.122656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:38.140356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.140871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.141325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.147832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.148600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.149109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.478147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:38.486293 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4c5aa34-27d9-452f-b3e5-dc73e31b79ab tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1314 microversion: 2.1 time: 0.429609 Oct 31 14:32:38.486897 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2887/5520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:38 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:38.641216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:38.656614 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32ac0bd8-8b41-4a00-9968-dd48303212fe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1308 microversion: 2.1 time: 0.539320 Oct 31 14:32:38.676928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2634/5521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:38 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:38.697908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:38.698435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:38.707864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.708609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.710061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.711010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.712077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.712699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.728538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 HTTP/1.1 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '7b9f19e0-c98f-48c1-896b-e02c143e1365'} Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:38.730558 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.734188 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.736912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:38.738262 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9900e25-1084-4481-b10d-661db4e4ca71 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 404 len: 111 microversion: 2.1 time: 0.044364 Oct 31 14:32:38.739386 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2888/5522] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:38 2022] DELETE /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:38.747678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:38.748567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] [instance: 7b9f19e0-c98f-48c1-896b-e02c143e1365] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:38.758909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.761896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.762622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.763612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:38.765294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:38.768114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:38.802142 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] HTTP exception thrown: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Request method failure captured: Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 HTTP/1.1 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9rjaKn3CEyeIZD3IsMRcByzM6lBqf226uRqNLeMXoq3APxYPOpPV0tXjTuhq55Od79vuPeL060Qa_GIMP2FwcXJ5KWKIZ_zSYJ22W7MDOAre9eTmQ_xVbrvlnL40VueL3WA6wWY0cf6QXyeowf72j3UcH8zHIImWBseP4rb59PXAHQ Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_722078c8963b46b890d3a73abde4a1d1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/722078c8963b46b890d3a73abde4a1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 722078c8963b46b890d3a73abde4a1d1 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1747886601 Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 18afbe74ab5c426087d0e4635b3c38ea Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-1747886601-project Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7b9f19e0-c98f-48c1-896b-e02c143e1365'} Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:38.806541 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. Oct 31 14:32:38.810627 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:32:38.814364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] Returning 404 to user: Instance 7b9f19e0-c98f-48c1-896b-e02c143e1365 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:38.815551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-398e3b61-b841-44ad-8ead-6df84a0cdc17 tempest-AttachVolumeNegativeTest-1747886601 tempest-AttachVolumeNegativeTest-1747886601-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365" status: 404 len: 111 microversion: 2.1 time: 0.071804 Oct 31 14:32:38.817494 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2635/5523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:38 2022] GET /compute/v2.1/servers/7b9f19e0-c98f-48c1-896b-e02c143e1365 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:39.509021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:39.510306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:39.518965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:39.519746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:39.520441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:39.521368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:39.522622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:39.523261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:39.690939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:39.691749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:39.702203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:39.702695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:39.703327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:39.704195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:39.705008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:39.705663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:39.831579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:39.847898 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1610f23-319e-4035-95e1-1ae45abfe656 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1496 microversion: 2.1 time: 0.341838 Oct 31 14:32:39.848872 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2889/5524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:39 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1496 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:39.923318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:39.934039 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acfa1087-9a95-4548-8c1e-688ec1550efb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1308 microversion: 2.1 time: 0.252766 Oct 31 14:32:39.937743 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2636/5525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:39 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:40.277210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f62b9bcd-c1b2-40ff-abf5-ddfaa9ed3468 req-a0d7b495-881b-454f-bddd-e117e6b34e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cd68ae-a2b5-4daf-981a-a371c16932f4", "name": "network-vif-plugged", "status": "completed", "tag": "ecaebdd2-683a-4e90-ae1d-0cb4eebcc855"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:40.296676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f62b9bcd-c1b2-40ff-abf5-ddfaa9ed3468 req-a0d7b495-881b-454f-bddd-e117e6b34e7e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.297169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f62b9bcd-c1b2-40ff-abf5-ddfaa9ed3468 req-a0d7b495-881b-454f-bddd-e117e6b34e7e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.299220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f62b9bcd-c1b2-40ff-abf5-ddfaa9ed3468 req-a0d7b495-881b-454f-bddd-e117e6b34e7e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:40.334419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:40.338248 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f62b9bcd-c1b2-40ff-abf5-ddfaa9ed3468 req-a0d7b495-881b-454f-bddd-e117e6b34e7e service nova] Creating event network-vif-plugged:ecaebdd2-683a-4e90-ae1d-0cb4eebcc855 for instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 on n-h2-863052-1 Oct 31 14:32:40.348793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f62b9bcd-c1b2-40ff-abf5-ddfaa9ed3468 req-a0d7b495-881b-454f-bddd-e117e6b34e7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075591 Oct 31 14:32:40.353440 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2890/5526] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:40.564367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:40.565372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:40.568004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:40.569656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:40.577497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.578101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.578629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:40.579398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.579936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.580431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:40.626439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:32:40.792895 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c994280c-caf9-4254-8e33-09c85ce3c31d tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 204 len: 0 microversion: 2.1 time: 0.233836 Oct 31 14:32:40.797600 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2637/5527] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:40 2022] DELETE /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:40.799993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:40.804861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:40.805565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:40.822213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.822699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.823317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:40.824554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.825172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.825749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:40.965449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:40.966666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:40.983849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.984575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.985193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:40.986780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:40.987404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:40.988721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:41.121484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:41.132995 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c353687-e0ba-4fb0-9c1c-e24004ac08ca tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1502 microversion: 2.1 time: 0.334691 Oct 31 14:32:41.134388 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2891/5528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:40 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:41.270726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:41.314084 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09e50da7-52c2-481a-8b68-5be0b4e9cdbe tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1308 microversion: 2.1 time: 0.354037 Oct 31 14:32:41.318104 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2638/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:40 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:42.162957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:42.164347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:42.176842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:42.182435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:42.183170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:42.184143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:42.184806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:42.186726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:42.343802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:42.344656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:42.375341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:42.376061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:42.376668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:42.377539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:42.398260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:42.399191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:42.616387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:42.634692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97badf15-18d8-40fe-ada3-fc8ec645fde3 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1502 microversion: 2.1 time: 0.476788 Oct 31 14:32:42.635618 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2892/5530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:42 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:42.751358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:42.761132 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d5b531b-8b32-4068-b1d3-3925e77541f6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1489 microversion: 2.1 time: 0.423454 Oct 31 14:32:42.762151 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2639/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:42 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1489 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:42.893872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-936907983", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:42.973703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:43.660110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:43.661291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:43.670416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:43.671288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:43.671887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:43.672771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:43.673457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:43.674361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:43.870647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:43.880514 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db68ccf2-a336-4e24-ae94-a01b02f6ec22 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1502 microversion: 2.1 time: 0.225065 Oct 31 14:32:43.894325 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2640/5532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:43 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:44.275409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0bf2d0e9-3264-45ef-9b1a-7a8c141b149e req-c6d5af78-2e8e-4cec-a093-1434aaf57373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39be1db5-17eb-4faa-95d4-3712a60a99b0", "name": "network-vif-deleted", "tag": "4be51061-acf1-44f3-abaa-641bad7f8df1"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:44.315451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0bf2d0e9-3264-45ef-9b1a-7a8c141b149e req-c6d5af78-2e8e-4cec-a093-1434aaf57373 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:44.316387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0bf2d0e9-3264-45ef-9b1a-7a8c141b149e req-c6d5af78-2e8e-4cec-a093-1434aaf57373 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:44.317191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0bf2d0e9-3264-45ef-9b1a-7a8c141b149e req-c6d5af78-2e8e-4cec-a093-1434aaf57373 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:44.330250 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0bf2d0e9-3264-45ef-9b1a-7a8c141b149e req-c6d5af78-2e8e-4cec-a093-1434aaf57373 service nova] Creating event network-vif-deleted:4be51061-acf1-44f3-abaa-641bad7f8df1 for instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 on n-h1-863052-1 Oct 31 14:32:44.336483 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0bf2d0e9-3264-45ef-9b1a-7a8c141b149e req-c6d5af78-2e8e-4cec-a093-1434aaf57373 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065649 Oct 31 14:32:44.337977 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2641/5533] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:44.442151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:44.442632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:44.443628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:44.444385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:44.445421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:44.489338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:44.490325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:44.490779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:44.492164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:44.492815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:44.493805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:44.555727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:44.562255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:44.579721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:44.582322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:44.651139 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e803dab-3a23-4796-be9b-f612a07df46e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760216 Oct 31 14:32:44.652319 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2893/5534] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:32:44.664836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0e742ff-2c48-4b13-9a22-bd844be2ae72 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:44.665695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0e742ff-2c48-4b13-9a22-bd844be2ae72 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:44.819648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0e742ff-2c48-4b13-9a22-bd844be2ae72 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:44.843543 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0e742ff-2c48-4b13-9a22-bd844be2ae72 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1208 microversion: 2.1 time: 0.182876 Oct 31 14:32:44.844156 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2642/5535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:44 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:44.906780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:44.907819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:44.919808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:44.921823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:44.923003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:44.924310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:44.926506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:44.928241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:45.063953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:45.066895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:45.067551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:45.069173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lazy-loading 'fault' on Instance uuid 39be1db5-17eb-4faa-95d4-3712a60a99b0 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:32:45.181058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abe13a4852a47db9bad6d7e5e7832a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d50bff391949ca87e5c4dc42980166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:45.194087 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fb04804-81e7-402f-baec-0cad8e394132 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 200 len: 1304 microversion: 2.1 time: 0.290947 Oct 31 14:32:45.195333 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2894/5536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:44 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 1304 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:45.869524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:45.870250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:45.887751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:45.888264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:45.890973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:45.891735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:45.893896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:45.894410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:46.221285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:46.222708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] [instance: 39be1db5-17eb-4faa-95d4-3712a60a99b0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:46.234325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:46.235083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:46.235688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:46.236600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:46.237223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:46.238275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:46.254080 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] HTTP exception thrown: Instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 could not be found. Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Request method failure captured: Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 HTTP/1.1 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xj7HHVKjp5HPquLqFNB2GWeiTYMcaP8GfSUXK-IBCqdwxQR61HmTQb6mLdeF0E3hFi0ew4BhwYoBXtyjCR-Q13b6HWMk2hsORoLG8oK-HGvI8IPvrLhC1-GaDZqHMzTz4E6idjbKZLe0W2MmdcP7R_fu8CaF449pk_CTAE_jGxQIs Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 61d50bff391949ca87e5c4dc42980166 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesActionsTest-509275509 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61d50bff391949ca87e5c4dc42980166", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61d50bff391949ca87e5c4dc42980166"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61d50bff391949ca87e5c4dc42980166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61d50bff391949ca87e5c4dc42980166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesActionsTest-509275509 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 61d50bff391949ca87e5c4dc42980166 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesActionsTest-509275509 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesActionsTest-509275509-project Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4abe13a4852a47db9bad6d7e5e7832a7 Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesActionsTest-509275509-project Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 could not be found. Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '39be1db5-17eb-4faa-95d4-3712a60a99b0'} Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 could not be found. Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 could not be found. Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:32:46.256715 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 could not be found. Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] Returning 404 to user: Instance 39be1db5-17eb-4faa-95d4-3712a60a99b0 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:32:46.260958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2de863bf-27b0-4f46-ab1a-7d2f4052da13 tempest-VolumesActionsTest-509275509 tempest-VolumesActionsTest-509275509-project] 10.222.0.27 "GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0" status: 404 len: 111 microversion: 2.1 time: 0.043864 Oct 31 14:32:46.261530 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2895/5537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:46 2022] GET /compute/v2.1/servers/39be1db5-17eb-4faa-95d4-3712a60a99b0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:32:46.275678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:46.278236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:46.285882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7393171b-949e-441f-93c3-a96a84d68704 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1260 microversion: 2.1 time: 0.422925 Oct 31 14:32:46.299446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2643/5538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:45 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1260 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:47.313039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:47.314645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:47.335661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:47.337665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:47.338450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:47.339457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:47.340315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:47.343813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:47.563934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-604527431", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "de1072ef-64fd-49c2-9dd2-c0f4eb60e2fb"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:47.705945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] validate_networks() for [('de1072ef-64fd-49c2-9dd2-c0f4eb60e2fb', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:47.739482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:47.749502 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f40490e7-f358-4ea3-8f51-1df28671674e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 0.442305 Oct 31 14:32:47.750686 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2644/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:47 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:48.555938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:48.556365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:48.556844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:48.557261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:48.557683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:48.575168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:48.576796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:48.578816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:48.580027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:48.580759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:48.581523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:48.611507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Getting quotas for project 873e8de041b74aca82937f9ed02db7cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:48.622494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Getting quotas for user fda8016cf61d466d98c2c4f716f4e33b and project 873e8de041b74aca82937f9ed02db7cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:48.644022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:48.646706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:48.736151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a5ca283-4ce6-4f0f-8614-469b5049de7e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.664602 Oct 31 14:32:48.738565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2896/5540] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:32:48.776240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9088d27-2206-4759-aa21-6c5a65f64959 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:48.776927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9088d27-2206-4759-aa21-6c5a65f64959 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:48.782193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:48.783103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:48.816757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:48.818566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:48.822266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:48.827157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:48.827886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:48.830595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:48.912547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9088d27-2206-4759-aa21-6c5a65f64959 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:48.925504 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9088d27-2206-4759-aa21-6c5a65f64959 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1213 microversion: 2.1 time: 0.176713 Oct 31 14:32:48.928944 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2645/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:48 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:49.210446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:49.259650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a0cb1b5-5815-44e1-9704-8c14656d93ad tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 0.485966 Oct 31 14:32:49.265997 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2897/5542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:48 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:49.563010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-59809c40-632e-4f26-95f4-f220186c4e26 req-0d366ccb-c90f-48e3-b837-ad35f216bc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4659ac8-98f6-416a-aa74-34e3066d8b9d", "tag": "57243c35-d36d-4e74-b343-796cdcda0431"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:49.604273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-59809c40-632e-4f26-95f4-f220186c4e26 req-0d366ccb-c90f-48e3-b837-ad35f216bc89 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:49.604981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-59809c40-632e-4f26-95f4-f220186c4e26 req-0d366ccb-c90f-48e3-b837-ad35f216bc89 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:49.605733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-59809c40-632e-4f26-95f4-f220186c4e26 req-0d366ccb-c90f-48e3-b837-ad35f216bc89 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:49.645144 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-59809c40-632e-4f26-95f4-f220186c4e26 req-0d366ccb-c90f-48e3-b837-ad35f216bc89 service nova] Creating event network-changed:57243c35-d36d-4e74-b343-796cdcda0431 for instance e4659ac8-98f6-416a-aa74-34e3066d8b9d on n-h1-863052-1 Oct 31 14:32:49.655178 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-59809c40-632e-4f26-95f4-f220186c4e26 req-0d366ccb-c90f-48e3-b837-ad35f216bc89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095357 Oct 31 14:32:49.659202 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2646/5543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:49.965532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:49.967102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:49.985429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:49.988681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:49.990829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:49.993055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:49.993846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:49.997357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:50.291357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:50.293461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:50.307821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:50.308663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:50.309376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:50.310532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:50.314719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:50.322039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:50.557443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:50.571233 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f91bd17-c2fc-4370-99f8-630cd0ebb856 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 0.285319 Oct 31 14:32:50.583268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2647/5544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:50 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:50.682155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:50.690404 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66568a3b-d2e6-441c-8503-6af7388df2ed tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1217 microversion: 2.1 time: 0.740313 Oct 31 14:32:50.690996 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2898/5545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:49 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1217 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:51.596637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:51.598038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:51.607279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:51.608978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:51.610054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:51.611922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:51.613642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:51.618636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:51.718644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:51.719851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:51.728860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:51.729720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:51.730360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:51.731258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:51.731867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:51.732445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:51.860347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:51.893275 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ae9b76b-dc62-4d17-bcca-1017fdecfe12 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1271 microversion: 2.1 time: 0.178657 Oct 31 14:32:51.907159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:51.914671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2899/5546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:51 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:51.925847 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7b16222-f938-4056-a389-5167c4ef3b8a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 0.332419 Oct 31 14:32:51.926807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2648/5547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:51 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:52.156248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ac8ddee-5f21-43c4-a102-4fce03c8cdda tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Action: 'create', calling method: .version_select at 0x7fe1066b9b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-603906419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHZ8n46raaI/pOIPf8v4QDoWA3dq+knMRD5m0tlGO4jDqacfvV0VtDkhz2goRV0XjRo+P3pZCQbFvBckbVIjCU22kqasRJyBrzaxfvEkc4ooqImTWJmmG47fJ3UO+hU5w=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:52.175967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0ac8ddee-5f21-43c4-a102-4fce03c8cdda tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Getting quotas for project 072bda06e0cd44269277a9b191809bd3. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:52.184048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-0ac8ddee-5f21-43c4-a102-4fce03c8cdda tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Getting quotas for user 3b4bf94fb7f64a85b8ac59f59e557afd and project 072bda06e0cd44269277a9b191809bd3. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:52.257622 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ac8ddee-5f21-43c4-a102-4fce03c8cdda tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.104559 Oct 31 14:32:52.259321 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2900/5548] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:32:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:52.639805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:52.641483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:52.660287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:52.663414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:52.666461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:52.671713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:52.673610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:52.675396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:52.721341 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b6d2255-1b1c-4faa-bfbd-7d455ef4085f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/ips" status: 200 len: 150 microversion: 2.20 time: 0.085825 Oct 31 14:32:52.728893 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2649/5549] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 31 14:32:52 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:32:52.921675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:52.923294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:52.935168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:52.936884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:52.938901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:52.939367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:52.941874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:52.944909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:52.945599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:52.950892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:52.951615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:52.978591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:52.982283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:52.982773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:52.983603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:52.990469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:52.991198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:53.560466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:53.575299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44155740-a33f-4e52-9412-4d71f9aa03a3 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.655787 Oct 31 14:32:53.589000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2901/5550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:52 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:54.061326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:54.071979 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cca1f43d-5344-43e8-b776-3f3380a96314 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 1.125805 Oct 31 14:32:54.072560 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2650/5551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:52 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:54.596173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:54.596790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:54.609485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:54.609984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:54.610452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:54.611163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:54.611610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:54.622900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:54.945224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b10fa81b-04c5-41d8-a2c5-21ee390c961b req-3eff7ba3-479f-49b7-9b37-bdf4fa7aea54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3362ee5b-2b1b-4ee2-b49a-8becd6b95606", "tag": "f8af84e1-e8ad-46de-836b-61107f0870b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:54.964955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b10fa81b-04c5-41d8-a2c5-21ee390c961b req-3eff7ba3-479f-49b7-9b37-bdf4fa7aea54 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:54.965525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b10fa81b-04c5-41d8-a2c5-21ee390c961b req-3eff7ba3-479f-49b7-9b37-bdf4fa7aea54 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:54.966027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b10fa81b-04c5-41d8-a2c5-21ee390c961b req-3eff7ba3-479f-49b7-9b37-bdf4fa7aea54 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:55.014692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b10fa81b-04c5-41d8-a2c5-21ee390c961b req-3eff7ba3-479f-49b7-9b37-bdf4fa7aea54 service nova] Creating event network-changed:f8af84e1-e8ad-46de-836b-61107f0870b5 for instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 on n-h2-863052-1 Oct 31 14:32:55.025401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b10fa81b-04c5-41d8-a2c5-21ee390c961b req-3eff7ba3-479f-49b7-9b37-bdf4fa7aea54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084023 Oct 31 14:32:55.030544 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2651/5552] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:55.101725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:55.103185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:55.121287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:55.127568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:55.129714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:55.131269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:55.132412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:55.133663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:55.481546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:55.494752 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79419781-120e-40e2-b889-7ae6d9320846 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 0.398221 Oct 31 14:32:55.517253 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2652/5553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:55 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:55.565546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:55.575964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4abf0be6-8a9a-46d0-8727-20cce3a62266 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.983548 Oct 31 14:32:55.593114 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2902/5554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:54 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:55.943164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d0e5fdfe-1190-403c-9085-5c4b74836e91 req-93fc65a7-f579-434e-9a95-0441e01eac0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4659ac8-98f6-416a-aa74-34e3066d8b9d", "name": "network-vif-plugged", "status": "completed", "tag": "57243c35-d36d-4e74-b343-796cdcda0431"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:55.960815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d0e5fdfe-1190-403c-9085-5c4b74836e91 req-93fc65a7-f579-434e-9a95-0441e01eac0c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:55.963986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d0e5fdfe-1190-403c-9085-5c4b74836e91 req-93fc65a7-f579-434e-9a95-0441e01eac0c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:55.964635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d0e5fdfe-1190-403c-9085-5c4b74836e91 req-93fc65a7-f579-434e-9a95-0441e01eac0c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:55.992415 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d0e5fdfe-1190-403c-9085-5c4b74836e91 req-93fc65a7-f579-434e-9a95-0441e01eac0c service nova] Creating event network-vif-plugged:57243c35-d36d-4e74-b343-796cdcda0431 for instance e4659ac8-98f6-416a-aa74-34e3066d8b9d on n-h1-863052-1 Oct 31 14:32:56.009192 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d0e5fdfe-1190-403c-9085-5c4b74836e91 req-93fc65a7-f579-434e-9a95-0441e01eac0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070077 Oct 31 14:32:56.010490 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2653/5555] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:32:56.288884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:56.289440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:56.308716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:56.310753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:56.311470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:56.313053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:56.314831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:56.317423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:56.384527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lazy-loading 'flavor' on Instance uuid e03d6aed-ba8c-4d89-99ba-7ddc86880d63 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:32:56.518625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:56.519333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:56.533358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:56.533868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:56.542604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:56.543370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:56.545853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:56.546347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:56.656609 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6ecdc95-39d6-4d96-8fcc-3759bda9c9d0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/action" status: 202 len: 0 microversion: 2.20 time: 0.372251 Oct 31 14:32:56.659248 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2903/5556] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:32:56 2022] POST /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:56.691143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1970833758", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "206a8c8a-a25c-4011-bc61-ed0c86f09d89", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-603906419", "security_groups": [{"name": "tempest-secgroup-smoke-341702941"}], "networks": [{"uuid": "94a71f9d-3097-4152-a6d2-9f2974bf110f"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:32:56.843488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:56.855974 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bcbd5fb1-c870-4494-afc8-76742624a619 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1308 microversion: 2.1 time: 0.342270 Oct 31 14:32:56.857142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2654/5557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:56 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:56.863537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:56.864730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:56.870727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:56.871695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:56.872320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:56.873205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:56.874035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:56.875563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:56.948461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] validate_networks() for [('94a71f9d-3097-4152-a6d2-9f2974bf110f', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:32:57.157943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:57.172329 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4faf03f5-08d6-4130-a6e2-8b1e531a5cb5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.313264 Oct 31 14:32:57.172920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2655/5558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:56 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:57.207355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:57.207977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:57.234098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:57.237066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:57.239711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:57.241913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:57.243994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:57.246709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:57.564082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:57.587358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:57.590811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:57.592253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-279d57a8-2789-4891-80c7-16e5961a1414 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.394623 Oct 31 14:32:57.596622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2656/5559] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:57 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:57.848045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:32:57.848712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:32:57.849950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:32:57.850555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:32:57.851232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:32:57.863969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:57.864772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:57.865434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:57.866599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:57.867228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:57.867818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:57.890251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:57.892304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Getting quotas for project 072bda06e0cd44269277a9b191809bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:32:57.895573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:57.915261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Getting quotas for user 3b4bf94fb7f64a85b8ac59f59e557afd and project 072bda06e0cd44269277a9b191809bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:32:57.918710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:57.921776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:57.922868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:57.925694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:57.926956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:57.928305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:57.929039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.014007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:32:58.020093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='206a8c8a-a25c-4011-bc61-ed0c86f09d89',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:32:58.178702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:58.199996 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5843929a-889c-4552-b387-775ced804601 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1489 microversion: 2.1 time: 0.319862 Oct 31 14:32:58.203201 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2657/5560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:57 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1489 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:58.222374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:58.222968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:58.234141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.234971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.235744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.242062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.243667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.264739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.413714 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-849d7303-43c3-4744-852b-db1bdc144224 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.740753 Oct 31 14:32:58.420406 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2904/5561] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:32:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:32:58.435043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:58.436389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:58.445342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.445962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.446666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.448042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.448745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.449281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.610484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:58.641472 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26d12748-5f91-4425-a893-04dade2cee6c tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.434820 Oct 31 14:32:58.642762 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2658/5562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:58 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:58.671268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b4b92b6-5294-46b0-b7d5-99d8616fd308 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:58.673398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b4b92b6-5294-46b0-b7d5-99d8616fd308 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:58.743038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b4b92b6-5294-46b0-b7d5-99d8616fd308 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:58.751342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b4b92b6-5294-46b0-b7d5-99d8616fd308 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1098 microversion: 2.1 time: 0.092059 Oct 31 14:32:58.751828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:58.752072 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2659/5563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:58 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1098 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:58.769444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:58.770057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:58.778850 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af116a65-7b87-4135-9ff1-206cbb634b8d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1489 microversion: 2.1 time: 0.346983 Oct 31 14:32:58.794598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.794598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.794598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.794598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.794598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.794598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.795404 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2905/5564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:58 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1489 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:58.816639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:58.817151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:58.828608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.829403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.830037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:58.830983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:58.831448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:58.831900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.065061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.073900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61782c22-19ea-464a-9310-d7b2e9bab53d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1489 microversion: 2.1 time: 0.274690 Oct 31 14:32:59.076426 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2906/5565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:58 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1489 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:32:59.086510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.108546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.109639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:59.111594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:59.115755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.119679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19ea036b-b2b0-4d05-96ae-066ac8dc00d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.366307 Oct 31 14:32:59.123017 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2660/5566] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:32:58 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:32:59.131556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.136020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.136485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.137217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.140352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.140986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.206351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:32:59.319759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:59.425395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e559f008-ffbd-4d8c-9761-c96c91163855 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 204 len: 0 microversion: 2.1 time: 0.325748 Oct 31 14:32:59.429940 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2907/5567] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:32:59 2022] DELETE /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:32:59.435403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:59.436018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:59.456289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.462526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.463658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.465400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.470233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.472097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.673688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:59.674437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:59.684215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.687902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.689293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.691665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.692790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.694246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.738536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.754797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f77c1258-f778-4c17-b925-703f564950ec tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1495 microversion: 2.1 time: 0.323397 Oct 31 14:32:59.771623 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2661/5568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:59 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1495 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:59.796309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:32:59.800976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:32:59.841857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.843842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.844314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.848292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:32:59.851086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:32:59.851564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:32:59.933006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.961929 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac92585d-b665-48cb-8c46-80433d75f885 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.293519 Oct 31 14:32:59.969197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:32:59.979492 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2908/5569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:59 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:32:59.980920 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b9a67ee-7d97-4547-b076-0bfb36c7b11f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1140 microversion: 2.1 time: 0.195172 Oct 31 14:32:59.981880 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2662/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:32:59 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1140 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:00.150793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:00.152171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:00.160008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:00.160783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:00.163219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:00.165056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:00.166554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:00.168137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:00.421291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:00.432110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:00.434011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:00.435971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f9d2cc8-ea24-4218-ab6c-930a0d722d04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.289158 Oct 31 14:33:00.470071 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2909/5571] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:00 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:00.626233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-635403e2-6108-4a2b-a01a-37cb69ced884 req-6d950d80-d0c8-4665-9cba-b2537a5e3f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3362ee5b-2b1b-4ee2-b49a-8becd6b95606", "name": "network-vif-plugged", "status": "completed", "tag": "f8af84e1-e8ad-46de-836b-61107f0870b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:00.654137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-635403e2-6108-4a2b-a01a-37cb69ced884 req-6d950d80-d0c8-4665-9cba-b2537a5e3f74 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:00.654673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-635403e2-6108-4a2b-a01a-37cb69ced884 req-6d950d80-d0c8-4665-9cba-b2537a5e3f74 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:00.655122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-635403e2-6108-4a2b-a01a-37cb69ced884 req-6d950d80-d0c8-4665-9cba-b2537a5e3f74 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:00.692095 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-635403e2-6108-4a2b-a01a-37cb69ced884 req-6d950d80-d0c8-4665-9cba-b2537a5e3f74 service nova] Creating event network-vif-plugged:f8af84e1-e8ad-46de-836b-61107f0870b5 for instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 on n-h2-863052-1 Oct 31 14:33:00.717650 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-635403e2-6108-4a2b-a01a-37cb69ced884 req-6d950d80-d0c8-4665-9cba-b2537a5e3f74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096187 Oct 31 14:33:00.720044 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2663/5572] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:00.786286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:00.787241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:00.799149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:00.799917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:00.801312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:00.806364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:00.806904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:00.807640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:00.985262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:00.986589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:01.011017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.013080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.015447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.018319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.019691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.020762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.156300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:01.170106 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7953d8b-ed6a-4473-8655-7ae6aaab179d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1495 microversion: 2.1 time: 0.389943 Oct 31 14:33:01.172643 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2910/5573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:00 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1495 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:01.182468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:01.183401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:01.191065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.192016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.192820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.193739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.194448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.196852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.324406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:01.336072 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-88d51549-f4fb-4534-9476-2d2ccc2a30c4 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.354807 Oct 31 14:33:01.340305 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2664/5574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:00 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:01.378946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:01.405891 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1597dff-dcd6-4762-9e69-b7cea22c4b18 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1196 microversion: 2.1 time: 0.231806 Oct 31 14:33:01.409833 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2911/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:01 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1196 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:01.466641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:01.467302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:01.477901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.480428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.482779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.483940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.485567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.486834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.547541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:01.840331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2c4f6a52-1c87-4dc4-8e12-5d6b4090501b req-b98e80de-d1dd-4ae7-b823-b171b422cbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4659ac8-98f6-416a-aa74-34e3066d8b9d", "name": "network-vif-deleted", "tag": "57243c35-d36d-4e74-b343-796cdcda0431"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:01.858301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c4f6a52-1c87-4dc4-8e12-5d6b4090501b req-b98e80de-d1dd-4ae7-b823-b171b422cbf9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:01.861458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c4f6a52-1c87-4dc4-8e12-5d6b4090501b req-b98e80de-d1dd-4ae7-b823-b171b422cbf9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:01.862423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c4f6a52-1c87-4dc4-8e12-5d6b4090501b req-b98e80de-d1dd-4ae7-b823-b171b422cbf9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:01.901667 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2c4f6a52-1c87-4dc4-8e12-5d6b4090501b req-b98e80de-d1dd-4ae7-b823-b171b422cbf9 service nova] Creating event network-vif-deleted:57243c35-d36d-4e74-b343-796cdcda0431 for instance e4659ac8-98f6-416a-aa74-34e3066d8b9d on n-h1-863052-1 Oct 31 14:33:01.930119 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2c4f6a52-1c87-4dc4-8e12-5d6b4090501b req-b98e80de-d1dd-4ae7-b823-b171b422cbf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093992 Oct 31 14:33:01.946563 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2912/5576] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:33:02.065217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:02.076234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:02.081422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:02.082722 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-914bb3ba-ba8b-4006-bb15-77c2e7ae74d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.621625 Oct 31 14:33:02.086602 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2665/5577] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:01 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:02.198862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:02.200214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:02.211373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.214834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.216947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.218073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.220361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.221029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.300609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.303767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.304675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.309236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lazy-loading 'fault' on Instance uuid e4659ac8-98f6-416a-aa74-34e3066d8b9d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:33:02.364824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:02.365408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:02.382006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.383820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.384302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.385921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.386436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.393503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.432330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:02.450655 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40cbe76f-c1e8-4379-8a40-92fd721c2de8 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 200 len: 1298 microversion: 2.1 time: 0.248999 Oct 31 14:33:02.451679 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2913/5578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:02 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 1298 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:02.475987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:02.478305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:02.495593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.496101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.496555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.498004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:02.498508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:02.498945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:02.606336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:02.618765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be2b71e6-e173-42a3-a337-04a0b959a9b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1214 microversion: 2.1 time: 0.164961 Oct 31 14:33:02.619284 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2914/5579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:02 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:02.760069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:02.800920 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-178d4e02-ed33-4add-a493-5a79673ed86e tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1313 microversion: 2.1 time: 0.440241 Oct 31 14:33:02.815043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2666/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:02 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:03.111891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:03.113126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:03.128123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.128991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.129610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.131119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.134021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.134698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.449545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:03.463398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:03.466290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:03.471196 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fca903da-3344-4996-a481-17a9a94d60f3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.361391 Oct 31 14:33:03.479280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:03.481935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:03.487082 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2915/5581] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:03 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:03.493447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.495097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.495624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.496981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.497581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.498382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.524401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d HTTP/1.1 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e4659ac8-98f6-416a-aa74-34e3066d8b9d'} Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:03.526482 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:33:03.530388 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:03.539770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:33:03.544348 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-51f80a17-948c-446b-b95f-a2dbb24e4055 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 404 len: 111 microversion: 2.1 time: 0.069199 Oct 31 14:33:03.556095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:03.556895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:03.563393 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2667/5582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:03 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:33:03.572218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.572950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.577596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.585368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.587192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.590594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.658610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:03.659672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:03.686940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.703306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.703942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.704812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:03.705398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:03.710796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:03.714010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:33:03.980073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ac15aab-5089-49e8-932f-9f38e07e006e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 204 len: 0 microversion: 2.1 time: 0.428972 Oct 31 14:33:03.981458 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2916/5583] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:33:03 2022] DELETE /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:33:03.995379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:03.996526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:04.006336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:04.007450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:04.008071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:04.008970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:04.009589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:04.010234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:04.174815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:04.187528 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f123095f-b05b-4b1d-b571-64a26f30ef08 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.546602 Oct 31 14:33:04.188266 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2668/5584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:03 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:04.194931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:04.195890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:04.217461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:04.218099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:04.218684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:04.219503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:04.220091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:04.220773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:04.328237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:04.340034 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f6f519a-cac0-4f26-be91-2a1d4e445db0 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1497 microversion: 2.1 time: 0.356807 Oct 31 14:33:04.340870 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2917/5585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:03 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1497 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:04.522568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:04.523212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:04.538959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:04.539484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:04.540761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:04.542835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:04.543354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:04.544167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:04.552613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:04.560710 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a315bee-2d7a-440f-a02d-e6aaed21386b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1495 microversion: 2.1 time: 0.367715 Oct 31 14:33:04.578272 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2669/5586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:04 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:04.880893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:04.897917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:04.899521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:04.903678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45bd4230-ba70-4ec0-a3af-c86d076fc1ba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.384603 Oct 31 14:33:04.920848 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2918/5587] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:04 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:05.213886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:05.215157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:05.225987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.226537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.226980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:05.227707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.228170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.228605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:05.449185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-edc5d19d-6b5a-4b36-b48b-22666cfc2f9f req-a41259ba-23fb-4630-9a50-9534063e5b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:05.491003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-edc5d19d-6b5a-4b36-b48b-22666cfc2f9f req-a41259ba-23fb-4630-9a50-9534063e5b7b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.491855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-edc5d19d-6b5a-4b36-b48b-22666cfc2f9f req-a41259ba-23fb-4630-9a50-9534063e5b7b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.492310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-edc5d19d-6b5a-4b36-b48b-22666cfc2f9f req-a41259ba-23fb-4630-9a50-9534063e5b7b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:05.537596 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-edc5d19d-6b5a-4b36-b48b-22666cfc2f9f req-a41259ba-23fb-4630-9a50-9534063e5b7b service nova] Creating event network-changed:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:33:05.546544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-edc5d19d-6b5a-4b36-b48b-22666cfc2f9f req-a41259ba-23fb-4630-9a50-9534063e5b7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106575 Oct 31 14:33:05.550530 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2919/5588] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:05.594676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:05.598913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:05.614985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.615891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.616592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:05.617863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.619372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.620105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:05.667012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:05.703368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c129cb19-474c-4001-8eb3-d54b60175712 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.482706 Oct 31 14:33:05.725424 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2670/5589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:05 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:05.932282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:05.936962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:05.938022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:05.950158 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-220f5336-ea2d-41c8-8169-54781eb9a627 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1495 microversion: 2.1 time: 0.352960 Oct 31 14:33:05.953019 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2920/5590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:05 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1495 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:05.957978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.959296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.960836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:05.963623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:05.964254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:05.964989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:06.527348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e0afaf2c-cdbd-4478-9182-63a2686290fe req-ee13e298-ed60-4902-8b16-f6a95d208102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cd68ae-a2b5-4daf-981a-a371c16932f4", "name": "network-vif-deleted", "tag": "ecaebdd2-683a-4e90-ae1d-0cb4eebcc855"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:06.568429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:06.590865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:06.593316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e0afaf2c-cdbd-4478-9182-63a2686290fe req-ee13e298-ed60-4902-8b16-f6a95d208102 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:06.594404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e0afaf2c-cdbd-4478-9182-63a2686290fe req-ee13e298-ed60-4902-8b16-f6a95d208102 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:06.595395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:06.596331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e0afaf2c-cdbd-4478-9182-63a2686290fe req-ee13e298-ed60-4902-8b16-f6a95d208102 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:06.602286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41171722-00d4-4d88-9567-25398b6afda5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.671993 Oct 31 14:33:06.625284 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2671/5591] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:05 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:06.678012 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e0afaf2c-cdbd-4478-9182-63a2686290fe req-ee13e298-ed60-4902-8b16-f6a95d208102 service nova] Creating event network-vif-deleted:ecaebdd2-683a-4e90-ae1d-0cb4eebcc855 for instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 on n-h2-863052-1 Oct 31 14:33:06.698592 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e0afaf2c-cdbd-4478-9182-63a2686290fe req-ee13e298-ed60-4902-8b16-f6a95d208102 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168432 Oct 31 14:33:06.705277 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2921/5592] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:06.731087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:06.732299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:06.755297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:06.756689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:06.759846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:06.761770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:06.762967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:06.764060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:06.985182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:06.986088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:07.010730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:07.012628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:07.013804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:07.019355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:07.021525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:07.024298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:07.105517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:07.109935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:07.110609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:07.111341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lazy-loading 'fault' on Instance uuid e5cd68ae-a2b5-4daf-981a-a371c16932f4 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:33:07.273710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:07.296249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77ff0dd4-26fe-4fbf-85d9-1859717e83a2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 200 len: 1298 microversion: 2.1 time: 0.317811 Oct 31 14:33:07.297459 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2922/5593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:06 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 1298 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:07.495839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:07.504808 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1655e9a5-1d7f-4006-ac5f-ae122d8f2895 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.777871 Oct 31 14:33:07.525069 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2672/5594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:06 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:07.634524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:07.636060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:07.647787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:07.650443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:07.651727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:07.654341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:07.655265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:07.661129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:07.692991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:07.882033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:07.922717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:07.929603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=22 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:07.939620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:07.949014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:07.953589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d8032f3-9cce-4b57-a095-d8d3ce6e5adb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1742 microversion: 2.20 time: 0.325804 Oct 31 14:33:07.980762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2923/5595] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:07 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1742 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:08.325408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:08.326744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:08.345041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:08.349321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:08.352014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:08.353073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:08.355327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:08.359499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:08.401828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 HTTP/1.1 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e5cd68ae-a2b5-4daf-981a-a371c16932f4'} Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:08.404130 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:33:08.407944 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:08.412719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:33:08.413815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8a9282d-dad3-44f9-bec4-fbde41f0e45f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 404 len: 111 microversion: 2.1 time: 0.092909 Oct 31 14:33:08.415156 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2673/5596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:08 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:33:08.533662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:08.534421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:08.553329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:08.555747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:08.556627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:08.557538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:08.561340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:08.562906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:08.666396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1472545472", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:08.749846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:08.822729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:33:08.932731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:08.952515 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e250a98a-bd31-4bba-a2f5-fcabb63768f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.418380 Oct 31 14:33:08.955606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2924/5597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:08 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:08.984709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:08.985387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:09.005732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:09.015396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:09.024819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:09.025682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:09.026194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:09.026634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:09.400683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:09.412028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:09.418619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:09.426949 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5a1b256-6448-4ce3-903d-1c176b310783 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1742 microversion: 2.20 time: 0.444672 Oct 31 14:33:09.434953 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2925/5598] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:08 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1742 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:09.980001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:09.981291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:09.995611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:09.996361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:09.997590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:09.998724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:09.999652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.000305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.030912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:33:10.031317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:33:10.032223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:33:10.032824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:33:10.033420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:33:10.057932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.058961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.060240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.062967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.063630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.065093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.128604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:33:10.136240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:33:10.187717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:33:10.193533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:33:10.284898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:10.303279 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-129516be-12a1-44f4-9540-f6d6fb4b57a2 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.328075 Oct 31 14:33:10.313123 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2926/5599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:09 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:10.325260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a9bec3e8-845b-47b8-aaac-b192a0aefc2c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690024 Oct 31 14:33:10.327036 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2674/5600] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:33:10.342008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ac9507c-6f47-4154-b979-0bf129eef159 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:10.343380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ac9507c-6f47-4154-b979-0bf129eef159 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:10.467883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:10.468907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:10.482320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ac9507c-6f47-4154-b979-0bf129eef159 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:10.494415 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ac9507c-6f47-4154-b979-0bf129eef159 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1209 microversion: 2.1 time: 0.152405 Oct 31 14:33:10.495444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.495986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.499073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.499854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.500288 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2927/5601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:10 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:10.500413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.500764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.592336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:10.592858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:10.606768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.607280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.607730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.608427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.608900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.629170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.711476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:33:10.922528 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00d1d28e-a86e-4468-ae6b-c85d1c2066f5 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 204 len: 0 microversion: 2.1 time: 0.338428 Oct 31 14:33:10.929012 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2928/5602] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:33:10 2022] DELETE /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:33:10.935331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:10.936487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:10.944441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.945158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.945928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.946821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:10.947451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:10.948032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:10.962945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:10.981629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:10.991932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:10.997811 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7173a1c-2056-4cde-a83b-3d4f38ff3388 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.534737 Oct 31 14:33:10.999500 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2675/5603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:10 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:11.314475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:11.330340 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-861a9b5e-ea99-43bd-9339-01863c5d318b tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1503 microversion: 2.1 time: 0.399863 Oct 31 14:33:11.342988 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2929/5604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:10 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:11.347574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:11.348807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:11.363109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:11.364316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:11.365266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:11.366146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:11.370473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:11.371115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:11.524869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:11.525512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:11.534417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:11.536491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:11.536491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:11.536745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:11.540609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:11.541374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:11.655846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:11.665116 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cbfb2223-d2e4-4391-9115-481efdbd3444 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.323386 Oct 31 14:33:11.671325 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2676/5605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:11 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:11.685406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:11.703557 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bf9c9af-482c-42dc-b6f6-e6285ffb566c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1213 microversion: 2.1 time: 0.181408 Oct 31 14:33:11.705099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2930/5606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:11 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:11.976636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8882a352-ae15-4533-b011-7ecc7cd46fc5 req-ab73d6ea-2e8e-4bcb-b8b7-d42290fc7c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:12.001608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8882a352-ae15-4533-b011-7ecc7cd46fc5 req-ab73d6ea-2e8e-4bcb-b8b7-d42290fc7c2f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.003446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8882a352-ae15-4533-b011-7ecc7cd46fc5 req-ab73d6ea-2e8e-4bcb-b8b7-d42290fc7c2f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.005883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8882a352-ae15-4533-b011-7ecc7cd46fc5 req-ab73d6ea-2e8e-4bcb-b8b7-d42290fc7c2f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.031030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:12.032164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:12.041878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:12.062920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.065304 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8882a352-ae15-4533-b011-7ecc7cd46fc5 req-ab73d6ea-2e8e-4bcb-b8b7-d42290fc7c2f service nova] Creating event network-vif-plugged:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:33:12.067143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.084468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.089978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.090778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.094871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.106622 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8882a352-ae15-4533-b011-7ecc7cd46fc5 req-ab73d6ea-2e8e-4bcb-b8b7-d42290fc7c2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134296 Oct 31 14:33:12.111001 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2677/5607] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:12.366110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:12.366868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:12.377262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.388150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.389677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.392150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.393147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.394413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.609442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:12.630132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:12.640907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:12.646154 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b32372fc-e9d1-4bd4-86e2-b3f3af8188f7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.622725 Oct 31 14:33:12.648357 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2931/5608] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:12 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:12.691989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:12.692919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:12.708969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.709691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.710672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.721352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.722065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.722817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.804635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:12.814581 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65ff294a-1984-4b04-baef-db971065b676 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1503 microversion: 2.1 time: 0.454809 Oct 31 14:33:12.819345 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2678/5609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:12 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1503 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:12.828767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:12.836100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:12.851540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.856887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.858964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:12.859956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:12.864316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:12.865506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:13.018694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:13.027426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:13.037530 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1095e7a0-bd75-4bee-9ee9-46242a2c8400 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1261 microversion: 2.1 time: 0.216536 Oct 31 14:33:13.043185 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c147928c-9874-484d-8416-4b24a7d1f6d7 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1281 microversion: 2.1 time: 0.355085 Oct 31 14:33:13.050376 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2679/5610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:12 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:13.051306 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2932/5611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:12 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1281 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:13.676083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:13.677992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:13.696616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:13.697499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:13.698158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:13.699196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:13.700490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:13.702398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:13.843064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:13.844396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:13.854767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:13.861410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:13.863647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:13.874431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:13.875392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:13.876074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:14.081491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:14.091201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:14.094327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:14.096048 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cb72ef3-2188-4769-8a3e-033603c461fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.423886 Oct 31 14:33:14.096857 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2680/5612] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:13 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:14.104730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:14.105845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:14.112334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:14.113364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:14.114053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:14.115016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:14.115799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:14.116409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:14.406215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:14.494035 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-303ca19d-47ee-4f85-8c23-d13fd66a7e2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.395698 Oct 31 14:33:14.496275 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2681/5613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:14 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:14.502434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:14.503718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:14.531549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:14.532084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:14.532494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:14.533208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:14.533705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:14.534126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:14.685508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:14.704516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda8016cf61d466d98c2c4f716f4e33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873e8de041b74aca82937f9ed02db7cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:14.705973 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6f65064-8cf9-4618-87c6-cd5675b35ba3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1267 microversion: 2.1 time: 0.204896 Oct 31 14:33:14.707362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2682/5614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:14 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:14.740100 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-731ff0a6-b841-4ce2-9078-eadfc42b1a28 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 200 len: 1503 microversion: 2.1 time: 0.894905 Oct 31 14:33:14.741548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2933/5615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:13 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 1503 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:15.076768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bb926c80-d280-43c8-84ca-785d15d811bf req-66dc897c-f2b4-4ed9-b40f-e76e04d70277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3362ee5b-2b1b-4ee2-b49a-8becd6b95606", "name": "network-vif-deleted", "tag": "f8af84e1-e8ad-46de-836b-61107f0870b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:15.127398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bb926c80-d280-43c8-84ca-785d15d811bf req-66dc897c-f2b4-4ed9-b40f-e76e04d70277 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.127873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:15.128507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:15.129185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bb926c80-d280-43c8-84ca-785d15d811bf req-66dc897c-f2b4-4ed9-b40f-e76e04d70277 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.132823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bb926c80-d280-43c8-84ca-785d15d811bf req-66dc897c-f2b4-4ed9-b40f-e76e04d70277 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.146595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.162190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.167124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.170630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.174799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.175376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bb926c80-d280-43c8-84ca-785d15d811bf req-66dc897c-f2b4-4ed9-b40f-e76e04d70277 service nova] Creating event network-vif-deleted:f8af84e1-e8ad-46de-836b-61107f0870b5 for instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 on n-h2-863052-1 Oct 31 14:33:15.180386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.188984 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bb926c80-d280-43c8-84ca-785d15d811bf req-66dc897c-f2b4-4ed9-b40f-e76e04d70277 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116379 Oct 31 14:33:15.191559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2683/5616] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:15.521243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:15.522234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:15.539673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.540175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.549078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.549948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.550474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.552592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.842376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:15.880803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:15.904242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:15.909961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e411d4ec-6456-43df-9c72-c60cac47ddb3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.786381 Oct 31 14:33:15.914710 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2934/5617] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:15 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:15.925394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:15.926080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:15.945208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.946200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.946859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.947776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:15.949741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:15.950553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:15.986363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:15.994647 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa004d5c-05a6-4982-9633-7680fa027a44 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.478375 Oct 31 14:33:16.014105 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2684/5618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:15 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:16.022937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:16.023565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] [instance: 3362ee5b-2b1b-4ee2-b49a-8becd6b95606] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:16.056870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:16.059236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:16.059879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:16.060829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:16.064465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:16.065389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:16.088422 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] HTTP exception thrown: Instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 could not be found. Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Request method failure captured: Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 HTTP/1.1 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9yMB65SeyHz4fEafsHxY4KLYFj7IY6CLdg0yTcXcn38zhaGOZ3kmj6ce1pzYtf7YFs9BjF4P8Low1orp4mmCO0xSQT3aJJXFRsFm-zjP5-pmSSTNebzwnnFHzCm_SRwRI82P10shkXFAYNNqRCZeBl4ZvifOpgCBtpvsXbIBoQ6nsU Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 873e8de041b74aca82937f9ed02db7cb Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesActionsTest-279315249 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_873e8de041b74aca82937f9ed02db7cb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/873e8de041b74aca82937f9ed02db7cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/873e8de041b74aca82937f9ed02db7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/873e8de041b74aca82937f9ed02db7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesActionsTest-279315249 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 873e8de041b74aca82937f9ed02db7cb Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesActionsTest-279315249 Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesActionsTest-279315249-project Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: fda8016cf61d466d98c2c4f716f4e33b Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesActionsTest-279315249-project Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 could not be found. Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3362ee5b-2b1b-4ee2-b49a-8becd6b95606'} Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 could not be found. Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 could not be found. Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:16.090889 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 could not be found. Oct 31 14:33:16.095118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:33:16.097587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] Returning 404 to user: Instance 3362ee5b-2b1b-4ee2-b49a-8becd6b95606 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:33:16.099113 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21470099-dcb1-4a17-aee0-9ba2ada74232 tempest-VolumesActionsTest-279315249 tempest-VolumesActionsTest-279315249-project] 10.222.0.27 "GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606" status: 404 len: 111 microversion: 2.1 time: 0.082447 Oct 31 14:33:16.100396 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2685/5619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:16 2022] GET /compute/v2.1/servers/3362ee5b-2b1b-4ee2-b49a-8becd6b95606 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:33:16.479066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:16.509659 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-abbc8447-1bbd-47da-af7a-1db21f38f2c0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.593623 Oct 31 14:33:16.514077 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2935/5620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:15 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:16.942300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:16.942926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:16.950762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:16.954549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:16.955640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:16.955734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:16.956176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:16.956605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:17.021383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:17.022001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:17.024079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:17.043348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:17.043950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:17.044407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:17.050786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:17.052179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:17.052633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:17.208986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:17.218006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:17.222829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:17.228373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c5e29cf0-20f0-4da4-8fae-15b76ea2c51d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.291089 Oct 31 14:33:17.230778 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2686/5621] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:16 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:17.460977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:17.480950 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0acda50a-1e97-48ba-ad20-5d021a17cded tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.463472 Oct 31 14:33:17.503107 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2936/5622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:17 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:17.534600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:17.536015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:17.553299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:17.554211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:17.554824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:17.555698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:17.556505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:17.557121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:17.580783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-31c1e78f-3d89-46dc-b03a-f17de48233d8 req-27dedafb-b1eb-49e6-9ffd-0f6fcef3ff46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f026edcf-2594-4f48-b0e1-3fb1d96be64c", "tag": "1994f784-329b-4a7d-9129-f9b727c76e68"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:17.616215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-31c1e78f-3d89-46dc-b03a-f17de48233d8 req-27dedafb-b1eb-49e6-9ffd-0f6fcef3ff46 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:17.621324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-31c1e78f-3d89-46dc-b03a-f17de48233d8 req-27dedafb-b1eb-49e6-9ffd-0f6fcef3ff46 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:17.622155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-31c1e78f-3d89-46dc-b03a-f17de48233d8 req-27dedafb-b1eb-49e6-9ffd-0f6fcef3ff46 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:17.667566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-31c1e78f-3d89-46dc-b03a-f17de48233d8 req-27dedafb-b1eb-49e6-9ffd-0f6fcef3ff46 service nova] Creating event network-changed:1994f784-329b-4a7d-9129-f9b727c76e68 for instance f026edcf-2594-4f48-b0e1-3fb1d96be64c on n-h2-863052-1 Oct 31 14:33:17.701183 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-31c1e78f-3d89-46dc-b03a-f17de48233d8 req-27dedafb-b1eb-49e6-9ffd-0f6fcef3ff46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124223 Oct 31 14:33:17.709940 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2937/5623] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:33:18.091939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:18.101097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b81d7bb-c305-4443-9b45-922a2e47fbf3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.571395 Oct 31 14:33:18.114210 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2687/5624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:17 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:18.260081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:18.261090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:18.273377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:18.274128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:18.274739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:18.275623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:18.276234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:18.277595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:18.509347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:18.510148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:18.525727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:18.526554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:18.527160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:18.528057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:18.528717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:18.529356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:18.831861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:18.839772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94367d7d-d6eb-4153-99a9-748299e4f3b0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.334533 Oct 31 14:33:18.846758 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2688/5625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:18 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:18.944233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:18.965960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:18.970627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:18.974842 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74b2982c-c82d-461d-b015-b1aa3dda3d7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.721225 Oct 31 14:33:19.000091 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2938/5626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:18 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:19.128775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:19.130061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:19.142009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:19.142607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:19.143149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:19.147102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:19.147832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:19.148481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:19.435558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:19.445527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5913adbf-d006-41cd-b1a4-995950374c20 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.321752 Oct 31 14:33:19.448091 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2689/5627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:19 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:19.870633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:19.871735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:19.898841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:19.901494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:19.912427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:19.914546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:19.927035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:19.930936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:20.010385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:20.011179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:20.032840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:20.036784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:20.037442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:20.041951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:20.043219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:20.043901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:20.098823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:20.167702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:20.356856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:20.366656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:20.375029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:20.378017 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5b2b1a5-d75b-40dc-a3fc-18e866679ed3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.371629 Oct 31 14:33:20.378870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2690/5628] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:20 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:20.463917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:20.470500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:20.471234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:20.478900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aba270c4-daf6-4d04-bec7-2042135d6568 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.612382 Oct 31 14:33:20.480067 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2939/5629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:19 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:20.483382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:20.484275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:20.484967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:20.485941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:20.498946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:20.499886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:21.251935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:21.260561 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0bfd24be-16e1-4fdc-af38-9b3654dfcc7c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.793995 Oct 31 14:33:21.280210 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2691/5630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:20 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:21.406389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:21.407287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:21.419264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:21.422472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:21.427433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:21.427889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:21.428631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:21.429090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:21.429519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:21.440302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:21.503459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:21.505131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:21.515790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:21.516605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:21.517260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:21.518229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:21.522285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:21.524703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:21.924716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:21.942663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:21.955023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:21.965743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:21.966817 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7496535-6bb2-4609-9aaa-78ae8afcf127 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.464832 Oct 31 14:33:21.967721 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2692/5631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:21 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:21.968064 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f1aa074-446e-4870-bd58-d09a449fe7b8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.565475 Oct 31 14:33:21.969391 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2940/5632] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:21 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:22.298923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:22.300868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:22.326025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:22.328324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:22.329593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:22.333498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:22.334327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:22.337605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:22.645929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:22.671212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dace84dd-a59f-4a0c-a4d7-c148847cef4e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.376786 Oct 31 14:33:22.672576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2693/5633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:22 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:23.016931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:23.017548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:23.019715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:23.022970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:23.053501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.054018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.059561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.060562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.064161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.064658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.065106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.069552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.071360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.072141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.078433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.080338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.489833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:23.506259 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-846096b0-83ce-44df-b4d9-267071d29c58 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.497356 Oct 31 14:33:23.506907 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2694/5634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:23 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:23.544800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bc706bb8-8088-4d97-89a8-4a79b84a7dc4 req-908b9048-6fb0-4f2a-94f0-a847c0e7894e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f026edcf-2594-4f48-b0e1-3fb1d96be64c", "name": "network-vif-plugged", "status": "completed", "tag": "1994f784-329b-4a7d-9129-f9b727c76e68"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:23.565373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bc706bb8-8088-4d97-89a8-4a79b84a7dc4 req-908b9048-6fb0-4f2a-94f0-a847c0e7894e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.570408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bc706bb8-8088-4d97-89a8-4a79b84a7dc4 req-908b9048-6fb0-4f2a-94f0-a847c0e7894e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.574191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bc706bb8-8088-4d97-89a8-4a79b84a7dc4 req-908b9048-6fb0-4f2a-94f0-a847c0e7894e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.601053 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bc706bb8-8088-4d97-89a8-4a79b84a7dc4 req-908b9048-6fb0-4f2a-94f0-a847c0e7894e service nova] Creating event network-vif-plugged:1994f784-329b-4a7d-9129-f9b727c76e68 for instance f026edcf-2594-4f48-b0e1-3fb1d96be64c on n-h2-863052-1 Oct 31 14:33:23.622935 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bc706bb8-8088-4d97-89a8-4a79b84a7dc4 req-908b9048-6fb0-4f2a-94f0-a847c0e7894e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081671 Oct 31 14:33:23.627947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2695/5635] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:23.698007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:23.698876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:23.711216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.717947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:23.722253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.727531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.731299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:23.731785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:23.732223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:23.737362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:23.744161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:23.746324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82cd332d-c611-4430-9975-e477870b25fc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.742803 Oct 31 14:33:23.767307 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2941/5636] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:23 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:24.110697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:24.120408 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ea1e785-d3fd-4ec6-a0dd-b3965c987ada tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.426391 Oct 31 14:33:24.121555 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2696/5637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:23 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:24.532492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:24.533121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:24.542134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:24.542900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:24.543526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:24.545044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:24.545692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:24.546325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:24.772472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:24.782516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:24.784278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:24.787151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ac2a173-b6cc-4a4c-b689-1d28ba393eff tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.259288 Oct 31 14:33:24.793515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:24.794362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:24.795156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:24.796139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:24.796850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:24.797491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:24.803669 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2942/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:24 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:25.073708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:25.093093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:25.095135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:25.096631 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7804f26-8e72-4f55-960c-b839e28c9ae4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.320107 Oct 31 14:33:25.097747 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2697/5639] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:24 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:25.144499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:25.145736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:25.161214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:25.162486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:25.163116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:25.164240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:25.166639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:25.167636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:25.464099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:25.476436 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10e0331f-8f7d-4a85-bd42-9bef8b2a3196 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1309 microversion: 2.1 time: 0.335817 Oct 31 14:33:25.478144 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2943/5640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:25 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1309 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:25.811207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:25.812536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:25.824741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:25.826878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:25.827523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:25.828447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:25.830805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:25.831436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.126630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:26.127255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:26.136900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.137404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.137855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.143165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.143659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.144097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.270337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:26.278825 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a34a9d72-f1fc-4b04-a59f-7671568407d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.471707 Oct 31 14:33:26.282940 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2698/5641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:25 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:26.323777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a03ff266-34c6-43ae-8158-abd51ae12f57 req-8eeb82e5-1241-4087-b11a-34ffba761db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "name": "network-vif-plugged", "status": "completed", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:26.340471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:26.346624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a03ff266-34c6-43ae-8158-abd51ae12f57 req-8eeb82e5-1241-4087-b11a-34ffba761db9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.347631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a03ff266-34c6-43ae-8158-abd51ae12f57 req-8eeb82e5-1241-4087-b11a-34ffba761db9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.348438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a03ff266-34c6-43ae-8158-abd51ae12f57 req-8eeb82e5-1241-4087-b11a-34ffba761db9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.367092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a03ff266-34c6-43ae-8158-abd51ae12f57 req-8eeb82e5-1241-4087-b11a-34ffba761db9 service nova] Creating event network-vif-plugged:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:33:26.375136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a03ff266-34c6-43ae-8158-abd51ae12f57 req-8eeb82e5-1241-4087-b11a-34ffba761db9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055987 Oct 31 14:33:26.376576 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2699/5642] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:33:26.509635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:26.526582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:26.533773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:26.559066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:26.565162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:26.567526 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1064973-68a1-46d4-bc07-d429cb2b0be8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.444812 Oct 31 14:33:26.568291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.568795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.573172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.574159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.574811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.575413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.587985 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2944/5643] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:26 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:26.754546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:26.781977 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04497057-de1f-4a60-ab56-66245320befa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1490 microversion: 2.1 time: 0.284495 Oct 31 14:33:26.782938 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2700/5644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:26 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1490 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:26.808420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:26.811354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:26.817662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.818378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.819103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.819973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.820586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.821169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.933107 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53aaed01-6fab-47c3-8adc-8baec593f939 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "PUT /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1085 microversion: 2.1 time: 0.130632 Oct 31 14:33:26.935338 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2945/5645] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:33:26 2022] PUT /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1085 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:26.954203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:26.954652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:26.970915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.971409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.971906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:26.972646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:26.973101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:26.973523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.205942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:27.220851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f1dc0f49-1fc7-4491-8f0e-479268762923 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1511 microversion: 2.1 time: 0.270514 Oct 31 14:33:27.221784 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2701/5646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:26 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:27.248839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:27.249378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:27.260277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.260778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.261218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.273248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.274140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.274305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.323601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:27.324678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:27.340084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.340849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.341649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.342573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.343182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.343769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.514920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:27.525222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-296106f9-3799-4e83-a4c6-14bf622cbed0 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1269 microversion: 2.1 time: 0.218862 Oct 31 14:33:27.541825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2702/5647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:27 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:27.594343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:27.595053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:27.610367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.613656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.614626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.616330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.618513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.619066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.627037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:27.635398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6f59353-b389-4362-a9f8-c83676444b86 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1511 microversion: 2.1 time: 0.390583 Oct 31 14:33:27.636399 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2946/5648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:27 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:27.669432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:27.671614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:27.690287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.690790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.691252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.691975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:27.694296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:27.695030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:27.774147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:33:27.922774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:27.936309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:27.938531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:27.939931 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4fe2ca22-fc24-4c08-b24d-a2a8bdc6a1b5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.350175 Oct 31 14:33:27.947916 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2703/5649] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:27 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:28.001893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91a0b69a-3b22-4e0c-8c06-a24dc3144b35 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 204 len: 0 microversion: 2.1 time: 0.340144 Oct 31 14:33:28.003104 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2947/5650] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:33:27 2022] DELETE /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:33:28.014513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:28.015655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:28.038482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:28.039110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:28.039562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:28.040272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:28.040746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:28.041342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:28.045604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:28.375123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:28.401399 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c437108c-30a1-408b-85bf-25ebf9ce2f47 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1517 microversion: 2.1 time: 0.394154 Oct 31 14:33:28.409636 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2704/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:28 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:28.551547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:28.552830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:28.598413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:28.599167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:28.599884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:28.600724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:28.602334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:28.604319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:28.844582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:28.855306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6091739e-4613-4f14-99ab-d791f3c8b800 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1458 microversion: 2.1 time: 0.308839 Oct 31 14:33:28.856392 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2948/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:28 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1458 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:28.880032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:28.881022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:28.891424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:28.892982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:28.893835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:28.895283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:28.895845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:28.896495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:28.982204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:28.983156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:29.004982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:29.007816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:29.010308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:29.013226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:29.013967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:29.014535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:29.252187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:29.269958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:29.275802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:29.277610 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c6706e1-9196-4f19-8a3e-96bf6e571aba tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.299483 Oct 31 14:33:29.306354 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2949/5653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:28 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:29.433377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:29.434159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:29.443566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:29.447127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:29.447721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:29.449752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:29.452878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:29.453637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:29.677788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:29.709418 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a641ad0-dd13-4545-8815-1a5f56879ac6 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1458 microversion: 2.1 time: 0.833642 Oct 31 14:33:29.718313 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2705/5654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:28 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1458 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:30.309604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:30.312691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:30.347161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:30.349600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:30.351283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:30.356655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:30.359252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:30.362555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:30.599696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:30.625398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ab5041a-a392-4c9c-8952-ce4b92c3c11b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 200 len: 1517 microversion: 2.1 time: 1.196029 Oct 31 14:33:30.627719 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2950/5655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:29 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 1517 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:30.653506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2a2f0706-0b3e-447b-be1a-718a37c0f047 req-346c9888-5b11-46dc-b938-f581002cd6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f026edcf-2594-4f48-b0e1-3fb1d96be64c", "name": "network-vif-deleted", "tag": "1994f784-329b-4a7d-9129-f9b727c76e68"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:30.685739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2a2f0706-0b3e-447b-be1a-718a37c0f047 req-346c9888-5b11-46dc-b938-f581002cd6dd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:30.689606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2a2f0706-0b3e-447b-be1a-718a37c0f047 req-346c9888-5b11-46dc-b938-f581002cd6dd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:30.690324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2a2f0706-0b3e-447b-be1a-718a37c0f047 req-346c9888-5b11-46dc-b938-f581002cd6dd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:30.713471 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2a2f0706-0b3e-447b-be1a-718a37c0f047 req-346c9888-5b11-46dc-b938-f581002cd6dd service nova] Creating event network-vif-deleted:1994f784-329b-4a7d-9129-f9b727c76e68 for instance f026edcf-2594-4f48-b0e1-3fb1d96be64c on n-h2-863052-1 Oct 31 14:33:30.719199 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2a2f0706-0b3e-447b-be1a-718a37c0f047 req-346c9888-5b11-46dc-b938-f581002cd6dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086235 Oct 31 14:33:30.733187 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2951/5656] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:31.108121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:31.124742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:31.133884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:31.135528 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e7101ec-61bc-4e3f-859c-9ba48f2ee1a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1737 microversion: 2.20 time: 0.830170 Oct 31 14:33:31.141973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2706/5657] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:30 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1737 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:31.652470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:31.653235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:31.667938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:31.679499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:31.680082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:31.681037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:31.681577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:31.682076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:31.733457 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c HTTP/1.1 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f026edcf-2594-4f48-b0e1-3fb1d96be64c'} Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:33:31.742117 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:33:31.747069 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9cbdfbad-ca0b-48c1-bba2-e5f1854c7f15 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 404 len: 111 microversion: 2.1 time: 0.097172 Oct 31 14:33:31.752146 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2952/5658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:31 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:33:32.018160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-853197403", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "bcc79cae-94f7-484b-8376-5a2e523bf2df"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:32.138733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] validate_networks() for [('bcc79cae-94f7-484b-8376-5a2e523bf2df', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:33:32.162907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:32.163533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:32.176707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:32.176707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:32.176707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:32.196571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:32.199496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:32.200132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:32.477011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:32.499719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:32.501781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:32.503373 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee162d3c-72f5-4799-8d01-980bf4a1b66e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1719 microversion: 2.20 time: 0.345150 Oct 31 14:33:32.504839 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2953/5659] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:32 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1719 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:33.380157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:33:33.381434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:33:33.381945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:33:33.384041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:33:33.384508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:33:33.424428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:33.428248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:33.428772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:33.429708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:33.430134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:33.434842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:33.514500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:33:33.531133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:33.531529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:33.540636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Getting quotas for user 3c31d943d44642e5b32d55da3f8d9a97 and project 7139ae97d73b48eca831ebc678635dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:33:33.553588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:33.554033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:33.554511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:33.555240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:33.555700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:33.556129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:33.561721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:33:33.565239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:33:33.667348 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4eb832fa-694a-49b5-aeb7-3ba42e98e76d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653004 Oct 31 14:33:33.681645 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2707/5660] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:33:33.695591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c6b5cb83-321d-4581-8dea-8f6cc8257b2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:33.696314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c6b5cb83-321d-4581-8dea-8f6cc8257b2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:33.971705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:33.991387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:33.992989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:33.996971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-086dfa2d-dede-430d-bba2-67944da2bf7a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1719 microversion: 2.20 time: 0.467529 Oct 31 14:33:33.998592 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2954/5661] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:33 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1719 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:34.197533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c6b5cb83-321d-4581-8dea-8f6cc8257b2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:34.208286 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c6b5cb83-321d-4581-8dea-8f6cc8257b2b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1208 microversion: 2.1 time: 0.526158 Oct 31 14:33:34.211213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2708/5662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:33 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1208 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:35.028758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:35.030068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:35.056472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:35.069688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:35.084153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:35.092298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:35.094920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:35.095507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:35.233321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:35.233948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:35.258151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:35.260339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:35.262394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:35.264538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:35.265501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:35.266239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:35.386446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:35.396024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:35.405307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:35.408894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:35.411326 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b0e820b-a9f0-4c73-a48b-0c2410fcef5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1719 microversion: 2.20 time: 0.388561 Oct 31 14:33:35.412563 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2955/5663] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:35 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1719 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:35.855701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9e714a98-4413-4a90-9cda-387de6a1c68d req-78620d2d-2118-4dfe-a15f-95102d775dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:35.889953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e714a98-4413-4a90-9cda-387de6a1c68d req-78620d2d-2118-4dfe-a15f-95102d775dfa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:35.890864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e714a98-4413-4a90-9cda-387de6a1c68d req-78620d2d-2118-4dfe-a15f-95102d775dfa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:35.893174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9e714a98-4413-4a90-9cda-387de6a1c68d req-78620d2d-2118-4dfe-a15f-95102d775dfa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:35.949895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9e714a98-4413-4a90-9cda-387de6a1c68d req-78620d2d-2118-4dfe-a15f-95102d775dfa service nova] Creating event network-changed:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:33:35.963004 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9e714a98-4413-4a90-9cda-387de6a1c68d req-78620d2d-2118-4dfe-a15f-95102d775dfa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111201 Oct 31 14:33:35.967223 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2956/5664] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:35.969252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:35.977860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2eb9be21-e02a-4e16-ba2d-2b8b8a0fa60e tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1260 microversion: 2.1 time: 0.748352 Oct 31 14:33:35.986971 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2709/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:35 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1260 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:36.095211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2b385c73-0876-4ad0-9545-bbd58da31260 req-0422bf2f-add8-4537-acd0-d5e57d8d3891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "name": "network-vif-unplugged", "status": "completed", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:36.149207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2b385c73-0876-4ad0-9545-bbd58da31260 req-0422bf2f-add8-4537-acd0-d5e57d8d3891 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:36.151215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2b385c73-0876-4ad0-9545-bbd58da31260 req-0422bf2f-add8-4537-acd0-d5e57d8d3891 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:36.152880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2b385c73-0876-4ad0-9545-bbd58da31260 req-0422bf2f-add8-4537-acd0-d5e57d8d3891 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:36.178151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2b385c73-0876-4ad0-9545-bbd58da31260 req-0422bf2f-add8-4537-acd0-d5e57d8d3891 service nova] Creating event network-vif-unplugged:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:33:36.196127 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2b385c73-0876-4ad0-9545-bbd58da31260 req-0422bf2f-add8-4537-acd0-d5e57d8d3891 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105322 Oct 31 14:33:36.196943 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2957/5666] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:36.440788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:36.442535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:36.454373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:36.454874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:36.455318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:36.456030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:36.461481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:36.463751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:36.991260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:37.002755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:37.004885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:37.020705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:37.024958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:37.027866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:37.029890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:37.030383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:37.032765 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb17eaf8-85ca-4cb3-82e7-1ba83b55d666 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1722 microversion: 2.20 time: 0.596838 Oct 31 14:33:37.036483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:37.037489 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2710/5667] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:36 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1722 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:37.037798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:37.038451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:37.065611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e4bd370-f195-4289-bdb0-52dab9e75583"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:37.069310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:37.086663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:37.089600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:37.091003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:37.095280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:37.095964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:37.097834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:37.647182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:37.654926 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b9c9850-ac53-40a7-974a-75b93cdaaee0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1266 microversion: 2.1 time: 0.657226 Oct 31 14:33:37.684291 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2958/5668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:36 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1266 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:37.707282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1210c66f-fa6b-4476-b917-06bd48ea5015 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.644909 Oct 31 14:33:37.708964 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2711/5669] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 31 14:33:37 2022] POST /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 188 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:33:37.913157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:37.914036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:37.920822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:37.921538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:37.922402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:37.923411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:37.924029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:37.924624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:37.963142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 14:33:38.092071 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7eb1854-e4c2-45a2-aff7-227231afe74f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/action" status: 202 len: 0 microversion: 2.20 time: 0.183043 Oct 31 14:33:38.094636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2959/5670] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:33:37 2022] POST /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:33:38.103374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:38.105109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:38.119011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:38.119749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:38.121347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:38.123789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:38.125174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:38.127253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:38.514270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:38.528805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:38.533139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:38.557176 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af5f2977-9db5-4f1a-950e-f839ac0ba990 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1748 microversion: 2.20 time: 0.455052 Oct 31 14:33:38.558825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2712/5671] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:38 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1748 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:38.698649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:38.699749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:38.705117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-338163e7-5904-4eb6-bd7d-7e800926f9b3 req-f97f477c-8e60-4758-b3cc-5530de9747cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:38.739937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:38.743950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:38.744690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:38.745544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-338163e7-5904-4eb6-bd7d-7e800926f9b3 req-f97f477c-8e60-4758-b3cc-5530de9747cb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:38.746913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:38.748168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-338163e7-5904-4eb6-bd7d-7e800926f9b3 req-f97f477c-8e60-4758-b3cc-5530de9747cb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:38.748883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:38.749553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-338163e7-5904-4eb6-bd7d-7e800926f9b3 req-f97f477c-8e60-4758-b3cc-5530de9747cb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:38.752258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:38.808195 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-338163e7-5904-4eb6-bd7d-7e800926f9b3 req-f97f477c-8e60-4758-b3cc-5530de9747cb service nova] Creating event network-changed:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:33:38.827664 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-338163e7-5904-4eb6-bd7d-7e800926f9b3 req-f97f477c-8e60-4758-b3cc-5530de9747cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126135 Oct 31 14:33:38.831182 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2713/5672] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:39.103916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:39.124718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a8fdcd3-e0e7-4fbb-857f-80517773584a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1266 microversion: 2.1 time: 0.431922 Oct 31 14:33:39.139140 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2960/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:38 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:39.591304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:39.592398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:39.606774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:39.607533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:39.608570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:39.612008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:39.613502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:39.615498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:40.160787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:40.161643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:40.172467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:40.172969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:40.173536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:40.174103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:40.181728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:40.182523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:40.283297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:40.297365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:40.302620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:40.311762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f16dc9f0-185a-4ad6-b144-6d0d6a3ed95c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1748 microversion: 2.20 time: 0.724094 Oct 31 14:33:40.326885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2714/5674] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:39 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1748 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:40.601250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:40.613137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f925e89f-bcdc-4513-b472-43ba63d01fca tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.459221 Oct 31 14:33:40.644754 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2961/5675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:40 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:40.920312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-97e52a22-3e46-4a8f-a354-b20912ce806f req-e5450e5b-7c88-4a3f-a41c-28d7e5b935c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:40.944933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-97e52a22-3e46-4a8f-a354-b20912ce806f req-e5450e5b-7c88-4a3f-a41c-28d7e5b935c3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:40.945644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-97e52a22-3e46-4a8f-a354-b20912ce806f req-e5450e5b-7c88-4a3f-a41c-28d7e5b935c3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:40.946086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-97e52a22-3e46-4a8f-a354-b20912ce806f req-e5450e5b-7c88-4a3f-a41c-28d7e5b935c3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:40.975291 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-97e52a22-3e46-4a8f-a354-b20912ce806f req-e5450e5b-7c88-4a3f-a41c-28d7e5b935c3 service nova] Creating event network-changed:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:33:40.980918 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-97e52a22-3e46-4a8f-a354-b20912ce806f req-e5450e5b-7c88-4a3f-a41c-28d7e5b935c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064581 Oct 31 14:33:40.983917 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2715/5676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:33:41.346100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:41.350804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:41.384677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:41.385275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:41.392392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:41.394143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:41.394825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:41.395551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:41.651693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:41.652858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:41.663063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:41.674590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:41.675657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:41.676107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:41.676831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:41.677294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:41.677745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:41.682025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:41.685676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:41.689225 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ad40226-fd72-4eab-aae7-87b747a9be44 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1750 microversion: 2.20 time: 0.352518 Oct 31 14:33:41.690806 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2962/5677] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:41 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1750 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:42.200787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:42.215981 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef861936-c775-4173-9ffb-e838d02514b3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.566908 Oct 31 14:33:42.216765 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2716/5678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:41 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:42.720276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:42.721653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:42.730966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:42.745411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:42.756249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:42.758354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:42.763199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:42.764681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:42.766947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:43.028966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:43.044174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a164bfb0-e5d6-4bd8-886a-2663cd368a57 req-434a65b7-46bf-42dd-9f37-d8e25384c77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e386af-638f-423f-9a43-585c711b657e", "tag": "41bc7586-e77e-4e22-bb7c-f221a0679836"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:43.044761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:43.047332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:43.049017 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95cab89b-3424-4671-ba94-6feedb38e538 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1750 microversion: 2.20 time: 0.333323 Oct 31 14:33:43.050228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2963/5679] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:42 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1750 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:43.060571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a164bfb0-e5d6-4bd8-886a-2663cd368a57 req-434a65b7-46bf-42dd-9f37-d8e25384c77e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:43.061046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a164bfb0-e5d6-4bd8-886a-2663cd368a57 req-434a65b7-46bf-42dd-9f37-d8e25384c77e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:43.061472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a164bfb0-e5d6-4bd8-886a-2663cd368a57 req-434a65b7-46bf-42dd-9f37-d8e25384c77e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:43.093807 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a164bfb0-e5d6-4bd8-886a-2663cd368a57 req-434a65b7-46bf-42dd-9f37-d8e25384c77e service nova] Creating event network-changed:41bc7586-e77e-4e22-bb7c-f221a0679836 for instance f2e386af-638f-423f-9a43-585c711b657e on n-h2-863052-1 Oct 31 14:33:43.099765 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a164bfb0-e5d6-4bd8-886a-2663cd368a57 req-434a65b7-46bf-42dd-9f37-d8e25384c77e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059321 Oct 31 14:33:43.100374 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2717/5680] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:33:43.243716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:43.243716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:43.248624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:43.249311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:43.249930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:43.250816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:43.251428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:43.252018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:43.419267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:43.430495 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3e57cf0-c293-4b64-806f-6c347cd0b7f4 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.194437 Oct 31 14:33:43.432298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2964/5681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:43 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:44.083701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:44.084532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:44.087402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:44.106855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:44.110048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:44.110627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:44.114939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:44.115491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:44.116058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:44.210528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:44.403117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:44.416020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:44.417725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:44.422489 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-060fa4fc-8c3c-4c99-9274-432256efcbc7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1750 microversion: 2.20 time: 0.343898 Oct 31 14:33:44.424270 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2718/5682] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:44 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1750 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:44.458720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:44.460025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:44.467869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:44.468726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:44.469382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:44.470377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:44.471015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:44.471931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:44.654595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:44.662715 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eab30461-0539-4851-905c-860bf0fb8821 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.209650 Oct 31 14:33:44.679175 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2965/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:44 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:45.460237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:45.460789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:45.483728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:45.486599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:45.491139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:45.493073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:45.494441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:45.495225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:45.686374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:45.687587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:45.704170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:45.708734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:45.711259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:45.711773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:45.712236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:45.712660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:45.817240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:45.843716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:45.845669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:45.862707 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-573acf57-4fbd-4e50-9564-5d1229d6e4d7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1750 microversion: 2.20 time: 0.411275 Oct 31 14:33:45.866515 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2719/5684] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:45 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1750 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:45.993580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:46.020272 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe267f10-dff3-4b8b-b4f2-e8e5c4c0be9c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.334503 Oct 31 14:33:46.034187 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2966/5685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:45 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:46.892639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:46.894194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:46.906197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:46.910910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:46.911775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:46.912865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:46.915199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:46.915903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:46.946712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d5c663e0-d7a5-4e20-b7aa-214b4a4fbed1 req-b34ca52f-e4bd-4c61-a0ba-f3e11cb15fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e386af-638f-423f-9a43-585c711b657e", "name": "network-vif-plugged", "status": "completed", "tag": "41bc7586-e77e-4e22-bb7c-f221a0679836"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:46.984064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d5c663e0-d7a5-4e20-b7aa-214b4a4fbed1 req-b34ca52f-e4bd-4c61-a0ba-f3e11cb15fb0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:46.985680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d5c663e0-d7a5-4e20-b7aa-214b4a4fbed1 req-b34ca52f-e4bd-4c61-a0ba-f3e11cb15fb0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:46.986673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d5c663e0-d7a5-4e20-b7aa-214b4a4fbed1 req-b34ca52f-e4bd-4c61-a0ba-f3e11cb15fb0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:47.037079 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d5c663e0-d7a5-4e20-b7aa-214b4a4fbed1 req-b34ca52f-e4bd-4c61-a0ba-f3e11cb15fb0 service nova] Creating event network-vif-plugged:41bc7586-e77e-4e22-bb7c-f221a0679836 for instance f2e386af-638f-423f-9a43-585c711b657e on n-h2-863052-1 Oct 31 14:33:47.056236 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d5c663e0-d7a5-4e20-b7aa-214b4a4fbed1 req-b34ca52f-e4bd-4c61-a0ba-f3e11cb15fb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116973 Oct 31 14:33:47.059792 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2967/5686] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:33:47.111353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:47.122155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:47.135136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:47.136278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:47.136876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:47.138000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:47.138662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:47.139274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:47.205635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:47.223511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:47.226039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:47.229155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e143067f-8b47-491f-b053-1011506f006d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1750 microversion: 2.20 time: 0.343294 Oct 31 14:33:47.229977 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2720/5687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:46 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1750 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:47.492704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:47.503763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa1384e8-95a8-41d5-b2ae-01b4373ad029 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.441492 Oct 31 14:33:47.519451 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2968/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:47 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:48.259684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:48.261244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:48.270194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:48.271337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:48.271850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:48.273084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:48.273828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:48.274391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:48.528239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:48.533603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:48.543841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:48.547267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:48.552142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:48.553523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:48.554683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:48.555680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:48.592324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:48.599873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:48.605984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:48.611366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:48.615394 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d401d57-89c8-4833-a070-945aea603325 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1750 microversion: 2.20 time: 0.360761 Oct 31 14:33:48.622222 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2721/5689] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:48 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1750 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:48.802150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:48.821895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8936f256-cad1-4ff9-9a40-a0a80f8a589a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1308 microversion: 2.1 time: 0.297374 Oct 31 14:33:48.824292 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2969/5690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:48 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:49.645807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:49.647523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:49.665535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:49.666962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:49.668722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:49.670732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:49.671347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:49.673471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:49.850030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:49.852032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:49.866434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:49.867226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:49.867963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:49.868944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:49.870319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:49.878765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:49.985185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:49.999885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:50.001919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:50.011897 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c81ea08d-eb05-408c-97ea-9d2f7cc829cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.371293 Oct 31 14:33:50.012786 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2722/5691] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:49 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:50.221447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:50.229577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb5f16c8-9761-4f5e-9bc6-b444819f1eaa tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1490 microversion: 2.1 time: 0.383583 Oct 31 14:33:50.243366 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2970/5692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:49 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1490 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:50.257517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1918601748"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:50.260263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:50.267774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:50.268634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:50.269819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:50.270605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:50.271130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:50.271569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:50.406204 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ed5f4e8-70fd-4407-8d68-f2ae2d3726fd tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "PUT /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1076 microversion: 2.1 time: 0.153179 Oct 31 14:33:50.418639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2723/5693] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:33:50 2022] PUT /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1076 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:50.428012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:50.428484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:50.442594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:50.443284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:50.444086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:50.445047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:50.445914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:50.446571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:50.709185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:50.720301 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a1a03d2-127c-45c4-843d-22caaa679eab tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1502 microversion: 2.1 time: 0.296559 Oct 31 14:33:50.732034 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2971/5694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:50 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1502 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:50.760634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:50.763531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:50.779807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:50.781047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:50.782152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:50.783915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:50.784659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:50.785335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:51.006640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:51.022033 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b74afce-3475-4e5b-9deb-ecfcddf93e07 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1502 microversion: 2.1 time: 0.278934 Oct 31 14:33:51.023618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2724/5695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:50 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:51.052295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e892cb3d-bde7-4e2a-a404-ee815c3d3c27 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:33:51.052757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:51.054920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:51.063852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:51.064510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:51.065100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:51.066633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e892cb3d-bde7-4e2a-a404-ee815c3d3c27 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:51.066807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:51.067115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:51.067550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:51.070751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e892cb3d-bde7-4e2a-a404-ee815c3d3c27 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:51.071300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e892cb3d-bde7-4e2a-a404-ee815c3d3c27 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:51.125467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e892cb3d-bde7-4e2a-a404-ee815c3d3c27 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:33:51.263265 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e892cb3d-bde7-4e2a-a404-ee815c3d3c27 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "POST /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e/action" status: 202 len: 0 microversion: 2.1 time: 0.211381 Oct 31 14:33:51.266807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2725/5696] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:33:51 2022] POST /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:33:51.283447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:51.285047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:51.293307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:51.294152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:51.295476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:51.296461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:51.297130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:51.297928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:51.382410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:51.398648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:51.400446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:51.404410 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2ce4074-5c2d-4666-83cd-86bb6fc946d8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.364601 Oct 31 14:33:51.419191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2972/5697] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:51 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:51.480712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:51.490230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-caad863f-e532-4e58-9526-5d077ec1a840 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.220228 Oct 31 14:33:51.491399 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2726/5698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:51 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:52.441123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:52.442774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:52.461172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:52.462251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:52.463047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:52.464090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:52.464553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:52.464985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:52.510337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:52.556020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:52.557438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:52.569729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:52.571569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:52.573290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:52.574456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:52.577540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:52.579120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:52.774146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:52.795427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:52.798564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:52.801357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ef6c24d-327e-402e-9a6d-389098782493 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.365637 Oct 31 14:33:52.810948 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2973/5699] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:52 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:53.075860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:53.136239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20970161-d276-4ac1-bac8-fb3c5b768f01 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.582212 Oct 31 14:33:53.141210 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2727/5700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:52 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:53.828688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:53.830057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:53.843514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:53.845016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:53.846406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:53.852058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:53.852744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:53.853366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:54.134335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:54.146937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:54.148648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:54.151134 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0601b990-4eec-4649-ad23-4dec6c2bf293 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.326467 Oct 31 14:33:54.152803 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2974/5701] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:53 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:54.170238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:54.171480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:54.178791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:54.184222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:54.184745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:54.185494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:54.186119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:54.186636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:54.472885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:54.483309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33c29847-1f6e-4734-91fe-c909833265fb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.322201 Oct 31 14:33:54.484536 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2728/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:54 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:55.183801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:55.185039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:55.193306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:55.194454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:55.195478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:55.196539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:55.197221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:55.197961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:55.466766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:55.479096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:55.480834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:55.483581 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6f7b7f1-78c9-485c-90cf-7d1b185a1af5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.303825 Oct 31 14:33:55.494213 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2975/5703] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:55 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:55.521039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:55.522488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:55.537076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:55.539866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:55.540611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:55.541568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:55.544076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:55.547695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:55.850300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:55.865512 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd5cfdf4-df92-4195-9cee-2b0a83d193f2 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.356444 Oct 31 14:33:55.868454 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2729/5704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:55 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:33:56.513945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:56.515459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:56.536825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:56.537445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:56.537902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:56.541078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:56.543650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:56.558422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:56.843927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:56.856499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:56.858067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:56.859298 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-597c1f31-5029-4009-a480-db3164e3c5cd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.350267 Oct 31 14:33:56.874893 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2976/5705] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:56 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:33:56.894379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:56.895770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:56.906182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:56.910152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:56.914624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:56.918722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:56.919767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:56.920460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:56.921143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:57.150964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:57.162011 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04ab9b35-caa0-457a-9343-28d96a6be278 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.272363 Oct 31 14:33:57.181285 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2730/5706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:56 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:57.891744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:57.892340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:57.909915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:57.913111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:57.914232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:57.915705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:57.917158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:57.918514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:58.158358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:58.172881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:58.174883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:58.176760 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8fd3fe47-636d-4dfc-970b-bb1d38560c4f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.290901 Oct 31 14:33:58.193842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:58.195091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:58.202908 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2977/5707] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:57 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:58.204743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:58.205230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:58.219305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:58.220342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:58.220976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:58.223872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:58.484021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:58.498964 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35ec2e17-e3fd-4986-a91c-8c9c6e122bc0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.309771 Oct 31 14:33:58.500010 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2731/5708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:58 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:33:59.212041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:59.214687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:59.230836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:59.233437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:59.235339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:59.238448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:59.239501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:59.241508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:59.509640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:59.531353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:33:59.532095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:33:59.550861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:59.552552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:59.553803 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-050afd0e-9dcc-4cd0-b866-f463a323b464 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.345999 Oct 31 14:33:59.554403 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2978/5709] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:33:59 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:33:59.559557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:59.560063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:59.564441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:59.567575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:33:59.569531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:33:59.570201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:33:59.974447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:33:59.989677 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b608ee8-8d8f-4935-9795-ee358e7ad106 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.469332 Oct 31 14:33:59.992500 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2732/5710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:33:59 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:00.579276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:00.579894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:00.597971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:00.598822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:00.599544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:00.600430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:00.601051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:00.601641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:00.999984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:01.026000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:01.028431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:01.029048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:01.031746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:01.038099 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b306a1d3-7551-413e-ae69-0a042de8a926 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.461354 Oct 31 14:34:01.039237 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2979/5711] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:00 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:01.051758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:01.055606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:01.056303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:01.064123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:01.064744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:01.065362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:01.461425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:01.487482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10b41d44-e005-4648-87bc-2f9adaf032e7 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.460841 Oct 31 14:34:01.490868 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2733/5712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:01 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:02.072303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:02.079024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:02.107956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:02.108716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:02.109350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:02.110401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:02.111030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:02.111609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:02.517104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:02.520256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:02.551397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:02.553026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:02.554206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:02.558700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:02.561791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:02.562931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:02.854840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:02.882883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:02.884707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:02.891893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-083e1dc3-d8af-4266-aeb9-af861c0b1ba9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.820838 Oct 31 14:34:02.892804 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2980/5713] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:02 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:03.029072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:03.049210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce2493d5-771d-4864-949b-7eff301ab7b9 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.537961 Oct 31 14:34:03.067257 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2734/5714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:02 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:03.926676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:03.928164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:03.936738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:03.937527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:03.938660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:03.938917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:03.939461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:03.939891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:04.072627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:04.073252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:04.084415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:04.085846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:04.086392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:04.087119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:04.087591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:04.088031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:04.091809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:04.101084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:04.102839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:04.104480 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca4c37b7-580d-4807-a57f-9a19b2a0de1c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.183660 Oct 31 14:34:04.105053 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2981/5715] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:03 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:04.326984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:04.339017 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4085d42f-ac4c-422e-bbb8-9af8c61da146 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.270092 Oct 31 14:34:04.339937 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2735/5716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:04 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:05.136446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:05.137619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:05.145559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:05.146302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:05.146926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:05.147787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:05.148787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:05.149389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:05.345581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:05.358551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:05.360362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:05.364513 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3492d72d-8251-4a4c-8ba6-857e6f2c248b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.232633 Oct 31 14:34:05.365662 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2982/5717] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:05 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:05.370804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:05.372129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:05.380344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:05.381102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:05.381727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:05.382931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:05.384102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:05.384739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:06.024442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:06.026992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:06.036896 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6ef105c-aba0-430e-9e3a-ea92366ff425 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.669965 Oct 31 14:34:06.050902 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2736/5718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:05 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:06.392926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:06.394124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:06.402732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:06.403640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:06.404308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:06.405236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:06.405938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:06.406836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:06.595425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:06.608508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:06.611290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:06.611290 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ddd74fe0-ffed-4686-a6e6-802157829d7c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.222996 Oct 31 14:34:06.612253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2983/5719] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:06 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:07.081323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:07.083085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:07.089953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:07.090673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:07.091284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:07.092166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:07.092660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:07.093101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:07.334760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:07.343971 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b775e47b-51af-4ad9-b082-5c0f1cca2f38 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.280759 Oct 31 14:34:07.344963 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2737/5720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:07 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:07.637393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:07.638015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:07.645119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:07.645666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:07.646193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:07.647058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:07.647703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:07.648289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:07.828619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:07.842949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:07.846897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:07.849407 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e952cec-904c-4851-9fa8-d403bf79cc47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.216162 Oct 31 14:34:07.851464 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2984/5721] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:07 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:08.370838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:08.374450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:08.386005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:08.387492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:08.388294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:08.389242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:08.389886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:08.390583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:08.560825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:08.572649 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d43efc06-de0c-41af-8701-386fcf7f0941 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.205984 Oct 31 14:34:08.574065 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2738/5722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:08 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:08.877833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:08.878511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:08.886141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:08.886909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:08.887566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:08.888497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:08.889407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:08.890077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:09.117922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:09.139194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:09.140731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:09.141957 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ab911e8-f6bd-484e-a8a1-f7a885a17f92 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.268755 Oct 31 14:34:09.142953 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2985/5723] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:08 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:09.601144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:09.601763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:09.608702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:09.609440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:09.610122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:09.615509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:09.615997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:09.616593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:09.770005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:09.785032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b346d4c2-b2fd-4df5-bfd6-752d5b417b24 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.188028 Oct 31 14:34:09.786200 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2739/5724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:09 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:10.169047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:10.169729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:10.186932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:10.187500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:10.188073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:10.188999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:10.189484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:10.190079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:10.571988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:10.581770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:10.583734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:10.585249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51e8cdac-076d-48e4-86f8-a4beb85702d5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.420263 Oct 31 14:34:10.602979 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2986/5725] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:10 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:10.808841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:10.809548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:10.819285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:10.819784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:10.820225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:10.820933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:10.821388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:10.821804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:11.040249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:11.048588 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99d68f91-4ac3-47a3-97df-5fb0f6b3e6c6 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.243456 Oct 31 14:34:11.059510 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2740/5726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:10 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:11.613326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:11.613943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:11.624617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:11.625109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:11.625548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:11.626282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:11.626730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:11.629169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:11.861244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:11.874334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:11.876834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:11.891188 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c814abe-be29-446f-8261-981abdde2514 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.275965 Oct 31 14:34:11.908417 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2987/5727] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:11 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:12.085700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:12.087032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:12.093901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:12.094723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:12.096035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:12.097059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:12.097736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:12.098421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:12.364615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:12.375229 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d3547eb-4cdf-44f8-8c91-a3cb3c0c40e0 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.293772 Oct 31 14:34:12.376607 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2741/5728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:12 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:12.917551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:12.918820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:12.922063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=50 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:12.935442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:12.935980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:12.936429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:12.937165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:12.937632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:12.938068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:13.154690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:13.167866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:13.169897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:13.171391 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2532151d-9caf-4e56-ab15-1562f56f8139 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.257907 Oct 31 14:34:13.186191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2988/5729] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:12 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:13.402517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:13.403136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:13.418002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:13.418770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:13.419388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:13.420259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:13.420876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:13.421758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:13.755147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:13.787764 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-228bcdcf-1755-474c-8c6e-e0b111b6291b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 0.389097 Oct 31 14:34:13.788359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2742/5730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:13 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:14.209673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:14.211412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:14.219400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:14.220156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:14.220801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:14.221689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:14.225746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:14.226570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:14.951907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-88015196-ad0f-4316-a21d-a7346e4d3cce req-eb1b1d62-8fee-4654-857c-0dd1a23c41b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:34:14.975619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88015196-ad0f-4316-a21d-a7346e4d3cce req-eb1b1d62-8fee-4654-857c-0dd1a23c41b3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:14.976117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88015196-ad0f-4316-a21d-a7346e4d3cce req-eb1b1d62-8fee-4654-857c-0dd1a23c41b3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:14.976554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88015196-ad0f-4316-a21d-a7346e4d3cce req-eb1b1d62-8fee-4654-857c-0dd1a23c41b3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:15.000165 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-88015196-ad0f-4316-a21d-a7346e4d3cce req-eb1b1d62-8fee-4654-857c-0dd1a23c41b3 service nova] Creating event network-vif-plugged:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:34:15.035157 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-88015196-ad0f-4316-a21d-a7346e4d3cce req-eb1b1d62-8fee-4654-857c-0dd1a23c41b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401554 Oct 31 14:34:15.037450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2743/5731] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:34:15.057155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:15.066743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:15.081411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:15.082975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:15.083617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:15.084659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:15.085276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:15.086893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:15.419171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:15.437603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:15.441259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:15.446517 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd4f4cb8-0b79-474d-a30c-5b7a092b5489 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 1.244581 Oct 31 14:34:15.447126 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2989/5732] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:14 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:16.037010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:16.052659 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dcbda8f2-f18f-46a3-8a7f-377e7d53a27b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1512 microversion: 2.1 time: 1.009290 Oct 31 14:34:16.056058 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2744/5733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:15 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1512 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:16.476702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:16.477594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:16.495153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:16.495867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:16.511835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.512344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.512786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.513816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.514346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.514914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.515630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.516087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.516517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.518442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.518901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.521305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.527889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:16.587808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:34:16.813664 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-529bb891-99cc-4f79-8f80-e1fedbc667f9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 204 len: 0 microversion: 2.1 time: 0.321231 Oct 31 14:34:16.815647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2745/5734] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:16 2022] DELETE /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:34:16.849799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:16.865433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:16.868702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:16.873863 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fe02cf2-da2b-4cc6-a0f8-8d97b880e06d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.401196 Oct 31 14:34:16.891139 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2990/5735] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:16 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:16.896288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:16.900009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:16.906820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.907475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.908675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.909585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.910527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.911418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.933999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-15b93685-dd69-4ae4-a9f8-89946ef868c7 req-e4b4e0fa-1d2b-499f-93ad-49d99958e21c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:34:16.945688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-15b93685-dd69-4ae4-a9f8-89946ef868c7 req-e4b4e0fa-1d2b-499f-93ad-49d99958e21c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:16.946690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-15b93685-dd69-4ae4-a9f8-89946ef868c7 req-e4b4e0fa-1d2b-499f-93ad-49d99958e21c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:16.947231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-15b93685-dd69-4ae4-a9f8-89946ef868c7 req-e4b4e0fa-1d2b-499f-93ad-49d99958e21c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:16.962586 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-15b93685-dd69-4ae4-a9f8-89946ef868c7 req-e4b4e0fa-1d2b-499f-93ad-49d99958e21c service nova] Creating event network-changed:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:34:16.968219 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-15b93685-dd69-4ae4-a9f8-89946ef868c7 req-e4b4e0fa-1d2b-499f-93ad-49d99958e21c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148797 Oct 31 14:34:16.969456 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2746/5736] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:34:17.070888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:17.080914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:17.082248 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-659d7d2f-06bd-4c64-9a8c-1060613b3c9f tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1582 microversion: 2.1 time: 0.189841 Oct 31 14:34:17.082433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:17.097341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2991/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:16 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1582 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:17.113979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.114529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.114973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.115691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.116149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.116577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.342291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:17.351792 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fc47171-7aa6-4e02-9cbb-06bf1d1ba201 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1489 microversion: 2.1 time: 0.276877 Oct 31 14:34:17.352428 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2747/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:17 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1489 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:17.379770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1370263035"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:34:17.382639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:17.390346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.391099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.391703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.392625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.393263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.393842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.474822 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-076cd4a7-4ab8-4668-9a8d-e815e356753f tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "PUT /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1062 microversion: 2.1 time: 0.098885 Oct 31 14:34:17.478612 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2992/5739] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 14:34:17 2022] PUT /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1062 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:17.495652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:17.496800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:17.504522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.505485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.506372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.507300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.508003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.508664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.669280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:17.678267 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7536c2b8-65c8-41a8-8616-6a87b629059a tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1489 microversion: 2.1 time: 0.186836 Oct 31 14:34:17.678879 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2748/5740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:17 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1489 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:17.701543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:17.702155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:17.711500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.712316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.712979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.714023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.714712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.715361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.913179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:17.914114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:17.953385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.963909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.964441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.976540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:17.977341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:17.977800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:17.998014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:18.032690 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17d1caeb-b59b-44cb-aa78-eec3b9991d18 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1489 microversion: 2.1 time: 0.334929 Oct 31 14:34:18.034097 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2993/5741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:17 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1489 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:18.066578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:18.077161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:18.096153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:18.096653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:18.097098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:18.097816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:18.098305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:18.098740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:18.191098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:34:18.395522 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee7bb307-4ed7-44d8-bd70-17ce0030a929 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 204 len: 0 microversion: 2.1 time: 0.337341 Oct 31 14:34:18.396127 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2994/5742] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:18 2022] DELETE /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:34:18.418624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:18.419349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:18.438055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:18.438600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:18.439044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:18.439812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:18.440269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:18.440695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:18.446216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:18.475249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:18.481430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:18.483729 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69446f0d-8382-4b1b-9f98-defdeeaa2f59 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1806 microversion: 2.20 time: 0.580503 Oct 31 14:34:18.492879 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2749/5743] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:17 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1806 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:18.521253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:18.526056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:18.551808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:18.556212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:18.558051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:18.561828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:18.562548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:18.562997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:18.914428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:18.924870 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b52109a-02db-41e8-a086-c991a92a2cc5 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1495 microversion: 2.1 time: 0.430579 Oct 31 14:34:18.933659 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2750/5744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:18 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1495 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:19.029554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:19.061019 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25ccc70c-0193-4d07-b3e8-7a52da999dfd tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1582 microversion: 2.1 time: 0.659431 Oct 31 14:34:19.062541 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2995/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:18 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1582 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:19.524278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:19.528645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:19.546116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:19.546724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:19.547179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:19.547931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:19.551056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:19.551753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:19.624162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e2ef80ad-9181-4917-8c2d-35111c83b994 req-e60fd4a4-9a15-4054-af3e-384e9fa27322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a67e729-fa9a-4318-baee-5ded862bef8b", "name": "network-vif-deleted", "tag": "ea24789c-9c88-43e0-b142-35b3c8aba4b7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:34:19.644808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e2ef80ad-9181-4917-8c2d-35111c83b994 req-e60fd4a4-9a15-4054-af3e-384e9fa27322 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:19.649813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e2ef80ad-9181-4917-8c2d-35111c83b994 req-e60fd4a4-9a15-4054-af3e-384e9fa27322 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:19.651140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e2ef80ad-9181-4917-8c2d-35111c83b994 req-e60fd4a4-9a15-4054-af3e-384e9fa27322 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:19.672574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e2ef80ad-9181-4917-8c2d-35111c83b994 req-e60fd4a4-9a15-4054-af3e-384e9fa27322 service nova] Creating event network-vif-deleted:ea24789c-9c88-43e0-b142-35b3c8aba4b7 for instance 1a67e729-fa9a-4318-baee-5ded862bef8b on n-h1-863052-1 Oct 31 14:34:19.678324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e2ef80ad-9181-4917-8c2d-35111c83b994 req-e60fd4a4-9a15-4054-af3e-384e9fa27322 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077733 Oct 31 14:34:19.680007 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2996/5746] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:34:19.958092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:19.960008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:19.993365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:19.993979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:19.994670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:19.995422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:19.995882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:19.996311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:20.244661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:20.258510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:20.260108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:20.261328 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3743845a-738c-49b2-9fd2-8dd0a0f068e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1793 microversion: 2.20 time: 0.746556 Oct 31 14:34:20.278306 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2751/5747] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:19 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1793 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:34:20.288425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:20.289288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:20.305236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:20.307631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:20.308274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:20.313330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:20.314896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:20.314896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:20.435912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:20.439812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:20.453226 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9221901-f73b-4dd0-890a-cca9db4b32d3 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 200 len: 1495 microversion: 2.1 time: 0.499880 Oct 31 14:34:20.453824 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2997/5748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:19 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 1495 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:20.456516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b0efb19-cd4d-4482-9cb9-666c7784a135 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1229 microversion: 2.1 time: 0.176944 Oct 31 14:34:20.460298 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2752/5749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:20 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1229 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:21.476578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.477205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.501453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.503002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.509164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.509668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.510106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.510850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.511304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.511730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.520357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.520854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.521297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.522012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.522500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.522929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.574306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e HTTP/1.1 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f2e386af-638f-423f-9a43-585c711b657e'} Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.576394 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.580797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.587112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:21.588309 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4051fbe6-d51a-478e-8d38-8c430a558d8b tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 404 len: 111 microversion: 2.1 time: 0.115690 Oct 31 14:34:21.589127 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2998/5750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:21 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:21.606915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.607159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:21.608023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.617913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.620349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.622499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.623572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.628268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.629043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.644904 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e HTTP/1.1 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f2e386af-638f-423f-9a43-585c711b657e'} Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:21.646933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.651543 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.653226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:21.654372 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f712434f-7813-4d0e-8f21-48bc90859263 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 404 len: 111 microversion: 2.1 time: 0.054205 Oct 31 14:34:21.655160 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2999/5751] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:21 2022] DELETE /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:34:21.663157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.664104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f2e386af-638f-423f-9a43-585c711b657e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.671818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.676458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.677152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.678082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.680258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.681652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.698410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:21.706343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e2f84f8-5cbf-4386-a03f-a4bb59c89535 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1229 microversion: 2.1 time: 0.208937 Oct 31 14:34:21.710986 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e HTTP/1.1 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f2e386af-638f-423f-9a43-585c711b657e'} Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.712763 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. Oct 31 14:34:21.718620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.720709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance f2e386af-638f-423f-9a43-585c711b657e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:21.721772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b446922-65d8-48ae-bcde-92bb6eed8862 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e" status: 404 len: 111 microversion: 2.1 time: 0.062474 Oct 31 14:34:21.722996 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3000/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:21 2022] GET /compute/v2.1/servers/f2e386af-638f-423f-9a43-585c711b657e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:34:21.726347 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2753/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:21 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1229 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:21.734499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.735417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.743399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.744159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.744793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.746942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.754509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.755260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.777287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.784658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-91364f71-cd64-484e-a22f-f459f043c39b req-89c81972-b094-46e1-b2e1-904387cd5408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e386af-638f-423f-9a43-585c711b657e", "name": "network-vif-deleted", "tag": "41bc7586-e77e-4e22-bb7c-f221a0679836"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c HTTP/1.1 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f026edcf-2594-4f48-b0e1-3fb1d96be64c'} Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:21.793154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.798039 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.800311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:21.801341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67ea8639-1e76-4a91-9727-924effc478ff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 404 len: 111 microversion: 2.1 time: 0.071082 Oct 31 14:34:21.804128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3001/5754] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:21 2022] DELETE /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:21.810378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-91364f71-cd64-484e-a22f-f459f043c39b req-89c81972-b094-46e1-b2e1-904387cd5408 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.812095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-91364f71-cd64-484e-a22f-f459f043c39b req-89c81972-b094-46e1-b2e1-904387cd5408 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.813860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.814894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-91364f71-cd64-484e-a22f-f459f043c39b req-89c81972-b094-46e1-b2e1-904387cd5408 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.816613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: f026edcf-2594-4f48-b0e1-3fb1d96be64c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.832649 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-91364f71-cd64-484e-a22f-f459f043c39b req-89c81972-b094-46e1-b2e1-904387cd5408 service nova] Creating event network-vif-deleted:41bc7586-e77e-4e22-bb7c-f221a0679836 for instance f2e386af-638f-423f-9a43-585c711b657e on n-h2-863052-1 Oct 31 14:34:21.842325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.842895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.843473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.844271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.844763 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-91364f71-cd64-484e-a22f-f459f043c39b req-89c81972-b094-46e1-b2e1-904387cd5408 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061306 Oct 31 14:34:21.844898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.845330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.847571 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2754/5755] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:34:21.865489 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c HTTP/1.1 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f026edcf-2594-4f48-b0e1-3fb1d96be64c'} Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.868064 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. Oct 31 14:34:21.874869 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.878757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance f026edcf-2594-4f48-b0e1-3fb1d96be64c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:21.879922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8038d41-390e-41c6-b5e9-6d4aee877b10 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c" status: 404 len: 111 microversion: 2.1 time: 0.072010 Oct 31 14:34:21.881055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3002/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:21 2022] GET /compute/v2.1/servers/f026edcf-2594-4f48-b0e1-3fb1d96be64c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:21.890421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.891023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.898279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.899143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.899809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.900780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.901503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.902118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.918675 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d HTTP/1.1 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e4659ac8-98f6-416a-aa74-34e3066d8b9d'} Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:21.920767 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:21.925149 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:21.928209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:21.930408 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7fbfeba6-5b55-46f6-970a-02b67e80ce94 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 404 len: 111 microversion: 2.1 time: 0.043202 Oct 31 14:34:21.934213 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2755/5757] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:21 2022] DELETE /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:21.947170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:21.947170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e4659ac8-98f6-416a-aa74-34e3066d8b9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:21.957266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.960209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.962229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:21.963256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:21.963888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:21.964505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.007251 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d HTTP/1.1 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e4659ac8-98f6-416a-aa74-34e3066d8b9d'} Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.008974 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance e4659ac8-98f6-416a-aa74-34e3066d8b9d could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.013162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ec8ec01-7074-4c4c-9169-1a94028d0dfb tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d" status: 404 len: 111 microversion: 2.1 time: 0.074726 Oct 31 14:34:22.015846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3003/5758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:21 2022] GET /compute/v2.1/servers/e4659ac8-98f6-416a-aa74-34e3066d8b9d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.022756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.027662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.040836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.050683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.051147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.051903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.052368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.052799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.087521 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 HTTP/1.1 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e5cd68ae-a2b5-4daf-981a-a371c16932f4'} Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.089238 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6497abd5-8674-4e58-8da0-882cfa5e9a4c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 404 len: 111 microversion: 2.1 time: 0.074042 Oct 31 14:34:22.097951 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2756/5759] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:22 2022] DELETE /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.105989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.107028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: e5cd68ae-a2b5-4daf-981a-a371c16932f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.119977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.122681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.123400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.124436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.125130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.125757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.144379 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 HTTP/1.1 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e5cd68ae-a2b5-4daf-981a-a371c16932f4'} Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.146353 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. Oct 31 14:34:22.151168 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.152742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance e5cd68ae-a2b5-4daf-981a-a371c16932f4 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.153825 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec0ae193-fc99-4ff6-907e-59c830e19933 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4" status: 404 len: 111 microversion: 2.1 time: 0.051813 Oct 31 14:34:22.154939 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3004/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:22 2022] GET /compute/v2.1/servers/e5cd68ae-a2b5-4daf-981a-a371c16932f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.163703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.164431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.173249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.174116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.174813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.175741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.177463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.178155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.200043 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 HTTP/1.1 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd0c68e14-fb6c-41f3-933a-2b8a37442479'} Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.202807 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.209582 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.212583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.213702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a910f52-2cd7-4d77-b2b1-d8fda772bc79 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 404 len: 111 microversion: 2.1 time: 0.054495 Oct 31 14:34:22.218405 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2757/5761] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:22 2022] DELETE /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.223654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.224278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: d0c68e14-fb6c-41f3-933a-2b8a37442479] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.237939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.239687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.240301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.247747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.248296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.248827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.279773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 HTTP/1.1 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'd0c68e14-fb6c-41f3-933a-2b8a37442479'} Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.281374 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance d0c68e14-fb6c-41f3-933a-2b8a37442479 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dea8bc1-dbb1-4a17-86c0-8271dc5b6e61 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479" status: 404 len: 111 microversion: 2.1 time: 0.063779 Oct 31 14:34:22.286076 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3005/5762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:22 2022] GET /compute/v2.1/servers/d0c68e14-fb6c-41f3-933a-2b8a37442479 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:34:22.292184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.293284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.304640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.305939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.305939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.310227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.310824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.311348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.367019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 HTTP/1.1 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'caaa0a9a-8142-4aee-a1ab-69ec14270bc7'} Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.382640 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-adc27f99-aff5-4e8d-8165-fb1b02647446 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 404 len: 111 microversion: 2.1 time: 0.095993 Oct 31 14:34:22.391106 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2758/5763] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:22 2022] DELETE /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.393500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.394119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: caaa0a9a-8142-4aee-a1ab-69ec14270bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.408670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.409167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.409605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.410343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.410801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.411233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.442367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 HTTP/1.1 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'caaa0a9a-8142-4aee-a1ab-69ec14270bc7'} Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.446161 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance caaa0a9a-8142-4aee-a1ab-69ec14270bc7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b524741c-14ac-4b31-9347-18cf0be91732 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7" status: 404 len: 111 microversion: 2.1 time: 0.058163 Oct 31 14:34:22.453933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3006/5764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:22 2022] GET /compute/v2.1/servers/caaa0a9a-8142-4aee-a1ab-69ec14270bc7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.458210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-763bf5e8-3479-4005-9db8-b14d93b348db tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.458726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-763bf5e8-3479-4005-9db8-b14d93b348db tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 588bd85f-dfae-486f-b6f0-b24c34876896] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.466383 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-763bf5e8-3479-4005-9db8-b14d93b348db tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-763bf5e8-3479-4005-9db8-b14d93b348db tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 HTTP/1.1 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '588bd85f-dfae-486f-b6f0-b24c34876896'} Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.467923 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.472113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-763bf5e8-3479-4005-9db8-b14d93b348db tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.473295 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-763bf5e8-3479-4005-9db8-b14d93b348db tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896" status: 404 len: 111 microversion: 2.1 time: 0.015150 Oct 31 14:34:22.481696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-701e8194-dbe3-4ef2-9479-45171c04b363 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.482365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-701e8194-dbe3-4ef2-9479-45171c04b363 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 588bd85f-dfae-486f-b6f0-b24c34876896] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.486989 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2759/5765] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:22 2022] DELETE /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:22.490690 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-701e8194-dbe3-4ef2-9479-45171c04b363 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-701e8194-dbe3-4ef2-9479-45171c04b363 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 HTTP/1.1 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '588bd85f-dfae-486f-b6f0-b24c34876896'} Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:22.492207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-701e8194-dbe3-4ef2-9479-45171c04b363 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance 588bd85f-dfae-486f-b6f0-b24c34876896 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-701e8194-dbe3-4ef2-9479-45171c04b363 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896" status: 404 len: 111 microversion: 2.1 time: 0.015841 Oct 31 14:34:22.499477 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3007/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:22 2022] GET /compute/v2.1/servers/588bd85f-dfae-486f-b6f0-b24c34876896 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:34:22.502646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.503162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.512561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.512991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.513433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.514131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.514617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.515048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.543035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:34:22.685604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec628d8c-05f5-4612-9b0e-45d896e07433 tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 204 len: 0 microversion: 2.1 time: 0.186474 Oct 31 14:34:22.690237 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2760/5767] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:34:22 2022] DELETE /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:34:22.695319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.695954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.727130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.728061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.728659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.729530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.730215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.730832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.738826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:22.739551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:22.754940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.755519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.755984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.758958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:22.759468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:22.759920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:22.858717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:22.875795 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf06bcb2-1232-41ba-a58f-dc0c4cc02138 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1229 microversion: 2.1 time: 0.148276 Oct 31 14:34:22.877516 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2761/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:22 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1229 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:23.091623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:23.118431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9df524fa-1a0e-43bd-a7bb-ed4e87e05fff tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1480 microversion: 2.1 time: 0.426959 Oct 31 14:34:23.141522 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3008/5769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:22 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1480 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:23.901680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:23.903260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:23.922319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:23.924315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:23.956175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:23.957400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:23.958839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:23.959666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:24.033066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:24.043609 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf6eccce-843e-43ac-8c8a-71f5a21740f5 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1229 microversion: 2.1 time: 0.148030 Oct 31 14:34:24.058191 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2762/5770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:23 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1229 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:24.144943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:24.145670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:24.155004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:24.155705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:24.156617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:24.158293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:24.159717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:24.160249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:25.068392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:25.069119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:25.082131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:25.082668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:25.083133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:25.083832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:25.084287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:25.084716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:25.175872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:25.202581 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e282eb34-41d2-4b3b-974d-6e1620d4038d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1480 microversion: 2.1 time: 1.049577 Oct 31 14:34:25.221246 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3009/5771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:24 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1480 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:25.227567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:25.237095 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b5bde5c-0dec-4740-a107-ef57fd54b6d9 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1229 microversion: 2.1 time: 0.172071 Oct 31 14:34:25.246155 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2763/5772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:25 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:34:25.717152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7cecdf3b-9723-4316-9805-f344fe9c5099 req-13ebf384-e8fa-4734-8179-1ae334bcc225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc69337-faca-468c-825f-80e06b29c596", "name": "network-vif-deleted", "tag": "4442e908-89f5-464b-967e-51bf8dde8b3f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:34:25.738532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7cecdf3b-9723-4316-9805-f344fe9c5099 req-13ebf384-e8fa-4734-8179-1ae334bcc225 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:25.739381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7cecdf3b-9723-4316-9805-f344fe9c5099 req-13ebf384-e8fa-4734-8179-1ae334bcc225 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:25.740092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7cecdf3b-9723-4316-9805-f344fe9c5099 req-13ebf384-e8fa-4734-8179-1ae334bcc225 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:25.761220 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7cecdf3b-9723-4316-9805-f344fe9c5099 req-13ebf384-e8fa-4734-8179-1ae334bcc225 service nova] Creating event network-vif-deleted:4442e908-89f5-464b-967e-51bf8dde8b3f for instance 5dc69337-faca-468c-825f-80e06b29c596 on n-h2-863052-1 Oct 31 14:34:25.774625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7cecdf3b-9723-4316-9805-f344fe9c5099 req-13ebf384-e8fa-4734-8179-1ae334bcc225 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061247 Oct 31 14:34:25.775630 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3010/5773] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:34:26.229499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:26.230204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:26.255789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:26.256572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:26.261609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:26.262578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:26.263168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:26.263676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:26.264083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:26.264772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:26.301517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:26.302023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:26.310431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:26.311410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:26.311921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:26.312361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:26.417455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:26.419810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:26.420461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:26.422529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lazy-loading 'fault' on Instance uuid 5dc69337-faca-468c-825f-80e06b29c596 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:34:26.489710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4bf94fb7f64a85b8ac59f59e557afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072bda06e0cd44269277a9b191809bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:26.500889 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7aac2ed-40eb-4f22-94b1-b6db629a8c92 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 200 len: 1229 microversion: 2.1 time: 0.241515 Oct 31 14:34:26.514348 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3011/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:26 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 1229 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:26.531383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c31d943d44642e5b32d55da3f8d9a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7139ae97d73b48eca831ebc678635dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:34:26.544243 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e1406fbc-84fb-4b99-83ac-18ef46aa202d tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 200 len: 1283 microversion: 2.1 time: 0.318554 Oct 31 14:34:26.554784 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2764/5775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:26 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 1283 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:27.529628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:27.531808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] [instance: 1a67e729-fa9a-4318-baee-5ded862bef8b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:27.544184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:27.544956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:27.545605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:27.547032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:27.547711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:27.548807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:27.568342 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] HTTP exception thrown: Instance 1a67e729-fa9a-4318-baee-5ded862bef8b could not be found. Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Request method failure captured: Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b HTTP/1.1 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9vHbBv4xsDY2nyoHGWBfzQlMDUGy8q8An3h3Bqkof9xXu1hQ9wY7Ks1TzIT_mOyAoFj0sGFd0eyskb1ZPLbu5XIhqozM2v0EV3RxMgvS5s0VymszBqZVq7VUGMlexRkMnptyLJ6hqKhM4ySRe68NwAJu8-m4u4GxHxdtxI-f4i1M8A Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 072bda06e0cd44269277a9b191809bd3 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBackupRestore-967795528 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072bda06e0cd44269277a9b191809bd3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072bda06e0cd44269277a9b191809bd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072bda06e0cd44269277a9b191809bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072bda06e0cd44269277a9b191809bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBackupRestore-967795528 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 072bda06e0cd44269277a9b191809bd3 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBackupRestore-967795528 Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBackupRestore-967795528-project Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 3b4bf94fb7f64a85b8ac59f59e557afd Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBackupRestore-967795528-project Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 1a67e729-fa9a-4318-baee-5ded862bef8b could not be found. Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '1a67e729-fa9a-4318-baee-5ded862bef8b'} Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a67e729-fa9a-4318-baee-5ded862bef8b could not be found. Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a67e729-fa9a-4318-baee-5ded862bef8b could not be found. Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:27.570837 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a67e729-fa9a-4318-baee-5ded862bef8b could not be found. Oct 31 14:34:27.575772 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.576676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:27.576676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] [instance: 5dc69337-faca-468c-825f-80e06b29c596] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:27.578500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Returning 404 to user: Instance 1a67e729-fa9a-4318-baee-5ded862bef8b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:27.579976 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66262d67-c9a1-4ff4-ab50-66156fc20a2d tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b" status: 404 len: 111 microversion: 2.1 time: 0.053719 Oct 31 14:34:27.585674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:27.588664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:27.589193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:27.590062 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3012/5776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:27 2022] GET /compute/v2.1/servers/1a67e729-fa9a-4318-baee-5ded862bef8b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:27.590399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:27.590947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:27.591934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:27.592560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:27.631718 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] HTTP exception thrown: Instance 5dc69337-faca-468c-825f-80e06b29c596 could not be found. Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Request method failure captured: Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 HTTP/1.1 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xA4xV8aOBEnwn6iNo5rdMOcpXlfzhWKZVvMS-buvgMcp1Xm2E9-UsDZZBz7KIRah2qHE_EprqQSGFAzDajR4nZOFKNrkebDv-onOC0N1xlK6Hjs-ZQtmY9mimptAOS1Fb66z5UgiIYc_2glgOHdAloLgBb2YDcqRY4gvq_Pul9hVw Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7139ae97d73b48eca831ebc678635dad", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7139ae97d73b48eca831ebc678635dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersTestJSON-1086795311 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 7139ae97d73b48eca831ebc678635dad Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersTestJSON-1086795311 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 3c31d943d44642e5b32d55da3f8d9a97 Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersTestJSON-1086795311-project Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 5dc69337-faca-468c-825f-80e06b29c596 could not be found. Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '5dc69337-faca-468c-825f-80e06b29c596'} Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc69337-faca-468c-825f-80e06b29c596 could not be found. Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc69337-faca-468c-825f-80e06b29c596 could not be found. Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:34:27.635883 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc69337-faca-468c-825f-80e06b29c596 could not be found. Oct 31 14:34:27.640570 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:34:27.643466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] Returning 404 to user: Instance 5dc69337-faca-468c-825f-80e06b29c596 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:34:27.646951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-927fb439-f71b-4a30-a365-62c1516db41c tempest-ServersTestJSON-1086795311 tempest-ServersTestJSON-1086795311-project] 10.222.0.27 "GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596" status: 404 len: 111 microversion: 2.1 time: 0.078465 Oct 31 14:34:27.651463 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2765/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:34:27 2022] GET /compute/v2.1/servers/5dc69337-faca-468c-825f-80e06b29c596 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:34:27.868189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6265db1c-b578-475b-87b7-da4b02538b01 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] Calling method '.version_select at 0x7fe106d9de50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:27.916445 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6265db1c-b578-475b-87b7-da4b02538b01 tempest-TestVolumeBackupRestore-967795528 tempest-TestVolumeBackupRestore-967795528-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-603906419" status: 202 len: 0 microversion: 2.1 time: 0.056830 Oct 31 14:34:27.917954 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3013/5778] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 31 14:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-603906419 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:34:49.026097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:49.028301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:49.035082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:49.044368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:49.062534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:49.066769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:49.067459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:49.069145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:49.069953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:49.072872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:49.133934 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a06d5d9-87b4-47c5-9634-1aa35244df53 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments/4e4bd370-f195-4289-bdb0-52dab9e75583" status: 200 len: 194 microversion: 2.20 time: 0.112628 Oct 31 14:34:49.135334 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2766/5779] 10.222.0.27 () {60 vars in 1454 bytes} [Mon Oct 31 14:34:49 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments/4e4bd370-f195-4289-bdb0-52dab9e75583 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:49.273528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:49.277197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:49.305149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:49.306184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:49.308572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:49.312846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:49.313688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:49.317842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:49.320124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:49.320849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:49.559840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lazy-loading 'services' on Instance uuid e03d6aed-ba8c-4d89-99ba-7ddc86880d63 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:34:49.784208 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0eee83b6-df43-4c78-803f-c978c6821b18 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments/4e4bd370-f195-4289-bdb0-52dab9e75583" status: 202 len: 0 microversion: 2.20 time: 0.517529 Oct 31 14:34:49.785422 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3014/5780] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 31 14:34:49 2022] DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments/4e4bd370-f195-4289-bdb0-52dab9e75583 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:34:49.795022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:49.799698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:49.811144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:49.813525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:49.815309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:49.819701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:49.821349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:49.822801 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:50.019368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f4b7a47-3585-4b55-9a6c-56fa0509966f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.229247 Oct 31 14:34:50.022949 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2767/5781] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:49 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:51.036473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:51.038886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:51.080851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:51.081363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:51.083792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:51.086202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:51.087039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:51.088718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:51.196022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-295b8242-804e-4223-b29c-556db1734420 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164349 Oct 31 14:34:51.197293 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3015/5782] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:51 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:52.210252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:52.212533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:52.232440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:52.232953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:52.233401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:52.234131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:52.234703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:52.235140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:52.324824 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e4b41221-9ca0-4d0b-a2cf-44712d024c5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119300 Oct 31 14:34:52.325724 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2768/5783] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:52 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:53.338355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:53.341857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:53.372045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:53.373257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:53.378981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:53.380319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:53.381053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:53.384744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:53.508827 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ee89b60-ebd8-4554-8d97-08de1668d4b4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172933 Oct 31 14:34:53.510364 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3016/5784] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:53 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:54.523485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:54.526336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:54.540765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:54.541537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:54.542197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:54.543095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:54.544867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:54.545304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:54.614082 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-201b7fa3-2cfb-469d-ba3a-1b3cfd29b8d9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095471 Oct 31 14:34:54.629201 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2769/5785] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:54 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:55.626942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:55.629197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:55.641908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:55.643230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:55.648321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:55.650567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:55.652764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:55.653374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:55.707067 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f21e5a1d-7ee8-4fa3-898b-3f4d918e6a47 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084542 Oct 31 14:34:55.713064 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3017/5786] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:55 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:56.721325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:56.723654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:56.742589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:56.743637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:56.745235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:56.750940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:56.751627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:56.752380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:56.821855 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0a5455a-cfd1-4657-8924-c098f6a4ff1b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105274 Oct 31 14:34:56.829368 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2770/5787] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:56 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:57.835940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:57.838414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:57.856295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:57.856795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:57.857250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:57.857928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:57.858412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:57.858850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:57.956393 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02262479-0d01-405c-9437-bb0f5e550a88 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124774 Oct 31 14:34:57.961820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3018/5788] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:57 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:34:58.971988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:58.974316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:58.992104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:58.993990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:58.996245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:59.001385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:59.002023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:59.002704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:59.120169 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-360f61f6-b75d-4b73-890a-66caca0c23d2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.154363 Oct 31 14:34:59.129730 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2771/5789] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:34:58 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:34:59.318786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:59.319872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:59.336516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:59.338934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:59.340951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:59.343209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:59.344080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:59.345712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:59.409511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:34:59.634851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dc22a11-6205-426e-aaf7-032c6a8dec54 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 204 len: 0 microversion: 2.20 time: 0.317793 Oct 31 14:34:59.643532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3019/5790] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:34:59 2022] DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:34:59.648778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:34:59.652519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:34:59.692569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:59.699332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:59.702774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:34:59.705240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:34:59.707699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:34:59.708538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:00.374250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:00.410886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:00.415604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:00.419714 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efd47f5d-f2ae-4a67-8647-2055554c5df2 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.775640 Oct 31 14:35:00.422799 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2772/5791] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:34:59 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:01.453880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:01.454644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:01.466732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:01.467223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:01.467656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:01.468367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:01.468846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:01.469265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:01.914380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:01.923037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:01.932390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:01.936685 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dcaadbc4-0bda-49f5-a5db-43bc3720b98d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1721 microversion: 2.20 time: 0.490582 Oct 31 14:35:01.939379 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3020/5792] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:01 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1721 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:02.970742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:02.972170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:02.989914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:02.993006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:02.993467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:03.019459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:03.019962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:03.028319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:03.605321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:03.624595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-38541fc5-b31b-440f-be90-dbaa80f773ae req-64429037-db33-41cb-992a-8e8fb40efb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d6aed-ba8c-4d89-99ba-7ddc86880d63", "name": "network-vif-deleted", "tag": "7aa2e22b-318e-4b1d-8177-dd6f9cccfe05"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:03.642155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:03.648366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:03.658373 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df6610cb-e565-45d6-9c4e-42b58f99f31a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 200 len: 1653 microversion: 2.20 time: 0.692657 Oct 31 14:35:03.660053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-38541fc5-b31b-440f-be90-dbaa80f773ae req-64429037-db33-41cb-992a-8e8fb40efb45 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:03.660541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-38541fc5-b31b-440f-be90-dbaa80f773ae req-64429037-db33-41cb-992a-8e8fb40efb45 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:03.660965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-38541fc5-b31b-440f-be90-dbaa80f773ae req-64429037-db33-41cb-992a-8e8fb40efb45 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:03.663308 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2773/5793] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:02 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 1653 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:03.696425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-38541fc5-b31b-440f-be90-dbaa80f773ae req-64429037-db33-41cb-992a-8e8fb40efb45 service nova] Creating event network-vif-deleted:7aa2e22b-318e-4b1d-8177-dd6f9cccfe05 for instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 on n-h1-863052-1 Oct 31 14:35:03.711935 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-38541fc5-b31b-440f-be90-dbaa80f773ae req-64429037-db33-41cb-992a-8e8fb40efb45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091111 Oct 31 14:35:03.715229 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3021/5794] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:35:04.686814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:04.687970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:04.697848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:04.698386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:04.699039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:04.699916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:04.700531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:04.701121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:04.719096 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] HTTP exception thrown: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Request method failure captured: Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 HTTP/1.1 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xe48P2Pm4LLzkpevFD-sk-MqvAnlmI1RgLHXu9CY-Js4aKf6vUr5Hrs-XQ6b1-2NWYp9vrddSHq3b1tpd9cAwSnpdAo7cGL44Vo8UAGVKMSSVkPa2ulMCw3xZQvhFF4p1H63AjZHEuR3banuSohaewJfHo2Prfelf7OB94s-3OqdU Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b14e27a7348b786b017e067a9bece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 9362cc6b2b5342e1b9f02c433bbb731b Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e03d6aed-ba8c-4d89-99ba-7ddc86880d63'} Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:35:04.720866 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:35:04.726229 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:35:04.727966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Returning 404 to user: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:35:04.729040 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2eb2ba44-3311-4f91-89c3-8dc400905ff7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 404 len: 111 microversion: 2.20 time: 0.046135 Oct 31 14:35:04.730126 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2774/5795] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:04 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:35:04.740040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-823f42cb-bc30-4f07-b68b-4772e88838e8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '.version_select at 0x7fe1078ae280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:04.775278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-823f42cb-bc30-4f07-b68b-4772e88838e8 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458919210" status: 204 len: 0 microversion: 2.20 time: 0.039881 Oct 31 14:35:04.780132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3022/5796] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:35:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458919210 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:35:06.190630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81c9a722-0608-4ccd-acfb-3012fa1522fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'create', calling method: .version_select at 0x7fe10fb86d30>, body: {"keypair": {"name": "tempest-keypair-244122901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBQ42Oa6M9ja+uYiQ4tCXnvwOpTww5n08oVr2H59NXQZGmRExVSX/dmOtuUC8vOTARLYk0r/oFEDkqeGM79gPcaDYi/f2/ZwUixDpGt223gGR7OTAuWpFV6Z0kaOeZL3g=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:06.214357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-81c9a722-0608-4ccd-acfb-3012fa1522fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for project b20b14e27a7348b786b017e067a9bece. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:35:06.222564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-81c9a722-0608-4ccd-acfb-3012fa1522fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for user 9362cc6b2b5342e1b9f02c433bbb731b and project b20b14e27a7348b786b017e067a9bece. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:35:06.254397 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81c9a722-0608-4ccd-acfb-3012fa1522fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.072809 Oct 31 14:35:06.257383 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2775/5797] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 31 14:35:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 14:35:09.020998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-705247682", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0dff37-70d3-4bfe-bb68-150fb3501d95"}], "security_groups": [{"name": "tempest-securitygroup--176024162"}], "key_name": "tempest-keypair-244122901", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:09.213577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] validate_networks() for [('8d0dff37-70d3-4bfe-bb68-150fb3501d95', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:35:09.847465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:35:09.847900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:35:09.848381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:35:09.848796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:35:09.849513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:35:09.863955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:09.866651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:09.867295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:09.868498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:09.869158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:09.869868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:09.891910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for project b20b14e27a7348b786b017e067a9bece. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:35:09.899189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Getting quotas for user 9362cc6b2b5342e1b9f02c433bbb731b and project b20b14e27a7348b786b017e067a9bece. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:35:09.915608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:35:09.918515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:35:10.066031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-415f3074-7042-434f-9de5-7fd0deeeb8fe tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.051307 Oct 31 14:35:10.068468 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3023/5798] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 31 14:35:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:35:10.081346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0711196c-9e9d-4c64-8326-5916b04f3826 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:10.082375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0711196c-9e9d-4c64-8326-5916b04f3826 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:10.458197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0711196c-9e9d-4c64-8326-5916b04f3826 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:10.471214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0711196c-9e9d-4c64-8326-5916b04f3826 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:10.473051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0711196c-9e9d-4c64-8326-5916b04f3826 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:10.474218 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0711196c-9e9d-4c64-8326-5916b04f3826 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1280 microversion: 2.20 time: 0.398024 Oct 31 14:35:10.476922 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2776/5799] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:10 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1280 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:11.500533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:11.502098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:11.519564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:11.527216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:11.530245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:11.534707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:11.536600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:11.537283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:11.715399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:11.725109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:11.736100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:11.737678 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e7b1271-22c0-461c-85e7-d0b862f780fd tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1276 microversion: 2.20 time: 0.242121 Oct 31 14:35:11.743406 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3024/5800] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:11 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:35:12.781437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:12.786666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:12.805635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:12.807765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:12.808799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:12.810400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:12.812326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:12.813984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:13.110638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:13.123524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:13.125456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:13.133257 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4cd5ca88-b56d-4442-9c3c-1f179a4bbde1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1338 microversion: 2.20 time: 0.360287 Oct 31 14:35:13.133837 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2777/5801] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:12 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:35:14.162645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:14.163697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:14.171670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:14.181117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:14.182078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:14.183461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:14.185319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:14.186002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:14.364737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:14.383061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:14.384514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:14.396048 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44103dcf-516f-4a15-97fb-fdc3d20f4118 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1338 microversion: 2.20 time: 0.237526 Oct 31 14:35:14.410684 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3025/5802] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:14 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1338 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:15.426877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:15.427570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:15.445047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:15.446748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:15.448000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:15.452084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:15.452884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:15.454730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:15.948383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:15.980419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:15.988013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:15.989340 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92929f4c-058e-4f6a-aa2f-192a84897da4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.566817 Oct 31 14:35:15.990083 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2778/5803] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:15 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:17.019845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:17.021298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:17.034671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:17.038413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:17.038865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:17.039589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:17.040049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:17.040483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:17.382121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:17.393624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:17.395366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:17.396686 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0d6a1b3-3ad4-422c-a22b-b6c05f8d4aeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.382257 Oct 31 14:35:17.411336 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3026/5804] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:17 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:17.610609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-85cd6328-e75f-456a-b7ad-c32f455bce45 req-12846488-111c-4a64-bad4-acd7faf9e3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:17.639600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-85cd6328-e75f-456a-b7ad-c32f455bce45 req-12846488-111c-4a64-bad4-acd7faf9e3e8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:17.642602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-85cd6328-e75f-456a-b7ad-c32f455bce45 req-12846488-111c-4a64-bad4-acd7faf9e3e8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:17.643303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-85cd6328-e75f-456a-b7ad-c32f455bce45 req-12846488-111c-4a64-bad4-acd7faf9e3e8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:17.670046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-85cd6328-e75f-456a-b7ad-c32f455bce45 req-12846488-111c-4a64-bad4-acd7faf9e3e8 service nova] Creating event network-changed:65a61124-1afd-484c-9b20-e2e8c50d3bb6 for instance 277ff531-7abe-4ac9-931d-99f9902de474 on n-h2-863052-1 Oct 31 14:35:17.684298 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-85cd6328-e75f-456a-b7ad-c32f455bce45 req-12846488-111c-4a64-bad4-acd7faf9e3e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083259 Oct 31 14:35:17.688179 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2779/5805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:35:18.424204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:18.425395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:18.437702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:18.438255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:18.438675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:18.439382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:18.444898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:18.445564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:18.832269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:18.852738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:18.854564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:18.857553 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01abb5dd-c4b7-4c52-aa7e-ec3a65c52d5e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.437358 Oct 31 14:35:18.860128 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3027/5806] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:18 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:19.885674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:19.886880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:19.892456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:19.914814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:19.915373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:19.915953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:19.919361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:19.919940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:19.920453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:19.971617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=65 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:20.237942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:20.246721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:20.248345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:20.250456 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dcbe592e-74b7-420f-b392-3f5982ce9216 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.370071 Oct 31 14:35:20.267352 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2780/5807] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:19 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:21.279752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:21.281707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:21.295700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:21.300247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:21.315874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:21.340545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:21.341133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:21.343022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:21.343844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:21.344325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:21.347034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:21.364645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:21.782517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:21.799066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:21.800725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:21.804303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc518adb-f3d5-4565-899c-7e17cfc10aab tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.529541 Oct 31 14:35:21.808496 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3028/5808] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:21 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:22.838271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:22.839032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:22.841145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:22.858761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:22.860683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:22.863549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:22.864445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:22.865071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:22.865752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:23.208309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:23.217472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:23.220930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:23.223451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b04ebad-a100-46dd-b3df-77620f2c95e1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.389069 Oct 31 14:35:23.224731 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2781/5809] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:22 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:23.854013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-40b4a1d3-390f-4949-9a14-8cc54675d942 req-9915371c-1efc-4a58-9aa6-135f540b1781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "name": "network-vif-plugged", "status": "completed", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:23.883228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-40b4a1d3-390f-4949-9a14-8cc54675d942 req-9915371c-1efc-4a58-9aa6-135f540b1781 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:23.883717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-40b4a1d3-390f-4949-9a14-8cc54675d942 req-9915371c-1efc-4a58-9aa6-135f540b1781 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:23.884152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-40b4a1d3-390f-4949-9a14-8cc54675d942 req-9915371c-1efc-4a58-9aa6-135f540b1781 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:23.942055 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-40b4a1d3-390f-4949-9a14-8cc54675d942 req-9915371c-1efc-4a58-9aa6-135f540b1781 service nova] Creating event network-vif-plugged:65a61124-1afd-484c-9b20-e2e8c50d3bb6 for instance 277ff531-7abe-4ac9-931d-99f9902de474 on n-h2-863052-1 Oct 31 14:35:23.957801 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-40b4a1d3-390f-4949-9a14-8cc54675d942 req-9915371c-1efc-4a58-9aa6-135f540b1781 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106596 Oct 31 14:35:23.959561 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3029/5810] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:35:24.256317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:24.257384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:24.272158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:24.274774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:24.275219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:24.275930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:24.276378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:24.276828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:24.445591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:24.460120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:24.463999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:24.465609 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea42d3f2-3820-4ddf-b886-94ffae7c46be tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1405 microversion: 2.20 time: 0.213720 Oct 31 14:35:24.466920 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2782/5811] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:24 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:35:25.238855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-897566137", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "1811bcad-cda4-43d3-a4d3-6eab9a6380cf"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:25.426481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] validate_networks() for [('1811bcad-cda4-43d3-a4d3-6eab9a6380cf', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:35:25.490331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:25.491141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:25.499113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:25.499766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:25.500315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:25.501134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:25.501690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:25.502231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:25.660752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:25.670389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:25.671869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:25.673372 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c9ef9bd-6a5e-4426-b028-354616db7fb9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1596 microversion: 2.20 time: 0.187480 Oct 31 14:35:25.673930 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2783/5812] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:35:25 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1596 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:35:25.697942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:25.698496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:25.705230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:25.705723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:25.706508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:25.707218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:25.707672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:25.708335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:25.793879 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2cb8236a-a7ff-47c5-b499-9472c20063c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099791 Oct 31 14:35:25.794909 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2784/5813] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 31 14:35:25 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:35:26.102437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:35:26.103190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:35:26.105449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:35:26.105934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:35:26.106417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:35:26.120866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:26.122798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:26.123191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:26.124633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:26.126089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:26.126831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:26.155298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Getting quotas for project 4365761700f14a89abb642ac34cffcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:35:26.169821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Getting quotas for user a6a460f649a74c8d83f9f8fa5845928d and project 4365761700f14a89abb642ac34cffcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:35:26.191616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:35:26.194401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:35:26.266480 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1daecd02-1eb7-4778-b601-5f84be15ee6b tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054317 Oct 31 14:35:26.268173 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3030/5814] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:35:26.280240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bed2de94-e867-40aa-9da7-46b5c313b590 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:26.281485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bed2de94-e867-40aa-9da7-46b5c313b590 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:26.432246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bed2de94-e867-40aa-9da7-46b5c313b590 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:26.442947 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bed2de94-e867-40aa-9da7-46b5c313b590 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1218 microversion: 2.1 time: 0.167614 Oct 31 14:35:26.444593 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2785/5815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:26 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:35:27.433119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f0cc3ad7-7b99-4f21-8d6c-5285ed5dd1c4 req-3e59dc0b-7185-4406-a0e7-72429377ad41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:27.447340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f0cc3ad7-7b99-4f21-8d6c-5285ed5dd1c4 req-3e59dc0b-7185-4406-a0e7-72429377ad41 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:27.448314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f0cc3ad7-7b99-4f21-8d6c-5285ed5dd1c4 req-3e59dc0b-7185-4406-a0e7-72429377ad41 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:27.448982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f0cc3ad7-7b99-4f21-8d6c-5285ed5dd1c4 req-3e59dc0b-7185-4406-a0e7-72429377ad41 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:27.474136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:27.474780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:27.480791 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f0cc3ad7-7b99-4f21-8d6c-5285ed5dd1c4 req-3e59dc0b-7185-4406-a0e7-72429377ad41 service nova] Creating event network-changed:65a61124-1afd-484c-9b20-e2e8c50d3bb6 for instance 277ff531-7abe-4ac9-931d-99f9902de474 on n-h2-863052-1 Oct 31 14:35:27.500692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f0cc3ad7-7b99-4f21-8d6c-5285ed5dd1c4 req-3e59dc0b-7185-4406-a0e7-72429377ad41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074428 Oct 31 14:35:27.501851 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3031/5816] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:35:27.507245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:27.508116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:27.509208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:27.510230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:27.510972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:27.511627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:27.607057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:27.620170 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2de03155-f7d5-4dbb-bee6-aca9da85585d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1270 microversion: 2.1 time: 0.151253 Oct 31 14:35:27.620983 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2786/5817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:27 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:35:28.649046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:28.649641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:28.660455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:28.660947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:28.661385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:28.662141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:28.662567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:28.662998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:28.850625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:28.860991 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9def072-8079-47cb-bcc8-e9945eeac650 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1276 microversion: 2.1 time: 0.216316 Oct 31 14:35:28.861831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3032/5818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:28 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:35:29.886950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:29.887571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:29.902598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:29.903066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:29.903549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:29.904189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:29.904647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:29.905693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:30.261905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:30.270154 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2afed15e-b4b2-46a4-bfa7-8f3ba2bf40a7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.387140 Oct 31 14:35:30.273231 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2787/5819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:29 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:30.811410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fc963a60-22ce-461f-ab5a-9771492530bc req-6aa5a71d-d886-4c7a-bea9-1b4564045f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185311e0-a9c4-4096-ad4e-14fad11c4f9d", "tag": "b6d8999d-364b-40d5-8526-9137553113a6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:30.829147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fc963a60-22ce-461f-ab5a-9771492530bc req-6aa5a71d-d886-4c7a-bea9-1b4564045f25 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:30.829632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fc963a60-22ce-461f-ab5a-9771492530bc req-6aa5a71d-d886-4c7a-bea9-1b4564045f25 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:30.834362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fc963a60-22ce-461f-ab5a-9771492530bc req-6aa5a71d-d886-4c7a-bea9-1b4564045f25 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:30.859166 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fc963a60-22ce-461f-ab5a-9771492530bc req-6aa5a71d-d886-4c7a-bea9-1b4564045f25 service nova] Creating event network-changed:b6d8999d-364b-40d5-8526-9137553113a6 for instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d on n-h1-863052-1 Oct 31 14:35:30.867824 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fc963a60-22ce-461f-ab5a-9771492530bc req-6aa5a71d-d886-4c7a-bea9-1b4564045f25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060384 Oct 31 14:35:30.868361 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3033/5820] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:35:31.299544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:31.301224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:31.314989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:31.317834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:31.318795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:31.328432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:31.337467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:31.337467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:31.565325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:31.573239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49c85849-6540-491a-80b5-77db0c690e77 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.280828 Oct 31 14:35:31.573823 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2788/5821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:31 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:32.600922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:32.602319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:32.625601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:32.626397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:32.627888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:32.633846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:32.636682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:32.637461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:32.971472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:32.991488 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-331d1f55-ab0d-4457-97e4-5b43a1183e58 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.397090 Oct 31 14:35:33.007314 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3034/5822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:32 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:34.014941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:34.015552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:34.028543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:34.029042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:34.029491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:34.035014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:34.035505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:34.035946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:34.272650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:34.286842 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5648cba9-351f-4a82-b7f9-8bc693e14403 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.275674 Oct 31 14:35:34.288028 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2789/5823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:34 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:35.326795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:35.329367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:35.371279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:35.373751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:35.374461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:35.386131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:35.387320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:35.387938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:35.748333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:35.759449 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fb7721f-6f0f-4e31-bb97-f604704c6850 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.444324 Oct 31 14:35:35.760437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3035/5824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:35 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:36.726229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0f77ed1a-1f51-4cf6-9d31-593cf8e1e11a req-b5684af7-e828-4def-8501-a29432cca61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185311e0-a9c4-4096-ad4e-14fad11c4f9d", "name": "network-vif-plugged", "status": "completed", "tag": "b6d8999d-364b-40d5-8526-9137553113a6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:35:36.736734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:36.743726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0f77ed1a-1f51-4cf6-9d31-593cf8e1e11a req-b5684af7-e828-4def-8501-a29432cca61e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:36.744306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0f77ed1a-1f51-4cf6-9d31-593cf8e1e11a req-b5684af7-e828-4def-8501-a29432cca61e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:36.744622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0f77ed1a-1f51-4cf6-9d31-593cf8e1e11a req-b5684af7-e828-4def-8501-a29432cca61e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:36.759562 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0f77ed1a-1f51-4cf6-9d31-593cf8e1e11a req-b5684af7-e828-4def-8501-a29432cca61e service nova] Creating event network-vif-plugged:b6d8999d-364b-40d5-8526-9137553113a6 for instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d on n-h1-863052-1 Oct 31 14:35:36.765516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0f77ed1a-1f51-4cf6-9d31-593cf8e1e11a req-b5684af7-e828-4def-8501-a29432cca61e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042994 Oct 31 14:35:36.766778 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2790/5825] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:35:36.785970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:36.787691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:36.793439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:36.794364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:36.807620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:36.809678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:36.812004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:36.813362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:36.815170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:36.815838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:37.133683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:37.158339 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-750496ce-1299-4835-a9a8-1671b406fc09 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.367181 Oct 31 14:35:37.162074 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3036/5826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:36 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:38.185134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:38.186149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:38.195848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:38.197253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:38.198373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:38.199331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:38.201061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:38.202603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:38.594339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:38.606701 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3e5b4a9-ad69-42e3-92c9-cfd628e097f2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1318 microversion: 2.1 time: 0.423561 Oct 31 14:35:38.612494 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2791/5827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:38 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:35:39.640419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:35:39.641086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:35:39.687835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:39.691712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:39.692600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:39.694920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:35:39.697144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:35:39.698679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:35:39.947186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:35:39.959788 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7deae1d4-6b6a-4da8-8ec4-5ac94d332ea0 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1508 microversion: 2.1 time: 0.327649 Oct 31 14:35:39.961218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3037/5828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:35:39 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:36:02.470890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:02.472179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:02.474699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=25 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:02.487637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=59 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:02.494029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:02.494929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:02.495598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:02.496547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:02.497783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:02.498477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:02.549802 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d278a2f-2efe-4a90-90b7-e80482a5fe84 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/ips" status: 200 len: 151 microversion: 2.20 time: 0.084893 Oct 31 14:36:02.560828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2792/5829] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 31 14:36:02 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/ips => generated 151 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:36:05.885642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:36:05.886379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:05.890614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:05.893708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=43 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:05.909824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:05.910731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:05.911610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:05.912740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:05.913962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:05.914896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:05.981316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lazy-loading 'flavor' on Instance uuid 277ff531-7abe-4ac9-931d-99f9902de474 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:36:06.533792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b8b99d0-5180-48ab-be32-7ba353ea1580 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/action" status: 202 len: 0 microversion: 2.20 time: 0.652004 Oct 31 14:36:06.539981 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3038/5830] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:36:05 2022] POST /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:36:06.550685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:06.551865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:06.561065 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:36:06.561315 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 14:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 (ip 10.222.0.27) !!! Oct 31 14:36:06.595688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:06.600035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:06.600782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:06.602722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:06.603365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:06.605128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:06.904784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:06.917449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:06.920177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:06.922401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9b4d12f-3f07-4020-a084-78a052f1183c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.377254 Oct 31 14:36:06.924443 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2793/5831] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:06 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:07.964074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:07.966068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:07.981256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:07.982725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:07.983713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:07.984934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:07.985935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:07.986836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:08.460083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:08.501523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:08.503688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:08.510974 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2f6bd99-363a-4e99-bf97-80595dedb58a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.561786 Oct 31 14:36:08.512096 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3039/5832] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:07 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:09.541154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:09.541779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:09.562884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:09.563135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:09.563530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:09.564359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:09.564874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:09.565361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:09.995111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:10.011797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:10.013366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:10.014704 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16fd2377-0a99-4125-b590-1439857784e4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.477923 Oct 31 14:36:10.015293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2794/5833] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:09 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:10.711465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44fa6e22-953f-4dee-9a4a-529e88962a83", "device": "/dev/sdb"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:36:10.715448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:10.722401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:10.723249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:10.723874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:10.725023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:10.725644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:10.726314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:11.047491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:11.048903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:11.066385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:11.066973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:11.068226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:11.069729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:11.071421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:11.071849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:11.255717 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e79bdfa-c517-4e0a-a3e9-67ef26dca451 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "POST /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549622 Oct 31 14:36:11.256363 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3040/5834] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:36:10 2022] POST /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:36:11.597232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:11.609197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:11.613817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:11.615917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3214cc1c-b6c4-4f71-8730-0ed5ab34b39a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.575962 Oct 31 14:36:11.617033 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2795/5835] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:11 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:36:12.650297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:12.651881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:12.677868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:12.682660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:12.684547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:12.687939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:12.689209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:12.691332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:13.356870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:13.374495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:13.379801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:13.383682 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33be1ec8-19a9-4230-afa1-4bc0644ee01a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.740036 Oct 31 14:36:13.399008 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3041/5836] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:12 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:14.412655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:14.413195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:14.421686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:14.427910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:14.428812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:14.431657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:14.432329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:14.435336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:14.682985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:14.695115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:14.702019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:14.703745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bf52e364-5ae8-46ef-83ef-8e9d520ecb78 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.295272 Oct 31 14:36:14.706476 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2796/5837] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:14 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:36:15.735172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:15.736044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:15.745566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:15.750918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:15.753888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:15.754858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:15.769180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:15.774442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:16.163506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:16.183449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:16.189071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:16.191487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5459be4-3838-4304-8cb0-4b722279ef73 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.460242 Oct 31 14:36:16.194995 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3042/5838] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:15 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:17.232500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:17.233948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:17.274907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:17.275710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:17.276335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:17.277597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:17.278354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:17.279286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:17.691707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:17.706355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:17.711125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:17.712848 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8dfa641f-9277-4e5e-a391-80c31d8657cf tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1742 microversion: 2.20 time: 0.488471 Oct 31 14:36:17.717548 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2797/5839] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:17 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1742 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:18.759762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:18.771548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:18.803001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:18.803808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:18.804263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:18.804985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:18.805444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:18.805875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:19.206845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:19.222421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:19.226425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:19.230599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d0b90b8-efcc-4d68-b401-bc27d018b8c4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.481951 Oct 31 14:36:19.236502 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3043/5840] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:18 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:20.261544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:20.262588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:20.301444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:20.303168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:20.305438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:20.312136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:20.312922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:20.314119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:20.954337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:20.964040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:20.971706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:20.973147 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe51803f-2163-4bd7-9608-b97756643f6b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.716358 Oct 31 14:36:20.973877 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2798/5841] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:20 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:22.003588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:22.004296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:22.020224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:22.020715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:22.021164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:22.021882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:22.028957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:22.030627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:22.475408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:22.483802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:22.485245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:22.495028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-776d2eb2-bb1b-4c95-a254-50bde8bb7120 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.495659 Oct 31 14:36:22.510206 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3044/5842] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:21 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:23.529757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:23.531096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:23.545693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:23.550292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:23.551045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:23.553418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:23.560416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:23.563303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:23.955964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1ca6c724-39b4-4deb-aca3-18e2383849ba req-b32acd88-fa84-4fd3-893d-80b7867202d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "name": "network-vif-plugged", "status": "completed", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:36:23.980474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1ca6c724-39b4-4deb-aca3-18e2383849ba req-b32acd88-fa84-4fd3-893d-80b7867202d4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:23.989136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1ca6c724-39b4-4deb-aca3-18e2383849ba req-b32acd88-fa84-4fd3-893d-80b7867202d4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:23.992388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1ca6c724-39b4-4deb-aca3-18e2383849ba req-b32acd88-fa84-4fd3-893d-80b7867202d4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:24.030864 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1ca6c724-39b4-4deb-aca3-18e2383849ba req-b32acd88-fa84-4fd3-893d-80b7867202d4 service nova] Creating event network-vif-plugged:65a61124-1afd-484c-9b20-e2e8c50d3bb6 for instance 277ff531-7abe-4ac9-931d-99f9902de474 on n-h2-863052-1 Oct 31 14:36:24.062515 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1ca6c724-39b4-4deb-aca3-18e2383849ba req-b32acd88-fa84-4fd3-893d-80b7867202d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110350 Oct 31 14:36:24.065135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3045/5843] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:36:24.187347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:24.211145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:24.242593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:24.244143 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84ca96a1-f600-4667-a28c-517a82a324d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.722595 Oct 31 14:36:24.252178 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2799/5844] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:23 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:25.276772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:25.277495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:25.292235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:25.293054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:25.294976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:25.300749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:25.301239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:25.301687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:25.667410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:25.690139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:25.691853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:25.693151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-718a4639-83af-468f-b70b-05d3860d546e tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.420990 Oct 31 14:36:25.712715 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3046/5845] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:25 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:26.717709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:26.718700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:26.730451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:26.736604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:26.741696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:26.742809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:26.743466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:26.744097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:27.213142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:27.226157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:27.227926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:27.229115 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63adcecf-431f-4675-bc54-d45ac8d3998b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.515278 Oct 31 14:36:27.229681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2800/5846] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:26 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:28.265552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:28.266205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:28.292177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:28.297920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:28.302009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:28.306092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:28.306703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:28.316279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:28.672415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:28.688052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:28.691400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:28.693472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5116c47e-97ef-4e02-b2cc-770872b5e27a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.432553 Oct 31 14:36:28.695226 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3047/5847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:28 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:29.726843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:29.727684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:29.742647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:29.750035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:29.751754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:29.755021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:29.756054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:29.758458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:30.332150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:30.356402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:30.361794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:30.376232 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2b22832-1b7b-4d49-96fb-a4acfb19bd01 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.645102 Oct 31 14:36:30.382487 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2801/5848] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:29 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:31.413922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:31.422918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:31.498838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:31.500907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:31.505297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:31.510136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:31.510876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:31.512345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:31.973464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:31.982748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:31.991226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:31.998002 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-811d5a59-c347-418b-8a63-22279409acb4 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.591993 Oct 31 14:36:32.001714 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3048/5849] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:31 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:33.030419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:33.030945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:33.035048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=21 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:33.064279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:33.069270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:33.073729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:33.075493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:33.077696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:33.081214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:33.189449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=59 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:33.604689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:33.614331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:33.616105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:33.617307 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43074a6d-eb1d-4f30-8e5d-08103eb6fb48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.592199 Oct 31 14:36:33.635155 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2802/5850] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:33 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:34.648015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:34.648722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:34.661748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:34.664377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:34.664962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:34.668313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:34.668906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:34.669559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:35.342420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:35.353658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:35.359609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:35.365784 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f7f1ce4-1489-4e87-9b7a-176d7ac30006 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.721846 Oct 31 14:36:35.370703 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3049/5851] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:34 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:36.496916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:36.500463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:36.524615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:36.525540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:36.526195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:36.527152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:36.531149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:36.531862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:36.963193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:36.978580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:36.987958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:36.991564 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b8501c1-5c62-4b81-97f2-1705cc66a693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.571322 Oct 31 14:36:36.995828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2803/5852] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:36 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:36:38.019750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:38.021039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:38.027812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=25 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:38.039428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:38.044930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:38.045667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:38.046786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:38.047431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:38.048034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:38.079664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:38.878392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:38.898646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:38.906913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:38.908474 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aba0ed76-05a4-45e9-9699-54aca2ebfe35 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.893342 Oct 31 14:36:38.910877 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3050/5853] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:38 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:39.938517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:39.939791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:39.947462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:39.948279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:39.949528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:39.950457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:39.951112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:39.951705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:40.829244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:40.854911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:40.870363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:40.876620 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-975e2028-a0ee-4d0f-9e9c-79e6e4538a46 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.941991 Oct 31 14:36:40.883451 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2804/5854] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:39 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:41.912987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:41.913608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:41.923656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:41.924151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:41.924590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:41.925295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:41.925751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:41.926193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:42.101870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:42.112944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:42.114712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:42.117720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5672bd6f-d827-4769-a236-a37b68095676 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.208683 Oct 31 14:36:42.118573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3051/5855] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:41 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:36:43.145893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:43.146547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:43.158402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:43.159155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:43.159886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:43.160761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:43.161407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:43.161997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:43.600050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:43.621975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:43.631561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:43.633940 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ece084c2-a804-40e3-badd-b29c296804a9 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.492875 Oct 31 14:36:43.646193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2805/5856] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:43 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:44.667534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:44.668951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:44.688851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:44.699652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:44.702952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:44.705225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:44.707095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:44.708980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:45.098504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:45.110777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:45.113127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:45.116595 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28d36447-a1f3-48b0-86f8-4043d445a724 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.454327 Oct 31 14:36:45.119194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3052/5857] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:44 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:46.148533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:46.149135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:46.162342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:46.164836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:46.165517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:46.168648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:46.169902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:46.170828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:46.638861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:46.656135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:46.657589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:46.658817 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40458315-5eb0-42d4-bf95-d78036d31a48 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1737 microversion: 2.20 time: 0.514143 Oct 31 14:36:46.659687 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2806/5858] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:46 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1737 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:47.689304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:47.691095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:47.717303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:47.718120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:47.718977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:47.719932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:47.720622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:47.721298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:48.092660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:48.111633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:48.113426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:48.115559 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60d509a2-e965-4408-a51c-4ea20d359b94 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1719 microversion: 2.20 time: 0.430402 Oct 31 14:36:48.116290 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3053/5859] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:47 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1719 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:49.168346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:49.169802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:49.183440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:49.186275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:49.186746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:49.187497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:49.187962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:49.192016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:49.853544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:49.862736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:49.864190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:49.865376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb256820-e2d9-42d6-9106-1c955913d80a tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1722 microversion: 2.20 time: 0.702579 Oct 31 14:36:49.891324 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2807/5860] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:49 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1722 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:49.911168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e243a41e-8173-49e8-bde1-6799c9549014"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:36:49.914916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:49.935553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:49.936407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:49.938350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:49.939430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:49.941460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:49.943406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:50.340153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-16de124d-75af-4de6-98bd-6d448aae3160 req-60fde483-deb2-43a0-8eb4-c4dcf4d630e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "name": "network-vif-unplugged", "status": "completed", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:36:50.363064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-16de124d-75af-4de6-98bd-6d448aae3160 req-60fde483-deb2-43a0-8eb4-c4dcf4d630e5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:50.364568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-16de124d-75af-4de6-98bd-6d448aae3160 req-60fde483-deb2-43a0-8eb4-c4dcf4d630e5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:50.366039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-16de124d-75af-4de6-98bd-6d448aae3160 req-60fde483-deb2-43a0-8eb4-c4dcf4d630e5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:50.401065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.server_external_events [req-16de124d-75af-4de6-98bd-6d448aae3160 req-60fde483-deb2-43a0-8eb4-c4dcf4d630e5 service nova] Unable to find a host for instance 277ff531-7abe-4ac9-931d-99f9902de474. Dropping event network-vif-unplugged {{(pid=120641) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 14:36:50.404449 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-16de124d-75af-4de6-98bd-6d448aae3160 req-60fde483-deb2-43a0-8eb4-c4dcf4d630e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070242 Oct 31 14:36:50.407446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2808/5861] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 14:36:50.670296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e4b2a9a-f5fa-4e8d-bb81-174b44e4f443 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.776386 Oct 31 14:36:50.672511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3054/5862] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 31 14:36:49 2022] POST /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments => generated 188 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:36:50.894484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:50.895308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:50.903564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:50.904389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:50.905001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:50.905898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:50.906582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:50.907290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:51.298526 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-56ccd7d5-3a83-4491-bd15-84cc04c49241 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments/e243a41e-8173-49e8-bde1-6799c9549014" status: 202 len: 0 microversion: 2.20 time: 0.407832 Oct 31 14:36:51.302116 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2809/5863] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 31 14:36:50 2022] DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments/e243a41e-8173-49e8-bde1-6799c9549014 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:36:51.409583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:36:51.411028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:51.441114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:51.441812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:51.442442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:51.443271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:51.443830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:51.444707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:51.764976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 14:36:51.987411 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e58c22c6-b4d6-44e2-b2d4-901ba5680671 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "POST /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/action" status: 202 len: 0 microversion: 2.20 time: 0.599562 Oct 31 14:36:51.988429 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3055/5864] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 31 14:36:51 2022] POST /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:36:52.004009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:52.005360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:52.016610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:52.017442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:52.018419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:52.019393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:52.020103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:52.020758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:52.172543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:52.173054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:52.183705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:52.184210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:52.190085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:52.190883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:52.192054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:52.192504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:52.372749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lazy-loading 'services' on Instance uuid 185311e0-a9c4-4096-ad4e-14fad11c4f9d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:36:52.450363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:52.464853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:52.466097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:52.467330 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb1b0f98-b2b6-4ec1-b8f8-3ea9db97f2f6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1670 microversion: 2.20 time: 0.468967 Oct 31 14:36:52.468098 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2810/5865] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:51 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1670 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:52.514397 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89436b33-2c4b-4ba9-b398-2caa793cba32 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d/os-volume_attachments/44fa6e22-953f-4dee-9a4a-529e88962a83" status: 202 len: 0 microversion: 2.1 time: 0.345623 Oct 31 14:36:52.520901 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3056/5866] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:36:52 2022] DELETE /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d/os-volume_attachments/44fa6e22-953f-4dee-9a4a-529e88962a83 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:36:53.499996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:53.500614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:53.517603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:53.518040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:53.520932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:53.521917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:53.524222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:53.524691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:53.969055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:53.980839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:53.984007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:53.986758 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-628764cd-aa14-4160-83d3-13f5b44231a0 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1670 microversion: 2.20 time: 0.492080 Oct 31 14:36:53.987928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2811/5867] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:53 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1670 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:55.020890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:55.021607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:55.032165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:55.037819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:55.040172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:55.041214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:55.043475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:55.044132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:55.341021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:55.355695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:55.360433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:55.365750 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58ed5e58-9b56-4e2a-87e6-bf48a43e726b tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.349832 Oct 31 14:36:55.371571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3057/5868] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:55 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:56.405002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:56.407720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:56.414916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:56.415656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:56.417710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:56.419141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:56.419792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:56.423557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:56.696323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:56.720410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:56.725939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:56.728892 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7aab00b-6b56-45bb-b74c-aeeacb52bfeb tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.328704 Oct 31 14:36:56.732485 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2812/5869] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:56 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:36:57.762582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:57.763649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:57.774095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:57.780749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:57.782402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:57.791199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:57.794133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:57.798865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:58.715624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:58.733643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:58.740166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:36:58.748691 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2319c6f5-3031-40e4-9e3a-c3d92de57485 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.990682 Oct 31 14:36:58.753692 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3058/5870] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:57 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:36:59.781971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:36:59.783702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:36:59.813172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:59.817823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:59.820131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:36:59.821199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:36:59.824745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:36:59.825943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:00.270939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:00.286952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:00.291863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:00.296605 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a1ca911-0bed-424e-b69a-c917b2fa3f6f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.519254 Oct 31 14:37:00.297487 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2813/5871] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:36:59 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:01.325736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:01.327327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:01.346734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:01.348732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:01.349898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:01.352330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:01.358344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:01.359221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:01.676357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:01.691533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:01.694980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:01.696104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c24bfbe-d31b-4024-8406-953e78a4e7e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.375040 Oct 31 14:37:01.716266 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3059/5872] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:01 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:02.107001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:02.107510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:02.130082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:02.133068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:02.133850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:02.137102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:02.145302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:02.145302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:02.220600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:37:02.422708 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c884918-5f56-40ce-b349-22c5ead52aba tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 204 len: 0 microversion: 2.1 time: 0.320590 Oct 31 14:37:02.423914 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2814/5873] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:37:02 2022] DELETE /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:37:02.434124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:02.434809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:02.460318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:02.461062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:02.461511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:02.462464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:02.462934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:02.463421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:02.754127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:02.754886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:02.762995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:02.763562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:02.764599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:02.765009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:02.765461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:02.766012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:02.785296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:03.175504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:03.185206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1b44c09-392a-4771-bb3c-b02a72ed64ee tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1514 microversion: 2.1 time: 0.756991 Oct 31 14:37:03.196351 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3060/5874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:02 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1514 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:03.456516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:03.477006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:03.479708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:03.481144 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86861eb2-f3f2-437a-89f6-1b6262f501e6 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.732717 Oct 31 14:37:03.485647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2815/5875] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:02 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:04.209192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:04.209825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:04.232664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:04.233063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:04.234895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:04.236376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:04.237065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:04.238442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:04.520523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:04.521673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:04.531539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:04.546715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:04.547226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:04.547669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:04.549675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:04.551359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:04.552941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:04.908275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:04.927952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:04.932568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:04.936285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:04.940361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5decdd9f-8e10-4780-8ea5-ed86c79df2b7 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.427743 Oct 31 14:37:04.940586 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6273fe1d-8b1f-40c6-b8d4-49a2a849be4f tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1514 microversion: 2.1 time: 0.735382 Oct 31 14:37:04.946334 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2816/5876] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:04 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:04.965016 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3061/5877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:04 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1514 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:37:05.970843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:05.971461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:05.992589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:05.993826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:06.000014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:06.002759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:06.003200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:06.004387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:06.005081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:06.005688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:06.009309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:06.009820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:06.010557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:06.015736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:06.016851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:06.017303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:06.086376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:06.214087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:06.228590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:06.234200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:06.236263 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-962fb493-88c0-4722-b218-f2fd287626c5 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.269585 Oct 31 14:37:06.250487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:06.252067 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2817/5878] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:05 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:06.269299 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dce4d08a-ca05-487e-88ed-0c3e3d4fc6b2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 200 len: 1472 microversion: 2.1 time: 0.280813 Oct 31 14:37:06.269942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3062/5879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:05 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:37:06.706261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6c7e3d05-81a5-4e11-9a4d-a4aeff3320dc req-9f44f8d0-d5b8-4f0e-80b7-0ed26a735dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185311e0-a9c4-4096-ad4e-14fad11c4f9d", "name": "network-vif-deleted", "tag": "b6d8999d-364b-40d5-8526-9137553113a6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:06.725325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6c7e3d05-81a5-4e11-9a4d-a4aeff3320dc req-9f44f8d0-d5b8-4f0e-80b7-0ed26a735dcc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:06.726390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6c7e3d05-81a5-4e11-9a4d-a4aeff3320dc req-9f44f8d0-d5b8-4f0e-80b7-0ed26a735dcc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:06.727352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6c7e3d05-81a5-4e11-9a4d-a4aeff3320dc req-9f44f8d0-d5b8-4f0e-80b7-0ed26a735dcc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:06.743121 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6c7e3d05-81a5-4e11-9a4d-a4aeff3320dc req-9f44f8d0-d5b8-4f0e-80b7-0ed26a735dcc service nova] Creating event network-vif-deleted:b6d8999d-364b-40d5-8526-9137553113a6 for instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d on n-h1-863052-1 Oct 31 14:37:06.750651 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6c7e3d05-81a5-4e11-9a4d-a4aeff3320dc req-9f44f8d0-d5b8-4f0e-80b7-0ed26a735dcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413185 Oct 31 14:37:06.751492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2818/5880] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:37:07.266135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:07.267497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:07.302763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:07.304125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 185311e0-a9c4-4096-ad4e-14fad11c4f9d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:07.313331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:07.316134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:07.316880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:07.323985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:07.324726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:07.328411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:07.337134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:07.337820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:07.341556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:07.345127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:07.346502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:07.349197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:07.401855 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] HTTP exception thrown: Instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d could not be found. Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Request method failure captured: Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d HTTP/1.1 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9zNiM5DvjQpwlEGfeS6OkNBoAj-FmniMkPGtefBpffm6C4d_2hI7G52JmQ6cQ1DgBy1ybQiL1ZP4z6dZvJQQxMUZ1bPGC3dKJUUyDROXOdnNPEN01VhNZz6X-e4X0EYn13eoNOpfCygs0sBS9gfDJcYg1D7yEtEJu3fPEPr_7A6BlY Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 4365761700f14a89abb642ac34cffcbe Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590942822 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4365761700f14a89abb642ac34cffcbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4365761700f14a89abb642ac34cffcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4365761700f14a89abb642ac34cffcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4365761700f14a89abb642ac34cffcbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590942822 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 4365761700f14a89abb642ac34cffcbe Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590942822 Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesSnapshotTestJSON-1590942822-project Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: a6a460f649a74c8d83f9f8fa5845928d Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590942822-project Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d could not be found. Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '185311e0-a9c4-4096-ad4e-14fad11c4f9d'} Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d could not be found. Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d could not be found. Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:37:07.404631 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d could not be found. Oct 31 14:37:07.410963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:37:07.414298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Returning 404 to user: Instance 185311e0-a9c4-4096-ad4e-14fad11c4f9d could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:37:07.418291 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f4907990-b1e8-4ac2-a24b-36b2035afa56 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d" status: 404 len: 111 microversion: 2.1 time: 0.119992 Oct 31 14:37:07.421098 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2819/5881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:07 2022] GET /compute/v2.1/servers/185311e0-a9c4-4096-ad4e-14fad11c4f9d => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:37:07.798819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:07.834619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:07.845359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:07.848702 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b999ed05-c03f-439e-9cd3-de65244abb31 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.586492 Oct 31 14:37:07.875600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3063/5882] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:07 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:08.892479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:08.893703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:08.909992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:08.910600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:08.911053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:08.914101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:08.914604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:08.915031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:09.162214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:09.181398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:09.185103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:09.187399 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c802184-2ef5-4541-bd53-7f62cc6efc9d tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.300789 Oct 31 14:37:09.188712 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2820/5883] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:08 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:10.215031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:10.215699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:10.223230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:10.226130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:10.227295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:10.229298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:10.230304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:10.231546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:10.232714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:10.409059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:10.419930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:10.422591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:10.423911 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1658b69-1d36-482a-afc1-4e458a6a19b1 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.213691 Oct 31 14:37:10.424738 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3064/5884] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:10 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:11.451084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:11.451691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:11.460117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:11.461162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:11.461786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:11.462696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:11.463359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:11.464516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:11.771664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:11.788809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:11.790382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:11.794230 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fde1b485-bfe2-4ad9-a712-1aa3023beb9c tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.349162 Oct 31 14:37:11.795705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2821/5885] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:11 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:12.831640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:12.831640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:12.858567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:12.859570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:12.860391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:12.862892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:12.865355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:12.865909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:13.253460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:13.262268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:13.263988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:13.265366 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ec4bf50-cfd9-47e0-a81f-d830fdba3f99 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.444522 Oct 31 14:37:13.266480 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3065/5886] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:12 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:14.300422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-18e2a77e-c5a4-433c-b220-8b08d8780ee4 req-3842d496-2405-4338-b919-e038eff51811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "name": "network-vif-plugged", "status": "completed", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:14.304909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:14.305642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:14.325196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:14.327245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18e2a77e-c5a4-433c-b220-8b08d8780ee4 req-3842d496-2405-4338-b919-e038eff51811 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:14.327958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:14.328573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:14.329243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18e2a77e-c5a4-433c-b220-8b08d8780ee4 req-3842d496-2405-4338-b919-e038eff51811 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:14.330227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:14.330831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18e2a77e-c5a4-433c-b220-8b08d8780ee4 req-3842d496-2405-4338-b919-e038eff51811 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:14.331475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:14.336003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:14.373211 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-18e2a77e-c5a4-433c-b220-8b08d8780ee4 req-3842d496-2405-4338-b919-e038eff51811 service nova] Creating event network-vif-plugged:65a61124-1afd-484c-9b20-e2e8c50d3bb6 for instance 277ff531-7abe-4ac9-931d-99f9902de474 on n-h2-863052-1 Oct 31 14:37:14.382721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-18e2a77e-c5a4-433c-b220-8b08d8780ee4 req-3842d496-2405-4338-b919-e038eff51811 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086284 Oct 31 14:37:14.387325 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3066/5887] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:37:14.638704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:14.652512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:14.670529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:14.678368 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a47676a-d979-440c-885b-af7dfdfddc04 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.383643 Oct 31 14:37:14.680103 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2822/5888] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:14 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:15.706491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:15.707907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:15.724418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:15.724858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:15.725302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:15.726011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:15.726504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:15.726934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:15.968548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:15.978390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:15.981195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:15.983708 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-338cfe06-4d7b-4427-940b-10c419975abc tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1728 microversion: 2.20 time: 0.281636 Oct 31 14:37:15.989924 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3067/5889] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:15 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1728 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:16.884206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1148221195", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "1811bcad-cda4-43d3-a4d3-6eab9a6380cf"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:16.970933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] validate_networks() for [('1811bcad-cda4-43d3-a4d3-6eab9a6380cf', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:37:17.017032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:17.017768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:17.025270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:17.026492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:17.027177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:17.028139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:17.028967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:17.029612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:17.217426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:17.231131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:17.233037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:17.235623 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76fb0f27-c9df-447d-b530-b090bf430b82 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1715 microversion: 2.20 time: 0.225574 Oct 31 14:37:17.255580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3068/5890] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:17 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1715 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:37:18.291953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:37:18.292920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:37:18.293593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:37:18.294223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:37:18.294812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:37:18.305200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:18.305622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:18.306065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:18.306876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:18.307331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:18.308262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:18.328195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Getting quotas for project 4365761700f14a89abb642ac34cffcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:37:18.335054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Getting quotas for user a6a460f649a74c8d83f9f8fa5845928d and project 4365761700f14a89abb642ac34cffcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:37:18.349242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:37:18.352039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:37:18.440523 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c91708ab-3155-4237-8c28-46033bf75bd1 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560269 Oct 31 14:37:18.442043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2823/5891] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:37:18.455201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb4d0996-ac2a-4836-a81b-ebe5e3cf2e19 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:18.455821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb4d0996-ac2a-4836-a81b-ebe5e3cf2e19 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:18.558456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb4d0996-ac2a-4836-a81b-ebe5e3cf2e19 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:18.565774 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb4d0996-ac2a-4836-a81b-ebe5e3cf2e19 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1219 microversion: 2.1 time: 0.116960 Oct 31 14:37:18.566387 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3069/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:18 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:19.593290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:19.594179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:19.603059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:19.604563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:19.605206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:19.606386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:19.607060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:19.608557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:19.702666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:19.726485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c540e05-421d-4a07-97a9-387ef15d020a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1215 microversion: 2.1 time: 0.136194 Oct 31 14:37:19.728457 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2824/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:19 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:20.756736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:20.757826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:20.769068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:20.769649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:20.770461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:20.772056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:20.772716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:20.773554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:20.899157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:20.913388 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3614831e-c56b-43cd-8512-021787d329cb tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1277 microversion: 2.1 time: 0.164183 Oct 31 14:37:20.926884 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3070/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:20 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:21.938559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:21.939273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:21.946107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:21.946865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:21.948052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:21.948930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:21.949557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:21.950155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:22.170662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-138e25fb-cea2-470b-aa37-d10a9bbf6ad9 req-3753afd8-9db1-41f8-a358-e8edb3116901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ac41ad-6e68-48d8-b31c-7041d1312499", "tag": "eb473052-dc25-4ea5-abe6-e061cdbae476"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:22.204441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-138e25fb-cea2-470b-aa37-d10a9bbf6ad9 req-3753afd8-9db1-41f8-a358-e8edb3116901 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:22.205078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-138e25fb-cea2-470b-aa37-d10a9bbf6ad9 req-3753afd8-9db1-41f8-a358-e8edb3116901 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:22.205521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-138e25fb-cea2-470b-aa37-d10a9bbf6ad9 req-3753afd8-9db1-41f8-a358-e8edb3116901 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:22.217945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:22.232033 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7bdb0fbe-853b-4846-9955-ff4c3edd1e0c tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.291890 Oct 31 14:37:22.232751 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2825/5895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:21 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:22.236243 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-138e25fb-cea2-470b-aa37-d10a9bbf6ad9 req-3753afd8-9db1-41f8-a358-e8edb3116901 service nova] Creating event network-changed:eb473052-dc25-4ea5-abe6-e061cdbae476 for instance 28ac41ad-6e68-48d8-b31c-7041d1312499 on n-h2-863052-1 Oct 31 14:37:22.245737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-138e25fb-cea2-470b-aa37-d10a9bbf6ad9 req-3753afd8-9db1-41f8-a358-e8edb3116901 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081997 Oct 31 14:37:22.246697 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3071/5896] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:37:23.265966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:23.267583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:23.278581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:23.279303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:23.279911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:23.280988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:23.282574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:23.283176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:23.554239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:23.566028 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73663d5f-234e-4f19-a669-ce7b569ad5a2 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.304786 Oct 31 14:37:23.566927 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2826/5897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:23 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:24.589411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:24.590851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:24.604871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:24.607882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:24.610538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:24.612423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:24.614565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:24.617167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:24.801388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:24.811267 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d0c8834-f1ad-490a-9768-5ddee5bda223 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.226015 Oct 31 14:37:24.811867 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3072/5898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:24 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:25.834500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:25.835711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:25.843545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:25.844259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:25.845023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:25.845735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:25.846401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:25.847001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:26.054323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:26.063855 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6db0beb7-4e53-4f1a-b5e2-1a1eb5c16f76 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.233359 Oct 31 14:37:26.082884 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2827/5899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:25 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:27.093652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:27.094300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:27.102686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:27.104007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:27.104605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:27.105472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:27.106326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:27.106926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:27.419488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:27.430650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-586a13f3-8a0e-4819-ab69-b6bd9b86267d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.342185 Oct 31 14:37:27.431597 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3073/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:27 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:37:28.336514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-30c42803-e8d0-4b2b-92bf-c0dfe29e70be req-429be4b7-3999-4d3b-8da6-606d19972543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ac41ad-6e68-48d8-b31c-7041d1312499", "name": "network-vif-plugged", "status": "completed", "tag": "eb473052-dc25-4ea5-abe6-e061cdbae476"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:28.351101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:28.352095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:28.364121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-30c42803-e8d0-4b2b-92bf-c0dfe29e70be req-429be4b7-3999-4d3b-8da6-606d19972543 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:28.366719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-30c42803-e8d0-4b2b-92bf-c0dfe29e70be req-429be4b7-3999-4d3b-8da6-606d19972543 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:28.367274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-30c42803-e8d0-4b2b-92bf-c0dfe29e70be req-429be4b7-3999-4d3b-8da6-606d19972543 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:28.398141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-30c42803-e8d0-4b2b-92bf-c0dfe29e70be req-429be4b7-3999-4d3b-8da6-606d19972543 service nova] Creating event network-vif-plugged:eb473052-dc25-4ea5-abe6-e061cdbae476 for instance 28ac41ad-6e68-48d8-b31c-7041d1312499 on n-h2-863052-1 Oct 31 14:37:28.408589 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-30c42803-e8d0-4b2b-92bf-c0dfe29e70be req-429be4b7-3999-4d3b-8da6-606d19972543 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076046 Oct 31 14:37:28.410984 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2828/5901] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:37:28.454893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:28.455682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:28.462922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:28.463715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:28.464235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:28.465174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:28.465732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:28.466457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:28.565767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:28.759878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:28.777499 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ecd3a20-9e22-47e4-915e-07e2e6d6813a tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.326373 Oct 31 14:37:28.794225 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3074/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:28 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:29.828898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:29.830037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:29.854833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:29.859697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:29.861862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:29.863776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:29.864483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:29.868881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:30.372063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:30.392485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eefeb66d-58b4-4456-814a-1c08fbb952e5 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1319 microversion: 2.1 time: 0.568130 Oct 31 14:37:30.401297 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2829/5903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:29 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:31.420741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:31.421998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:31.433671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:31.434506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:31.435179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:31.436524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:31.437273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:31.438155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:31.622879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:31.632074 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78cd3408-05b8-486c-b7c8-5b012d8a6964 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1509 microversion: 2.1 time: 0.215122 Oct 31 14:37:31.632876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3075/5904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:31 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:31.655646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "881bcc18-75f9-4778-85c9-270426934229", "device": "/dev/sdb"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:31.659436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:31.666513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:31.667230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:31.667675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:31.668426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:31.669114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:31.669712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:32.036645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8d1aa41-c885-40f1-b4fe-ee641c2e9179 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "POST /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384514 Oct 31 14:37:32.038627 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2830/5905] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:37:31 2022] POST /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:37:50.099652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:50.104207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:50.112537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=25 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:50.113421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=67 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:50.114746 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:37:50.115065 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:37:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments (ip 10.222.0.27) !!! Oct 31 14:37:50.120217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:50.120910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:50.123404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:50.124310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:50.125070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:50.125676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:50.208193 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-995d28be-5620-4ff7-a91e-0dd6abf95fff tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.113920 Oct 31 14:37:50.213011 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3076/5906] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 31 14:37:50 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:37:50.339139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:50.341734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:50.349397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:50.361127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:50.362785 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:37:50.363211 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 14:37:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 (ip 10.222.0.27) !!! Oct 31 14:37:50.377038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:50.377800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:50.378399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:50.379885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:50.381456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:50.382202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:50.424426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:37:50.632639 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8edf8032-68d5-4113-a9d4-1708ea3bb84f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 204 len: 0 microversion: 2.20 time: 0.301704 Oct 31 14:37:50.633144 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2831/5907] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:37:50 2022] DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:37:50.644778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:50.646525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:50.660476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:50.661120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:50.661855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:50.665259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:50.665867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:50.667463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:50.841496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:50.850784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:50.853111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:50.854586 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-881f52cd-9c37-4b05-ad62-5021fb769693 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.216658 Oct 31 14:37:50.855302 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3077/5908] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:50 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:51.885310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:51.887226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:51.897860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:51.898566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:51.899849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:51.900661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:51.901188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:51.902031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:52.547792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:52.557559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:52.559054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:52.560249 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8063daef-dded-4d92-bc00-0725cbcc7a10 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1721 microversion: 2.20 time: 0.680027 Oct 31 14:37:52.560817 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2832/5909] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:51 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1721 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:53.568107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e255e270-03d0-4868-998e-79551537efc4 req-7deba0bf-e5ef-4f06-890a-cd3b806ec554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ff531-7abe-4ac9-931d-99f9902de474", "name": "network-vif-deleted", "tag": "65a61124-1afd-484c-9b20-e2e8c50d3bb6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:37:53.592262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e255e270-03d0-4868-998e-79551537efc4 req-7deba0bf-e5ef-4f06-890a-cd3b806ec554 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:53.600110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:53.603289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:53.608412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e255e270-03d0-4868-998e-79551537efc4 req-7deba0bf-e5ef-4f06-890a-cd3b806ec554 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:53.613244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e255e270-03d0-4868-998e-79551537efc4 req-7deba0bf-e5ef-4f06-890a-cd3b806ec554 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:53.622988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:53.624253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:53.630965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:53.632185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:53.632868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:53.633589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:53.642010 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e255e270-03d0-4868-998e-79551537efc4 req-7deba0bf-e5ef-4f06-890a-cd3b806ec554 service nova] Creating event network-vif-deleted:65a61124-1afd-484c-9b20-e2e8c50d3bb6 for instance 277ff531-7abe-4ac9-931d-99f9902de474 on n-h2-863052-1 Oct 31 14:37:53.655463 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e255e270-03d0-4868-998e-79551537efc4 req-7deba0bf-e5ef-4f06-890a-cd3b806ec554 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090914 Oct 31 14:37:53.656806 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3078/5910] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:37:53.733485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:53.765676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:53.772971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9362cc6b2b5342e1b9f02c433bbb731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b14e27a7348b786b017e067a9bece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:37:53.783584 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9cf26810-1358-4bb5-8021-b6f77e334047 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 200 len: 1365 microversion: 2.20 time: 0.186068 Oct 31 14:37:53.808090 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2833/5911] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:53 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:37:54.820555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:54.821905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:54.842397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:54.843081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:54.843963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:54.853167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:54.866687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:54.867215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:54.886997 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] HTTP exception thrown: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Request method failure captured: Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 HTTP/1.1 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xe48P2Pm4LLzkpevFD-sk-MqvAnlmI1RgLHXu9CY-Js4aKf6vUr5Hrs-XQ6b1-2NWYp9vrddSHq3b1tpd9cAwSnpdAo7cGL44Vo8UAGVKMSSVkPa2ulMCw3xZQvhFF4p1H63AjZHEuR3banuSohaewJfHo2Prfelf7OB94s-3OqdU Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b14e27a7348b786b017e067a9bece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 9362cc6b2b5342e1b9f02c433bbb731b Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '277ff531-7abe-4ac9-931d-99f9902de474'} Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:37:54.889272 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:37:54.892695 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:37:54.894655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Returning 404 to user: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:37:54.895797 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbcdc023-4abf-4f0e-b0dc-8df46431c4d3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 404 len: 111 microversion: 2.20 time: 0.080683 Oct 31 14:37:54.898213 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3079/5912] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:37:54 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:37:54.907227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8986dc6a-dd2b-4f7a-9e14-55c9b5df2068 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '.version_select at 0x7fe1067edb80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:54.957350 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8986dc6a-dd2b-4f7a-9e14-55c9b5df2068 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-244122901" status: 204 len: 0 microversion: 2.20 time: 0.053887 Oct 31 14:37:54.957942 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2834/5913] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 31 14:37:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-244122901 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 14:37:56.696439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:37:56.697476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:37:56.709114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:56.709799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:56.713122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:56.713948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:37:56.715014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:37:56.725452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:37:57.037441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lazy-loading 'services' on Instance uuid 28ac41ad-6e68-48d8-b31c-7041d1312499 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:37:57.150274 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6aedd08-439b-4f05-881a-fabf5df51fd7 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499/os-volume_attachments/881bcc18-75f9-4778-85c9-270426934229" status: 202 len: 0 microversion: 2.1 time: 0.460045 Oct 31 14:37:57.151362 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3080/5914] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:37:56 2022] DELETE /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499/os-volume_attachments/881bcc18-75f9-4778-85c9-270426934229 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:38:00.107028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:00.108099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:00.119805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:00.131054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:00.131730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:00.132648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:00.133851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:00.134465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:00.153870 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] HTTP exception thrown: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Request method failure captured: Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 HTTP/1.1 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xe48P2Pm4LLzkpevFD-sk-MqvAnlmI1RgLHXu9CY-Js4aKf6vUr5Hrs-XQ6b1-2NWYp9vrddSHq3b1tpd9cAwSnpdAo7cGL44Vo8UAGVKMSSVkPa2ulMCw3xZQvhFF4p1H63AjZHEuR3banuSohaewJfHo2Prfelf7OB94s-3OqdU Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b14e27a7348b786b017e067a9bece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 9362cc6b2b5342e1b9f02c433bbb731b Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '277ff531-7abe-4ac9-931d-99f9902de474'} Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:38:00.155867 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.158850 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.160924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Returning 404 to user: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:00.162086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6689615-5eff-49f3-bbde-5ed07c47b260 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 404 len: 111 microversion: 2.20 time: 0.060016 Oct 31 14:38:00.163005 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2835/5915] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:38:00 2022] DELETE /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:38:00.173706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:00.174513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: 277ff531-7abe-4ac9-931d-99f9902de474] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:00.196998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:00.197715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:00.198385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:00.199302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:00.199961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:00.200609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:00.259454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] HTTP exception thrown: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Request method failure captured: Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 HTTP/1.1 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xe48P2Pm4LLzkpevFD-sk-MqvAnlmI1RgLHXu9CY-Js4aKf6vUr5Hrs-XQ6b1-2NWYp9vrddSHq3b1tpd9cAwSnpdAo7cGL44Vo8UAGVKMSSVkPa2ulMCw3xZQvhFF4p1H63AjZHEuR3banuSohaewJfHo2Prfelf7OB94s-3OqdU Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b14e27a7348b786b017e067a9bece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 9362cc6b2b5342e1b9f02c433bbb731b Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '277ff531-7abe-4ac9-931d-99f9902de474'} Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.261611 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. Oct 31 14:38:00.264825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:00.266644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Returning 404 to user: Instance 277ff531-7abe-4ac9-931d-99f9902de474 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:00.267778 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6e3ea68-ffdd-4ad2-a5d8-46c866db4215 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474" status: 404 len: 111 microversion: 2.20 time: 0.099802 Oct 31 14:38:00.268561 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3081/5916] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:38:00 2022] GET /compute/v2.1/servers/277ff531-7abe-4ac9-931d-99f9902de474 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:38:04.990548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:04.993619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:05.019347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:05.020670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:05.021798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:05.023743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:05.025146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:05.028828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:05.100914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:38:05.242493 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e626dba-7bf4-4feb-b731-3661b3e0966e tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 204 len: 0 microversion: 2.1 time: 0.256554 Oct 31 14:38:05.244951 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2836/5917] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:38:04 2022] DELETE /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:38:05.253159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:05.253800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:05.264072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:05.264766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:05.266659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:05.267748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:05.268362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:05.268929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:05.544084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:38:05.556340 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b19c588-3b85-4383-aa21-49cffb7f58e3 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1515 microversion: 2.1 time: 0.306946 Oct 31 14:38:05.557229 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3082/5918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:38:05 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:38:06.582227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:06.583516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:06.594437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:06.602666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:06.603228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:06.604048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:06.604610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:06.605107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:06.911106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:38:06.922663 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06684562-0194-4854-8cb9-6de04ac0e5de tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1515 microversion: 2.1 time: 0.344949 Oct 31 14:38:06.923253 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2837/5919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:38:06 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1515 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:38:07.647961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-107aaba3-a29a-418d-9c26-d5c5dbf3093d req-d8d21191-64f6-4555-a856-f9223c4defb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ac41ad-6e68-48d8-b31c-7041d1312499", "name": "network-vif-deleted", "tag": "eb473052-dc25-4ea5-abe6-e061cdbae476"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:38:07.687496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-107aaba3-a29a-418d-9c26-d5c5dbf3093d req-d8d21191-64f6-4555-a856-f9223c4defb2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:07.691668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-107aaba3-a29a-418d-9c26-d5c5dbf3093d req-d8d21191-64f6-4555-a856-f9223c4defb2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:07.691668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-107aaba3-a29a-418d-9c26-d5c5dbf3093d req-d8d21191-64f6-4555-a856-f9223c4defb2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:07.731473 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-107aaba3-a29a-418d-9c26-d5c5dbf3093d req-d8d21191-64f6-4555-a856-f9223c4defb2 service nova] Creating event network-vif-deleted:eb473052-dc25-4ea5-abe6-e061cdbae476 for instance 28ac41ad-6e68-48d8-b31c-7041d1312499 on n-h2-863052-1 Oct 31 14:38:07.743101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-107aaba3-a29a-418d-9c26-d5c5dbf3093d req-d8d21191-64f6-4555-a856-f9223c4defb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104500 Oct 31 14:38:07.746475 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3083/5920] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:38:07.948831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:07.949490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:07.973027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:07.974883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:07.977666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:07.978879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:07.980382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:07.981494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:08.041813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:08.042556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:08.043345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:08.043948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lazy-loading 'fault' on Instance uuid 28ac41ad-6e68-48d8-b31c-7041d1312499 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:38:08.126357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:08.127296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:08.137003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:08.142355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:08.142989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:08.143769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:08.144368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:08.144977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:08.147091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a460f649a74c8d83f9f8fa5845928d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4365761700f14a89abb642ac34cffcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:38:08.157832 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0859a7e6-4fe6-49e2-b678-0f1475e25591 tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 200 len: 1309 microversion: 2.1 time: 0.214020 Oct 31 14:38:08.169349 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2838/5921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:38:07 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:38:08.185958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] HTTP exception thrown: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Request method failure captured: Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 HTTP/1.1 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9xe48P2Pm4LLzkpevFD-sk-MqvAnlmI1RgLHXu9CY-Js4aKf6vUr5Hrs-XQ6b1-2NWYp9vrddSHq3b1tpd9cAwSnpdAo7cGL44Vo8UAGVKMSSVkPa2ulMCw3xZQvhFF4p1H63AjZHEuR3banuSohaewJfHo2Prfelf7OB94s-3OqdU Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b14e27a7348b786b017e067a9bece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 9362cc6b2b5342e1b9f02c433bbb731b Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'e03d6aed-ba8c-4d89-99ba-7ddc86880d63'} Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:38:08.188597 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Returning 404 to user: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:08.192632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-522f8652-798a-4a56-b735-28f5e4a1b5a3 tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 404 len: 111 microversion: 2.20 time: 0.073268 Oct 31 14:38:08.193431 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3084/5922] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 31 14:38:08 2022] DELETE /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:38:08.206553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:08.207341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] [instance: e03d6aed-ba8c-4d89-99ba-7ddc86880d63] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:08.214263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:08.214869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:08.217929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:08.218876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:08.219594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:08.220235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:08.267944 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] HTTP exception thrown: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Request method failure captured: Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 HTTP/1.1 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9xe48P2Pm4LLzkpevFD-sk-MqvAnlmI1RgLHXu9CY-Js4aKf6vUr5Hrs-XQ6b1-2NWYp9vrddSHq3b1tpd9cAwSnpdAo7cGL44Vo8UAGVKMSSVkPa2ulMCw3xZQvhFF4p1H63AjZHEuR3banuSohaewJfHo2Prfelf7OB94s-3OqdU Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b14e27a7348b786b017e067a9bece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b14e27a7348b786b017e067a9bece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b20b14e27a7348b786b017e067a9bece Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1372002374 Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 9362cc6b2b5342e1b9f02c433bbb731b Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1372002374-project Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e03d6aed-ba8c-4d89-99ba-7ddc86880d63'} Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.272251 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. Oct 31 14:38:08.276385 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:08.282774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] Returning 404 to user: Instance e03d6aed-ba8c-4d89-99ba-7ddc86880d63 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:08.284927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2eaacb1a-8c81-44f4-a6ea-ed652c6e587f tempest-AttachVolumeShelveTestJSON-1372002374 tempest-AttachVolumeShelveTestJSON-1372002374-project] 10.222.0.27 "GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63" status: 404 len: 111 microversion: 2.20 time: 0.085644 Oct 31 14:38:08.290822 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2839/5923] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 31 14:38:08 2022] GET /compute/v2.1/servers/e03d6aed-ba8c-4d89-99ba-7ddc86880d63 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:38:09.197528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:09.198534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] [instance: 28ac41ad-6e68-48d8-b31c-7041d1312499] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:38:09.207225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:09.207724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:09.208234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:09.208949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:38:09.209407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:38:09.209994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:38:09.225369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] HTTP exception thrown: Instance 28ac41ad-6e68-48d8-b31c-7041d1312499 could not be found. Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Request method failure captured: Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 HTTP/1.1 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX9zNiM5DvjQpwlEGfeS6OkNBoAj-FmniMkPGtefBpffm6C4d_2hI7G52JmQ6cQ1DgBy1ybQiL1ZP4z6dZvJQQxMUZ1bPGC3dKJUUyDROXOdnNPEN01VhNZz6X-e4X0EYn13eoNOpfCygs0sBS9gfDJcYg1D7yEtEJu3fPEPr_7A6BlY Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 4365761700f14a89abb642ac34cffcbe Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590942822 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4365761700f14a89abb642ac34cffcbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4365761700f14a89abb642ac34cffcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4365761700f14a89abb642ac34cffcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4365761700f14a89abb642ac34cffcbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590942822 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 4365761700f14a89abb642ac34cffcbe Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590942822 Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotTestJSON-1590942822-project Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: a6a460f649a74c8d83f9f8fa5845928d Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590942822-project Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 28ac41ad-6e68-48d8-b31c-7041d1312499 could not be found. Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '28ac41ad-6e68-48d8-b31c-7041d1312499'} Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28ac41ad-6e68-48d8-b31c-7041d1312499 could not be found. Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28ac41ad-6e68-48d8-b31c-7041d1312499 could not be found. Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:09.228075 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28ac41ad-6e68-48d8-b31c-7041d1312499 could not be found. Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] Returning 404 to user: Instance 28ac41ad-6e68-48d8-b31c-7041d1312499 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09072cc3-3f5e-4165-a4ce-6d90da483c9d tempest-VolumesSnapshotTestJSON-1590942822 tempest-VolumesSnapshotTestJSON-1590942822-project] 10.222.0.27 "GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499" status: 404 len: 111 microversion: 2.1 time: 0.036974 Oct 31 14:38:09.233462 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3085/5924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:38:09 2022] GET /compute/v2.1/servers/28ac41ad-6e68-48d8-b31c-7041d1312499 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:38:15.022409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34d5d0af-b1d6-4d92-aef5-c8dd8e213d9e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Action: 'create', calling method: .version_select at 0x7fe10c05e820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1607730557", "metadata": {"Type": "work"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34d5d0af-b1d6-4d92-aef5-c8dd8e213d9e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Request method failure captured: Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 122 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX93WRH3a16ErMWMAUFU3cKm8LgHvWCKFdiWYtzgxDrB611ICtgkAWWYood_E9ugtzw9EoUbEJbQeG6NWEqWWktD7X7nY9gi0-SQeQB-J2YnjId1-2aPKHg_20MSRHvAzXlUdbQm0if-WNEl02Hx_blPQo8zH4uK0233fHaozuaqcqNE Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f2c8d5957748feb394ba6b3dccf396", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e3d0ccc0a5f14a5cb4221c9a26c33d2c Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1607730557", "metadata": {"Type": "work"}}} Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1607730557', 'metadata': {'Type': 'work'}}}} Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '#$%' Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:38:15.025127 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34d5d0af-b1d6-4d92-aef5-c8dd8e213d9e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34d5d0af-b1d6-4d92-aef5-c8dd8e213d9e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.171245 Oct 31 14:38:15.028283 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2840/5925] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 31 14:38:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:38:15.040942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff0cffb4-f4a3-4d00-b52e-af93dbae3127 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Action: 'create', calling method: .version_select at 0x7fe1078cf0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1293002100", "metadata": {"Type": "work"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff0cffb4-f4a3-4d00-b52e-af93dbae3127 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Request method failure captured: Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 120 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX93WRH3a16ErMWMAUFU3cKm8LgHvWCKFdiWYtzgxDrB611ICtgkAWWYood_E9ugtzw9EoUbEJbQeG6NWEqWWktD7X7nY9gi0-SQeQB-J2YnjId1-2aPKHg_20MSRHvAzXlUdbQm0if-WNEl02Hx_blPQo8zH4uK0233fHaozuaqcqNE Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f2c8d5957748feb394ba6b3dccf396", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: e3d0ccc0a5f14a5cb4221c9a26c33d2c Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1293002100", "metadata": {"Type": "work"}}} Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1293002100', 'metadata': {'Type': 'work'}}}} Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '0' Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:38:15.047289 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff0cffb4-f4a3-4d00-b52e-af93dbae3127 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff0cffb4-f4a3-4d00-b52e-af93dbae3127 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013855 Oct 31 14:38:15.051345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3086/5926] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 31 14:38:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:38:15.060364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b34a236-175c-4472-a02f-dc4698c6ce0e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Action: 'create', calling method: .version_select at 0x7fe1067edf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-378676098", "metadata": {"Type": "work"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b34a236-175c-4472-a02f-dc4698c6ce0e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Request method failure captured: Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 118 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX93WRH3a16ErMWMAUFU3cKm8LgHvWCKFdiWYtzgxDrB611ICtgkAWWYood_E9ugtzw9EoUbEJbQeG6NWEqWWktD7X7nY9gi0-SQeQB-J2YnjId1-2aPKHg_20MSRHvAzXlUdbQm0if-WNEl02Hx_blPQo8zH4uK0233fHaozuaqcqNE Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f2c8d5957748feb394ba6b3dccf396", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e3d0ccc0a5f14a5cb4221c9a26c33d2c Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-378676098", "metadata": {"Type": "work"}}} Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-378676098', 'metadata': {'Type': 'work'}}}} Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '' Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:38:15.065998 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b34a236-175c-4472-a02f-dc4698c6ce0e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b34a236-175c-4472-a02f-dc4698c6ce0e tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012061 Oct 31 14:38:15.074463 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2841/5927] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 31 14:38:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 14:38:15.077450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11236ca2-6bc0-4e03-ae1a-e26a199a7b21 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Calling method '.version_select at 0x7fe10662b160>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:15.132406 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-11236ca2-6bc0-4e03-ae1a-e26a199a7b21 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] HTTP exception thrown: Volume tempest-invalid-1230870721 could not be found. Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11236ca2-6bc0-4e03-ae1a-e26a199a7b21 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Request method failure captured: Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1230870721 HTTP/1.1 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX93WRH3a16ErMWMAUFU3cKm8LgHvWCKFdiWYtzgxDrB611ICtgkAWWYood_E9ugtzw9EoUbEJbQeG6NWEqWWktD7X7nY9gi0-SQeQB-J2YnjId1-2aPKHg_20MSRHvAzXlUdbQm0if-WNEl02Hx_blPQo8zH4uK0233fHaozuaqcqNE Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f2c8d5957748feb394ba6b3dccf396", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: e3d0ccc0a5f14a5cb4221c9a26c33d2c Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: exception: Volume tempest-invalid-1230870721 could not be found. Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'tempest-invalid-1230870721'} Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1230870721 could not be found. (HTTP 404) (Request-ID: req-624d1659-414f-4d32-9731-d2f74d3d65b5) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:38:15.134812 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1230870721 could not be found. Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1230870721 could not be found. Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1230870721 could not be found. Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11236ca2-6bc0-4e03-ae1a-e26a199a7b21 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Returning 404 to user: Volume tempest-invalid-1230870721 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11236ca2-6bc0-4e03-ae1a-e26a199a7b21 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1230870721" status: 404 len: 99 microversion: 2.1 time: 0.063339 Oct 31 14:38:15.137797 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3087/5928] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 14:38:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1230870721 => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 14:38:15.147451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c2213b7-184f-4a76-aad9-37f3fa21e7e3 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003789 Oct 31 14:38:15.155618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2842/5929] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 31 14:38:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:38:15.172539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9afe8edf-e526-4dbe-9039-91578137a50a tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018251 Oct 31 14:38:15.173111 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3088/5930] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 31 14:38:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:38:15.184521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22b40f47-2871-4408-923b-14c66aea6170 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Calling method '.version_select at 0x7fe107db1430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:15.224022 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-22b40f47-2871-4408-923b-14c66aea6170 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] HTTP exception thrown: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22b40f47-2871-4408-923b-14c66aea6170 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Request method failure captured: Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/os-volumes/d5a06df4-5c01-4ea4-a321-b2f6b6965b69 HTTP/1.1 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX93WRH3a16ErMWMAUFU3cKm8LgHvWCKFdiWYtzgxDrB611ICtgkAWWYood_E9ugtzw9EoUbEJbQeG6NWEqWWktD7X7nY9gi0-SQeQB-J2YnjId1-2aPKHg_20MSRHvAzXlUdbQm0if-WNEl02Hx_blPQo8zH4uK0233fHaozuaqcqNE Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f2c8d5957748feb394ba6b3dccf396", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: e3d0ccc0a5f14a5cb4221c9a26c33d2c Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: method: Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: exception: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'd5a06df4-5c01-4ea4-a321-b2f6b6965b69'} Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. (HTTP 404) (Request-ID: req-20d5fac4-361e-4478-975a-7fc9d1478059) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:38:15.226207 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22b40f47-2871-4408-923b-14c66aea6170 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Returning 404 to user: Volume d5a06df4-5c01-4ea4-a321-b2f6b6965b69 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22b40f47-2871-4408-923b-14c66aea6170 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d5a06df4-5c01-4ea4-a321-b2f6b6965b69" status: 404 len: 109 microversion: 2.1 time: 0.046961 Oct 31 14:38:15.235104 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2843/5931] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 31 14:38:15 2022] DELETE /compute/v2.1/os-volumes/d5a06df4-5c01-4ea4-a321-b2f6b6965b69 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:38:15.243477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de98c599-040b-45ea-aa97-80b9ff697a58 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Calling method '.version_select at 0x7fe1066245e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:38:15.274840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-de98c599-040b-45ea-aa97-80b9ff697a58 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] HTTP exception thrown: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de98c599-040b-45ea-aa97-80b9ff697a58 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Request method failure captured: Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/os-volumes/f4f0b106-2f29-43dc-897b-a70b7be0aa26 HTTP/1.1 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX93WRH3a16ErMWMAUFU3cKm8LgHvWCKFdiWYtzgxDrB611ICtgkAWWYood_E9ugtzw9EoUbEJbQeG6NWEqWWktD7X7nY9gi0-SQeQB-J2YnjId1-2aPKHg_20MSRHvAzXlUdbQm0if-WNEl02Hx_blPQo8zH4uK0233fHaozuaqcqNE Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f2c8d5957748feb394ba6b3dccf396", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f2c8d5957748feb394ba6b3dccf396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 19f2c8d5957748feb394ba6b3dccf396 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-875777592 Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: e3d0ccc0a5f14a5cb4221c9a26c33d2c Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-875777592-project Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: method: Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: exception: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'f4f0b106-2f29-43dc-897b-a70b7be0aa26'} Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. (HTTP 404) (Request-ID: req-2dbbe3ab-f38e-482f-83c3-2b7f0f1b8324) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:38:15.277181 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. Oct 31 14:38:15.281209 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:38:15.284544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de98c599-040b-45ea-aa97-80b9ff697a58 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] Returning 404 to user: Volume f4f0b106-2f29-43dc-897b-a70b7be0aa26 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:38:15.285944 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de98c599-040b-45ea-aa97-80b9ff697a58 tempest-VolumesNegativeTest-875777592 tempest-VolumesNegativeTest-875777592-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f4f0b106-2f29-43dc-897b-a70b7be0aa26" status: 404 len: 109 microversion: 2.1 time: 0.046970 Oct 31 14:38:15.286601 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3089/5932] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 31 14:38:15 2022] GET /compute/v2.1/os-volumes/f4f0b106-2f29-43dc-897b-a70b7be0aa26 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:51.428156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:51.434318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:51.438871 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 31 14:39:51.457141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9825883e-eeea-4ab2-b4c1-dfe8037ba8dd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'create', calling method: .version_select at 0x7fe107db1430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-40921701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjX3hj8WYJKwjmb2/L7SWpWz6PiGQgcIiZFlTHLVuOqpxs8b0/aHvlNTm5MutlmJf6rfD4BPAkYB+pJ8Jb/ADbmbDMIvxr28rhvN+vH6hK3WkQ4cJVM9dmtRHSftzcw9A=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:39:51.481828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9825883e-eeea-4ab2-b4c1-dfe8037ba8dd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for project e077e99d7ee747198ff0f8f042820619. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:39:51.491697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9825883e-eeea-4ab2-b4c1-dfe8037ba8dd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for user fdc99c152a5446eda2f925f29a224c17 and project e077e99d7ee747198ff0f8f042820619. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:39:51.524380 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9825883e-eeea-4ab2-b4c1-dfe8037ba8dd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.100827 Oct 31 14:39:51.532716 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2844/5933] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:39:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:39:53.571224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=20 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:53.572383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:53.575929 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:39:53.576023 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 31 14:39:53.590025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1751409567", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "f614dec3-166e-4933-8719-5b57ec2e7b38"}], "key_name": "tempest-TestNetworkBasicOps-40921701", "security_groups": [{"name": "tempest-secgroup-smoke-1641491328"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:39:53.806074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] validate_networks() for [('f614dec3-166e-4933-8719-5b57ec2e7b38', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:39:54.591741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:39:54.591741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:39:54.591741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:39:54.591741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:39:54.591741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:39:54.599920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:54.600690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:54.601138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:54.602216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:54.602690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:54.603120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:54.625701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for project e077e99d7ee747198ff0f8f042820619. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:39:54.632158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for user fdc99c152a5446eda2f925f29a224c17 and project e077e99d7ee747198ff0f8f042820619. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:39:54.651173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:39:54.654010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:39:54.745917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88f5bd3f-ae6f-49ea-a603-a363ceed91a6 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.177151 Oct 31 14:39:54.747252 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3090/5934] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:39:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:39:54.760316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f5c1749-35d2-410e-816a-9ae98aa54fcf tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:39:54.761185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f5c1749-35d2-410e-816a-9ae98aa54fcf tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:39:54.944508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f5c1749-35d2-410e-816a-9ae98aa54fcf tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:39:54.951782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f5c1749-35d2-410e-816a-9ae98aa54fcf tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1247 microversion: 2.1 time: 0.197078 Oct 31 14:39:54.954771 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2845/5935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:39:54 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1247 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:39:55.986229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:39:55.990614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:39:55.999601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:56.000459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:56.001960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:56.003516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:56.005142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:56.005774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:56.184948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:39:56.208712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2be33578-f694-485d-a868-094c5620a290 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1243 microversion: 2.1 time: 0.226560 Oct 31 14:39:56.222238 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3091/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:39:55 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1243 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:39:57.234751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:39:57.235542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:39:57.255372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:57.256037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:57.256603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:57.257472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:57.258038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:57.258594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:57.489552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:39:57.501650 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cadb295-d2d1-4943-a0b3-081acab8baa2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1305 microversion: 2.1 time: 0.270993 Oct 31 14:39:57.502661 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2846/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:39:57 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:39:58.528312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:39:58.528967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:39:58.545407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:58.546654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:58.552590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:58.553597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:39:58.554253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:39:58.554828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:39:59.057990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:39:59.067149 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-748bb5ea-83fc-4afb-b4d9-2381788a9988 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.542613 Oct 31 14:39:59.071381 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3092/5938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:39:58 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:00.106250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:00.110069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:00.123015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:00.123795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:00.124392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:00.125262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:00.125873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:00.126478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:00.297734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-73a59001-1927-4c22-9c7e-144129a81a64 req-a4fc6b5b-80d9-44b7-892e-66221095b9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7236b7d6-0b88-4c9c-b708-ad1891c7775f", "tag": "732a9f59-9ea2-40c8-9660-7081e2b20767"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:00.321975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73a59001-1927-4c22-9c7e-144129a81a64 req-a4fc6b5b-80d9-44b7-892e-66221095b9c7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:00.328846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73a59001-1927-4c22-9c7e-144129a81a64 req-a4fc6b5b-80d9-44b7-892e-66221095b9c7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:00.329383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73a59001-1927-4c22-9c7e-144129a81a64 req-a4fc6b5b-80d9-44b7-892e-66221095b9c7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:00.345464 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-73a59001-1927-4c22-9c7e-144129a81a64 req-a4fc6b5b-80d9-44b7-892e-66221095b9c7 service nova] Creating event network-changed:732a9f59-9ea2-40c8-9660-7081e2b20767 for instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f on n-h2-863052-1 Oct 31 14:40:00.353298 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-73a59001-1927-4c22-9c7e-144129a81a64 req-a4fc6b5b-80d9-44b7-892e-66221095b9c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059167 Oct 31 14:40:00.355501 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3093/5939] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:40:00.651687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:00.667830 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d138c22-69c9-4b62-9e52-965a198e2d86 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.568238 Oct 31 14:40:00.668456 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2847/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:00 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:01.692239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:01.693051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:01.712558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:01.713289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:01.716131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:01.716989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:01.719806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:01.720337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:02.081267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:02.090750 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a80763f5-4f35-4772-a5d5-7e584c77243b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.403185 Oct 31 14:40:02.094702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3094/5941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:01 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:03.124241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:03.124788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:03.139784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:03.142391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:03.144660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:03.147168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:03.149416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:03.149927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:03.490868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:03.508670 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db5c3dbd-1f3b-4287-8fc6-919f28ba8419 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.389432 Oct 31 14:40:03.511540 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2848/5942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:03 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:04.537667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:04.538560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:04.550282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:04.551103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:04.551749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:04.552485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:04.552939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:04.553542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:04.617592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:04.645822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:04.730881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:04.740202 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0eee64a1-a7c9-4502-bd3d-85d440c59189 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.210638 Oct 31 14:40:04.740802 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3095/5943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:04 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:05.765466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:05.766774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:05.790516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:05.795208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:05.801383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:05.802197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:05.803312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:05.804051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:05.804692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:06.163048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:06.191862 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e5fd860-b850-4231-87d8-2d0f328f8a8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.430618 Oct 31 14:40:06.198135 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2849/5944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:05 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:07.219140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:07.220536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:07.262838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:07.263692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:07.266863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:07.267931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:07.269650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:07.273168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:07.700994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fb7d6e58-c3ee-4cfa-8ede-7b0c34080ee0 req-803c6bcc-0f54-4d46-b2dd-ec12d30e4f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7236b7d6-0b88-4c9c-b708-ad1891c7775f", "name": "network-vif-plugged", "status": "completed", "tag": "732a9f59-9ea2-40c8-9660-7081e2b20767"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:07.718692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb7d6e58-c3ee-4cfa-8ede-7b0c34080ee0 req-803c6bcc-0f54-4d46-b2dd-ec12d30e4f1b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:07.719186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb7d6e58-c3ee-4cfa-8ede-7b0c34080ee0 req-803c6bcc-0f54-4d46-b2dd-ec12d30e4f1b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:07.719631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb7d6e58-c3ee-4cfa-8ede-7b0c34080ee0 req-803c6bcc-0f54-4d46-b2dd-ec12d30e4f1b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:07.781083 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fb7d6e58-c3ee-4cfa-8ede-7b0c34080ee0 req-803c6bcc-0f54-4d46-b2dd-ec12d30e4f1b service nova] Creating event network-vif-plugged:732a9f59-9ea2-40c8-9660-7081e2b20767 for instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f on n-h2-863052-1 Oct 31 14:40:07.791569 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fb7d6e58-c3ee-4cfa-8ede-7b0c34080ee0 req-803c6bcc-0f54-4d46-b2dd-ec12d30e4f1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.518691 Oct 31 14:40:07.793824 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2850/5945] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:40:08.009652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:08.020205 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eefbf7fa-0a41-421d-a7a9-f40bf74328b3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.805966 Oct 31 14:40:08.023034 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3096/5946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:07 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:09.046025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:09.046905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:09.069286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:09.070139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:09.070893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:09.071927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:09.072628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:09.073299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:09.437992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:09.450018 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05dedf1f-a7d8-42f5-a56f-942399c58f3a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1373 microversion: 2.1 time: 0.408968 Oct 31 14:40:09.466718 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2851/5947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:09 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1373 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:10.482456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:10.483342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:10.509193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:10.510215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:10.510918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:10.511890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:10.512564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:10.513203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:10.898511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:10.913273 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30216042-23d9-4f2b-9dc2-8f692f1b6a4e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1545 microversion: 2.1 time: 0.434275 Oct 31 14:40:10.915934 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3097/5948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:10 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1545 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:10.938773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:10.939393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:10.951474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:10.951971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:10.952411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:10.956971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:10.957508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:10.957945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:11.113258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:11.121394 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd8ce2a3-ef84-46a4-8189-46ffca197a88 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1545 microversion: 2.1 time: 0.186453 Oct 31 14:40:11.123525 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2852/5949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:10 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1545 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:14.409262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3c06d0ec-9d40-483d-9f61-2fab67d6e0e6 req-c335668e-f8d9-4ce0-8096-2827c4d81cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7236b7d6-0b88-4c9c-b708-ad1891c7775f", "tag": "732a9f59-9ea2-40c8-9660-7081e2b20767"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:14.429180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3c06d0ec-9d40-483d-9f61-2fab67d6e0e6 req-c335668e-f8d9-4ce0-8096-2827c4d81cdd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:14.429944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3c06d0ec-9d40-483d-9f61-2fab67d6e0e6 req-c335668e-f8d9-4ce0-8096-2827c4d81cdd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:14.430572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3c06d0ec-9d40-483d-9f61-2fab67d6e0e6 req-c335668e-f8d9-4ce0-8096-2827c4d81cdd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:14.443786 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3c06d0ec-9d40-483d-9f61-2fab67d6e0e6 req-c335668e-f8d9-4ce0-8096-2827c4d81cdd service nova] Creating event network-changed:732a9f59-9ea2-40c8-9660-7081e2b20767 for instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f on n-h2-863052-1 Oct 31 14:40:14.449974 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3c06d0ec-9d40-483d-9f61-2fab67d6e0e6 req-c335668e-f8d9-4ce0-8096-2827c4d81cdd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163020 Oct 31 14:40:14.451194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3098/5950] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:40:34.769457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:34.772378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:34.775179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:34.776313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:34.782037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:34.783529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:34.784157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:34.785023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:34.785749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:34.786435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:34.847097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e96406bc-f4fd-4718-884e-04fce3914fc2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f/action" status: 200 len: 24566 microversion: 2.1 time: 0.081269 Oct 31 14:40:34.849033 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2853/5951] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:40:34 2022] POST /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f/action => generated 24566 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:40:46.710003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75dc6054-0b47-442e-81f3-ca8b70f6ac27 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'create', calling method: .version_select at 0x7fe10662b160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1402961217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr9OKGjP5HMi5iaIkMustMivTB60jvkPZn7D4/H6I13pdEJZaX82bO+Q+MNS5Ubo+x7BOIiaHWSvGX+19BNBkKX9p4qfslPRs/egYoGL1ZXkQeJUHj5DOqApB6j+W0ISA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:46.723836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:46.724659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=42 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:46.759122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-75dc6054-0b47-442e-81f3-ca8b70f6ac27 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for project e077e99d7ee747198ff0f8f042820619. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:40:46.783176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-75dc6054-0b47-442e-81f3-ca8b70f6ac27 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for user fdc99c152a5446eda2f925f29a224c17 and project e077e99d7ee747198ff0f8f042820619. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:40:46.844898 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75dc6054-0b47-442e-81f3-ca8b70f6ac27 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.138743 Oct 31 14:40:46.860107 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3099/5952] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:40:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:40:48.578419 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 14:40:48.582765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1807930945", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "64141f38-4666-4169-a218-f7afd76d47b4"}], "key_name": "tempest-TestNetworkBasicOps-1402961217", "security_groups": [{"name": "tempest-secgroup-smoke-40817403"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:48.597668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:48.600710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:48.735435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] validate_networks() for [('64141f38-4666-4169-a218-f7afd76d47b4', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:40:49.592283 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40824. Oct 31 14:40:49.770880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:40:49.772574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:40:49.774971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:40:49.775456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:40:49.777638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:40:49.813102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:49.814157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:49.814622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:49.815398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:49.815882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:49.816322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:49.850412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for project e077e99d7ee747198ff0f8f042820619. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:40:49.856928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for user fdc99c152a5446eda2f925f29a224c17 and project e077e99d7ee747198ff0f8f042820619. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:40:49.884790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:40:49.888815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:40:49.975141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-85637963-9c39-4fcd-bed8-3c9d2c77abe2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.396391 Oct 31 14:40:49.978519 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2854/5953] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:40:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:40:49.987748 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] AMQP server on 10.222.0.27:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 31 14:40:49.997485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f82ea85-916b-4bc2-865a-c8711566fa29 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:49.998518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f82ea85-916b-4bc2-865a-c8711566fa29 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:50.136649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f82ea85-916b-4bc2-865a-c8711566fa29 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:50.144209 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f82ea85-916b-4bc2-865a-c8711566fa29 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1249 microversion: 2.1 time: 0.160639 Oct 31 14:40:50.148194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3100/5954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:49 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1249 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:40:51.173727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:51.175507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:51.230447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:51.231200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:51.232107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:51.233913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:51.237515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:51.238564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:51.359188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:51.368627 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43c3137b-6e24-48aa-9c26-40aff5ff0d98 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1301 microversion: 2.1 time: 0.202429 Oct 31 14:40:51.369701 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2855/5955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:51 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1301 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:52.393296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:52.394581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:52.406208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:52.407575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:52.408174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:52.410411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:52.411193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:52.411859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:52.424037 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40968. Oct 31 14:40:52.533103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:52.547988 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce7dff1b-88d5-41ee-aaa4-6b33100a54e0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1307 microversion: 2.1 time: 0.159736 Oct 31 14:40:52.550398 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3101/5956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:52 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:53.573167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:53.573790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:53.585036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:53.585540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:53.585989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:53.593649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:53.594149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:53.594709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:53.869236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:53.877805 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dedf7e2c-5739-4932-807c-57b6c6b65c40 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1373 microversion: 2.1 time: 0.308800 Oct 31 14:40:53.882978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2856/5957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:53 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1373 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:54.069285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b329d6fc-ea48-46a5-bba3-877e07ade580 req-ceb8f844-aeb3-4990-ac40-a22ae8438d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "772e5561-4e81-4818-aeb7-b983692807f5", "tag": "64dfd30e-1fb2-4c96-b9f1-f26f9262800f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:54.081883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b329d6fc-ea48-46a5-bba3-877e07ade580 req-ceb8f844-aeb3-4990-ac40-a22ae8438d75 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:54.082334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b329d6fc-ea48-46a5-bba3-877e07ade580 req-ceb8f844-aeb3-4990-ac40-a22ae8438d75 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:54.082958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b329d6fc-ea48-46a5-bba3-877e07ade580 req-ceb8f844-aeb3-4990-ac40-a22ae8438d75 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:54.096590 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b329d6fc-ea48-46a5-bba3-877e07ade580 req-ceb8f844-aeb3-4990-ac40-a22ae8438d75 service nova] Creating event network-changed:64dfd30e-1fb2-4c96-b9f1-f26f9262800f for instance 772e5561-4e81-4818-aeb7-b983692807f5 on n-h1-863052-1 Oct 31 14:40:54.103456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b329d6fc-ea48-46a5-bba3-877e07ade580 req-ceb8f844-aeb3-4990-ac40-a22ae8438d75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038036 Oct 31 14:40:54.106365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3102/5958] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:40:54.904175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:54.905776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:54.916165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:54.916665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:54.921360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:54.924109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:54.930046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:54.931010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:55.155109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:55.167503 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5b194f2-69b6-4ca9-8389-586eb3efba95 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1373 microversion: 2.1 time: 0.268606 Oct 31 14:40:55.170616 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2857/5959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:54 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:56.193875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:56.196161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:56.212647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:56.214119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:56.214808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:56.216558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:56.217241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:56.222871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:56.474115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:56.486542 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63e1e1e9-1ddb-4887-aead-3b46dd25469e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1373 microversion: 2.1 time: 0.298475 Oct 31 14:40:56.487587 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3103/5960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:56 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1373 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:57.514995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:57.515832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:57.524122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:57.524849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:57.525618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:57.526529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:57.527191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:57.527826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:57.709197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:57.717541 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0c97f6c5-724d-4fd8-8154-dc7cb513f783 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1373 microversion: 2.1 time: 0.206662 Oct 31 14:40:57.719902 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2858/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:57 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1373 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:57.840510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5bd2bda1-eb8c-4a47-ba41-74a4f35e4b85 req-c729b7ae-5c10-4c07-8dd2-e3d4d09ce4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772e5561-4e81-4818-aeb7-b983692807f5", "name": "network-vif-plugged", "status": "completed", "tag": "64dfd30e-1fb2-4c96-b9f1-f26f9262800f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:40:57.860996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5bd2bda1-eb8c-4a47-ba41-74a4f35e4b85 req-c729b7ae-5c10-4c07-8dd2-e3d4d09ce4cd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:57.864980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5bd2bda1-eb8c-4a47-ba41-74a4f35e4b85 req-c729b7ae-5c10-4c07-8dd2-e3d4d09ce4cd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:57.865834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5bd2bda1-eb8c-4a47-ba41-74a4f35e4b85 req-c729b7ae-5c10-4c07-8dd2-e3d4d09ce4cd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:57.882647 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5bd2bda1-eb8c-4a47-ba41-74a4f35e4b85 req-c729b7ae-5c10-4c07-8dd2-e3d4d09ce4cd service nova] Creating event network-vif-plugged:64dfd30e-1fb2-4c96-b9f1-f26f9262800f for instance 772e5561-4e81-4818-aeb7-b983692807f5 on n-h1-863052-1 Oct 31 14:40:57.888285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5bd2bda1-eb8c-4a47-ba41-74a4f35e4b85 req-c729b7ae-5c10-4c07-8dd2-e3d4d09ce4cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051644 Oct 31 14:40:57.889468 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3104/5962] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:40:58.744511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:58.745232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:58.761963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:58.762730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:58.763394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:58.764052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:58.764512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:58.764941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:58.946294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:40:58.957635 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3a346dc-0409-4fde-8a73-414b195de096 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1373 microversion: 2.1 time: 0.216930 Oct 31 14:40:58.958263 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2859/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:58 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1373 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:40:59.984396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:40:59.986417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:40:59.993132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:59.994282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:59.994282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:40:59.994766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:40:59.995218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:40:59.995731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:00.142237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:00.147724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:00.157731 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ce09383-e388-4838-89fe-d233b9eb329e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1546 microversion: 2.1 time: 0.178318 Oct 31 14:41:00.159575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3105/5964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:40:59 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:00.180514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:00.186851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:00.192030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:00.198727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:00.210088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:00.210630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:00.211077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:00.211795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:00.212717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:00.213152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:00.369713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:00.378312 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7949f02-a851-4c1b-b786-2ab275c4cb02 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1546 microversion: 2.1 time: 0.200697 Oct 31 14:41:00.379200 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2860/5965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:00 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:16.671800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-918443565", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:16.683196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:16.684210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=22 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:16.738210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:41:17.341245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:41:17.341826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:41:17.342642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:41:17.343157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:41:17.343937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:41:17.353503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:17.354363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:17.354943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:17.356482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:17.357015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:17.357773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:17.376464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Getting quotas for project c896ec06f8aa4c5cb162b459523a2929. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:41:17.390542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Getting quotas for user 4f98a9099f43410992f9f75bd7a01b27 and project c896ec06f8aa4c5cb162b459523a2929. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:41:17.401804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:41:17.404354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:41:17.452627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa24d46e-27f7-4ff3-b49b-9dcf10efd47c tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786513 Oct 31 14:41:17.453294 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3106/5966] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:41:17.464700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-561a726c-85fe-4a1a-a8c5-2de1debd096a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:17.466102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-561a726c-85fe-4a1a-a8c5-2de1debd096a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:17.469441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:17.470475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:17.532611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-561a726c-85fe-4a1a-a8c5-2de1debd096a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:17.542581 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-561a726c-85fe-4a1a-a8c5-2de1debd096a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1214 microversion: 2.1 time: 0.081375 Oct 31 14:41:17.543677 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2861/5967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:17 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:18.568166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:18.568776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:18.576016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:18.576753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:18.577359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:18.578819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:18.579422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:18.580177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:18.673268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:18.682333 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a22801e-dd0f-4286-bf30-d8de851592f8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1266 microversion: 2.1 time: 0.118775 Oct 31 14:41:18.683497 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3107/5968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:18 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:19.708336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:19.709583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:19.725397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:19.725910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:19.726429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:19.727828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:19.728306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:19.728735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:20.073469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:20.087827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-39106088-9190-49e4-8522-f6215d00874a tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1314 microversion: 2.1 time: 0.385160 Oct 31 14:41:20.089000 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2862/5969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:19 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:20.747827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9dad5d03-eeb2-4fe9-afb7-3a9a0050451b req-33e58ca0-2c4b-4d34-b46d-dc5d3e1a1533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf", "tag": "e22244fd-0e0a-46dd-8a06-de5f481956ce"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:20.759837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9dad5d03-eeb2-4fe9-afb7-3a9a0050451b req-33e58ca0-2c4b-4d34-b46d-dc5d3e1a1533 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:20.760574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9dad5d03-eeb2-4fe9-afb7-3a9a0050451b req-33e58ca0-2c4b-4d34-b46d-dc5d3e1a1533 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:20.761011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9dad5d03-eeb2-4fe9-afb7-3a9a0050451b req-33e58ca0-2c4b-4d34-b46d-dc5d3e1a1533 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:20.791274 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9dad5d03-eeb2-4fe9-afb7-3a9a0050451b req-33e58ca0-2c4b-4d34-b46d-dc5d3e1a1533 service nova] Creating event network-changed:e22244fd-0e0a-46dd-8a06-de5f481956ce for instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf on n-h2-863052-1 Oct 31 14:41:20.798318 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9dad5d03-eeb2-4fe9-afb7-3a9a0050451b req-33e58ca0-2c4b-4d34-b46d-dc5d3e1a1533 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055294 Oct 31 14:41:20.799943 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3108/5970] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:21.112831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:21.113458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:21.120636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:21.121335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:21.121776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:21.122690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:21.123347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:21.124029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:21.284709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:21.293283 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b2be25ab-a87a-41a0-87fd-1a17acc2f466 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1314 microversion: 2.1 time: 0.185276 Oct 31 14:41:21.307116 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2863/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:21 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:22.321372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:22.323018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:22.331356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:22.332118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:22.332908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:22.333822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:22.334556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:22.335209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:22.576267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:22.587878 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8f804d7-3c06-440d-8269-4d83148c8bf6 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1314 microversion: 2.1 time: 0.273928 Oct 31 14:41:22.590580 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3109/5972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:22 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:23.613723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:23.614702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:23.622134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:23.622958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:23.623510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:23.624838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:23.625775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:23.626447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:23.790556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:23.807296 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef1b446c-bbde-4acc-9d45-cec365a7e000 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1314 microversion: 2.1 time: 0.197344 Oct 31 14:41:23.808515 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2864/5973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:23 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:24.831289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:24.832079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:24.839516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:24.840360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:24.840970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:24.842056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:24.842745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:24.843437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:24.992395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:25.001745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f0f258b-6bf5-45d8-b46e-c2b1d1c7f7df tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1314 microversion: 2.1 time: 0.175139 Oct 31 14:41:25.002598 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3110/5974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:24 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:25.399170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-bf730f46-f559-4127-9698-fb009cf6cec4 req-6a3467d1-13c3-4400-a2df-954646b22409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf", "name": "network-vif-plugged", "status": "completed", "tag": "e22244fd-0e0a-46dd-8a06-de5f481956ce"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:25.418675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf730f46-f559-4127-9698-fb009cf6cec4 req-6a3467d1-13c3-4400-a2df-954646b22409 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:25.419528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf730f46-f559-4127-9698-fb009cf6cec4 req-6a3467d1-13c3-4400-a2df-954646b22409 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:25.420159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-bf730f46-f559-4127-9698-fb009cf6cec4 req-6a3467d1-13c3-4400-a2df-954646b22409 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:25.433693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-bf730f46-f559-4127-9698-fb009cf6cec4 req-6a3467d1-13c3-4400-a2df-954646b22409 service nova] Creating event network-vif-plugged:e22244fd-0e0a-46dd-8a06-de5f481956ce for instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf on n-h2-863052-1 Oct 31 14:41:25.451656 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-bf730f46-f559-4127-9698-fb009cf6cec4 req-6a3467d1-13c3-4400-a2df-954646b22409 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056992 Oct 31 14:41:25.455005 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2865/5975] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:41:26.026143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:26.026788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:26.035215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:26.035714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:26.036156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:26.036864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:26.037346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:26.037970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:26.207531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:26.217565 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f558e33-8fc3-4c58-b8c7-871fcd7fe4b8 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1314 microversion: 2.1 time: 0.195394 Oct 31 14:41:26.218225 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3111/5976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:26 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:27.079358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:27.080404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:27.088040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.088536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.088977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.089685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.090377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.090952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.124626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:41:27.240513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:27.241198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:27.248627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.249163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.249612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.253140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.253854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.254475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.263369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b1075f7-b859-4600-a9e7-84e969e73378 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 204 len: 0 microversion: 2.1 time: 0.189212 Oct 31 14:41:27.264206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2866/5977] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:41:27 2022] DELETE /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:41:27.284067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:27.286083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:27.294010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.294862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.295690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.298347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.299075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.299861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.369474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:27.401034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:27.461109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:27.472770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64c6a160-8345-4674-ae24-9ab89dea3bef tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1464 microversion: 2.1 time: 0.236087 Oct 31 14:41:27.473376 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3112/5978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:27 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:27.539129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:27.544433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:27.545794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:27.554761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.555245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.555814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.556827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.557707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.558365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.592615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:41:27.691151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:27.700930 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de47a771-fe95-4842-9fa1-c99bd53bd180 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1552 microversion: 2.1 time: 0.429287 Oct 31 14:41:27.703821 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2867/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:27 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1552 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:27.802779 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a5f97ee-2df9-490d-8409-9e1d6d7050f9 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 204 len: 0 microversion: 2.1 time: 0.262164 Oct 31 14:41:27.803810 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3113/5980] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:41:27 2022] DELETE /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:41:27.814339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:27.815729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:27.822611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.823511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.824207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:27.825228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:27.825859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:27.827206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:28.059593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:28.068716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a58bc9a2-c6ce-437e-b7a1-2572cdeb0d2e tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1470 microversion: 2.1 time: 0.260530 Oct 31 14:41:28.074209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2868/5981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:27 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:41:28.731400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:28.732636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:28.745991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:28.751139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:28.751848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:28.753287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:28.755829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:28.756539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:29.015694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:29.028255 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d0b4681-9efe-4c05-b322-f6c9f20d77be tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 200 len: 1552 microversion: 2.1 time: 0.302752 Oct 31 14:41:29.031563 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3114/5982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:28 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 1552 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:29.091178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:29.092553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:29.100433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:29.100969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:29.101356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:29.102306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:29.102763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:29.103187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:29.280992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:29.290634 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20aacda8-9ca3-4f25-b3e3-43054bb3738d tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1470 microversion: 2.1 time: 0.203330 Oct 31 14:41:29.293825 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2869/5983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:29 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:41:29.365920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-23ad5c42-6905-46df-b062-601026ab9e27 req-9ea1af53-50d2-43da-80f7-ade8c27302a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772e5561-4e81-4818-aeb7-b983692807f5", "name": "network-vif-deleted", "tag": "64dfd30e-1fb2-4c96-b9f1-f26f9262800f"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:29.387407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23ad5c42-6905-46df-b062-601026ab9e27 req-9ea1af53-50d2-43da-80f7-ade8c27302a8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:29.392561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23ad5c42-6905-46df-b062-601026ab9e27 req-9ea1af53-50d2-43da-80f7-ade8c27302a8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:29.393248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23ad5c42-6905-46df-b062-601026ab9e27 req-9ea1af53-50d2-43da-80f7-ade8c27302a8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:29.429709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-23ad5c42-6905-46df-b062-601026ab9e27 req-9ea1af53-50d2-43da-80f7-ade8c27302a8 service nova] Creating event network-vif-deleted:64dfd30e-1fb2-4c96-b9f1-f26f9262800f for instance 772e5561-4e81-4818-aeb7-b983692807f5 on n-h1-863052-1 Oct 31 14:41:29.447404 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-23ad5c42-6905-46df-b062-601026ab9e27 req-9ea1af53-50d2-43da-80f7-ade8c27302a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086317 Oct 31 14:41:29.449272 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3115/5984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:30.063359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:30.063976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 772e5561-4e81-4818-aeb7-b983692807f5] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:30.078232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:30.078809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:30.079934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:30.084241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:30.084916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:30.086648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:30.128207 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] HTTP exception thrown: Instance 772e5561-4e81-4818-aeb7-b983692807f5 could not be found. Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Request method failure captured: Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 HTTP/1.1 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX94qXEZb9fCMlEv77nFjs53D-T5N2cgh4FIiAcfQBBVDdMJ2U6UreDOe-uj93VNBihFmqB2ePULh2rMwOlraQJbFghsh8q7f40wV3zVz8vHj0DsT19gS7qTUd_180rxdx1eG6u-XrlGB5O9L1SbvttQbQbd6RGq07Hmf5WxXZew_w-Q Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: e077e99d7ee747198ff0f8f042820619 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestNetworkBasicOps-613101656 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e077e99d7ee747198ff0f8f042820619", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestNetworkBasicOps-613101656 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: e077e99d7ee747198ff0f8f042820619 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestNetworkBasicOps-613101656 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestNetworkBasicOps-613101656-project Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: fdc99c152a5446eda2f925f29a224c17 Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestNetworkBasicOps-613101656-project Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 772e5561-4e81-4818-aeb7-b983692807f5 could not be found. Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '772e5561-4e81-4818-aeb7-b983692807f5'} Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 772e5561-4e81-4818-aeb7-b983692807f5 could not be found. Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 772e5561-4e81-4818-aeb7-b983692807f5 could not be found. Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:41:30.130782 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 772e5561-4e81-4818-aeb7-b983692807f5 could not be found. Oct 31 14:41:30.135639 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:30.137516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Returning 404 to user: Instance 772e5561-4e81-4818-aeb7-b983692807f5 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:41:30.138916 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27569f42-a93d-48d3-b20b-21a6376a2f19 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5" status: 404 len: 111 microversion: 2.1 time: 0.080620 Oct 31 14:41:30.154260 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2870/5985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:30 2022] GET /compute/v2.1/servers/772e5561-4e81-4818-aeb7-b983692807f5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:41:30.319201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:30.320612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:30.331554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:30.332368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:30.332907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:30.334677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:30.335662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:30.336614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:30.378912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d20e9d1-6a25-4237-ab31-4c97be77566a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '.version_select at 0x7fe10684a310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:30.411485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d20e9d1-6a25-4237-ab31-4c97be77566a tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1402961217" status: 202 len: 0 microversion: 2.1 time: 0.035193 Oct 31 14:41:30.415427 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2871/5986] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 31 14:41:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1402961217 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:41:30.430001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:30.431381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:30.431839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:30.432307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lazy-loading 'fault' on Instance uuid a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:41:30.541730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f98a9099f43410992f9f75bd7a01b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896ec06f8aa4c5cb162b459523a2929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:30.583986 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb58c1e2-cb9f-47c6-87a2-b334f7540472 tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 200 len: 1304 microversion: 2.1 time: 0.269451 Oct 31 14:41:30.591511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3116/5987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:30 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 1304 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:31.484731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b6b81cc8-2ba8-409c-a36b-8147ddd0673a req-0887ce15-1181-413d-8f2d-ab52f00af877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf", "name": "network-vif-deleted", "tag": "e22244fd-0e0a-46dd-8a06-de5f481956ce"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:31.511068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b6b81cc8-2ba8-409c-a36b-8147ddd0673a req-0887ce15-1181-413d-8f2d-ab52f00af877 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:31.512459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b6b81cc8-2ba8-409c-a36b-8147ddd0673a req-0887ce15-1181-413d-8f2d-ab52f00af877 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:31.513310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b6b81cc8-2ba8-409c-a36b-8147ddd0673a req-0887ce15-1181-413d-8f2d-ab52f00af877 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:31.526815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b6b81cc8-2ba8-409c-a36b-8147ddd0673a req-0887ce15-1181-413d-8f2d-ab52f00af877 service nova] Creating event network-vif-deleted:e22244fd-0e0a-46dd-8a06-de5f481956ce for instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf on n-h2-863052-1 Oct 31 14:41:31.542905 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b6b81cc8-2ba8-409c-a36b-8147ddd0673a req-0887ce15-1181-413d-8f2d-ab52f00af877 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062780 Oct 31 14:41:31.543605 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2872/5988] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:31.615668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:31.615668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] [instance: a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:31.615668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:31.615668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:31.615668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:31.616531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:31.616531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:31.617073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:31.666514 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] HTTP exception thrown: Instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf could not be found. Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Request method failure captured: Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf HTTP/1.1 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX96KWonHKPW7iVpJ7v5tzUk5n4dJC8tWbqWizQXdKj2pCFkqJeYXYJ-OhQC-4O45Nyhx7W5rYuIv_8vLHBLCDe9VGkhT0uurFML4imvyggI7_aKd8yOGaKzT7isN7Yw1SoRf4ChBmn_QxO35CvD9OCLqrRoklGlEhCNMKb_5ZfuybbQ Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: c896ec06f8aa4c5cb162b459523a2929 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1600795274 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c896ec06f8aa4c5cb162b459523a2929", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c896ec06f8aa4c5cb162b459523a2929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c896ec06f8aa4c5cb162b459523a2929"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c896ec06f8aa4c5cb162b459523a2929"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1600795274 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: c896ec06f8aa4c5cb162b459523a2929 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1600795274 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1600795274-project Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4f98a9099f43410992f9f75bd7a01b27 Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1600795274-project Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf could not be found. Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf'} Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf could not be found. Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf could not be found. Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:41:31.668333 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf could not be found. Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] Returning 404 to user: Instance a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:41:31.673620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-975de30f-8ba9-4272-a507-df86a6232afd tempest-VolumesNegativeTest-1600795274 tempest-VolumesNegativeTest-1600795274-project] 10.222.0.27 "GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf" status: 404 len: 111 microversion: 2.1 time: 0.067589 Oct 31 14:41:31.703522 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3117/5989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:31 2022] GET /compute/v2.1/servers/a6a393eb-2bca-4c3f-95ee-d5cf7b1d1abf => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:41:33.552578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:33.553200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:33.562187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:33.562910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:33.571403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c8750662-0fce-47d4-8f38-769f6c89a959 req-f38e2bce-0a6d-4a31-bd13-7a4af64f08e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7236b7d6-0b88-4c9c-b708-ad1891c7775f", "tag": "732a9f59-9ea2-40c8-9660-7081e2b20767"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:33.581119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:33.581891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:33.582466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:33.582915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:33.590990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c8750662-0fce-47d4-8f38-769f6c89a959 req-f38e2bce-0a6d-4a31-bd13-7a4af64f08e5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:33.591492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c8750662-0fce-47d4-8f38-769f6c89a959 req-f38e2bce-0a6d-4a31-bd13-7a4af64f08e5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:33.592173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c8750662-0fce-47d4-8f38-769f6c89a959 req-f38e2bce-0a6d-4a31-bd13-7a4af64f08e5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:33.616498 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c8750662-0fce-47d4-8f38-769f6c89a959 req-f38e2bce-0a6d-4a31-bd13-7a4af64f08e5 service nova] Creating event network-changed:732a9f59-9ea2-40c8-9660-7081e2b20767 for instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f on n-h2-863052-1 Oct 31 14:41:33.631912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:41:33.633990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c8750662-0fce-47d4-8f38-769f6c89a959 req-f38e2bce-0a6d-4a31-bd13-7a4af64f08e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069196 Oct 31 14:41:33.634895 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3118/5990] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:33.813688 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50aada24-e64f-4def-b2e7-6d82bcf45605 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 204 len: 0 microversion: 2.1 time: 0.265545 Oct 31 14:41:33.825205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:33.826050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:33.829117 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2873/5991] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:41:33 2022] DELETE /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:41:33.834382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:33.835165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:33.835761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:33.836636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:33.837294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:33.838340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:34.099525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:34.109709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36936297-9b4e-4500-b2e7-28ee12528509 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1669 microversion: 2.1 time: 0.289880 Oct 31 14:41:34.111315 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3119/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:33 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:35.136259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:35.136958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:35.161714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:35.162768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:35.166916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:35.168846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:35.169523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:35.170115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:35.459541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:35.471773 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4183eafd-ef1f-4884-874e-7b719fe46a68 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 200 len: 1669 microversion: 2.1 time: 0.339745 Oct 31 14:41:35.472705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2874/5993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:35 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 1669 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:35.896429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-770c452b-9603-481c-8a73-210b023ecb3e req-0ca2c253-a197-4d8a-a5c2-e1932ed7ef06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7236b7d6-0b88-4c9c-b708-ad1891c7775f", "name": "network-vif-deleted", "tag": "732a9f59-9ea2-40c8-9660-7081e2b20767"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:35.907808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-770c452b-9603-481c-8a73-210b023ecb3e req-0ca2c253-a197-4d8a-a5c2-e1932ed7ef06 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:35.908497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-770c452b-9603-481c-8a73-210b023ecb3e req-0ca2c253-a197-4d8a-a5c2-e1932ed7ef06 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:35.909108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-770c452b-9603-481c-8a73-210b023ecb3e req-0ca2c253-a197-4d8a-a5c2-e1932ed7ef06 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:35.930458 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-770c452b-9603-481c-8a73-210b023ecb3e req-0ca2c253-a197-4d8a-a5c2-e1932ed7ef06 service nova] Creating event network-vif-deleted:732a9f59-9ea2-40c8-9660-7081e2b20767 for instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f on n-h2-863052-1 Oct 31 14:41:35.936702 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-770c452b-9603-481c-8a73-210b023ecb3e req-0ca2c253-a197-4d8a-a5c2-e1932ed7ef06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043285 Oct 31 14:41:35.938141 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3120/5994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:36.496498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:36.497419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 7236b7d6-0b88-4c9c-b708-ad1891c7775f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:36.505810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:36.508540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:36.521623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:36.524298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:36.529518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:36.530962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:36.565880 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] HTTP exception thrown: Instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f could not be found. Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Request method failure captured: Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f HTTP/1.1 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX94qXEZb9fCMlEv77nFjs53D-T5N2cgh4FIiAcfQBBVDdMJ2U6UreDOe-uj93VNBihFmqB2ePULh2rMwOlraQJbFghsh8q7f40wV3zVz8vHj0DsT19gS7qTUd_180rxdx1eG6u-XrlGB5O9L1SbvttQbQbd6RGq07Hmf5WxXZew_w-Q Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: e077e99d7ee747198ff0f8f042820619 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestNetworkBasicOps-613101656 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e077e99d7ee747198ff0f8f042820619", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestNetworkBasicOps-613101656 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: e077e99d7ee747198ff0f8f042820619 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestNetworkBasicOps-613101656 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestNetworkBasicOps-613101656-project Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: fdc99c152a5446eda2f925f29a224c17 Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestNetworkBasicOps-613101656-project Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f could not be found. Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '7236b7d6-0b88-4c9c-b708-ad1891c7775f'} Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f could not be found. Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f could not be found. Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:41:36.569587 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f could not be found. Oct 31 14:41:36.573776 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:41:36.579457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Returning 404 to user: Instance 7236b7d6-0b88-4c9c-b708-ad1891c7775f could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:41:36.580361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78f6f5b5-0a02-42ae-9980-8a14bed9ec24 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f" status: 404 len: 111 microversion: 2.1 time: 0.088119 Oct 31 14:41:36.580933 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2875/5995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:36 2022] GET /compute/v2.1/servers/7236b7d6-0b88-4c9c-b708-ad1891c7775f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:41:36.776386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-123beb5e-525d-4ed2-829e-6a7943c059b2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '.version_select at 0x7fe1066328b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:36.815923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-123beb5e-525d-4ed2-829e-6a7943c059b2 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-40921701" status: 202 len: 0 microversion: 2.1 time: 0.043971 Oct 31 14:41:36.819808 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3121/5996] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 14:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-40921701 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:41:43.547268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a9698a3-2672-4276-815f-8dcb751e2598 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: .version_select at 0x7fe1067c0280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-578019658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmrsnZycsHLvJQmr9Cjj+sEPFQYg1rq3LlOvdcmeFbMCuxDfL4J4dKpuR4W54w4eGNyx52gsIFESAwOG6pViLZSn3ZKicA9OjKXb1NtJmAJLGNpBxt5tFTwwXf8mGzPVQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:43.569971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0a9698a3-2672-4276-815f-8dcb751e2598 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:41:43.577882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0a9698a3-2672-4276-815f-8dcb751e2598 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:41:43.618378 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a9698a3-2672-4276-815f-8dcb751e2598 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.444861 Oct 31 14:41:43.619492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2876/5997] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:41:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:44.493018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1917070596", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:44.552110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:41:44.920549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:41:44.922080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:41:44.922960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:41:44.923465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:41:44.924089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:41:44.934399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:44.934593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:44.935220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:44.936656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:44.937274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:44.938000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:44.957949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Getting quotas for project 5456dec898264354bb55a05d7e839bcd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:41:44.964993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Getting quotas for user 11d2355db7d146cc840f8f2300f4fc50 and project 5456dec898264354bb55a05d7e839bcd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:41:44.982552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:41:44.986013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:41:45.060913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e0c46bc-cc72-4cae-b2cf-0503f44880cd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572680 Oct 31 14:41:45.062125 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3122/5998] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:41:45.077948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c0af3e6-2d55-42b6-845b-26d59a951949 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:45.078805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c0af3e6-2d55-42b6-845b-26d59a951949 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:45.165147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c0af3e6-2d55-42b6-845b-26d59a951949 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:45.178325 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c0af3e6-2d55-42b6-845b-26d59a951949 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1214 microversion: 2.1 time: 0.108821 Oct 31 14:41:45.179043 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2877/5999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:45 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:46.203605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:46.205488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:46.218381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:46.219211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:46.219826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:46.220783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:46.223326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:46.224128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:46.381178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:46.393488 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b34af3f-4e13-4306-ab7b-9a72dbed93c9 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1266 microversion: 2.1 time: 0.196026 Oct 31 14:41:46.394428 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3123/6000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:46 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:47.425402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:47.426131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:47.431551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:47.464739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:47.465401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:47.469364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:47.470535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:47.470924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:47.471459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:47.672571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:47.689553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5e484712-c663-4e3d-b49d-7441ab60deb8 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1272 microversion: 2.1 time: 0.272219 Oct 31 14:41:47.697346 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2878/6001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:47 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:48.723856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:48.724535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:48.734008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:48.736389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:48.742883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:48.743725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:48.744573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:48.746225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:48.746720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:48.750891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:48.905373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:48.922465 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62987beb-c574-456a-9c0b-cc5499be98f4 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1272 microversion: 2.1 time: 0.200727 Oct 31 14:41:48.924384 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3124/6002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:48 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:49.950671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:49.951995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:49.955162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:49.964244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:49.966446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:49.967555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:49.968447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:49.969295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:49.970921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:50.266915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:50.280078 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-07e2dcea-24f6-48f4-9248-04cbc999512c tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.333703 Oct 31 14:41:50.318184 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2879/6003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:49 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:51.311082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:51.311701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:51.329480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:51.329981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:51.330444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:51.331337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:51.331944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:51.332521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:51.970260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49e54d89-375f-4882-8ccb-7fc5e9ee6cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'create', calling method: .version_select at 0x7fe1067c0670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1027735786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFtCIPEw29Mx7/Jr1l9U34VanuY+7eTPaSNeIh1ienNYOS2QEVon2j6ITao+i6swCg4ZpK9VF/EReG+Xbl3MIo95XFQZdDuH0TT5oF1dqTr5QReMkhgpiZCgAhdC6WiTw=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:52.014766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-49e54d89-375f-4882-8ccb-7fc5e9ee6cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for project e077e99d7ee747198ff0f8f042820619. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:41:52.041070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-49e54d89-375f-4882-8ccb-7fc5e9ee6cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for user fdc99c152a5446eda2f925f29a224c17 and project e077e99d7ee747198ff0f8f042820619. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:41:52.125110 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49e54d89-375f-4882-8ccb-7fc5e9ee6cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.159013 Oct 31 14:41:52.126012 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2880/6004] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:41:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:41:52.787382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:52.798425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58840112-4b1d-4dcd-be0c-c3af5508d9bc tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 1.491008 Oct 31 14:41:52.810406 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3125/6005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:51 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:53.520458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-258d4200-6415-444a-b5b9-c8d301706f7c req-0370c6f9-07b3-46af-a320-59a085f75f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4", "tag": "c441e10b-e0fd-4cb0-8ecd-8808a353c977"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:53.553722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-258d4200-6415-444a-b5b9-c8d301706f7c req-0370c6f9-07b3-46af-a320-59a085f75f1a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:53.556873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-258d4200-6415-444a-b5b9-c8d301706f7c req-0370c6f9-07b3-46af-a320-59a085f75f1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:53.557389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-258d4200-6415-444a-b5b9-c8d301706f7c req-0370c6f9-07b3-46af-a320-59a085f75f1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:53.596531 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-258d4200-6415-444a-b5b9-c8d301706f7c req-0370c6f9-07b3-46af-a320-59a085f75f1a service nova] Creating event network-changed:c441e10b-e0fd-4cb0-8ecd-8808a353c977 for instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 on n-h2-863052-1 Oct 31 14:41:53.619347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-258d4200-6415-444a-b5b9-c8d301706f7c req-0370c6f9-07b3-46af-a320-59a085f75f1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107382 Oct 31 14:41:53.622668 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2881/6006] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:41:53.828797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:53.829858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:53.842375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:53.843499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:53.844563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:53.845454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:53.846077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:53.846639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:54.699139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:54.708721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b8e5f99-db5a-4725-9c7c-145d2aa4b7aa tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.888894 Oct 31 14:41:54.722300 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3126/6007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:53 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:55.265690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-851178676", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "867cbc0b-9583-4bd5-b6cf-3bf6becd77da"}], "key_name": "tempest-TestNetworkBasicOps-1027735786", "security_groups": [{"name": "tempest-secgroup-smoke-413866120"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:55.455050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] validate_networks() for [('867cbc0b-9583-4bd5-b6cf-3bf6becd77da', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:41:55.735101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:55.736278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:55.741275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:55.746117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:55.763081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:55.767066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:55.769886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:55.770696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:55.771175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:55.771610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:56.036696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:56.058105 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8db1ed0-c7cc-4612-9a7c-2980d5671b37 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.324332 Oct 31 14:41:56.059565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3127/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:55 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:41:56.073939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-630676420", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "3eeb437c-7ff9-4e26-8ad5-73614c6fb659"}], "key_name": "tempest-TestNetworkAdvancedServerOps-578019658", "security_groups": [{"name": "tempest-secgroup-smoke-511193150"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:41:56.325853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] validate_networks() for [('3eeb437c-7ff9-4e26-8ad5-73614c6fb659', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:41:56.472479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:41:56.474975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:41:56.475577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:41:56.477303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:41:56.477887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:41:56.498007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:56.498731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:56.499394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:56.500363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:56.500976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:56.501922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:56.528261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for project e077e99d7ee747198ff0f8f042820619. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:41:56.536243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Getting quotas for user fdc99c152a5446eda2f925f29a224c17 and project e077e99d7ee747198ff0f8f042820619. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:41:56.552782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:41:56.555512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:41:56.616092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-780686d1-761e-44a0-9327-10c87a4c26d3 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.354949 Oct 31 14:41:56.625323 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2882/6009] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:41:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:41:56.631370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac05c8b3-ebfc-4f6b-9880-696400488952 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:56.633067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac05c8b3-ebfc-4f6b-9880-696400488952 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:56.749213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac05c8b3-ebfc-4f6b-9880-696400488952 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:56.760587 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac05c8b3-ebfc-4f6b-9880-696400488952 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1248 microversion: 2.1 time: 0.133523 Oct 31 14:41:56.761332 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2883/6010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:56 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1248 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:57.087848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:57.088719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:57.098405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:57.099318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:57.105608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:57.109065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:57.109572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:57.110016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:57.283857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:57.297997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9e7545e-e0ba-4b76-aa25-f853b07ec797 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.214104 Oct 31 14:41:57.314493 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2884/6011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:57 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:57.676023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:41:57.676951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:41:57.677591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:41:57.678160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:41:57.678773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:41:57.689136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:57.690286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:57.690925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:57.691831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:57.692440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:57.693048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:57.714621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:41:57.721191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:41:57.735835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:41:57.738636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:41:57.786954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:57.788320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:57.792772 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85e6dc75-52df-4d4b-8a85-2f1ccd68b370 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.730544 Oct 31 14:41:57.793753 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3128/6012] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:41:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:41:57.819868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:57.820720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20dab030-44f6-4b6b-89f6-b74912d7d0cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:57.821428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20dab030-44f6-4b6b-89f6-b74912d7d0cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:57.821594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:57.822455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:57.824969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:57.825743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:57.826327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:57.941154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20dab030-44f6-4b6b-89f6-b74912d7d0cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:57.953584 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20dab030-44f6-4b6b-89f6-b74912d7d0cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1265 microversion: 2.1 time: 0.148030 Oct 31 14:41:57.960394 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3129/6013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:57 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:57.963432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:57.982681 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25c1568f-6100-4b77-8e82-4cc002e34fed tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1300 microversion: 2.1 time: 0.201465 Oct 31 14:41:57.983612 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2885/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:57 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:58.320884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:58.321501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:58.327923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:58.328361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:58.329007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:58.329742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:58.330199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:58.330627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:58.668105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:58.692897 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e572f99f-0459-4dca-a354-ce0320782cf6 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.374900 Oct 31 14:41:58.695495 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3130/6015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:58 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:58.985743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:58.986380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:58.996919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:58.998309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:58.999037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:59.001171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:59.003303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:59.003938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:59.013985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:59.014985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:59.031815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:59.032327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:59.032772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:59.033492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:59.046956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:59.052172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:59.125091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:59.134777 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71c86103-a4e1-4f0c-87f0-f1715b7a4c79 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1317 microversion: 2.1 time: 0.153937 Oct 31 14:41:59.136171 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2886/6016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:58 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:41:59.152006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:41:59.169062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c8cd40f-6db9-4b99-b2f6-81bb5c73cb59 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1306 microversion: 2.1 time: 0.160711 Oct 31 14:41:59.182748 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3131/6017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:59 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1306 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:41:59.721695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:41:59.722352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:41:59.735407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:59.736162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:59.736770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:59.737659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:41:59.741224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:41:59.741521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:41:59.977684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-13e9fd84-62f7-4089-80dd-7528d9c652a3 req-e18fd4d9-33b0-4dec-b239-78485da16b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4", "name": "network-vif-plugged", "status": "completed", "tag": "c441e10b-e0fd-4cb0-8ecd-8808a353c977"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:00.009203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-13e9fd84-62f7-4089-80dd-7528d9c652a3 req-e18fd4d9-33b0-4dec-b239-78485da16b4b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:00.009709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-13e9fd84-62f7-4089-80dd-7528d9c652a3 req-e18fd4d9-33b0-4dec-b239-78485da16b4b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:00.010149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-13e9fd84-62f7-4089-80dd-7528d9c652a3 req-e18fd4d9-33b0-4dec-b239-78485da16b4b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:00.013144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:00.026092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f03d5a46-6053-4297-9ddb-b32e5ca88715 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.307113 Oct 31 14:42:00.038260 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2887/6018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:59 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:00.038435 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-13e9fd84-62f7-4089-80dd-7528d9c652a3 req-e18fd4d9-33b0-4dec-b239-78485da16b4b service nova] Creating event network-vif-plugged:c441e10b-e0fd-4cb0-8ecd-8808a353c977 for instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 on n-h2-863052-1 Oct 31 14:42:00.041710 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-13e9fd84-62f7-4089-80dd-7528d9c652a3 req-e18fd4d9-33b0-4dec-b239-78485da16b4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071178 Oct 31 14:42:00.042995 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3132/6019] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:00.159578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:00.160565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:00.167799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:00.168377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:00.168887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:00.170430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:00.170961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:00.171567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:00.193457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:00.194573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:00.200578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:00.201880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:00.202507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:00.203197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:00.203806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:00.204234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:00.242514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:00.252397 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d060c9b-0b8e-45ae-a154-9a1abd375a7d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1323 microversion: 2.1 time: 0.096708 Oct 31 14:42:00.252994 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2888/6020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:00 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:00.556957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:00.565242 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-334610a0-341d-4b24-8373-f716f2859cfd tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.376037 Oct 31 14:42:00.565741 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3133/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:00 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:01.057861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:01.058974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:01.077570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.078399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.079863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.081034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.081795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.082590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.148639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1c9e885d-851d-4863-bfd1-c92a69584422 req-a8f08d6e-3b32-4ba2-a8d6-b98bbd540a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998f6c08-bcb8-4dbb-9b98-983c73a8fb0d", "tag": "d0724ff1-8909-4910-aaec-baccf770a3c4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:01.170803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1c9e885d-851d-4863-bfd1-c92a69584422 req-a8f08d6e-3b32-4ba2-a8d6-b98bbd540a4f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.172886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1c9e885d-851d-4863-bfd1-c92a69584422 req-a8f08d6e-3b32-4ba2-a8d6-b98bbd540a4f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.174395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1c9e885d-851d-4863-bfd1-c92a69584422 req-a8f08d6e-3b32-4ba2-a8d6-b98bbd540a4f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.197498 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1c9e885d-851d-4863-bfd1-c92a69584422 req-a8f08d6e-3b32-4ba2-a8d6-b98bbd540a4f service nova] Creating event network-changed:d0724ff1-8909-4910-aaec-baccf770a3c4 for instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d on n-h1-863052-1 Oct 31 14:42:01.213766 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1c9e885d-851d-4863-bfd1-c92a69584422 req-a8f08d6e-3b32-4ba2-a8d6-b98bbd540a4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069256 Oct 31 14:42:01.214470 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3134/6022] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:42:01.277383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:01.278100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:01.290096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.290820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.291471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.295630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.296318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.296925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.353178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:01.366465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4664abfe-e69b-4651-8c82-ae9ecf2ea739 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1314 microversion: 2.1 time: 0.315698 Oct 31 14:42:01.378835 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2889/6023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:01 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:01.590955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:01.594638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:01.603294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.604468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.605199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.606258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:01.607776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:01.608367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:01.742786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:01.756503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fbc8088-a48b-4074-8cbe-659bbc135291 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1390 microversion: 2.1 time: 0.483963 Oct 31 14:42:01.757387 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3135/6024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:01 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1390 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:01.760371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:01.768757 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b946293-807e-48bc-94c0-380545e693ca tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.182125 Oct 31 14:42:01.772080 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2890/6025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:01 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:02.390335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:02.390982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:02.397778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:02.398556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:02.398970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:02.399681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:02.400301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:02.400731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:02.648762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:02.656879 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a5067c9-f9bd-478f-8256-614cebde7b0b tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1464 microversion: 2.1 time: 0.270875 Oct 31 14:42:02.657453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3136/6026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:02 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1464 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:02.680444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b267360-51c5-40dc-9cfc-3eaf2575011b", "device": "/dev/sdb"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:02.682994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:02.690635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:02.691064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:02.691506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:02.692277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:02.692742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:02.693171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:02.780996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:02.781623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:02.790292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:02.790799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:02.791535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:02.792255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:02.792713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:02.793143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:02.974690 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc7fdebf-397e-4e1e-9c87-3943e2cc4d01 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "POST /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297017 Oct 31 14:42:02.978298 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2891/6027] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 14:42:02 2022] POST /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:02.986380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:02.987325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:02.999699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:03.001620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:03.002378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:03.003743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:03.004702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:03.005394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:03.214638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:03.223531 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c5fc68d9-1448-49aa-a90a-dd9b4aa62be5 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.243459 Oct 31 14:42:03.231127 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2892/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:02 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:03.306855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c6e93ae3-d4b9-4aa5-885f-807e4a617934 req-07d54032-cd65-4bc5-9bd7-a072e6b1d16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:03.317759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c6e93ae3-d4b9-4aa5-885f-807e4a617934 req-07d54032-cd65-4bc5-9bd7-a072e6b1d16e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:03.318494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c6e93ae3-d4b9-4aa5-885f-807e4a617934 req-07d54032-cd65-4bc5-9bd7-a072e6b1d16e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:03.319187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c6e93ae3-d4b9-4aa5-885f-807e4a617934 req-07d54032-cd65-4bc5-9bd7-a072e6b1d16e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:03.350783 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c6e93ae3-d4b9-4aa5-885f-807e4a617934 req-07d54032-cd65-4bc5-9bd7-a072e6b1d16e service nova] Creating event network-changed:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h2-863052-1 Oct 31 14:42:03.357632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c6e93ae3-d4b9-4aa5-885f-807e4a617934 req-07d54032-cd65-4bc5-9bd7-a072e6b1d16e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055194 Oct 31 14:42:03.358833 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2893/6029] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:03.423325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:03.440575 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c02eab7-9ef7-4701-8a6c-c1c4fc271a87 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1390 microversion: 2.1 time: 0.664916 Oct 31 14:42:03.443757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3137/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:02 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1390 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:04.249809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:04.250372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:04.258057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:04.258642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:04.259443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:04.260469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:04.261257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:04.261850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:04.427640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:04.437206 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-075a7972-f02a-4522-b800-78fddae18889 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.192286 Oct 31 14:42:04.438565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2894/6031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:04 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:04.467673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:04.469454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:04.478894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:04.479936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:04.481187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:04.482512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:04.483575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:04.484726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:04.731097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:04.743138 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70d80d5b-7cca-4cbe-8892-7ab4f1cc0689 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1390 microversion: 2.1 time: 0.280032 Oct 31 14:42:04.758957 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3138/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:04 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:05.461088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:05.462388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:05.480936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:05.482570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:05.485065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:05.495183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:05.495903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:05.496495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:05.706043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:05.718224 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c20909c8-e898-4532-9ac5-cd1f73f5be9f tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.260869 Oct 31 14:42:05.719450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2895/6033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:05 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:05.769050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:05.769994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:05.779999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:05.781186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:05.781642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:05.785081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:05.785579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:05.786043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:05.948375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:05.959588 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19f90cd3-7eaa-4b02-8f9e-210a33480957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1390 microversion: 2.1 time: 0.194939 Oct 31 14:42:05.961260 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3139/6034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:05 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1390 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:06.742627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:06.744365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:06.752481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:06.754975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:06.755856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:06.756506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:06.757586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:06.758293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:06.758727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:06.759560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=18 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:06.925347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:06.937073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9daded51-9a00-416a-b961-d6568d29dacc tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.198232 Oct 31 14:42:06.937073 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2896/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:06 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:06.986795 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:06.987538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:06.994522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:06.994939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:06.995387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:06.996205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:06.996655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:06.997076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:07.136667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:07.145366 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3c137c5-a6e8-4ff9-8d9e-16bece4c6b01 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1390 microversion: 2.1 time: 0.162478 Oct 31 14:42:07.145943 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3140/6036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:06 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:07.479771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9ff5e7af-2ae9-4769-a175-54d93c37eb6f req-a26d7a24-99b5-49c1-86d4-6c6f2bffb8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "name": "network-vif-plugged", "status": "completed", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:07.506662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9ff5e7af-2ae9-4769-a175-54d93c37eb6f req-a26d7a24-99b5-49c1-86d4-6c6f2bffb8cd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:07.508167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9ff5e7af-2ae9-4769-a175-54d93c37eb6f req-a26d7a24-99b5-49c1-86d4-6c6f2bffb8cd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:07.509240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9ff5e7af-2ae9-4769-a175-54d93c37eb6f req-a26d7a24-99b5-49c1-86d4-6c6f2bffb8cd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:07.520009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:07.534658 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9ff5e7af-2ae9-4769-a175-54d93c37eb6f req-a26d7a24-99b5-49c1-86d4-6c6f2bffb8cd service nova] Creating event network-vif-plugged:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h2-863052-1 Oct 31 14:42:07.542831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9ff5e7af-2ae9-4769-a175-54d93c37eb6f req-a26d7a24-99b5-49c1-86d4-6c6f2bffb8cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065508 Oct 31 14:42:07.545142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2897/6037] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:07.960967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:07.961879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:07.968083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:07.969387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:07.971567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:07.972390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:07.973138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:07.974234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:07.974990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:07.975957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:08.135095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:08.144501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c404b26-50c7-4ffc-b372-27dc69147639 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.187391 Oct 31 14:42:08.145348 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3141/6038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:07 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:08.169968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:08.171303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:08.179312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:08.180030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:08.180628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:08.181513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:08.182132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:08.182756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:08.365721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:08.374358 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e4d82e66-56b5-49ea-8639-9ff598e617f3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1390 microversion: 2.1 time: 0.208598 Oct 31 14:42:08.378228 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2898/6039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:08 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:09.168864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:09.170099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:09.179015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.180273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.180714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.181415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.181863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.182313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.334384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:09.353616 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6961d47f-1a08-429a-8cce-81d30abf86f9 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.188568 Oct 31 14:42:09.354235 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3142/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:09 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:09.400343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:09.400959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:09.408669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.409165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.409601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.410368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.410819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.411253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.562526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a6c3ffd4-03d0-4c95-a97b-542b32020f2b req-7d2ae32d-8f9b-4acf-bef6-0cdc907bd220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998f6c08-bcb8-4dbb-9b98-983c73a8fb0d", "name": "network-vif-plugged", "status": "completed", "tag": "d0724ff1-8909-4910-aaec-baccf770a3c4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:09.570592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:09.572865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6c3ffd4-03d0-4c95-a97b-542b32020f2b req-7d2ae32d-8f9b-4acf-bef6-0cdc907bd220 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.573424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6c3ffd4-03d0-4c95-a97b-542b32020f2b req-7d2ae32d-8f9b-4acf-bef6-0cdc907bd220 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.573952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6c3ffd4-03d0-4c95-a97b-542b32020f2b req-7d2ae32d-8f9b-4acf-bef6-0cdc907bd220 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.581878 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-958680e5-8892-46c9-8b24-e13130cb6b77 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1563 microversion: 2.1 time: 0.186983 Oct 31 14:42:09.598670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2899/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:09 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:09.598845 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a6c3ffd4-03d0-4c95-a97b-542b32020f2b req-7d2ae32d-8f9b-4acf-bef6-0cdc907bd220 service nova] Creating event network-vif-plugged:d0724ff1-8909-4910-aaec-baccf770a3c4 for instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d on n-h1-863052-1 Oct 31 14:42:09.599028 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a6c3ffd4-03d0-4c95-a97b-542b32020f2b req-7d2ae32d-8f9b-4acf-bef6-0cdc907bd220 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041555 Oct 31 14:42:09.599995 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3143/6042] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:09.605853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:09.606828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:09.613285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.613783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.614243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.614977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:09.615430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:09.616034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:09.806136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:09.815208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ca9b7ef-1115-4488-8108-7c76497a3089 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1563 microversion: 2.1 time: 0.214003 Oct 31 14:42:09.816219 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2900/6043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:09 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:10.382131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:10.382740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:10.392341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:10.393029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:10.393613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:10.394612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:10.395232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:10.395805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:10.430803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:10.559404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:10.572698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bcaa4fc-3c10-4f1a-b765-cc6ff1f62a34 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1373 microversion: 2.1 time: 0.195567 Oct 31 14:42:10.574526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3144/6044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:10 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:11.597583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:11.598772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:11.606250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:11.607750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:11.608346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:11.609211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:11.609822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:11.610447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:11.857282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:11.871744 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cba45f79-4b48-4078-9ba2-d632f8902bea tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1544 microversion: 2.1 time: 0.278254 Oct 31 14:42:11.874357 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2901/6045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:11 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1544 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:11.897325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:11.897943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:11.905694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:11.906210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:11.906819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:11.907709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:11.908328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:11.908753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:11.929489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:11.930333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:11.939087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:11.939582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:11.940021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:11.940718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:11.943580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:11.947196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:12.123429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:12.133792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29075711-c45f-4ba8-a0b3-9cc105dca478 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1544 microversion: 2.1 time: 0.240201 Oct 31 14:42:12.146708 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3145/6046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:11 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1544 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:12.157966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-23b9d866-6329-4d5a-bd17-38c34d898989 req-faa833b9-fc3c-409c-8f11-d8f56e14436c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:12.178093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23b9d866-6329-4d5a-bd17-38c34d898989 req-faa833b9-fc3c-409c-8f11-d8f56e14436c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:12.178593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:12.180622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23b9d866-6329-4d5a-bd17-38c34d898989 req-faa833b9-fc3c-409c-8f11-d8f56e14436c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:12.183439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23b9d866-6329-4d5a-bd17-38c34d898989 req-faa833b9-fc3c-409c-8f11-d8f56e14436c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:12.191633 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-265986ce-0215-4032-9e19-a0ec398bcba2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1563 microversion: 2.1 time: 0.265136 Oct 31 14:42:12.192530 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2902/6047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:11 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1563 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:12.206489 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-23b9d866-6329-4d5a-bd17-38c34d898989 req-faa833b9-fc3c-409c-8f11-d8f56e14436c service nova] Creating event network-changed:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h2-863052-1 Oct 31 14:42:12.233760 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-23b9d866-6329-4d5a-bd17-38c34d898989 req-faa833b9-fc3c-409c-8f11-d8f56e14436c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085000 Oct 31 14:42:12.235136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3146/6048] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:14.712141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e979a5e5-4dfd-4d03-9780-3971c08b4595 req-83ca2602-ac44-418d-8ed8-bedc30346da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998f6c08-bcb8-4dbb-9b98-983c73a8fb0d", "tag": "d0724ff1-8909-4910-aaec-baccf770a3c4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:14.727644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e979a5e5-4dfd-4d03-9780-3971c08b4595 req-83ca2602-ac44-418d-8ed8-bedc30346da5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:14.728792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e979a5e5-4dfd-4d03-9780-3971c08b4595 req-83ca2602-ac44-418d-8ed8-bedc30346da5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:14.729680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e979a5e5-4dfd-4d03-9780-3971c08b4595 req-83ca2602-ac44-418d-8ed8-bedc30346da5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:14.753609 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e979a5e5-4dfd-4d03-9780-3971c08b4595 req-83ca2602-ac44-418d-8ed8-bedc30346da5 service nova] Creating event network-changed:d0724ff1-8909-4910-aaec-baccf770a3c4 for instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d on n-h1-863052-1 Oct 31 14:42:14.781006 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e979a5e5-4dfd-4d03-9780-3971c08b4595 req-83ca2602-ac44-418d-8ed8-bedc30346da5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070171 Oct 31 14:42:14.782358 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2903/6049] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:34.693431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:34.695280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=11 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:34.701679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:34.704232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:34.712265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:34.713393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:34.714008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:34.715944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:34.716570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:34.717348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:34.787895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3e5d48f-56b7-44c7-af43-e83e7733ad4e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action" status: 200 len: 24571 microversion: 2.1 time: 0.096248 Oct 31 14:42:34.788582 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3147/6050] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:42:34 2022] POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action => generated 24571 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:42:35.094753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:35.098391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:35.107839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:35.108857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=32 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:35.110804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:35.112047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:35.112626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:35.113875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:35.114586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:35.115584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:35.188547 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ce44281a-c8d4-4736-8815-637b3f85ed0d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d/action" status: 200 len: 24550 microversion: 2.1 time: 0.093428 Oct 31 14:42:35.189535 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2904/6051] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:42:35 2022] POST /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d/action => generated 24550 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:42:38.788366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5608375-7c8c-4f6c-a69e-47df7e40726a tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-23101735", "availability_zone": "foo_zone"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:38.795076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.aggregate [None req-c5608375-7c8c-4f6c-a69e-47df7e40726a tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Generated uuid d7962bc9-a792-41a0-835c-9ea825de303e for aggregate {{(pid=120640) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 14:42:38.833453 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5608375-7c8c-4f6c-a69e-47df7e40726a tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.231562 Oct 31 14:42:38.842489 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3148/6052] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 31 14:42:38 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:42:38.853010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7126f022-83fb-4181-95ed-a9e2842b2d01 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:38.918034 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7126f022-83fb-4181-95ed-a9e2842b2d01 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.073357 Oct 31 14:42:38.922973 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2905/6053] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:42:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:38.931953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:38.937196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:38.938094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:38.938569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:38.939493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:38.940122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:38.940741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:38.973114 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68a3a875-d93f-44dc-819b-8ba2fdc311c7 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044837 Oct 31 14:42:38.985955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-66c84eff-c955-493b-af19-6cdd23baca29 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:38.991953 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3149/6054] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 31 14:42:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:38.995459 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-66c84eff-c955-493b-af19-6cdd23baca29 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.013005 Oct 31 14:42:39.008568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fbdb127-183f-499e-bde1-c9b894b92534 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863052-1"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:39.012876 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2906/6055] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 31 14:42:38 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:39.020022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbdb127-183f-499e-bde1-c9b894b92534 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:39.020760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbdb127-183f-499e-bde1-c9b894b92534 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:39.022686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fbdb127-183f-499e-bde1-c9b894b92534 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:39.475103 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fbdb127-183f-499e-bde1-c9b894b92534 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 0.470210 Oct 31 14:42:39.475893 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3150/6056] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:42:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:39.487159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd2278ed-7ae2-4f1a-9a18-02d537c41a8d tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:39.499752 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd2278ed-7ae2-4f1a-9a18-02d537c41a8d tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.016061 Oct 31 14:42:39.501625 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2907/6057] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:42:39 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:39.513146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58f254c0-fbe5-4934-98b7-cc4fc64e3b5a tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-717479893", "availability_zone": "foo_zone"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:39.643539 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58f254c0-fbe5-4934-98b7-cc4fc64e3b5a tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.134135 Oct 31 14:42:39.651298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3151/6058] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 31 14:42:39 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:39.656754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac9526fb-eb0d-40dd-bcc6-aa7488effe5f tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:39.696029 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac9526fb-eb0d-40dd-bcc6-aa7488effe5f tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.043789 Oct 31 14:42:39.696639 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2908/6059] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:42:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:42:39.708314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2baf3a9b-592d-4ac0-b211-8b0319b13049 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:39.719748 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2baf3a9b-592d-4ac0-b211-8b0319b13049 tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.015280 Oct 31 14:42:39.720496 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3152/6060] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 31 14:42:39 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:39.733238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37dcbfb7-6b29-46a5-ab7a-7094a888f0fc tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863052-1"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:39.743849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37dcbfb7-6b29-46a5-ab7a-7094a888f0fc tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:39.744336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37dcbfb7-6b29-46a5-ab7a-7094a888f0fc tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:39.744773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37dcbfb7-6b29-46a5-ab7a-7094a888f0fc tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:39.938929 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37dcbfb7-6b29-46a5-ab7a-7094a888f0fc tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.210109 Oct 31 14:42:39.945975 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2909/6061] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 31 14:42:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:39.951421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60a15c78-15b5-477e-8959-66bd25dacb0c tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:39.975150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60a15c78-15b5-477e-8959-66bd25dacb0c tempest-TestAggregatesBasicOps-651467264 tempest-TestAggregatesBasicOps-651467264-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.027900 Oct 31 14:42:39.976445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3153/6062] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 31 14:42:39 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 14:42:45.786775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:45.787503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:45.813055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:45.813847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:45.814471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:45.815348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:45.815951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:45.816537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.149402 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82245a8c-c5e2-48a7-9e42-719a5ba3e121 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1832 microversion: 2.1 time: 0.367149 Oct 31 14:42:46.162798 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2910/6063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:45 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1832 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:46.178988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:46.179864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:46.203935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.205819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.208568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.209331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.211261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.212158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.350458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:46.352763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:46.363198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.363930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.365384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.366332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.366789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.367208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.428306 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c84a3b2-d571-4f2c-bd27-1f2349f3c24b tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "POST /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d/action" status: 200 len: 32625 microversion: 2.1 time: 0.081645 Oct 31 14:42:46.428890 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2911/6064] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:42:46 2022] POST /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d/action => generated 32625 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:42:46.512776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:46.521554 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6dea7153-2f4f-4c30-962e-40be067d4957 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1681 microversion: 2.1 time: 0.347869 Oct 31 14:42:46.522710 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3154/6065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:46 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:46.686724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:46.689403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:46.709212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.709710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.710147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.710884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.711335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.711778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.810360 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78a62f11-f598-4e05-a7cb-1a29b754e5f1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action" status: 200 len: 32643 microversion: 2.1 time: 0.128453 Oct 31 14:42:46.818450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2912/6066] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:42:46 2022] POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action => generated 32643 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:42:46.962816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:46.963330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:46.977545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.978061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.978551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:46.979275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:46.979730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:46.987241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:47.061766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a67f9a310fa848019dc4f5c07822c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abb981762a642cc85d24493441e6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:47.063218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 954a7481-74a0-4504-a043-c95032148be7] flavor_id is None. Assuming migration. {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 31 14:42:47.064201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 954a7481-74a0-4504-a043-c95032148be7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:42:47.387900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02feea1a-10f0-4a6c-9062-d06e77b7725e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action" status: 202 len: 0 microversion: 2.1 time: 0.429481 Oct 31 14:42:47.400958 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3155/6067] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:42:46 2022] POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:42:47.408286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:47.409782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:47.425281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:47.431195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:47.431697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:47.434703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:47.435835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:47.437486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:47.856760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:47.865067 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9263821f-4430-4e50-b09b-773cb743b5a9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1690 microversion: 2.1 time: 0.462825 Oct 31 14:42:47.867190 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2913/6068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:47 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1690 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:48.488435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4236752c-7aa1-4775-93f9-3a8b09906a00 req-b137d119-f093-4a67-9d8b-1a92a01008b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998f6c08-bcb8-4dbb-9b98-983c73a8fb0d", "tag": "d0724ff1-8909-4910-aaec-baccf770a3c4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:48.489637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:48.490512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:48.506853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.509821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.510684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:48.513537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4236752c-7aa1-4775-93f9-3a8b09906a00 req-b137d119-f093-4a67-9d8b-1a92a01008b0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.514053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.514581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.515025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:48.517704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4236752c-7aa1-4775-93f9-3a8b09906a00 req-b137d119-f093-4a67-9d8b-1a92a01008b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.518271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4236752c-7aa1-4775-93f9-3a8b09906a00 req-b137d119-f093-4a67-9d8b-1a92a01008b0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:48.542311 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4236752c-7aa1-4775-93f9-3a8b09906a00 req-b137d119-f093-4a67-9d8b-1a92a01008b0 service nova] Creating event network-changed:d0724ff1-8909-4910-aaec-baccf770a3c4 for instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d on n-h1-863052-1 Oct 31 14:42:48.555892 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4236752c-7aa1-4775-93f9-3a8b09906a00 req-b137d119-f093-4a67-9d8b-1a92a01008b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074477 Oct 31 14:42:48.557492 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2914/6069] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:48.573572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:42:48.742222 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16421ce6-96a2-40f9-9be5-86a8a2120ce4 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 204 len: 0 microversion: 2.1 time: 0.268163 Oct 31 14:42:48.747667 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3156/6070] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:42:48 2022] DELETE /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:42:48.752827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:48.753736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:48.768321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.769548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.770253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:48.771272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.772031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.772602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:48.890434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:48.891302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:48.928716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.929287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.929744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:48.937868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:48.940560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:48.941260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:49.004203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:49.009964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:49.020637 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1cdc6d9-3c4d-49cc-86d3-156033db6f8d tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1669 microversion: 2.1 time: 0.271892 Oct 31 14:42:49.021565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2915/6071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:48 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:49.278103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:49.291964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62026dd8-dbde-47ba-9b0a-567fd233215e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1690 microversion: 2.1 time: 0.403487 Oct 31 14:42:49.316155 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3157/6072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:48 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1690 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:50.048954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:50.054266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:50.082738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:50.095941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:50.096534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:50.107442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:50.107442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:50.107442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:50.312300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:50.313477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:50.320811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:50.321525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:50.321974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:50.322721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:50.323201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:50.323924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:50.384398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc99c152a5446eda2f925f29a224c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077e99d7ee747198ff0f8f042820619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:50.393979 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d558a42f-1727-4c94-8bb3-282e8d876cf8 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 200 len: 1669 microversion: 2.1 time: 0.353390 Oct 31 14:42:50.406310 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2916/6073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:50 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 1669 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:50.486933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:50.503979 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a3a3133-b667-47b5-9cbc-7c63871304ec tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1690 microversion: 2.1 time: 0.195945 Oct 31 14:42:50.506611 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3158/6074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:50 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:42:50.699506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d74100ac-eab0-4848-a92e-3e7e7aaf5e96 req-b76ffc98-d5e7-4e01-9b39-b4dbdbfe1aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998f6c08-bcb8-4dbb-9b98-983c73a8fb0d", "name": "network-vif-deleted", "tag": "d0724ff1-8909-4910-aaec-baccf770a3c4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:50.713098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d74100ac-eab0-4848-a92e-3e7e7aaf5e96 req-b76ffc98-d5e7-4e01-9b39-b4dbdbfe1aff service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:50.714404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d74100ac-eab0-4848-a92e-3e7e7aaf5e96 req-b76ffc98-d5e7-4e01-9b39-b4dbdbfe1aff service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:50.715008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d74100ac-eab0-4848-a92e-3e7e7aaf5e96 req-b76ffc98-d5e7-4e01-9b39-b4dbdbfe1aff service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:50.732506 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d74100ac-eab0-4848-a92e-3e7e7aaf5e96 req-b76ffc98-d5e7-4e01-9b39-b4dbdbfe1aff service nova] Creating event network-vif-deleted:d0724ff1-8909-4910-aaec-baccf770a3c4 for instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d on n-h1-863052-1 Oct 31 14:42:50.738702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d74100ac-eab0-4848-a92e-3e7e7aaf5e96 req-b76ffc98-d5e7-4e01-9b39-b4dbdbfe1aff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044110 Oct 31 14:42:50.742633 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2917/6075] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:51.420269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:51.421010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] [instance: 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:51.428178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:51.428754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:51.429288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:51.430051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:51.430667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:51.431193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:51.444658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] HTTP exception thrown: Instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d could not be found. Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Request method failure captured: Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d HTTP/1.1 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX94qXEZb9fCMlEv77nFjs53D-T5N2cgh4FIiAcfQBBVDdMJ2U6UreDOe-uj93VNBihFmqB2ePULh2rMwOlraQJbFghsh8q7f40wV3zVz8vHj0DsT19gS7qTUd_180rxdx1eG6u-XrlGB5O9L1SbvttQbQbd6RGq07Hmf5WxXZew_w-Q Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: e077e99d7ee747198ff0f8f042820619 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestNetworkBasicOps-613101656 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e077e99d7ee747198ff0f8f042820619", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e077e99d7ee747198ff0f8f042820619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestNetworkBasicOps-613101656 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: e077e99d7ee747198ff0f8f042820619 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestNetworkBasicOps-613101656 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestNetworkBasicOps-613101656-project Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: fdc99c152a5446eda2f925f29a224c17 Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestNetworkBasicOps-613101656-project Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d could not be found. Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '998f6c08-bcb8-4dbb-9b98-983c73a8fb0d'} Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d could not be found. Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d could not be found. Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:42:51.446436 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d could not be found. Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Returning 404 to user: Instance 998f6c08-bcb8-4dbb-9b98-983c73a8fb0d could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:42:51.451606 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6208bf0e-fe30-4d02-b146-f080d6193d6e tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d" status: 404 len: 111 microversion: 2.1 time: 0.033541 Oct 31 14:42:51.452211 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3159/6076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:51 2022] GET /compute/v2.1/servers/998f6c08-bcb8-4dbb-9b98-983c73a8fb0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:42:51.533770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:51.534831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:51.542692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:51.543971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:51.544667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:51.545620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:51.546684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:51.547449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:51.697751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9255d2d-ffb8-4294-b745-3ce361d6cdb0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] Calling method '.version_select at 0x7fe10659a9d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:51.724515 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9255d2d-ffb8-4294-b745-3ce361d6cdb0 tempest-TestNetworkBasicOps-613101656 tempest-TestNetworkBasicOps-613101656-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1027735786" status: 202 len: 0 microversion: 2.1 time: 0.030549 Oct 31 14:42:51.725051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:51.726575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3160/6077] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 31 14:42:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1027735786 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:42:51.742032 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43b66ba7-4935-4eb0-bcd4-89ec95f3f249 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.213965 Oct 31 14:42:51.742957 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2918/6078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:51 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:52.773466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:52.774714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:52.783072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:52.783756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:52.784254 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:52.785028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:52.785555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:52.786207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:53.055494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:53.066431 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fbfd57ce-7905-49f5-ac5e-4ea607ab07fe tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.300774 Oct 31 14:42:53.068180 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3161/6079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:52 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:54.091947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:54.093155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:54.100740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:54.101523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:54.102131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:54.103111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:54.103727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:54.104317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:54.858645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:54.867925 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0368305e-799a-4c35-9d72-21aed979273f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.780246 Oct 31 14:42:54.868509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2919/6080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:54 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:55.895122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:55.895741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:55.902613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:55.903105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:55.903537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:55.904235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:55.904690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:55.905108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:56.047233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:56.057217 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d789e7a-5134-4a1b-930b-4581aea44d51 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.165977 Oct 31 14:42:56.058029 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3162/6081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:55 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:57.080720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:57.081609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:57.088741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:57.089366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:57.089898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:57.090714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:57.091378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:57.091872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:57.250225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:57.259030 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e84f9c2-cd99-4554-bb7a-872f18d96985 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.182103 Oct 31 14:42:57.259716 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2920/6082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:57 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:58.291000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:58.291676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:58.299831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:58.300330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:58.300982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:58.301694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:58.302283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:58.302817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:58.628752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22363b48-eda3-43d4-89fb-e624b0c3b00d tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Action: 'create', calling method: .version_select at 0x7fe106bbd9d0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2061979115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKAJ38EDSgluW5slHDMmNDnBF6qfFsbiWtDiPf4EaTC45mYiMIhPBTiyC0qk343GJe5Z/LSBO1WbPExs4pRkiccpGTK3aFzqs8DuKj2x2stqO+7qboqbxaOiYmPHZ41UA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:42:58.645868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-22363b48-eda3-43d4-89fb-e624b0c3b00d tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Getting quotas for project cf512bf0ede741c88382c50d2f738ca8. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:42:58.652060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-22363b48-eda3-43d4-89fb-e624b0c3b00d tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Getting quotas for user 15e44d70cbfb4347ae225d48d75d128c and project cf512bf0ede741c88382c50d2f738ca8. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:42:58.679618 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22363b48-eda3-43d4-89fb-e624b0c3b00d tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.256679 Oct 31 14:42:58.680473 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2921/6083] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:42:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:42:58.688359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:42:58.696433 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2429ebe2-840c-4c2d-8c20-cf7e6fa21d61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.415461 Oct 31 14:42:58.697209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3163/6084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:58 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:42:59.723392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:42:59.723878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:42:59.731378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:59.731883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:59.732333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:42:59.733087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:42:59.733573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:42:59.734010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:00.024107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:00.032772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cec522b5-6cbf-41a9-ae97-c52bc8f028df tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.313400 Oct 31 14:43:00.033643 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2922/6085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:42:59 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:01.060937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:01.062350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:01.071705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:01.072347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:01.073033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:01.074047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:01.074857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:01.075504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:01.322820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:01.340866 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e9e0f34-954c-4ade-bf40-e9e72607747f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.285794 Oct 31 14:43:01.342587 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3164/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:01 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:02.368448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:02.369245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:02.379698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:02.380317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:02.382896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:02.383641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:02.384112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:02.384544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:02.836574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:02.863098 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9de73fec-ec4a-4e1c-a1f8-ba4217a3c4ab tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1695 microversion: 2.1 time: 0.499824 Oct 31 14:43:02.864038 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2923/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:02 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1695 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:03.889060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:03.889590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:03.896825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:03.897561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:03.898205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:03.899130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:03.899760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:03.906328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:04.100768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:04.112211 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30872d63-93c1-4246-be90-2181829e1701 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1694 microversion: 2.1 time: 0.226029 Oct 31 14:43:04.113027 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3165/6088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:03 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:04.739230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "name": "network-vif-unplugged", "status": "completed", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:04.757920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:04.758619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:04.759054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:04.771938 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] Creating event network-vif-unplugged:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h1-863052-1 Oct 31 14:43:04.778949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] Instance 954a7481-74a0-4504-a043-c95032148be7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:43:04.796597 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-aeb83e19-a13f-40bd-9fb4-8a4fe7ac2c6c req-a3a5c3cc-4145-4d9a-9737-c52ad9c5a1a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060998 Oct 31 14:43:04.797864 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2924/6089] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:05.136847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:05.137471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:05.143689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:05.145129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:05.145621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:05.146063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:05.146798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:05.147433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:05.148092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:05.153672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:05.353875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:05.362813 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d63d2608-a37f-4706-8679-5f92b110e3dc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1694 microversion: 2.1 time: 0.229771 Oct 31 14:43:05.366994 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3166/6090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:05 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1694 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:06.059845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2056936928-access_point-385330763", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "7c9a6b2c-5005-4f62-8cd2-8986e7fa1647"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2061979115", "security_groups": [{"name": "tempest-secgroup_access--1377110551"}, {"name": "tempest-secgroup_general--1520959823"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:06.081805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:06.395377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:06.396042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:06.410260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:06.410755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:06.411412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:06.412976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:06.414603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:06.415372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:06.515267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] validate_networks() for [('7c9a6b2c-5005-4f62-8cd2-8986e7fa1647', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:43:06.636623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:06.652521 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88a06442-fc6e-4933-a3d3-64e9481b5cb5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1694 microversion: 2.1 time: 0.267106 Oct 31 14:43:06.667636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3167/6091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:06 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1694 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:07.193916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:07.211442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:07.212019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:07.212518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:07.242008 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] Creating event network-changed:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h1-863052-1 Oct 31 14:43:07.256242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] Instance 954a7481-74a0-4504-a043-c95032148be7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:43:07.281575 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4f96179f-2826-4650-b032-f3e8ce914add req-2c664ed1-dc0c-451a-9218-ba5e6e8f803a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091114 Oct 31 14:43:07.282350 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3168/6092] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:43:07.681286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:07.682932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:07.693467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:07.702392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:07.703399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:07.704855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:07.708097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:07.708792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:08.166753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:43:08.168259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:43:08.168431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:43:08.169018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:43:08.169591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:43:08.190997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:08.198494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:08.198956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:08.200414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:08.200888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:08.201317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:08.210261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=79 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:08.250584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:08.259545 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9885c69-92d4-466d-9f3a-6e2c22828a3d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1692 microversion: 2.1 time: 0.584923 Oct 31 14:43:08.274918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3169/6093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:07 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1692 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:43:08.280451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Getting quotas for project cf512bf0ede741c88382c50d2f738ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:43:08.293738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Getting quotas for user 15e44d70cbfb4347ae225d48d75d128c and project cf512bf0ede741c88382c50d2f738ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:43:08.322729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:43:08.325445 n-d-863052-1 devstack@n-api.service[120641]: WARNING nova.utils [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-2056936928-access_point-385330763 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-2056936928-ac Oct 31 14:43:08.327533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:43:08.413086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a34552f-4e07-4919-8154-57ae7a087120 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.358895 Oct 31 14:43:08.415013 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2925/6094] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:43:06 2022] POST /compute/v2.1/servers => generated 458 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:43:08.435618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5dd599c-d5f7-4880-a109-a23c95ab7cc7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:08.436548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5dd599c-d5f7-4880-a109-a23c95ab7cc7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:08.548447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5dd599c-d5f7-4880-a109-a23c95ab7cc7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:08.559238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5dd599c-d5f7-4880-a109-a23c95ab7cc7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1294 microversion: 2.1 time: 0.135683 Oct 31 14:43:08.563896 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3170/6095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:08 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1294 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:09.311740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:09.312399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:09.329738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:09.348970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:09.349432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:09.350241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:09.350700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:09.351140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:09.584558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:09.586524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:09.610091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:09.610512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:09.613392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:09.614120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:09.626616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:09.627098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:09.759505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:09.773216 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27c0a3c9-84d9-480c-8620-c08cb42ea5f7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1346 microversion: 2.1 time: 0.192220 Oct 31 14:43:09.783265 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3171/6096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:09 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1346 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:09.805068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:09.813527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0879aad8-6244-4ea5-a02a-6b793369d631 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1692 microversion: 2.1 time: 0.532897 Oct 31 14:43:09.818225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2926/6097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:09 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1692 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:10.473814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:10.474358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:10.481243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:10.481725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:10.482157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:10.482874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:10.483327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:10.483749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:10.565530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lazy-loading 'services' on Instance uuid a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:43:10.646487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff970dd4-69d6-4faa-a744-ec36ea4e3c63 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4/os-volume_attachments/3b267360-51c5-40dc-9cfc-3eaf2575011b" status: 202 len: 0 microversion: 2.1 time: 0.176574 Oct 31 14:43:10.647383 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3172/6098] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 14:43:10 2022] DELETE /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4/os-volume_attachments/3b267360-51c5-40dc-9cfc-3eaf2575011b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:43:10.799834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:10.800452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:10.807612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:10.808105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:10.808545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:10.809460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:10.809674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:10.810102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:10.840333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:10.841411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:10.849850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:10.850811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:10.852038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:10.852976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:10.853893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:10.854934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:10.978995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:10.987700 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3dd3183-5534-40e6-8356-030c058f3f23 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.191633 Oct 31 14:43:10.988303 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2927/6099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:10 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:11.200620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:11.208902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e3f28d11-fc32-459c-b246-12a648cc2edb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1689 microversion: 2.1 time: 0.374869 Oct 31 14:43:11.209571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3173/6100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:10 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1689 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:11.232682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:11.233154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:11.239294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:11.239780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:11.240220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:11.240911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:11.241365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:11.241790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:11.302693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79505f8a-9b72-4b5e-a6ee-c0ddf26b472b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action" status: 204 len: 0 microversion: 2.1 time: 0.074192 Oct 31 14:43:11.303361 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2928/6101] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:43:11 2022] POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:43:11.313144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:11.313764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:11.319787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:11.320279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:11.320950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:11.321656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:11.322403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:11.334057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:12.014809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:12.015647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:12.023491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:12.023980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:12.024646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:12.025352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:12.026540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:12.026980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:12.032920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:12.047378 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-015582c6-bd06-4023-ac74-9e8bacd0d5cb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1689 microversion: 2.1 time: 0.738762 Oct 31 14:43:12.049285 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3174/6102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:11 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1689 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:12.209419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:12.220457 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30172822-25bb-456f-9c68-ad280a9e6d26 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.211497 Oct 31 14:43:12.221483 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2929/6103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:12 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:12.510500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ab481b55-920c-46a1-934b-92091763571d req-2b25ca06-354a-4c30-83fa-430679575e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fdff91-1e5b-437e-ab64-0cd64390bbb4", "tag": "320d5080-61fc-4bb6-9250-a96b9dac633b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:12.529778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab481b55-920c-46a1-934b-92091763571d req-2b25ca06-354a-4c30-83fa-430679575e9a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:12.530657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab481b55-920c-46a1-934b-92091763571d req-2b25ca06-354a-4c30-83fa-430679575e9a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:12.531214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab481b55-920c-46a1-934b-92091763571d req-2b25ca06-354a-4c30-83fa-430679575e9a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:12.545366 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ab481b55-920c-46a1-934b-92091763571d req-2b25ca06-354a-4c30-83fa-430679575e9a service nova] Creating event network-changed:320d5080-61fc-4bb6-9250-a96b9dac633b for instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 on n-h1-863052-1 Oct 31 14:43:12.551805 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ab481b55-920c-46a1-934b-92091763571d req-2b25ca06-354a-4c30-83fa-430679575e9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160984 Oct 31 14:43:12.552716 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3175/6104] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:13.070577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:13.071308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:13.078941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:13.079851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:13.080367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:13.081173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:13.081639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:13.082244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:13.230291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:13.238959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eac4e39b-c09f-42e8-a544-52181c841c91 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1689 microversion: 2.1 time: 0.172182 Oct 31 14:43:13.239902 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2930/6105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:13 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:13.246773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:13.247753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:13.257686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:13.258338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:13.258901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:13.259654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:13.260157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:13.261224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:13.414061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:13.422072 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3609969a-a5e9-4be7-b7df-b0ef7007cd57 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.180959 Oct 31 14:43:13.422675 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3176/6106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:13 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:43:14.263925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:14.264680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:14.271426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:14.271926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:14.272598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:14.273301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:14.273931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:14.274395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:14.414702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c00f3874-bed4-4c3f-9e4d-2f63bb606d9e req-23f8088f-d593-4ca5-b731-d6ae7e09ef52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "name": "network-vif-plugged", "status": "completed", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:14.431568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c00f3874-bed4-4c3f-9e4d-2f63bb606d9e req-23f8088f-d593-4ca5-b731-d6ae7e09ef52 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:14.432946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c00f3874-bed4-4c3f-9e4d-2f63bb606d9e req-23f8088f-d593-4ca5-b731-d6ae7e09ef52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:14.433570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c00f3874-bed4-4c3f-9e4d-2f63bb606d9e req-23f8088f-d593-4ca5-b731-d6ae7e09ef52 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:14.446621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:14.451968 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c00f3874-bed4-4c3f-9e4d-2f63bb606d9e req-23f8088f-d593-4ca5-b731-d6ae7e09ef52 service nova] Creating event network-vif-plugged:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h1-863052-1 Oct 31 14:43:14.456549 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eebbc2c6-b929-4c3e-b60a-82d0a12bc680 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1681 microversion: 2.1 time: 0.196871 Oct 31 14:43:14.457268 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2931/6107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:14 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:14.459052 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c00f3874-bed4-4c3f-9e4d-2f63bb606d9e req-23f8088f-d593-4ca5-b731-d6ae7e09ef52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050910 Oct 31 14:43:14.459931 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3177/6108] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:43:14.472318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:14.473380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:14.492306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:14.493131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:14.493789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:14.495568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:14.496271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:14.496999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:14.667077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:14.674930 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ef866b3-6dbc-402d-8ff6-5d73ee8dabe2 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.216328 Oct 31 14:43:14.675502 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2932/6109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:14 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:15.699739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:15.700448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:15.706688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:15.707185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:15.707623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:15.708320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:15.708768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:15.709190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:15.848068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:15.856643 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6754110-e2ba-4b63-b14f-d465d5900997 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.162630 Oct 31 14:43:15.857126 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3178/6110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:15 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:16.046301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:16.046805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:16.053555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:16.054044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:16.054603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:16.055295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:16.055748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:16.056174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:16.081586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:43:16.155515 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-633fff95-acc3-4d3f-ab2e-5471ec7f90fd tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 204 len: 0 microversion: 2.1 time: 0.112630 Oct 31 14:43:16.156056 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2933/6111] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:43:16 2022] DELETE /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:43:16.164303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:16.164999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:16.171453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:16.171936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:16.172372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:16.173052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:16.173505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:16.173921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:16.309627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:16.317140 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c17fa370-d408-473b-a1d7-69072fa55f50 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1470 microversion: 2.1 time: 0.156629 Oct 31 14:43:16.317728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3179/6112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:16 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:16.880490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:16.881229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:16.887280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:16.887757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:16.888202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:16.888893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:16.889347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:16.889774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:17.030429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:17.038094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb582b7f-ece9-43d8-8748-b7f4192afcf7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.161856 Oct 31 14:43:17.038693 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2934/6113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:16 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:17.340801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:17.341412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:17.348383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:17.348862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:17.349296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:17.349976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:17.350461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:17.350878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:17.482248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:17.490013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21d24c62-821b-484d-af0c-38bd950d20d2 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1470 microversion: 2.1 time: 0.153577 Oct 31 14:43:17.491239 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3180/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:17 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:43:18.019314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-27c8ef10-dce4-4248-a0e7-a3c8d4d46dfe req-a1e63459-3294-4693-b3db-b87c447b8cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4", "name": "network-vif-deleted", "tag": "c441e10b-e0fd-4cb0-8ecd-8808a353c977"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:18.030335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-27c8ef10-dce4-4248-a0e7-a3c8d4d46dfe req-a1e63459-3294-4693-b3db-b87c447b8cea service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.030814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-27c8ef10-dce4-4248-a0e7-a3c8d4d46dfe req-a1e63459-3294-4693-b3db-b87c447b8cea service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.031242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-27c8ef10-dce4-4248-a0e7-a3c8d4d46dfe req-a1e63459-3294-4693-b3db-b87c447b8cea service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.043068 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-27c8ef10-dce4-4248-a0e7-a3c8d4d46dfe req-a1e63459-3294-4693-b3db-b87c447b8cea service nova] Creating event network-vif-deleted:c441e10b-e0fd-4cb0-8ecd-8808a353c977 for instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 on n-h2-863052-1 Oct 31 14:43:18.047878 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-27c8ef10-dce4-4248-a0e7-a3c8d4d46dfe req-a1e63459-3294-4693-b3db-b87c447b8cea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Oct 31 14:43:18.048476 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2935/6115] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:18.062824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:18.063532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:18.070457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.071023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.071548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.072307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.072768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.073195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.219194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:18.227006 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ec8dde5-22f6-474f-a852-e60189800f28 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.168954 Oct 31 14:43:18.227766 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3181/6116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:18 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:18.387429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:18.392625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:18.406319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0d2f2f7b-61a5-437c-860f-ed62f4d65b1e req-25dbfef8-6013-412f-b784-91ccaba28c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fdff91-1e5b-437e-ab64-0cd64390bbb4", "name": "network-vif-plugged", "status": "completed", "tag": "320d5080-61fc-4bb6-9250-a96b9dac633b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:18.421541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d2f2f7b-61a5-437c-860f-ed62f4d65b1e req-25dbfef8-6013-412f-b784-91ccaba28c8b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.422274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d2f2f7b-61a5-437c-860f-ed62f4d65b1e req-25dbfef8-6013-412f-b784-91ccaba28c8b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.422745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d2f2f7b-61a5-437c-860f-ed62f4d65b1e req-25dbfef8-6013-412f-b784-91ccaba28c8b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.434705 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0d2f2f7b-61a5-437c-860f-ed62f4d65b1e req-25dbfef8-6013-412f-b784-91ccaba28c8b service nova] Creating event network-vif-plugged:320d5080-61fc-4bb6-9250-a96b9dac633b for instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 on n-h1-863052-1 Oct 31 14:43:18.440355 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0d2f2f7b-61a5-437c-860f-ed62f4d65b1e req-25dbfef8-6013-412f-b784-91ccaba28c8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054158 Oct 31 14:43:18.441337 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2936/6117] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:18.514351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:18.514964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:18.522219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.522925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.523360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.524058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.524582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.525004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.560847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:18.565767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:18.566295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:18.566743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:18.567206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lazy-loading 'fault' on Instance uuid a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:43:18.625184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d2355db7d146cc840f8f2300f4fc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5456dec898264354bb55a05d7e839bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:18.632515 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-556c9298-5f1b-4f88-804a-ebef2b872905 tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 200 len: 1304 microversion: 2.1 time: 0.122399 Oct 31 14:43:18.635858 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3182/6118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:18 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:19.252555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:19.253192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:19.259297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:19.259788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:19.260832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:19.261521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:19.261977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:19.262427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:19.401387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:19.409055 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4eee67ad-b625-44a9-b83c-42df4d15ccf0 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1472 microversion: 2.1 time: 0.161625 Oct 31 14:43:19.409622 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2937/6119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:19 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:19.656228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:19.657099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] [instance: a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:19.664717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:19.665207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:19.665654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:19.666382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:19.666845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:19.667284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:19.681905 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] HTTP exception thrown: Instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 could not be found. Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Request method failure captured: Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 HTTP/1.1 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX96mRadh5h9ccmupNH-x_DMyNJIQaEWOb1lAM552co3uMX_5GIxi7Vn9Tf91YrPPBLah2NBHvPzDUYxnP92eSH-ERlYw6uC2God231NfMbHptU9G0UBqyhaq1GuB6Ib82Xm7qgJjWxH3KMPVuRGDANPmA6iar_FHen2Pbxauql7BkMc Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 5456dec898264354bb55a05d7e839bcd Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesBackupsTest-742862796 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5456dec898264354bb55a05d7e839bcd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5456dec898264354bb55a05d7e839bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5456dec898264354bb55a05d7e839bcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5456dec898264354bb55a05d7e839bcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-VolumesBackupsTest-742862796 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 5456dec898264354bb55a05d7e839bcd Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesBackupsTest-742862796 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-VolumesBackupsTest-742862796-project Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 11d2355db7d146cc840f8f2300f4fc50 Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-VolumesBackupsTest-742862796-project Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 could not be found. Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4'} Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 could not be found. Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 could not be found. Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:43:19.683971 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 could not be found. Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] Returning 404 to user: Instance a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-939f0d2f-843b-420f-8d45-81ab8ce4056f tempest-VolumesBackupsTest-742862796 tempest-VolumesBackupsTest-742862796-project] 10.222.0.27 "GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4" status: 404 len: 111 microversion: 2.1 time: 0.033098 Oct 31 14:43:19.688293 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3183/6120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:19 2022] GET /compute/v2.1/servers/a9dc6ec8-7d8f-4c68-aebe-ccf8f0ee83b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:43:20.433475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:20.434208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:20.441019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:20.441508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:20.441946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:20.442685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:20.443139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:20.443562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:20.602722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:20.611411 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bcab895e-36fa-4c3e-8826-3e67337395d3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1645 microversion: 2.1 time: 0.182500 Oct 31 14:43:20.611984 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2938/6121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:20 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1645 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:20.633910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:20.634580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:20.641427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:20.641917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:20.642407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:20.643093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:20.643545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:20.643966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:20.785052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:20.793526 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b63ad8b-e780-4ecf-9afb-d1a308c21db8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1645 microversion: 2.1 time: 0.163389 Oct 31 14:43:20.794033 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3184/6122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:20 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1645 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:20.817522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:20.818262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:20.827872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:20.828732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:20.829305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:20.830067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:20.830576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:20.831202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:21.364490 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50df9ac4-6ef9-4254-a4e8-aba6a573637a tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1796 microversion: 2.1 time: 0.552350 Oct 31 14:43:21.366386 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2939/6123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:20 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1796 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:23.586540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fa82883e-a7b5-4bf1-8545-91fd235b7a18 req-8d616cd6-8aae-4a19-b58b-e33df9ea0f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fdff91-1e5b-437e-ab64-0cd64390bbb4", "tag": "320d5080-61fc-4bb6-9250-a96b9dac633b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:23.607573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa82883e-a7b5-4bf1-8545-91fd235b7a18 req-8d616cd6-8aae-4a19-b58b-e33df9ea0f2a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:23.608243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa82883e-a7b5-4bf1-8545-91fd235b7a18 req-8d616cd6-8aae-4a19-b58b-e33df9ea0f2a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:23.608855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa82883e-a7b5-4bf1-8545-91fd235b7a18 req-8d616cd6-8aae-4a19-b58b-e33df9ea0f2a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:23.613263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:23.634129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fa82883e-a7b5-4bf1-8545-91fd235b7a18 req-8d616cd6-8aae-4a19-b58b-e33df9ea0f2a service nova] Creating event network-changed:320d5080-61fc-4bb6-9250-a96b9dac633b for instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 on n-h1-863052-1 Oct 31 14:43:23.643376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fa82883e-a7b5-4bf1-8545-91fd235b7a18 req-8d616cd6-8aae-4a19-b58b-e33df9ea0f2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060525 Oct 31 14:43:23.643996 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3185/6124] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:34.666159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:34.668396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:34.671568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:34.672385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:34.678822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:34.679319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:34.679765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:34.680471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:34.680930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:34.681384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:34.737085 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-439ee495-8ef4-473e-85e2-d9b969645aff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action" status: 200 len: 24580 microversion: 2.1 time: 0.074767 Oct 31 14:43:34.738870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2940/6125] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:43:34 2022] POST /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7/action => generated 24580 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:43:41.008491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=43 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:41.012973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:41.013737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:41.020455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:41.020941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:41.021387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:41.022079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:41.022563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:41.022990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:41.152516 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0ff0c01-fc1a-4f61-aeed-f5de15c97235 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1832 microversion: 2.1 time: 0.146650 Oct 31 14:43:41.153027 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3186/6126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:41 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1832 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:42.031360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:42.031964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:42.036582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e00730fc-e3b3-4c1c-8613-70feed76558a req-1e33716d-b926-4a88-b87b-966bb86a1d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:42.047877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e00730fc-e3b3-4c1c-8613-70feed76558a req-1e33716d-b926-4a88-b87b-966bb86a1d68 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:42.048356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e00730fc-e3b3-4c1c-8613-70feed76558a req-1e33716d-b926-4a88-b87b-966bb86a1d68 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:42.048786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e00730fc-e3b3-4c1c-8613-70feed76558a req-1e33716d-b926-4a88-b87b-966bb86a1d68 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:42.052532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:42.053031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:42.053482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:42.054359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:42.054821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:42.055250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:42.062316 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e00730fc-e3b3-4c1c-8613-70feed76558a req-1e33716d-b926-4a88-b87b-966bb86a1d68 service nova] Creating event network-changed:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h1-863052-1 Oct 31 14:43:42.067649 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e00730fc-e3b3-4c1c-8613-70feed76558a req-1e33716d-b926-4a88-b87b-966bb86a1d68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034568 Oct 31 14:43:42.068750 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3187/6127] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:42.088865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:43:42.200737 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1e26d61-8a33-4c11-9932-d899a4308713 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 204 len: 0 microversion: 2.1 time: 0.173239 Oct 31 14:43:42.202135 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2941/6128] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:43:42 2022] DELETE /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:43:42.211272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:42.212033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:42.219696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:42.222212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:42.222941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:42.223878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:42.224519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:42.225208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:42.393449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:42.405163 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3983fdec-7de4-434c-9ac4-4fd2f8228fa2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1687 microversion: 2.1 time: 0.198228 Oct 31 14:43:42.406030 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3188/6129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:42 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1687 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:43.429702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:43.430509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:43.438440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:43.438929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:43.439368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:43.440055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:43.440504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:43.440927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:43.577116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:43.585151 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-12a58787-439f-4753-9be3-dea1b8c39eee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1687 microversion: 2.1 time: 0.159674 Oct 31 14:43:43.585715 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2942/6130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:43 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:44.340571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2c541c14-455e-457d-9295-ee476db9121e req-76dd1e88-f4b7-4141-a877-53d1a24d9a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954a7481-74a0-4504-a043-c95032148be7", "name": "network-vif-deleted", "tag": "1072eb8d-d97e-4002-a720-7c4a932588b5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:44.351560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c541c14-455e-457d-9295-ee476db9121e req-76dd1e88-f4b7-4141-a877-53d1a24d9a8f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:44.352194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c541c14-455e-457d-9295-ee476db9121e req-76dd1e88-f4b7-4141-a877-53d1a24d9a8f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:44.353246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c541c14-455e-457d-9295-ee476db9121e req-76dd1e88-f4b7-4141-a877-53d1a24d9a8f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:44.369211 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2c541c14-455e-457d-9295-ee476db9121e req-76dd1e88-f4b7-4141-a877-53d1a24d9a8f service nova] Creating event network-vif-deleted:1072eb8d-d97e-4002-a720-7c4a932588b5 for instance 954a7481-74a0-4504-a043-c95032148be7 on n-h1-863052-1 Oct 31 14:43:44.374610 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2c541c14-455e-457d-9295-ee476db9121e req-76dd1e88-f4b7-4141-a877-53d1a24d9a8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038321 Oct 31 14:43:44.375247 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3189/6131] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:44.608905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:44.609521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:44.616528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:44.617034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:44.617488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:44.618473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:44.618948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:44.619384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:44.653988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:44.654627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:44.655300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:44.655880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lazy-loading 'fault' on Instance uuid 954a7481-74a0-4504-a043-c95032148be7 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:43:44.699850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:44.708752 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2cd7824-a3b0-487b-9bad-b924d10304bd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 200 len: 1355 microversion: 2.1 time: 0.104099 Oct 31 14:43:44.709509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2943/6132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:44 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:43:45.735251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:45.736054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 954a7481-74a0-4504-a043-c95032148be7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:45.742399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:45.742885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:45.743373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:45.744062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:45.744546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:45.744974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:45.758198 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] HTTP exception thrown: Instance 954a7481-74a0-4504-a043-c95032148be7 could not be found. Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Request method failure captured: Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 HTTP/1.1 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX96mgtaOTLtPuKtnhPLz3REpHeArWDPtiA00bG2Yd2IDjcqvZayMCsFTe0kjgn11Qua7g0ObEQKHarBlDqOl_Xg9vDsbjfScOTNmpsQarhkxLY89dgKSxTlNOGpUTO9FRnGb0w_I8aJo6PfdkWDhATS78BFCzz77MYeMJ6rcdUKmi-o Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7f152314f7d4b67b90d8df1058173bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 540514132f50424ab738477360754cca Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 954a7481-74a0-4504-a043-c95032148be7 could not be found. Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '954a7481-74a0-4504-a043-c95032148be7'} Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954a7481-74a0-4504-a043-c95032148be7 could not be found. Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954a7481-74a0-4504-a043-c95032148be7 could not be found. Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:45.759809 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954a7481-74a0-4504-a043-c95032148be7 could not be found. Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Returning 404 to user: Instance 954a7481-74a0-4504-a043-c95032148be7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23b8d720-7b72-4509-8b47-6d60cb7f561f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7" status: 404 len: 111 microversion: 2.1 time: 0.031420 Oct 31 14:43:45.764549 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3190/6133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:45 2022] GET /compute/v2.1/servers/954a7481-74a0-4504-a043-c95032148be7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:43:49.228611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70a29718-68c4-480a-aa0f-18b88d0f20b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '.version_select at 0x7fe1067dbdc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:49.266560 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70a29718-68c4-480a-aa0f-18b88d0f20b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-578019658" status: 202 len: 0 microversion: 2.1 time: 0.043571 Oct 31 14:43:49.267681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2944/6134] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 14:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-578019658 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:43:49.301171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e93c694-ad5a-49b9-8210-fe19db95c05e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: .version_select at 0x7fe1065031f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-840260688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW5w9r6WTNKuc6TMM4VY0ig6M0FVTwY+uyGEDYcDXJXJru5JonziDoDqPV15uGIwT2rmSObZUBvZR4mx+V3E0UBF6F5ARav1i1i0+IqPm3+f0LWGqslql4gj1bJ7bpP+w=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:49.331305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4e93c694-ad5a-49b9-8210-fe19db95c05e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:43:49.340064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4e93c694-ad5a-49b9-8210-fe19db95c05e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:43:49.376081 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e93c694-ad5a-49b9-8210-fe19db95c05e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.078989 Oct 31 14:43:49.378987 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3191/6135] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:43:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:43:55.677628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:55.685377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-815001911", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "dc1e455b-6db0-4ed5-8124-56557c1440c0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-840260688", "security_groups": [{"name": "tempest-secgroup-smoke-2066940331"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:55.853179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] validate_networks() for [('dc1e455b-6db0-4ed5-8124-56557c1440c0', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:43:56.343757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:43:56.344388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:43:56.345021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:43:56.345440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:43:56.345852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:43:56.364469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:56.365284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:56.365901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:56.366854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:56.367320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:56.367795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:56.391619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:43:56.397631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:43:56.413348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:43:56.416652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:43:56.474158 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea1f82df-6736-4e89-83a1-77ed05cf7c4d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798156 Oct 31 14:43:56.475330 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2945/6136] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:43:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:43:56.486132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=19 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:56.491932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5c7a9da-2e33-4a00-82d9-f413cc4ddefd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:56.492554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5c7a9da-2e33-4a00-82d9-f413cc4ddefd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:56.567746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5c7a9da-2e33-4a00-82d9-f413cc4ddefd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:56.576680 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5c7a9da-2e33-4a00-82d9-f413cc4ddefd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1265 microversion: 2.1 time: 0.092795 Oct 31 14:43:56.578057 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3192/6137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:56 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:57.605754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:57.606516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:57.613566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:57.614446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:57.624308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:57.628544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:57.632027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:57.632647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:57.752924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:57.764136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24e275a6-2a19-4443-9814-654b94d03622 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1325 microversion: 2.1 time: 0.168127 Oct 31 14:43:57.772120 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2946/6138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:57 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:58.796401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:43:58.797139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:43:58.815248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:58.815762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:58.817706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:58.818578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:58.819055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:58.819493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:59.369579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:43:59.381031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25aa6b64-c096-4983-afbf-273119ae4354 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1391 microversion: 2.1 time: 0.589285 Oct 31 14:43:59.388090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3193/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:43:58 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1391 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:43:59.875720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a3222c1d-7482-424e-a1f7-f68627e4afda req-5c69eaec-5b75-418b-9b6c-cc5f6a535562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:43:59.894515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a3222c1d-7482-424e-a1f7-f68627e4afda req-5c69eaec-5b75-418b-9b6c-cc5f6a535562 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:43:59.895141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a3222c1d-7482-424e-a1f7-f68627e4afda req-5c69eaec-5b75-418b-9b6c-cc5f6a535562 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:43:59.895597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a3222c1d-7482-424e-a1f7-f68627e4afda req-5c69eaec-5b75-418b-9b6c-cc5f6a535562 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:43:59.911476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a3222c1d-7482-424e-a1f7-f68627e4afda req-5c69eaec-5b75-418b-9b6c-cc5f6a535562 service nova] Creating event network-changed:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:43:59.919560 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a3222c1d-7482-424e-a1f7-f68627e4afda req-5c69eaec-5b75-418b-9b6c-cc5f6a535562 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060771 Oct 31 14:43:59.920335 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2947/6140] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:00.411605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:00.412588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:00.420373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:00.420865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:00.421485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:00.422211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:00.422675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:00.423102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:00.567234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:00.575253 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a41bd94-199c-495a-a2cd-487f5d50b9b4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1391 microversion: 2.1 time: 0.168761 Oct 31 14:44:00.576228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3194/6141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:00 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:01.600937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:01.602877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:01.614587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:01.617756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:01.634870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:01.637015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:01.639796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:01.640459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:01.838031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:01.846485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2501251b-421d-418a-aba9-eeb890a8453e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1391 microversion: 2.1 time: 0.250848 Oct 31 14:44:01.847103 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2948/6142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:01 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:02.873336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:02.874806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:02.889333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:02.910608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:02.911106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:02.911875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:02.928660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:02.936902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:03.215971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:03.228002 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d289a482-1dd2-4309-b17b-46c77bcb8bfa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1391 microversion: 2.1 time: 0.358484 Oct 31 14:44:03.228781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3195/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:02 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1391 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:04.155913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a9b174cd-f83e-4c71-9926-f16271c1c793 req-0598ac82-5c83-45c2-ac68-9b606aa82cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "name": "network-vif-plugged", "status": "completed", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:04.180434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a9b174cd-f83e-4c71-9926-f16271c1c793 req-0598ac82-5c83-45c2-ac68-9b606aa82cab service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:04.181091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a9b174cd-f83e-4c71-9926-f16271c1c793 req-0598ac82-5c83-45c2-ac68-9b606aa82cab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:04.181527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a9b174cd-f83e-4c71-9926-f16271c1c793 req-0598ac82-5c83-45c2-ac68-9b606aa82cab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:04.202322 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a9b174cd-f83e-4c71-9926-f16271c1c793 req-0598ac82-5c83-45c2-ac68-9b606aa82cab service nova] Creating event network-vif-plugged:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:44:04.209562 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a9b174cd-f83e-4c71-9926-f16271c1c793 req-0598ac82-5c83-45c2-ac68-9b606aa82cab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057299 Oct 31 14:44:04.210705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2949/6144] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:04.252458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:04.253155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:04.270239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:04.271486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:04.272190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:04.273166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:04.274397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:04.275192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:04.542592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:04.551238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f6851ca-dd90-42fd-8ace-fc6e3c6e4bad tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1391 microversion: 2.1 time: 0.303773 Oct 31 14:44:04.571243 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3196/6145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:04 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1391 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:05.217933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-247584879", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "5f523e01-54ec-46ac-b537-4492fa221bbe"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2061979115", "security_groups": []}, "os:scheduler_hints": {"different_host": ["99fdff91-1e5b-437e-ab64-0cd64390bbb4"]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:05.229702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:05.280997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] validate_networks() for [('5f523e01-54ec-46ac-b537-4492fa221bbe', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:44:05.576234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:05.584160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:05.594861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:05.595708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:05.596519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:05.597459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:05.598243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:05.598899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:05.880829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:44:05.881292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:44:05.881788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:44:05.882603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:44:05.883109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:44:05.893062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:05.893557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:05.894231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:05.895375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:05.895847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:05.896231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:05.896359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:05.915298 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71fb0bbe-4be3-4057-9c9e-b9fe9f57f8cd tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1562 microversion: 2.1 time: 0.343829 Oct 31 14:44:05.915572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Getting quotas for project cf512bf0ede741c88382c50d2f738ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:44:05.916335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3197/6146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:05 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1562 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:05.920967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Getting quotas for user 15e44d70cbfb4347ae225d48d75d128c and project cf512bf0ede741c88382c50d2f738ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:44:05.939616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:05.940096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:44:05.940709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:05.942629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:44:05.947843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:05.948541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:05.949163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:05.950031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:05.950675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:05.951261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:06.000342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1febe74-31fd-4db0-834c-95170d6e68d4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.786317 Oct 31 14:44:06.001475 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2950/6147] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:44:05 2022] POST /compute/v2.1/servers => generated 361 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:44:06.013011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-020e741f-e2f4-43b1-9d95-1151504a9aed tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:06.013764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-020e741f-e2f4-43b1-9d95-1151504a9aed tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:06.078751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-020e741f-e2f4-43b1-9d95-1151504a9aed tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:06.085945 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-020e741f-e2f4-43b1-9d95-1151504a9aed tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1241 microversion: 2.1 time: 0.077181 Oct 31 14:44:06.087481 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2951/6148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:06 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:06.117363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:06.125726 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71820e6e-faea-44cd-9c36-439833e7f4fa tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1562 microversion: 2.1 time: 0.190726 Oct 31 14:44:06.145116 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3198/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:05 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:44:07.111293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:07.111929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:07.123280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:07.123800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:07.124260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:07.124994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:07.134086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:07.134611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:07.292188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:07.303313 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8560cea7-d315-4ece-a9e8-f0537e56d9e9 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1293 microversion: 2.1 time: 0.195687 Oct 31 14:44:07.323280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2952/6150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:07 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:08.328943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:08.330208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:08.342516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:08.346216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:08.346892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:08.347531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:08.348415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:08.351043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:08.352944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:08.565563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:08.579515 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1f3b82c-8fa2-450e-bed7-6ebdb38aebca tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.255867 Oct 31 14:44:08.582230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3199/6151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:08 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:09.208467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:09.209260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:09.214742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2563d3f3-6158-45f9-a070-dbb5f29c1c20 req-1ed9d55b-8fc4-4b9c-9807-ede4064b7ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:09.223734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:09.227893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:09.228671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:09.229716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:09.230856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:09.232084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2563d3f3-6158-45f9-a070-dbb5f29c1c20 req-1ed9d55b-8fc4-4b9c-9807-ede4064b7ab7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:09.232496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:09.232620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2563d3f3-6158-45f9-a070-dbb5f29c1c20 req-1ed9d55b-8fc4-4b9c-9807-ede4064b7ab7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:09.232993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2563d3f3-6158-45f9-a070-dbb5f29c1c20 req-1ed9d55b-8fc4-4b9c-9807-ede4064b7ab7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:09.263094 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2563d3f3-6158-45f9-a070-dbb5f29c1c20 req-1ed9d55b-8fc4-4b9c-9807-ede4064b7ab7 service nova] Creating event network-changed:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:44:09.276348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2563d3f3-6158-45f9-a070-dbb5f29c1c20 req-1ed9d55b-8fc4-4b9c-9807-ede4064b7ab7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065121 Oct 31 14:44:09.281697 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3200/6152] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:09.519854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:09.546654 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-66480c88-20de-447c-880c-7cd181dc97d2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1562 microversion: 2.1 time: 0.333797 Oct 31 14:44:09.549708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2953/6153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:09 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1562 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:09.609165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:09.609988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:09.630193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:09.633005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:09.633642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:09.634982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:09.637220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:09.637824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:09.764712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:09.776343 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a04d28e9-1d4c-4ca7-946f-d02fc90cf185 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.171377 Oct 31 14:44:09.779005 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3201/6154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:09 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:10.502896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8e4aac1e-bc5d-45c7-b5e4-e0a41b984a86 req-aa9dcb81-d48b-46cb-9056-bd78e0876577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4", "tag": "e1398927-fd6d-4ee5-b8fb-0a0d47a585a2"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:10.516609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8e4aac1e-bc5d-45c7-b5e4-e0a41b984a86 req-aa9dcb81-d48b-46cb-9056-bd78e0876577 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:10.517974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8e4aac1e-bc5d-45c7-b5e4-e0a41b984a86 req-aa9dcb81-d48b-46cb-9056-bd78e0876577 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:10.519201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8e4aac1e-bc5d-45c7-b5e4-e0a41b984a86 req-aa9dcb81-d48b-46cb-9056-bd78e0876577 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:10.535079 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8e4aac1e-bc5d-45c7-b5e4-e0a41b984a86 req-aa9dcb81-d48b-46cb-9056-bd78e0876577 service nova] Creating event network-changed:e1398927-fd6d-4ee5-b8fb-0a0d47a585a2 for instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 on n-h2-863052-1 Oct 31 14:44:10.544106 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8e4aac1e-bc5d-45c7-b5e4-e0a41b984a86 req-aa9dcb81-d48b-46cb-9056-bd78e0876577 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044846 Oct 31 14:44:10.545231 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2954/6155] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:10.802013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:10.802787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:10.810115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:10.810667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:10.811152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:10.811847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:10.812467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:10.812929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:10.970115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:10.979619 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-541ca9b0-f331-49d0-b5d6-a083a3c89be4 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.182444 Oct 31 14:44:10.995378 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3202/6156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:10 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:12.004896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:12.005749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:12.012059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:12.012552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:12.013002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:12.013694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:12.014156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:12.014610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:12.096064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:12.104524 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2e05141f-b703-4e00-8c34-be6b134f974c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.104803 Oct 31 14:44:12.105353 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2955/6157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:11 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:13.127977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:13.128591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:13.133590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:13.137300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:13.137839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:13.138519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:13.139213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:13.139662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:13.140082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:13.227640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:13.235654 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45b5f955-fe22-4f1f-ae3e-989b3a0f5ab8 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.111662 Oct 31 14:44:13.236226 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3203/6158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:13 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:14.259684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:14.263795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:14.267964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:14.268536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:14.269033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:14.269807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:14.270353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:14.270853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:14.361133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:14.369411 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25fd3b29-81b1-4754-bcc8-345aba2cc925 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.114345 Oct 31 14:44:14.369985 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2956/6159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:14 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:15.392555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:15.393167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:15.400674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:15.401156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:15.401591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:15.402308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:15.402760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:15.403180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:15.487692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:15.496092 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39c96f3c-11aa-475c-b1f3-5fa7de5c1bb3 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.107466 Oct 31 14:44:15.496743 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3204/6160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:15 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:16.046732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f8a9d5a8-4dc6-4afb-89d1-8cf573160119 req-5c5a89cd-b813-4bb0-bc45-c1f1cc0a06bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4", "name": "network-vif-plugged", "status": "completed", "tag": "e1398927-fd6d-4ee5-b8fb-0a0d47a585a2"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:16.053845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:16.058746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8a9d5a8-4dc6-4afb-89d1-8cf573160119 req-5c5a89cd-b813-4bb0-bc45-c1f1cc0a06bf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:16.059417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8a9d5a8-4dc6-4afb-89d1-8cf573160119 req-5c5a89cd-b813-4bb0-bc45-c1f1cc0a06bf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:16.060294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8a9d5a8-4dc6-4afb-89d1-8cf573160119 req-5c5a89cd-b813-4bb0-bc45-c1f1cc0a06bf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:16.073025 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f8a9d5a8-4dc6-4afb-89d1-8cf573160119 req-5c5a89cd-b813-4bb0-bc45-c1f1cc0a06bf service nova] Creating event network-vif-plugged:e1398927-fd6d-4ee5-b8fb-0a0d47a585a2 for instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 on n-h2-863052-1 Oct 31 14:44:16.077823 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f8a9d5a8-4dc6-4afb-89d1-8cf573160119 req-5c5a89cd-b813-4bb0-bc45-c1f1cc0a06bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Oct 31 14:44:16.079367 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2957/6161] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:44:16.520066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:16.520690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:16.527542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:16.528024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:16.528498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:16.529219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:16.529674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:16.530095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:16.613701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:16.621834 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a128b4fa-a785-4c20-8adc-be0f9607ef8c tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1299 microversion: 2.1 time: 0.106301 Oct 31 14:44:16.622513 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3205/6162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:16 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:17.642755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:17.648692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:17.649403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:17.656146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:17.656633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:17.657077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:17.657777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:17.658275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:17.658689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:17.750699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:17.759100 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b230acab-363d-4646-9b53-3f1460babb8b tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1472 microversion: 2.1 time: 0.117305 Oct 31 14:44:17.759681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2958/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:17 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:17.781524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:17.782139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:17.789108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:17.789590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:17.790032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:17.790807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:17.791262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:17.791718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:17.895867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:17.903865 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7baf4ae-67f9-493d-9a3a-6a8b1fb48e3e tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1472 microversion: 2.1 time: 0.126310 Oct 31 14:44:17.904454 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3206/6164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:17 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1472 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:17.926058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:17.926809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:17.933431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:17.933997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:17.934536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:17.935423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:17.935895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:17.936498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.019143 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bdbffbab-1ea9-47f1-9ac5-372fefd77451 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1623 microversion: 2.1 time: 0.096778 Oct 31 14:44:18.019724 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2959/6165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:17 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1623 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:18.041472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:18.042118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:18.048205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:18.048695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:18.049135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.049821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:18.050308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:18.050742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.189829 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45504907-462d-42d2-8695-7fa0434f9b63 tempest-TestSecurityGroupsBasicOps-1635961261 tempest-TestSecurityGroupsBasicOps-1635961261-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1914 microversion: 2.1 time: 0.152070 Oct 31 14:44:18.190671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3207/6166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:18 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1914 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:44:18.255696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:18.256194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:18.262001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:18.262517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:18.262956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.263639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:18.264089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:18.264513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.289438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:44:18.368743 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f2387c47-69ba-4f99-9e49-5d583790611f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 204 len: 0 microversion: 2.1 time: 0.116582 Oct 31 14:44:18.372708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2960/6167] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:44:18 2022] DELETE /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:44:18.377809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:18.378445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:18.384809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:18.385314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:18.385723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.386487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:18.386940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:18.387303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:18.478198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:18.490254 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0548c146-05d3-4071-9ea9-a293954a81fa tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1478 microversion: 2.1 time: 0.116273 Oct 31 14:44:18.490961 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3208/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:18 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1478 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:19.517156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:19.517857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:19.525253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:19.525738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:19.526199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:19.526886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:19.527342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:19.527767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:19.610061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:19.617362 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04c3e908-ff25-47fb-8044-67a7835b037f tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1478 microversion: 2.1 time: 0.104465 Oct 31 14:44:19.617955 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2961/6169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:19 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1478 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:20.182434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d3b6d4db-08c0-47a9-912c-e45145baf8e5 req-738e8c6f-b258-40c5-9fa1-4cf20fc81f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4", "name": "network-vif-deleted", "tag": "e1398927-fd6d-4ee5-b8fb-0a0d47a585a2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:20.194556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d3b6d4db-08c0-47a9-912c-e45145baf8e5 req-738e8c6f-b258-40c5-9fa1-4cf20fc81f81 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:20.195697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d3b6d4db-08c0-47a9-912c-e45145baf8e5 req-738e8c6f-b258-40c5-9fa1-4cf20fc81f81 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:20.196107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d3b6d4db-08c0-47a9-912c-e45145baf8e5 req-738e8c6f-b258-40c5-9fa1-4cf20fc81f81 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:20.215550 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d3b6d4db-08c0-47a9-912c-e45145baf8e5 req-738e8c6f-b258-40c5-9fa1-4cf20fc81f81 service nova] Creating event network-vif-deleted:e1398927-fd6d-4ee5-b8fb-0a0d47a585a2 for instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 on n-h2-863052-1 Oct 31 14:44:20.221131 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d3b6d4db-08c0-47a9-912c-e45145baf8e5 req-738e8c6f-b258-40c5-9fa1-4cf20fc81f81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043689 Oct 31 14:44:20.221946 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3209/6170] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:20.642400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:20.643579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:20.653852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:20.654381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:20.654827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:20.655530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:20.656840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:20.657651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:20.692842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:20.693163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:20.693795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:20.694412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lazy-loading 'fault' on Instance uuid 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:44:20.740278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:20.749595 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b4dd58c-ac5a-4a8d-a8c1-7e9e1a697d1a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 200 len: 1331 microversion: 2.1 time: 0.112676 Oct 31 14:44:20.750736 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2962/6171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:20 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:21.774894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:21.775691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:21.782077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:21.782701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:21.783213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:21.783980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:21.784512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:21.785012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:21.799279 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] HTTP exception thrown: Instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 could not be found. Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Request method failure captured: Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 HTTP/1.1 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX97x3TGg5su6ZnvGAay6JYrYL9W1s_ACBgCl9FfuOpyOYQ84NKxzJaIJicX9LjDieX2CLJo6E9--ArLU_dH0GAewkCw55fQjlxHbtc_TTd7lZ1pddlTNjnrwUOg5EPfi6SyZMYr0t-hCISUT0q4uuPAWfi-_ZZIT2JbBD894-52InN0 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: cf512bf0ede741c88382c50d2f738ca8 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2056936928 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf512bf0ede741c88382c50d2f738ca8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf512bf0ede741c88382c50d2f738ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf512bf0ede741c88382c50d2f738ca8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf512bf0ede741c88382c50d2f738ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2056936928 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: cf512bf0ede741c88382c50d2f738ca8 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2056936928 Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestSecurityGroupsBasicOps-2056936928-project Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 15e44d70cbfb4347ae225d48d75d128c Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2056936928-project Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 could not be found. Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4'} Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 could not be found. Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 could not be found. Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:44:21.800947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 could not be found. Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Returning 404 to user: Instance 2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9285579c-9822-4557-a9b1-570a0798d2eb tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4" status: 404 len: 111 microversion: 2.1 time: 0.033210 Oct 31 14:44:21.805876 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3210/6172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:21 2022] GET /compute/v2.1/servers/2ae2bcbf-bc7d-4f62-b42e-08ead753b3c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:44:26.041156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0ccd763d-f242-43f2-ba3c-e7400c588f64 req-a206a4d9-bec3-40e1-86bd-7b92ae17767b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fdff91-1e5b-437e-ab64-0cd64390bbb4", "tag": "320d5080-61fc-4bb6-9250-a96b9dac633b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:26.041826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:26.042374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:26.051190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:26.051687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:26.052330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:26.053219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:26.053716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ccd763d-f242-43f2-ba3c-e7400c588f64 req-a206a4d9-bec3-40e1-86bd-7b92ae17767b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:26.053854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:26.054345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:26.054835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ccd763d-f242-43f2-ba3c-e7400c588f64 req-a206a4d9-bec3-40e1-86bd-7b92ae17767b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:26.055474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ccd763d-f242-43f2-ba3c-e7400c588f64 req-a206a4d9-bec3-40e1-86bd-7b92ae17767b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:26.067937 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0ccd763d-f242-43f2-ba3c-e7400c588f64 req-a206a4d9-bec3-40e1-86bd-7b92ae17767b service nova] Creating event network-changed:320d5080-61fc-4bb6-9250-a96b9dac633b for instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 on n-h1-863052-1 Oct 31 14:44:26.073803 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0ccd763d-f242-43f2-ba3c-e7400c588f64 req-a206a4d9-bec3-40e1-86bd-7b92ae17767b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037312 Oct 31 14:44:26.075226 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3211/6173] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:26.080179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:26.086913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:44:26.202447 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-779bbcfd-2f8d-4bb3-a0fe-9365dd6b5c3a tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 204 len: 0 microversion: 2.1 time: 0.164571 Oct 31 14:44:26.204925 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2963/6174] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:44:26 2022] DELETE /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:44:26.214246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:26.215275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:26.222368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:26.223505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:26.224171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:26.225275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:26.225856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:26.227105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:26.254419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:26.398542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:26.408902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9eafe351-e226-4ce0-ba49-b5e8b359dcc5 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1769 microversion: 2.1 time: 0.199468 Oct 31 14:44:26.409902 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3212/6175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:26 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1769 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:27.433447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:27.434386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:27.441312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:27.441807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:27.442292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:27.442994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:27.443449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:27.454231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:27.679834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e44d70cbfb4347ae225d48d75d128c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf512bf0ede741c88382c50d2f738ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:27.699262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3008d33c-c60d-4007-b5e5-94179c1ec8b7 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 200 len: 1769 microversion: 2.1 time: 0.269946 Oct 31 14:44:27.700684 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2964/6176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:27 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 1769 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:28.091739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c6008775-6464-40e2-811e-6ba010b246fa req-8b3c4703-be94-4b8c-bef7-94637351c043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fdff91-1e5b-437e-ab64-0cd64390bbb4", "name": "network-vif-deleted", "tag": "320d5080-61fc-4bb6-9250-a96b9dac633b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:28.105419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c6008775-6464-40e2-811e-6ba010b246fa req-8b3c4703-be94-4b8c-bef7-94637351c043 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:28.106204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c6008775-6464-40e2-811e-6ba010b246fa req-8b3c4703-be94-4b8c-bef7-94637351c043 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:28.106537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c6008775-6464-40e2-811e-6ba010b246fa req-8b3c4703-be94-4b8c-bef7-94637351c043 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:28.121098 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c6008775-6464-40e2-811e-6ba010b246fa req-8b3c4703-be94-4b8c-bef7-94637351c043 service nova] Creating event network-vif-deleted:320d5080-61fc-4bb6-9250-a96b9dac633b for instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 on n-h1-863052-1 Oct 31 14:44:28.126502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c6008775-6464-40e2-811e-6ba010b246fa req-8b3c4703-be94-4b8c-bef7-94637351c043 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038605 Oct 31 14:44:28.127316 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3213/6177] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:28.724081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:28.724703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] [instance: 99fdff91-1e5b-437e-ab64-0cd64390bbb4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:28.731967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:28.732460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:28.732902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:28.733594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:28.734050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:28.734516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:28.747899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] HTTP exception thrown: Instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 could not be found. Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Request method failure captured: Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 HTTP/1.1 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX97x3TGg5su6ZnvGAay6JYrYL9W1s_ACBgCl9FfuOpyOYQ84NKxzJaIJicX9LjDieX2CLJo6E9--ArLU_dH0GAewkCw55fQjlxHbtc_TTd7lZ1pddlTNjnrwUOg5EPfi6SyZMYr0t-hCISUT0q4uuPAWfi-_ZZIT2JbBD894-52InN0 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: cf512bf0ede741c88382c50d2f738ca8 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2056936928 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf512bf0ede741c88382c50d2f738ca8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf512bf0ede741c88382c50d2f738ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf512bf0ede741c88382c50d2f738ca8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf512bf0ede741c88382c50d2f738ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2056936928 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: cf512bf0ede741c88382c50d2f738ca8 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2056936928 Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestSecurityGroupsBasicOps-2056936928-project Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 15e44d70cbfb4347ae225d48d75d128c Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2056936928-project Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 could not be found. Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '99fdff91-1e5b-437e-ab64-0cd64390bbb4'} Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 could not be found. Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 could not be found. Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:44:28.749555 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 could not be found. Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Returning 404 to user: Instance 99fdff91-1e5b-437e-ab64-0cd64390bbb4 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0aedf14-7666-45ec-973a-65fe17fb8881 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4" status: 404 len: 111 microversion: 2.1 time: 0.030820 Oct 31 14:44:28.754470 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2965/6178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:28 2022] GET /compute/v2.1/servers/99fdff91-1e5b-437e-ab64-0cd64390bbb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:44:29.955249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:29.961024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:29.975940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:29.976843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:29.977524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:29.979095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:29.979555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:29.982251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:30.060458 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69e32828-0f37-43c8-8b25-27c7ce4eaaa3 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action" status: 200 len: 24574 microversion: 2.1 time: 0.122339 Oct 31 14:44:30.061394 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3214/6179] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:44:29 2022] POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action => generated 24574 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:44:32.494972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff28e55a-ff5a-46d4-8dd8-83380dc97e39 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] Calling method '.version_select at 0x7fe10fc3e160>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:32.528126 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff28e55a-ff5a-46d4-8dd8-83380dc97e39 tempest-TestSecurityGroupsBasicOps-2056936928 tempest-TestSecurityGroupsBasicOps-2056936928-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2061979115" status: 202 len: 0 microversion: 2.1 time: 0.037075 Oct 31 14:44:32.529077 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2966/6180] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 31 14:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2061979115 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:44:41.182036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:41.182774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:41.185723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=23 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:41.186411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:41.192831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:41.193305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:41.193748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:41.195014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:41.195469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:41.195895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:41.328288 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-671749ca-873d-4945-a506-017b29dad1c6 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1831 microversion: 2.1 time: 0.150886 Oct 31 14:44:41.329148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3215/6181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:41 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1831 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:41.348597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:41.353330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:41.353957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:41.356021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:41.361994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:41.362532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:41.362981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:41.363693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:41.364158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:41.364599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:41.798449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:41.806838 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbd39d8a-1dbc-43d5-bb5d-ef50b09af590 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1680 microversion: 2.1 time: 0.460221 Oct 31 14:44:41.807429 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2967/6182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:41 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1680 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:41.909724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:41.912089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:41.918903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:41.919389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:41.919832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:41.920529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:41.920984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:41.921416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:41.973683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a8bd2e1-3646-49f8-8cab-b23b7fd3abce tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action" status: 200 len: 32647 microversion: 2.1 time: 0.067786 Oct 31 14:44:41.976217 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3216/6183] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:44:41 2022] POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action => generated 32647 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:44:42.152377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:42.153024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:42.159107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:42.159595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:42.160028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:42.160718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:42.161165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:42.161585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:42.207562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a67f9a310fa848019dc4f5c07822c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abb981762a642cc85d24493441e6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:42.208192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] flavor_id is None. Assuming migration. {{(pid=120641) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 31 14:44:42.208631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120641) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:44:42.372495 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-570c0c5d-ea5c-4a43-abf2-69c1149f8d09 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action" status: 202 len: 0 microversion: 2.1 time: 0.223848 Oct 31 14:44:42.373129 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2968/6184] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:44:42 2022] POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:44:42.381799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:42.382541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:42.404382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:42.404896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:42.405355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:42.406081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:42.406708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:42.407167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:42.579751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:42.588200 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ee168b7-1344-4bcb-adaa-19f69a1e5647 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1689 microversion: 2.1 time: 0.210699 Oct 31 14:44:42.595700 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3217/6185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:42 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:43.613198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:43.614582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:43.622756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:43.623255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:43.623698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:43.624425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:43.624887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:43.625347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:43.771406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:43.782100 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f7b8db2-b0bf-4bfe-b859-a3ac5305b0d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1689 microversion: 2.1 time: 0.173662 Oct 31 14:44:43.783471 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2969/6186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:43 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:44.807087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:44.807836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:44.815622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:44.816182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:44.816687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:44.817442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:44.817968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:44.818506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:44.961565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:44.969568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e450294-63c2-4e1b-bb59-47312b5d6f71 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.166874 Oct 31 14:44:44.970149 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3218/6187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:44 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:45.993739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:45.994291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:46.001236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:46.001729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:46.002189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:46.002912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:46.003377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:46.003808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:46.134392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:46.142555 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8bd6ea9-e824-425d-8741-d7ad6792d385 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.153434 Oct 31 14:44:46.143130 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2970/6188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:45 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:47.164948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:47.165674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:47.172642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:47.173128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:47.173565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:47.174310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:47.174764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:47.175188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:47.311887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:47.319786 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f1c128d-d819-4d0d-be8c-ab1e6bdc903d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.158785 Oct 31 14:44:47.320365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3219/6189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:47 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:48.344399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:48.345025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:48.352117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:48.352611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:48.353061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:48.353770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:48.354257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:48.354941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:48.493121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:48.501014 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b29ce8ce-9d7d-4fe0-9a87-9a9d3cf0ccc4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.160708 Oct 31 14:44:48.501592 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2971/6190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:48 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:49.524461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:49.525101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:49.532007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:49.532491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:49.532924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:49.533606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:49.534054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:49.534499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:49.666892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:49.674683 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3d892674-4b9b-47b4-9ae4-7c109b46943f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.154150 Oct 31 14:44:49.675502 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3220/6191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:49 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:50.699279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:50.699800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:50.706583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:50.707079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:50.707527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:50.708231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:50.708695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:50.709700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:50.848940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:50.857716 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5522e330-81cf-4d56-9a4a-4f1dabdbacef tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.162447 Oct 31 14:44:50.858422 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2972/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:50 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:44:51.881205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:51.881937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:51.888854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:51.889344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:51.889787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:51.890553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:51.891010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:51.891439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:52.027203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:52.035247 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7877c50c-e1fc-4ae9-b203-00ce790eeca4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.158150 Oct 31 14:44:52.035831 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3221/6193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:51 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:53.061816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:53.062588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:53.070787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:53.071278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:53.071760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:53.072446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:53.072902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:53.073325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:53.215615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:53.223406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-48b38b84-2205-4d97-99a3-83ef87268227 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.166528 Oct 31 14:44:53.223981 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2973/6194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:53 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:54.248399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:54.249008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:54.255533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:54.256539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:54.257162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:54.257869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:54.258332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:54.258758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:54.395095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:54.403648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76473877-b594-4469-8f4f-595c14c210d0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.159440 Oct 31 14:44:54.410768 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3222/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:54 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:55.426567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:55.427181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:55.434027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:55.434544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:55.434988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:55.435676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:55.436135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:55.436558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:55.573053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:55.581301 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe7dc57d-3d7c-4ab0-b9c6-292d7aaf687e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1694 microversion: 2.1 time: 0.158690 Oct 31 14:44:55.581868 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2974/6196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:55 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:56.605088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:56.606397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:56.611118 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:44:56.611283 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 (ip 10.222.0.27) !!! Oct 31 14:44:56.617016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:56.617500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:56.617937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:56.618665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:56.619120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:56.619544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:56.820564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:56.828395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5510a29-a809-4395-93f7-03cd0c971aea tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1693 microversion: 2.1 time: 0.227413 Oct 31 14:44:56.828985 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3223/6197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:56 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:56.845568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "name": "network-vif-unplugged", "status": "completed", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:56.857079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:56.857667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:56.858121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:56.871843 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] Creating event network-vif-unplugged:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h1-863052-1 Oct 31 14:44:56.877122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] Instance 3331805a-d7a4-45db-90df-c28e8ed65363 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:44:56.889216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-dc99b4c4-e330-4b3c-a41c-17db594067c4 req-70b279a4-2f44-482c-9e04-a2bd8a7ddc1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048084 Oct 31 14:44:56.889835 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2975/6198] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:57.853352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:57.854072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:57.862753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:57.863575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:57.864015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:57.864811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:57.865493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:57.866364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:58.086025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:58.094632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd6d6c56-ccbb-4c93-be68-931150c6bee1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1693 microversion: 2.1 time: 0.246147 Oct 31 14:44:58.095209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3224/6199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:57 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1693 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:44:58.913852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:44:58.924445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:58.924937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:58.925378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:58.938128 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] Creating event network-changed:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h1-863052-1 Oct 31 14:44:58.944600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] Instance 3331805a-d7a4-45db-90df-c28e8ed65363 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:44:58.967745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d5a8f8ab-993d-42a5-a9a7-975c72526480 req-1331a3f0-49c9-4d8d-894d-da59fdaaacb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058049 Oct 31 14:44:58.968359 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2976/6200] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:44:59.120190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:44:59.121643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:44:59.129630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:59.130128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:59.131011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:59.131995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:44:59.132629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:44:59.133569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:44:59.368266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:44:59.376327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0744fb88-383f-42a8-bdee-952f0be76252 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1691 microversion: 2.1 time: 0.261945 Oct 31 14:44:59.376917 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3225/6201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:44:59 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1691 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:00.402970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:00.403680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:00.409934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:00.410456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:00.410902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:00.411740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:00.412197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:00.412808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:00.578851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:00.588791 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c8ce444-e2bf-413b-906b-fa6d6009f4c6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1688 microversion: 2.1 time: 0.191338 Oct 31 14:45:00.589619 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2977/6202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:00 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:00.611792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:00.612332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:00.619578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:00.620080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:00.620521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:00.621229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:00.621685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:00.622117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:00.749352 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-daf60394-6e41-402a-88f7-712a7f78ea2a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action" status: 202 len: 0 microversion: 2.1 time: 0.141220 Oct 31 14:45:00.752997 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3226/6203] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:45:00 2022] POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:45:00.760403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:00.761057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:00.768269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:00.769202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:00.769680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:00.770620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:00.771483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:00.772249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:01.049282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:01.058037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d5f37c96-6242-4f30-a078-d93033d8376c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1687 microversion: 2.1 time: 0.303728 Oct 31 14:45:01.058817 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2978/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:00 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1687 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:02.084087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:02.084918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:02.091360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:02.091960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:02.092474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:02.093247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:02.093778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:02.094308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:02.238879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:02.246894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3052d8fc-00f5-44e7-80fd-dc642874cb49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1687 microversion: 2.1 time: 0.168682 Oct 31 14:45:02.247571 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3227/6205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:02 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:03.270440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:03.271704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:03.278979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:03.279461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:03.280001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:03.280643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:03.281097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:03.281518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:03.443306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:03.453740 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4fc6cc32-fd57-4112-9ccd-5c1dfc76cfe6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1687 microversion: 2.1 time: 0.187322 Oct 31 14:45:03.472032 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2979/6206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:03 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1687 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:04.414648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:04.426104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:04.426605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:04.427827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:04.441350 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] Creating event network-changed:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:45:04.449238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] Instance 3331805a-d7a4-45db-90df-c28e8ed65363 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:45:04.463941 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-69877547-3c9d-4238-a59a-f22e0b32a603 req-cfe21d96-e466-4dd2-bfc8-dd0f6d0b69ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052892 Oct 31 14:45:04.464556 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3228/6207] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:45:04.478469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:04.479955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:04.488185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:04.488896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:04.489525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:04.491051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:04.491708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:04.492340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:04.732484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:04.741262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44fc3639-ca11-45d3-8ac4-bcfb5573023a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1687 microversion: 2.1 time: 0.266701 Oct 31 14:45:04.755247 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2980/6208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:04 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1687 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:05.766612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:05.767458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:05.773665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:05.774157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:05.774628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:05.775328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:05.775786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:05.776220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:05.918060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:05.926573 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f587912-d9f9-44cf-ae9c-71f576dddd21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1687 microversion: 2.1 time: 0.165221 Oct 31 14:45:05.927725 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3229/6209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:05 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:06.952439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:06.952827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:06.960343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:06.960843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:06.961293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:06.962010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:06.962503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:06.962932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:07.112611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:07.120554 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0223767e-87a0-4d60-9e49-489a06eb520a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1680 microversion: 2.1 time: 0.172244 Oct 31 14:45:07.121147 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2981/6210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:06 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:10.416112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7e8b9a33-0c44-445a-8965-76928fc075b0 req-9efebf17-432f-49e4-90e6-f482863d8a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "name": "network-vif-plugged", "status": "completed", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:10.425626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e8b9a33-0c44-445a-8965-76928fc075b0 req-9efebf17-432f-49e4-90e6-f482863d8a59 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:10.426099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e8b9a33-0c44-445a-8965-76928fc075b0 req-9efebf17-432f-49e4-90e6-f482863d8a59 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:10.426553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7e8b9a33-0c44-445a-8965-76928fc075b0 req-9efebf17-432f-49e4-90e6-f482863d8a59 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:10.437417 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7e8b9a33-0c44-445a-8965-76928fc075b0 req-9efebf17-432f-49e4-90e6-f482863d8a59 service nova] Creating event network-vif-plugged:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:45:10.443101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7e8b9a33-0c44-445a-8965-76928fc075b0 req-9efebf17-432f-49e4-90e6-f482863d8a59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198502 Oct 31 14:45:10.443881 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3230/6211] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:45:31.330203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:31.333166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:31.335763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=31 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:31.336453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:31.342900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:31.343402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:31.343850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:31.344572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:31.345226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:31.345664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:31.405392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0fd87219-19b9-45fc-9334-8c22ce8cd406 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action" status: 200 len: 63126 microversion: 2.1 time: 0.079020 Oct 31 14:45:31.406362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2982/6212] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:45:31 2022] POST /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363/action => generated 63126 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:45:37.639068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:37.639815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:37.642189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:37.642912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:37.649320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:37.649814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:37.650309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:37.651005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:37.651463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:37.651892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:37.787988 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cc944ed-69fd-48fa-b374-0b97a197469e tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1831 microversion: 2.1 time: 0.153141 Oct 31 14:45:37.788574 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3231/6213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:37 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1831 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:39.001089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:39.001581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-acc9ac74-697b-4705-848f-1e858ce0a70a req-2a436d7c-a1da-4683-8cbf-894b8dffc37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:39.002626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:39.011557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:39.012316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:39.012943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:39.013802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-acc9ac74-697b-4705-848f-1e858ce0a70a req-2a436d7c-a1da-4683-8cbf-894b8dffc37a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:39.013998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:39.014624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-acc9ac74-697b-4705-848f-1e858ce0a70a req-2a436d7c-a1da-4683-8cbf-894b8dffc37a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:39.014815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:39.015193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-acc9ac74-697b-4705-848f-1e858ce0a70a req-2a436d7c-a1da-4683-8cbf-894b8dffc37a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:39.015587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:39.036400 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-acc9ac74-697b-4705-848f-1e858ce0a70a req-2a436d7c-a1da-4683-8cbf-894b8dffc37a service nova] Creating event network-changed:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:45:39.046961 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-acc9ac74-697b-4705-848f-1e858ce0a70a req-2a436d7c-a1da-4683-8cbf-894b8dffc37a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052911 Oct 31 14:45:39.048249 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3232/6214] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:45:39.053557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:45:39.150719 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6939e04c-dd7b-40a7-8085-ad850f1f8c38 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 204 len: 0 microversion: 2.1 time: 0.160026 Oct 31 14:45:39.162651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:39.163367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:39.166085 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2983/6215] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:45:38 2022] DELETE /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:39.172269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:39.172772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:39.173217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:39.173931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:39.174462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:39.175032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:39.389718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:39.399026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7353b309-af96-464a-b1d3-ee56f5c2f5f7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1686 microversion: 2.1 time: 0.242600 Oct 31 14:45:39.400097 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3233/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:39 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1686 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:40.423553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:40.424267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:40.431876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:40.432580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:40.433033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:40.433739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:40.434424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:40.434864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:40.586150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:40.594576 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37933efd-a19b-40eb-aa6c-25988cedddc6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 200 len: 1686 microversion: 2.1 time: 0.175308 Oct 31 14:45:40.595267 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2984/6217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:40 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:41.062891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d4df2010-574c-4c7b-b6cf-4a54e4d91a4c req-e2a9aeb6-2014-4134-b853-e0d86223153e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331805a-d7a4-45db-90df-c28e8ed65363", "name": "network-vif-deleted", "tag": "7698d30d-d909-4b83-92c3-b477e9c1c185"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:41.073493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d4df2010-574c-4c7b-b6cf-4a54e4d91a4c req-e2a9aeb6-2014-4134-b853-e0d86223153e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:41.073972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d4df2010-574c-4c7b-b6cf-4a54e4d91a4c req-e2a9aeb6-2014-4134-b853-e0d86223153e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:41.074445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d4df2010-574c-4c7b-b6cf-4a54e4d91a4c req-e2a9aeb6-2014-4134-b853-e0d86223153e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:41.087149 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d4df2010-574c-4c7b-b6cf-4a54e4d91a4c req-e2a9aeb6-2014-4134-b853-e0d86223153e service nova] Creating event network-vif-deleted:7698d30d-d909-4b83-92c3-b477e9c1c185 for instance 3331805a-d7a4-45db-90df-c28e8ed65363 on n-h2-863052-1 Oct 31 14:45:41.092332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d4df2010-574c-4c7b-b6cf-4a54e4d91a4c req-e2a9aeb6-2014-4134-b853-e0d86223153e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033497 Oct 31 14:45:41.093809 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3234/6218] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:45:41.619600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:41.620223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: 3331805a-d7a4-45db-90df-c28e8ed65363] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:41.627703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:41.628148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:41.628601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:41.629888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:41.630340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:41.630776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:41.645599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] HTTP exception thrown: Instance 3331805a-d7a4-45db-90df-c28e8ed65363 could not be found. Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Request method failure captured: Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 HTTP/1.1 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX96mgtaOTLtPuKtnhPLz3REpHeArWDPtiA00bG2Yd2IDjcqvZayMCsFTe0kjgn11Qua7g0ObEQKHarBlDqOl_Xg9vDsbjfScOTNmpsQarhkxLY89dgKSxTlNOGpUTO9FRnGb0w_I8aJo6PfdkWDhATS78BFCzz77MYeMJ6rcdUKmi-o Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7f152314f7d4b67b90d8df1058173bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 540514132f50424ab738477360754cca Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 3331805a-d7a4-45db-90df-c28e8ed65363 could not be found. Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '3331805a-d7a4-45db-90df-c28e8ed65363'} Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3331805a-d7a4-45db-90df-c28e8ed65363 could not be found. Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3331805a-d7a4-45db-90df-c28e8ed65363 could not be found. Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:45:41.647300 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3331805a-d7a4-45db-90df-c28e8ed65363 could not be found. Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Returning 404 to user: Instance 3331805a-d7a4-45db-90df-c28e8ed65363 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3aff2765-bfee-41c2-8e1f-f4ad5f1b9ff9 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363" status: 404 len: 111 microversion: 2.1 time: 0.033081 Oct 31 14:45:41.652393 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2985/6219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:41 2022] GET /compute/v2.1/servers/3331805a-d7a4-45db-90df-c28e8ed65363 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:45:45.288151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af68feee-0d96-4d76-9e2f-d32c45cd3bee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '.version_select at 0x7fe106504dc0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:45.320065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af68feee-0d96-4d76-9e2f-d32c45cd3bee tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-840260688" status: 202 len: 0 microversion: 2.1 time: 0.036605 Oct 31 14:45:45.321090 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3235/6220] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 14:45:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-840260688 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:45:45.359458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31f79c97-4055-4751-8fe6-1a93219f5ecf tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: .version_select at 0x7fe106a50af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1124272568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVRCcGEOT5Kd2cjQPgg2OCzyfnGD5NuHbRON2Uj7BFYdC40ByEuHWl7CAfRzOLE8PYrXaFXl70omve8JIy9kkQBcfBs3de43c1UmtT3VVE5xXTipbm7RgIy/QZvV4tcmA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:45.375977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-31f79c97-4055-4751-8fe6-1a93219f5ecf tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:45:45.383388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-31f79c97-4055-4751-8fe6-1a93219f5ecf tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:45:45.406858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31f79c97-4055-4751-8fe6-1a93219f5ecf tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055135 Oct 31 14:45:45.407453 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2986/6221] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:45:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:45:51.426760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:51.431646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-827884177", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "aa35aff6-12c0-4f86-8c75-7a5dee045e27"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1124272568", "security_groups": [{"name": "tempest-secgroup-smoke-486415834"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:51.600752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] validate_networks() for [('aa35aff6-12c0-4f86-8c75-7a5dee045e27', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:45:52.085648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:45:52.086068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:45:52.087173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:45:52.087587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:45:52.088002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:45:52.103311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:52.104200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:52.104898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:52.105629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:52.106081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:52.106554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:52.132759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:45:52.140694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:45:52.155841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:45:52.158589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:45:52.219514 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-531531ae-5232-48a0-aa80-81d0e8864a59 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.794710 Oct 31 14:45:52.220170 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3236/6222] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:45:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:45:52.234447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:52.239461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-714f8d25-85ab-4828-9531-faf4c2cf5d5a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:52.240097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-714f8d25-85ab-4828-9531-faf4c2cf5d5a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:52.317036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-714f8d25-85ab-4828-9531-faf4c2cf5d5a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:52.324147 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-714f8d25-85ab-4828-9531-faf4c2cf5d5a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1266 microversion: 2.1 time: 0.095782 Oct 31 14:45:52.324732 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2987/6223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:52 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:45:53.349428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:53.350023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:53.360895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:53.361391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:53.361835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:53.365933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:53.366434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:53.369201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:53.449767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:53.460332 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84ffc9c6-f851-489d-855d-6d8a24c8515a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1318 microversion: 2.1 time: 0.115999 Oct 31 14:45:53.460933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3237/6224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:53 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1318 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:54.483782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:54.484490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:54.492345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:54.493112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:54.493723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:54.494633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:54.495250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:54.495840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:54.733185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:54.741761 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba9f9845-267e-444a-b6fe-2d965354764c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.262286 Oct 31 14:45:54.758696 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2988/6225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:54 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:55.565704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6f3aee86-949f-48cd-8e8e-bf61e9a9e452 req-a369a680-cfc8-4fde-83f6-6daa8bc04197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:45:55.577864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6f3aee86-949f-48cd-8e8e-bf61e9a9e452 req-a369a680-cfc8-4fde-83f6-6daa8bc04197 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:55.578877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6f3aee86-949f-48cd-8e8e-bf61e9a9e452 req-a369a680-cfc8-4fde-83f6-6daa8bc04197 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:55.579554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6f3aee86-949f-48cd-8e8e-bf61e9a9e452 req-a369a680-cfc8-4fde-83f6-6daa8bc04197 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:55.591838 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6f3aee86-949f-48cd-8e8e-bf61e9a9e452 req-a369a680-cfc8-4fde-83f6-6daa8bc04197 service nova] Creating event network-changed:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h2-863052-1 Oct 31 14:45:55.597401 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6f3aee86-949f-48cd-8e8e-bf61e9a9e452 req-a369a680-cfc8-4fde-83f6-6daa8bc04197 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036740 Oct 31 14:45:55.599183 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3238/6226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:45:55.765317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:55.766025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:55.773157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:55.773766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:55.774334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:55.775298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:55.775820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:55.776332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:55.932622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:55.942614 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd827caa-4f22-4ec7-b87b-c7ed110c60d8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.181395 Oct 31 14:45:55.943229 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2989/6227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:55 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:56.968050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:56.968851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:56.975548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:56.976361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:56.977015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:56.978025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:56.978516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:56.979199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:57.225166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:57.233879 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0866aba0-82c4-41c3-b182-734f6a43bdae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.270861 Oct 31 14:45:57.234634 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3239/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:56 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:58.258999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:58.259624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:58.266550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:58.267067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:58.267516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:58.268254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:58.268716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:58.269152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:58.404836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:58.412625 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c932fa3c-aac4-4b19-9764-b6b7f49dd274 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.158486 Oct 31 14:45:58.413195 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2990/6229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:58 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:59.435890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:45:59.436464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:45:59.444073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:59.444556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:59.444992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:59.445709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:45:59.446186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:45:59.446637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:45:59.583458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:45:59.591263 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f73f328-c173-4235-8341-ff59266c0070 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.159342 Oct 31 14:45:59.591835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3240/6230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:45:59 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:00.614714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:00.615345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:00.622655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:00.623189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:00.623636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:00.624359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:00.624821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:00.625250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:00.774126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:00.789141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c521d949-f0b7-4f77-8cff-8fce6dbb0f61 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.178129 Oct 31 14:46:00.791961 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2991/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:00 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:01.811722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:01.812392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:01.819945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:01.820433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:01.820875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:01.821577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:01.822035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:01.822486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:01.957167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:01.965735 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd162c75-f49d-494e-9bdf-92e6d8ed28e5 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.157866 Oct 31 14:46:01.966490 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3241/6232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:01 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:02.481895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-014e7feb-90f9-4f94-bf63-fb7e8a290ba9 req-8e6ebe18-be75-44bd-9410-0808fdeb52a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "name": "network-vif-plugged", "status": "completed", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:02.487881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:02.488656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:02.497072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-014e7feb-90f9-4f94-bf63-fb7e8a290ba9 req-8e6ebe18-be75-44bd-9410-0808fdeb52a5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:02.498465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-014e7feb-90f9-4f94-bf63-fb7e8a290ba9 req-8e6ebe18-be75-44bd-9410-0808fdeb52a5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:02.498904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-014e7feb-90f9-4f94-bf63-fb7e8a290ba9 req-8e6ebe18-be75-44bd-9410-0808fdeb52a5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:02.511574 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-014e7feb-90f9-4f94-bf63-fb7e8a290ba9 req-8e6ebe18-be75-44bd-9410-0808fdeb52a5 service nova] Creating event network-vif-plugged:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h2-863052-1 Oct 31 14:46:02.516755 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-014e7feb-90f9-4f94-bf63-fb7e8a290ba9 req-8e6ebe18-be75-44bd-9410-0808fdeb52a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039120 Oct 31 14:46:02.517352 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2992/6233] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:02.989906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:02.990595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:02.992496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:02.993261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:02.999371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:02.999854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:03.000289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:03.000972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:03.001423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:03.001848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:03.133872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:03.141490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f32ecb6-7551-475b-a6f7-c760b11f39d4 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1391 microversion: 2.1 time: 0.156043 Oct 31 14:46:03.142054 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3242/6234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:02 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:04.164545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:04.165909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:04.172975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:04.173463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:04.173902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:04.174619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:04.175071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:04.175500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:04.322149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:04.330600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1d24f8a-d87e-4e2a-8c53-2171ea1e94c1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1563 microversion: 2.1 time: 0.170248 Oct 31 14:46:04.331486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2993/6235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:04 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:04.353720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:04.354531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:04.361678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:04.362338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:04.362877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:04.364208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:04.364662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:04.365085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:04.503706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:04.511944 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5a38294-a53a-4356-baba-22bd856d8d4b tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1563 microversion: 2.1 time: 0.162254 Oct 31 14:46:04.512518 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3243/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:04 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:06.499866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9b4a0bbb-912b-43b4-a798-13fbd3e47e59 req-49928d0f-1df1-4d34-ba1d-bc60b2cd2a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:06.502032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:06.505427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:06.517093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:06.519296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:06.521471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:06.522422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:06.525524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:06.526157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:06.530950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9b4a0bbb-912b-43b4-a798-13fbd3e47e59 req-49928d0f-1df1-4d34-ba1d-bc60b2cd2a1a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:06.531740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9b4a0bbb-912b-43b4-a798-13fbd3e47e59 req-49928d0f-1df1-4d34-ba1d-bc60b2cd2a1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:06.532342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9b4a0bbb-912b-43b4-a798-13fbd3e47e59 req-49928d0f-1df1-4d34-ba1d-bc60b2cd2a1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:06.549647 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9b4a0bbb-912b-43b4-a798-13fbd3e47e59 req-49928d0f-1df1-4d34-ba1d-bc60b2cd2a1a service nova] Creating event network-changed:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h2-863052-1 Oct 31 14:46:06.558634 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9b4a0bbb-912b-43b4-a798-13fbd3e47e59 req-49928d0f-1df1-4d34-ba1d-bc60b2cd2a1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062489 Oct 31 14:46:06.563881 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3244/6237] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:06.682911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:06.691860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ffe98a9b-1c9d-4eb3-8d58-e91ef30e42b0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1563 microversion: 2.1 time: 0.200467 Oct 31 14:46:06.702647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2994/6238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:06 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1563 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:27.960181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:27.962479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:27.965592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:27.966275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=42 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:27.973225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:27.973712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:27.974143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:27.974864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:27.975309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:27.975728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:28.032685 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98399860-9444-4f26-8547-ff378f91b49f tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action" status: 200 len: 24566 microversion: 2.1 time: 0.077632 Oct 31 14:46:28.033686 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3245/6239] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:46:27 2022] POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action => generated 24566 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:46:34.416531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:34.417147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:34.419512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:34.420334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:34.427989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:34.428484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:34.428933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:34.429641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:34.430101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:34.430558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:34.565914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:34.573912 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78c0eef4-f564-4b1d-b435-1e8a10775e5d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1682 microversion: 2.1 time: 0.161542 Oct 31 14:46:34.574530 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2995/6240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:34 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:34.672991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:34.675299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:34.683197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:34.683685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:34.684125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:34.684814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:34.685267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:34.685690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:34.741343 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff94d8f0-9b9c-48f4-b9b8-eeceabf598e8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action" status: 200 len: 32638 microversion: 2.1 time: 0.072525 Oct 31 14:46:34.742028 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3246/6241] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:46:34 2022] POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:46:34.916413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:34.917036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:34.923454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:34.923948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:34.924422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:34.925244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:34.925735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:34.926161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:35.072787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b3a9a87-550f-4192-a4c5-65c62a083115 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1833 microversion: 2.1 time: 0.160174 Oct 31 14:46:35.073374 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2996/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:34 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1833 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:35.103494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:35.106558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:35.113956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:35.114467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:35.114900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:35.115666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:35.116091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:35.116512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:35.142425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lazy-loading 'flavor' on Instance uuid da444c8b-198c-4840-946b-3987e559b3de {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:46:35.155264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: da444c8b-198c-4840-946b-3987e559b3de] Going to try to live migrate instance to another host {{(pid=120640) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 31 14:46:36.472718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-490b1583-98cb-45e5-a421-218421f5ccba tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action" status: 202 len: 0 microversion: 2.1 time: 1.373171 Oct 31 14:46:36.478280 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3247/6243] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:46:35 2022] POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action => generated 0 bytes in 1380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:46:36.485885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:36.486733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:36.497230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:36.497755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:36.498504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:36.499579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:36.500048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:36.500484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:36.700204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:36.709719 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7e165a72-09ca-4033-91fb-76fc280b016c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.230619 Oct 31 14:46:36.711733 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2997/6244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:36 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:46:37.735329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:37.735954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:37.744049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:37.744544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:37.744988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:37.745697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:37.746151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:37.746762 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:37.889461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:37.899928 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d236160c-a1a1-4420-9149-1f9d7c95cf82 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.168544 Oct 31 14:46:37.900644 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3248/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:37 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:38.030886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-85880f92-d203-4b5c-9ef3-34c649243eff req-d9a1ab39-0f4c-4ac5-a0e2-06977383497a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "name": "network-vif-unplugged", "status": "completed", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:38.042397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-85880f92-d203-4b5c-9ef3-34c649243eff req-d9a1ab39-0f4c-4ac5-a0e2-06977383497a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:38.043228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-85880f92-d203-4b5c-9ef3-34c649243eff req-d9a1ab39-0f4c-4ac5-a0e2-06977383497a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:38.043897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-85880f92-d203-4b5c-9ef3-34c649243eff req-d9a1ab39-0f4c-4ac5-a0e2-06977383497a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:38.055828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-85880f92-d203-4b5c-9ef3-34c649243eff req-d9a1ab39-0f4c-4ac5-a0e2-06977383497a service nova] Creating event network-vif-unplugged:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h2-863052-1 Oct 31 14:46:38.062035 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-85880f92-d203-4b5c-9ef3-34c649243eff req-d9a1ab39-0f4c-4ac5-a0e2-06977383497a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108372 Oct 31 14:46:38.062983 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2998/6246] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:38.923915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:38.924568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:38.932081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:38.932577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:38.933022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:38.933729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:38.934207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:38.934643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:39.077010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:39.085434 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89ef500f-4dd1-47ee-9707-b69090787a21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.165577 Oct 31 14:46:39.086021 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3249/6247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:38 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:40.080830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-79e6c2de-6f83-4129-92d2-d801ce153461 req-0624e1a5-d876-428f-aa78-5e14ecb96ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:40.091839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79e6c2de-6f83-4129-92d2-d801ce153461 req-0624e1a5-d876-428f-aa78-5e14ecb96ddf service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:40.092309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79e6c2de-6f83-4129-92d2-d801ce153461 req-0624e1a5-d876-428f-aa78-5e14ecb96ddf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:40.093240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-79e6c2de-6f83-4129-92d2-d801ce153461 req-0624e1a5-d876-428f-aa78-5e14ecb96ddf service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:40.108813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:40.109333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:40.116789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-79e6c2de-6f83-4129-92d2-d801ce153461 req-0624e1a5-d876-428f-aa78-5e14ecb96ddf service nova] Creating event network-changed:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h2-863052-1 Oct 31 14:46:40.119461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:40.123362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:40.124175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:40.125101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:40.125752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:40.127520 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-79e6c2de-6f83-4129-92d2-d801ce153461 req-0624e1a5-d876-428f-aa78-5e14ecb96ddf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052820 Oct 31 14:46:40.128130 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2999/6248] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:40.128840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:40.402872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:40.411492 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f745c5e6-1ed3-495f-8de5-21cd36094db7 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.306764 Oct 31 14:46:40.412135 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3250/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:40 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:46:41.437507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:41.438350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:41.444777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:41.445273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:41.445722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:41.446459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:41.446925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:41.447363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:41.588796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:41.600818 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e116e6db-c365-4d2f-9f31-f7a8cb9e6000 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.164687 Oct 31 14:46:41.600818 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3000/6250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:41 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:42.620314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:42.620864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:42.627463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:42.627949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:42.628389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:42.629713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:42.630196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:42.630620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:42.768366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:42.776123 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f1e068e-324b-4375-a328-ae1d950bd758 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.159851 Oct 31 14:46:42.776688 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3251/6251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:42 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:43.973610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:43.974266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:43.980367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:43.981120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:43.981572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:43.982317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:43.982783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:43.983214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:44.122039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:44.132141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7941ef6-68d1-4423-80e8-7208dd18f241 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1692 microversion: 2.1 time: 0.336243 Oct 31 14:46:44.132727 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3001/6252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:43 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1692 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:45.155503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:45.156767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:45.163885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.164381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.164820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.165519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.165972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.166583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.301535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:45.309577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-925db5c3-e7ed-4621-a9ed-64007fc9c109 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1682 microversion: 2.1 time: 0.158533 Oct 31 14:46:45.310159 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3252/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:45 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:45.332192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:45.332788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:45.339787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.340277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.340722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.341416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.341877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.342343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.484754 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1da4f8bf-a9c6-42ff-ad47-ffab5c961786 tempest-TestNetworkAdvancedServerOps-1774756479 tempest-TestNetworkAdvancedServerOps-1774756479-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1833 microversion: 2.1 time: 0.155730 Oct 31 14:46:45.485905 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3002/6254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:45 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1833 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:46:45.516131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:45.516750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:45.525445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.525926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.526395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.527095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.527551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.527978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.678859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:45.687582 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cca8349c-a421-42e0-9add-e3ac47783674 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1682 microversion: 2.1 time: 0.182828 Oct 31 14:46:45.688171 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3253/6255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:45 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:45.808875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:45.813622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:45.820742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.823165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.823676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.824522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:45.825364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:45.826624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:45.885372 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b55445e-1a47-4ddc-8901-da1bd22fe68c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action" status: 200 len: 38340 microversion: 2.1 time: 0.081287 Oct 31 14:46:45.886333 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3003/6256] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:46:45 2022] POST /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de/action => generated 38340 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:46:46.900949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:46.901463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:46.904798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4525a55b-6256-47ee-aa36-076f9cb9e530 req-bb35afba-3747-4bc5-87b8-105c2c9a923d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:46.908588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:46.909539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:46.910746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:46.911811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:46.912494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:46.913259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:46.919919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4525a55b-6256-47ee-aa36-076f9cb9e530 req-bb35afba-3747-4bc5-87b8-105c2c9a923d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:46.921136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4525a55b-6256-47ee-aa36-076f9cb9e530 req-bb35afba-3747-4bc5-87b8-105c2c9a923d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:46.921826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4525a55b-6256-47ee-aa36-076f9cb9e530 req-bb35afba-3747-4bc5-87b8-105c2c9a923d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:46.943273 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4525a55b-6256-47ee-aa36-076f9cb9e530 req-bb35afba-3747-4bc5-87b8-105c2c9a923d service nova] Creating event network-changed:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h1-863052-1 Oct 31 14:46:46.943937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:46:46.953469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4525a55b-6256-47ee-aa36-076f9cb9e530 req-bb35afba-3747-4bc5-87b8-105c2c9a923d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051708 Oct 31 14:46:46.954802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3004/6257] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:47.035752 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a98ed15c-9aea-455f-a749-6c4ded6cd9b1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 204 len: 0 microversion: 2.1 time: 0.138474 Oct 31 14:46:47.036992 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3254/6258] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:46:46 2022] DELETE /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:47.046206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:47.047131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:47.057876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:47.059226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:47.060009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:47.061531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:47.062282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:47.063683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:47.206542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:47.220069 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc6763f6-f16e-4516-a70c-24ba971a4508 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1688 microversion: 2.1 time: 0.178479 Oct 31 14:46:47.222226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3005/6259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:47 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:48.247261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:48.248039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:48.255724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:48.256218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:48.256656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:48.257372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:48.257837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:48.258294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:48.303345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:48.303842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:48.304284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:48.304740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lazy-loading 'fault' on Instance uuid da444c8b-198c-4840-946b-3987e559b3de {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:46:48.351978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:46:48.360694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-199bdc68-2128-4de9-a377-d64d75424088 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 200 len: 1356 microversion: 2.1 time: 0.118109 Oct 31 14:46:48.362001 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3255/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:48 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:46:48.969066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2a1b1424-5a5b-466c-bfc5-1900d27922ab req-a14e0a39-6674-44ad-898d-32447bd0e9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da444c8b-198c-4840-946b-3987e559b3de", "name": "network-vif-deleted", "tag": "69859bd8-0413-42ce-a49e-731210acdf68"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:48.979981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a1b1424-5a5b-466c-bfc5-1900d27922ab req-a14e0a39-6674-44ad-898d-32447bd0e9b8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:48.980464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a1b1424-5a5b-466c-bfc5-1900d27922ab req-a14e0a39-6674-44ad-898d-32447bd0e9b8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:48.981145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2a1b1424-5a5b-466c-bfc5-1900d27922ab req-a14e0a39-6674-44ad-898d-32447bd0e9b8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:48.992829 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2a1b1424-5a5b-466c-bfc5-1900d27922ab req-a14e0a39-6674-44ad-898d-32447bd0e9b8 service nova] Creating event network-vif-deleted:69859bd8-0413-42ce-a49e-731210acdf68 for instance da444c8b-198c-4840-946b-3987e559b3de on n-h1-863052-1 Oct 31 14:46:48.997687 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2a1b1424-5a5b-466c-bfc5-1900d27922ab req-a14e0a39-6674-44ad-898d-32447bd0e9b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032250 Oct 31 14:46:48.998309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3006/6261] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:49.385773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:49.386602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: da444c8b-198c-4840-946b-3987e559b3de] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:46:49.393532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:49.394027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:49.394509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:49.395255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:46:49.395715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:46:49.396146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:46:49.409696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] HTTP exception thrown: Instance da444c8b-198c-4840-946b-3987e559b3de could not be found. Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Request method failure captured: Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de HTTP/1.1 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX96mgtaOTLtPuKtnhPLz3REpHeArWDPtiA00bG2Yd2IDjcqvZayMCsFTe0kjgn11Qua7g0ObEQKHarBlDqOl_Xg9vDsbjfScOTNmpsQarhkxLY89dgKSxTlNOGpUTO9FRnGb0w_I8aJo6PfdkWDhATS78BFCzz77MYeMJ6rcdUKmi-o Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7f152314f7d4b67b90d8df1058173bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 540514132f50424ab738477360754cca Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance da444c8b-198c-4840-946b-3987e559b3de could not be found. Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'da444c8b-198c-4840-946b-3987e559b3de'} Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da444c8b-198c-4840-946b-3987e559b3de could not be found. Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da444c8b-198c-4840-946b-3987e559b3de could not be found. Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:46:49.411385 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da444c8b-198c-4840-946b-3987e559b3de could not be found. Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Returning 404 to user: Instance da444c8b-198c-4840-946b-3987e559b3de could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4ad66b8-f2e4-47bc-809d-7d7a592b4114 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de" status: 404 len: 111 microversion: 2.1 time: 0.030920 Oct 31 14:46:49.416644 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3256/6262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:46:49 2022] GET /compute/v2.1/servers/da444c8b-198c-4840-946b-3987e559b3de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:46:52.996256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d59208d7-fa9f-4ecf-a94c-018739b8979a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '.version_select at 0x7fe10c2ef040>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:46:53.048907 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d59208d7-fa9f-4ecf-a94c-018739b8979a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1124272568" status: 202 len: 0 microversion: 2.1 time: 0.057249 Oct 31 14:46:53.059318 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3007/6263] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 31 14:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1124272568 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:46:53.083583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2182c8f3-9ba5-4e3d-b084-4eb502641730 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: .version_select at 0x7fe1064f7ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-243644116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaioEnfK+L0uLcb8WY5qNwkcn7/hAWjcrIn3rstBZ+kvGUJwXQ0ibEkQDsF/OC8aT6c22iMoR0xfLnffG77Kur+48dZJd/g5nAfMvj1LzUVyhpO2JSxACSKQLrWkNkccg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:53.100606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2182c8f3-9ba5-4e3d-b084-4eb502641730 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:46:53.108450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2182c8f3-9ba5-4e3d-b084-4eb502641730 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:46:53.143675 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2182c8f3-9ba5-4e3d-b084-4eb502641730 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.066540 Oct 31 14:46:53.144335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3257/6264] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:46:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:46:59.315320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1995844654", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "ea673b84-4903-4091-9c84-bcdafb563135"}], "key_name": "tempest-TestNetworkAdvancedServerOps-243644116", "security_groups": [{"name": "tempest-secgroup-smoke-1872931171"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:46:59.348169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=54 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:59.503253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] validate_networks() for [('ea673b84-4903-4091-9c84-bcdafb563135', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:47:00.136455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:47:00.137195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:47:00.138134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:47:00.138818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:47:00.139499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:47:00.150472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:00.151386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:00.152211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:00.153264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:00.154029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:00.154792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:00.183310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:47:00.190194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Getting quotas for user 540514132f50424ab738477360754cca and project b7f152314f7d4b67b90d8df1058173bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:47:00.205337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:47:00.208021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:47:00.262937 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9af70403-eb58-44c1-8de9-d60fb1cb3dde tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.954466 Oct 31 14:47:00.263597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3008/6265] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:46:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:47:00.275501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f58c09de-e90a-4412-a999-4a2afdd55ebb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:00.276282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f58c09de-e90a-4412-a999-4a2afdd55ebb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:00.303126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.310257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.399646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f58c09de-e90a-4412-a999-4a2afdd55ebb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:00.407773 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f58c09de-e90a-4412-a999-4a2afdd55ebb tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1266 microversion: 2.1 time: 0.136586 Oct 31 14:47:00.408372 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3258/6266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:00 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:01.433533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:01.433990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:01.449810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:01.450422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:01.451236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:01.451948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:01.452577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:01.453014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:01.553893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:01.565522 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-59bedfec-a62d-4844-9e44-b2ed1c20fd09 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1326 microversion: 2.1 time: 0.136320 Oct 31 14:47:01.568824 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3009/6267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:01 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1326 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:02.595554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:02.596386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:02.604102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:02.611521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:02.612201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:02.613145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:02.613721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:02.614456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:02.882042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:02.891932 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae122277-7c15-449f-a58e-870c8d3a1111 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.301961 Oct 31 14:47:02.893114 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3259/6268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:02 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:03.319260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b7726b90-1e34-432c-9f25-a9d65abd3074 req-91f00271-1996-4d8d-be83-415a10a38c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:03.334535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b7726b90-1e34-432c-9f25-a9d65abd3074 req-91f00271-1996-4d8d-be83-415a10a38c02 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:03.335024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b7726b90-1e34-432c-9f25-a9d65abd3074 req-91f00271-1996-4d8d-be83-415a10a38c02 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:03.335452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b7726b90-1e34-432c-9f25-a9d65abd3074 req-91f00271-1996-4d8d-be83-415a10a38c02 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:03.347428 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b7726b90-1e34-432c-9f25-a9d65abd3074 req-91f00271-1996-4d8d-be83-415a10a38c02 service nova] Creating event network-changed:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:47:03.352705 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b7726b90-1e34-432c-9f25-a9d65abd3074 req-91f00271-1996-4d8d-be83-415a10a38c02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045185 Oct 31 14:47:03.353466 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3010/6269] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:03.919154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:03.919763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:03.926618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:03.927036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:03.927467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:03.928153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:03.928602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:03.929022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:04.075836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:04.085104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a654c30-dae7-4eae-b674-3beb3538851d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.169813 Oct 31 14:47:04.085946 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3260/6270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:03 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:05.112240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:05.113857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:05.123646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.127580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:05.128577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:05.129298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:05.130486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:05.131136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:05.131745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:05.285927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:05.298760 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed690a28-1614-47c4-a260-84cb3d831194 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.191759 Oct 31 14:47:05.299620 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3011/6271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:05 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:06.322623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:06.323244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:06.330741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:06.331274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:06.331757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:06.332457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:06.332918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:06.333348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:06.470383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:06.479513 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b532cf3-eb1a-443f-8ed8-ece8f05538db tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.160766 Oct 31 14:47:06.480111 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3261/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:06 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:06.960547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-516575938", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "65f2d2ce-0d00-41d2-a1da-cb34cc5d7807"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:07.015950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] validate_networks() for [('65f2d2ce-0d00-41d2-a1da-cb34cc5d7807', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:47:07.365448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:47:07.365943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:47:07.366508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:47:07.366985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:47:07.367490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:47:07.376596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:07.377078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:07.377549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:07.378314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:07.378842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:07.379290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:07.396314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Getting quotas for project 264806e4036b413a9cff076742ed1463. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:47:07.401914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Getting quotas for user 5420b3300fe74ac8bb6b8d3689c61aad and project 264806e4036b413a9cff076742ed1463. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:47:07.414235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:47:07.416529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:47:07.462636 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36bec2c0-595b-4d3f-9a71-6c00faa371a5 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625291 Oct 31 14:47:07.463293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3012/6273] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:47:07.474450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57bb18a4-2f05-4734-8d0c-08c92ad86619 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:07.475062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57bb18a4-2f05-4734-8d0c-08c92ad86619 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:07.506443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:07.507212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:07.514534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:07.515312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:07.515816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:07.516660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:07.517181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:07.517671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:07.541878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-57bb18a4-2f05-4734-8d0c-08c92ad86619 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:07.549437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57bb18a4-2f05-4734-8d0c-08c92ad86619 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1214 microversion: 2.1 time: 0.079018 Oct 31 14:47:07.552663 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3262/6274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:07 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:07.659335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:07.667316 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-79fed12e-2c04-4512-9416-428a97473f55 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.165019 Oct 31 14:47:07.667980 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3013/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:07 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:08.572754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:08.574053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:08.583072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:08.583704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:08.584241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:08.585173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:08.585724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:08.586273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:08.664051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:08.672830 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e078b0e4-bf2c-4911-87d6-8bad2940e9c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1272 microversion: 2.1 time: 0.103609 Oct 31 14:47:08.686829 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3263/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:08 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:08.690225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:08.691494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:08.698352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:08.699106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:08.699726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:08.700643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:08.701295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:08.701919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:08.767569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5c304340-9993-4b6c-8c5b-d2aeb9cf766a req-d8f01788-755c-4a65-a8e9-c9b0b56c3f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "name": "network-vif-plugged", "status": "completed", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:08.791863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c304340-9993-4b6c-8c5b-d2aeb9cf766a req-d8f01788-755c-4a65-a8e9-c9b0b56c3f0f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:08.792534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c304340-9993-4b6c-8c5b-d2aeb9cf766a req-d8f01788-755c-4a65-a8e9-c9b0b56c3f0f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:08.793285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c304340-9993-4b6c-8c5b-d2aeb9cf766a req-d8f01788-755c-4a65-a8e9-c9b0b56c3f0f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:08.809196 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5c304340-9993-4b6c-8c5b-d2aeb9cf766a req-d8f01788-755c-4a65-a8e9-c9b0b56c3f0f service nova] Creating event network-vif-plugged:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:47:08.815356 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5c304340-9993-4b6c-8c5b-d2aeb9cf766a req-d8f01788-755c-4a65-a8e9-c9b0b56c3f0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051203 Oct 31 14:47:08.817631 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3264/6277] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:08.845083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:08.855361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7d7b01a-c356-4522-ba1e-7a3615807c21 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.169039 Oct 31 14:47:08.856637 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3014/6278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:08 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:09.703237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:09.704070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:09.711071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:09.711560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:09.711999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:09.712702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:09.713293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:09.713724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:09.878850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:09.879465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:09.886438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:09.886929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:09.887367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:09.888065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:09.888524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:09.888949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:09.917014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:09.926876 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f498e609-128f-46d5-81e1-35281ce2bbc4 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1314 microversion: 2.1 time: 0.230616 Oct 31 14:47:09.927467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3265/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:09 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:10.046724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:10.049104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a78550db-b19e-4f04-9d30-a578d70d0235 req-375ca959-bba4-49a1-9ed6-a654befc6c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42490d7d-ffa8-43fa-b12e-00d98a8c1e4b", "tag": "0e8f837c-779a-45f8-9374-1ee5b6c0c3a4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:10.055536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bf5f2185-fa49-4bd9-afa5-a84101917a13 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1392 microversion: 2.1 time: 0.180552 Oct 31 14:47:10.071129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a78550db-b19e-4f04-9d30-a578d70d0235 req-375ca959-bba4-49a1-9ed6-a654befc6c94 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:10.071129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a78550db-b19e-4f04-9d30-a578d70d0235 req-375ca959-bba4-49a1-9ed6-a654befc6c94 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:10.071129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a78550db-b19e-4f04-9d30-a578d70d0235 req-375ca959-bba4-49a1-9ed6-a654befc6c94 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:10.072035 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3015/6280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:09 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:10.085197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a78550db-b19e-4f04-9d30-a578d70d0235 req-375ca959-bba4-49a1-9ed6-a654befc6c94 service nova] Creating event network-changed:0e8f837c-779a-45f8-9374-1ee5b6c0c3a4 for instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b on n-h1-863052-1 Oct 31 14:47:10.092022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a78550db-b19e-4f04-9d30-a578d70d0235 req-375ca959-bba4-49a1-9ed6-a654befc6c94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046671 Oct 31 14:47:10.092972 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3266/6281] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:47:10.949927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:10.950569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:10.957997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:10.958524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:10.958970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:10.959671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:10.960160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:10.960590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:11.081898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:11.082654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:11.090101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:11.090437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:11.090883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:11.091586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:11.092041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:11.092472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:11.092595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:11.101070 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-287f1053-7ee6-413d-bd72-84b34d446e0d tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1314 microversion: 2.1 time: 0.154985 Oct 31 14:47:11.101665 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3016/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:10 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:11.227576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:11.235545 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a0100ac-aac6-4425-b572-7bab51e483d6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1564 microversion: 2.1 time: 0.158455 Oct 31 14:47:11.236124 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3267/6283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:11 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:11.257981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:11.258638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:11.264545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:11.265038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:11.265486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:11.266194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:11.266672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:11.267101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:11.399086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:11.406869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-863e0b50-e49f-4cc7-93e7-d1c3c97655ac tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1564 microversion: 2.1 time: 0.152721 Oct 31 14:47:11.407434 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3017/6284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:11 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:12.124710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:12.125333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:12.132713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:12.133206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:12.133647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:12.134378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:12.134834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:12.135269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:12.268649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:12.276971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65005780-8cb2-4a34-bc59-49c8aba5a79c tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1314 microversion: 2.1 time: 0.156242 Oct 31 14:47:12.277544 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3268/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:12 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:13.273924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:13.274584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:13.275574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b10ab80a-bc22-4660-907c-efd645e03ba3 req-368eda41-bed3-49bd-a193-27227878b10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:13.281806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:13.282576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:13.283015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:13.286400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b10ab80a-bc22-4660-907c-efd645e03ba3 req-368eda41-bed3-49bd-a193-27227878b10f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:13.286823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b10ab80a-bc22-4660-907c-efd645e03ba3 req-368eda41-bed3-49bd-a193-27227878b10f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:13.287456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b10ab80a-bc22-4660-907c-efd645e03ba3 req-368eda41-bed3-49bd-a193-27227878b10f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:13.293503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:13.294093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:13.294631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:13.303810 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b10ab80a-bc22-4660-907c-efd645e03ba3 req-368eda41-bed3-49bd-a193-27227878b10f service nova] Creating event network-changed:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:47:13.309566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b10ab80a-bc22-4660-907c-efd645e03ba3 req-368eda41-bed3-49bd-a193-27227878b10f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038019 Oct 31 14:47:13.310208 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3269/6286] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:13.317674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:13.318409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:13.324846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:13.325337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:13.325774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:13.326753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:13.327453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:13.328059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:13.460961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:13.469731 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6bdb573-f5c0-4530-886f-dd87e9894104 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1564 microversion: 2.1 time: 0.200264 Oct 31 14:47:13.488832 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3018/6287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:13 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1564 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:13.570685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:13.582982 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acd7a53b-5019-4301-9b42-134561c4606f tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1314 microversion: 2.1 time: 0.271294 Oct 31 14:47:13.584596 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3270/6288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:13 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:14.607004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:14.607613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:14.615341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:14.615832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:14.616270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:14.617100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:14.617673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:14.618126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:14.747451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:14.755123 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec062ed6-b02d-4429-845d-fc838a6effe2 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1314 microversion: 2.1 time: 0.152335 Oct 31 14:47:14.755699 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3019/6289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:14 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:15.639167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-21093697-77ef-47fd-80e3-efe8e56543b7 req-788633bc-7929-489a-8992-23028aeec977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42490d7d-ffa8-43fa-b12e-00d98a8c1e4b", "name": "network-vif-plugged", "status": "completed", "tag": "0e8f837c-779a-45f8-9374-1ee5b6c0c3a4"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:15.650349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-21093697-77ef-47fd-80e3-efe8e56543b7 req-788633bc-7929-489a-8992-23028aeec977 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:15.650839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-21093697-77ef-47fd-80e3-efe8e56543b7 req-788633bc-7929-489a-8992-23028aeec977 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:15.651286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-21093697-77ef-47fd-80e3-efe8e56543b7 req-788633bc-7929-489a-8992-23028aeec977 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:15.663802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-21093697-77ef-47fd-80e3-efe8e56543b7 req-788633bc-7929-489a-8992-23028aeec977 service nova] Creating event network-vif-plugged:0e8f837c-779a-45f8-9374-1ee5b6c0c3a4 for instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b on n-h1-863052-1 Oct 31 14:47:15.668733 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-21093697-77ef-47fd-80e3-efe8e56543b7 req-788633bc-7929-489a-8992-23028aeec977 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 Oct 31 14:47:15.669480 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3271/6290] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:15.778809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:15.779433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:15.786479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:15.786973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:15.787416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:15.788119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:15.788579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:15.789008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:15.922834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:15.931066 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9744212-b3eb-4ee3-b23b-f638c564f1c8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1314 microversion: 2.1 time: 0.156345 Oct 31 14:47:15.931645 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3020/6291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:15 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:16.955686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:16.956986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:16.963259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:16.963771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:16.964235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:16.964925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:16.965434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:16.965862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.095542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:17.103954 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20eadaba-bfc2-469b-982d-74217ab75482 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1502 microversion: 2.1 time: 0.153760 Oct 31 14:47:17.104528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3272/6292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:16 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:17.126347 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:17.126965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:17.133667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:17.134149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:17.134615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.135302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:17.135754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:17.136175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.262694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:17.270967 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f04e34a4-bd33-4fdd-8eff-e54ba0d7e0bc tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1502 microversion: 2.1 time: 0.148482 Oct 31 14:47:17.271543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3021/6293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:17 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:17.293243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:17.293810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:17.299838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:17.300858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:17.301298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.301979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:17.302450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:17.302872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.326607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lazy-loading 'flavor' on Instance uuid 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:47:17.388874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-074dce09-f274-4cd0-a373-4da42ca2d8c9 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action" status: 202 len: 0 microversion: 2.1 time: 0.099242 Oct 31 14:47:17.389477 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3273/6294] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:47:17 2022] POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:47:17.398231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:17.399128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:17.401537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.408522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:17.409254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:17.410434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.411340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:17.411899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:17.412563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:17.413099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=12 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.545799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:17.554153 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea53d97e-898a-4c4b-b488-264794356e98 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1510 microversion: 2.1 time: 0.160493 Oct 31 14:47:17.554755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3022/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:17 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:18.574212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:18.579626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:18.580338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:18.586914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:18.587404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:18.587843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:18.588529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:18.589007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:18.589457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:18.726770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:18.734712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f292b17d-74e8-4c7a-80c8-0279577a92ba tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1493 microversion: 2.1 time: 0.161552 Oct 31 14:47:18.735279 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3274/6296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:18 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1493 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:18.758862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:18.759412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:18.766950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:18.767467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:18.767964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:18.768746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:18.769253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:18.769745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:18.839517 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6632b4d-dfd7-4780-b4d1-f348181b7fa0 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action" status: 202 len: 0 microversion: 2.1 time: 0.084796 Oct 31 14:47:18.840070 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3023/6297] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:47:18 2022] POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:47:18.848945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:18.849563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:18.855644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:18.856390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:18.856827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:18.857551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:18.857981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:18.858446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:19.078622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:19.086745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ebeee53-d9d2-481c-9e27-041ef06e29fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1499 microversion: 2.1 time: 0.242231 Oct 31 14:47:19.087321 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3275/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:18 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1499 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:20.112195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:20.113406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:20.119591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:20.120077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:20.120519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:20.121206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:20.121664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:20.122088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:20.251669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:20.260055 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72ea6e90-4ab5-4ea7-8b5f-609d11910f42 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1502 microversion: 2.1 time: 0.153051 Oct 31 14:47:20.260627 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3024/6299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:20 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:20.282543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:20.283080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:20.290544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:20.291029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:20.291457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:20.292148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:20.292598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:20.293017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:20.317080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lazy-loading 'flavor' on Instance uuid 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:47:20.340242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.382829 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a4deb5c-fbf7-4a57-90d6-09e86a594f76 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action" status: 202 len: 0 microversion: 2.1 time: 0.103941 Oct 31 14:47:20.383501 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3276/6300] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:47:20 2022] POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 14:47:20.392113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:20.392737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:20.398839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:20.399339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:20.399790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:20.400509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:20.400965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:20.401410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:20.420080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.533852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:20.542206 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b3de6db-9f70-45a5-890e-996b92e7bce8 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1510 microversion: 2.1 time: 0.154187 Oct 31 14:47:20.542786 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3025/6301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:20 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:21.567031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:21.567650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:21.573850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:21.574459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:21.574897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:21.575574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:21.576023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:21.576443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:21.708625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:21.716399 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c33686f-03d2-4456-9db8-c7c638be2cf3 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1493 microversion: 2.1 time: 0.155273 Oct 31 14:47:21.716966 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3277/6302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:21 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1493 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:21.739750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:21.740284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:21.747131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:21.747618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:21.748060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:21.748752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:21.749209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:21.749659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:21.814506 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ccaf5d76-0e98-49a0-8d2b-5fdbd953dfbf tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action" status: 202 len: 0 microversion: 2.1 time: 0.078938 Oct 31 14:47:21.815550 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3026/6303] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:47:21 2022] POST /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:47:21.824441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:21.824988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:21.831992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:21.832626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:21.833933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:21.835088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:21.835601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:21.836025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:22.067414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:22.075394 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-771dd439-318b-490b-9691-ab5e20cae732 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1499 microversion: 2.1 time: 0.254806 Oct 31 14:47:22.075933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3278/6304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:21 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1499 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:23.099293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:23.100216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:23.107831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:23.108309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:23.108758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:23.109513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:23.110001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:23.110530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:23.248164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:23.256482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa87f927-7bdf-4d61-866d-9661370677fb tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1502 microversion: 2.1 time: 0.161440 Oct 31 14:47:23.257045 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3027/6305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:23 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:23.278769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:23.279291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:23.285884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:23.286408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:23.286855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:23.287548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:23.288008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:23.288437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:23.314561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:47:23.388397 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa281bbc-42a8-4f2d-b640-7a12a8fdf928 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "DELETE /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 204 len: 0 microversion: 2.1 time: 0.113462 Oct 31 14:47:23.388923 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3279/6306] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:47:23 2022] DELETE /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:23.398096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:23.398913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:23.406353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:23.406898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:23.407411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:23.408207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:23.408711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:23.409182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:23.539944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:23.547581 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ae381a6-59bb-4dc1-8d35-a3bda389b857 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1508 microversion: 2.1 time: 0.154130 Oct 31 14:47:23.548151 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3028/6307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:23 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:24.572768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:24.573393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:24.580006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:24.580486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:24.580920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:24.581645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:24.582089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:24.582598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:24.713053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:24.721632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de383db0-d79f-4969-86dc-9dbfbc9fe87e tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1508 microversion: 2.1 time: 0.153203 Oct 31 14:47:24.722297 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3280/6308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:24 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:25.564179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b4a19701-b581-4d77-a521-e37a6b0e07e9 req-a46ddece-18b2-41b8-ab0a-adf5512fe58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42490d7d-ffa8-43fa-b12e-00d98a8c1e4b", "name": "network-vif-deleted", "tag": "0e8f837c-779a-45f8-9374-1ee5b6c0c3a4"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:25.574647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b4a19701-b581-4d77-a521-e37a6b0e07e9 req-a46ddece-18b2-41b8-ab0a-adf5512fe58d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:25.575126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b4a19701-b581-4d77-a521-e37a6b0e07e9 req-a46ddece-18b2-41b8-ab0a-adf5512fe58d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:25.575553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b4a19701-b581-4d77-a521-e37a6b0e07e9 req-a46ddece-18b2-41b8-ab0a-adf5512fe58d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:25.588103 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b4a19701-b581-4d77-a521-e37a6b0e07e9 req-a46ddece-18b2-41b8-ab0a-adf5512fe58d service nova] Creating event network-vif-deleted:0e8f837c-779a-45f8-9374-1ee5b6c0c3a4 for instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b on n-h1-863052-1 Oct 31 14:47:25.592899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b4a19701-b581-4d77-a521-e37a6b0e07e9 req-a46ddece-18b2-41b8-ab0a-adf5512fe58d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Oct 31 14:47:25.593486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3029/6309] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:25.746854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:25.747469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:25.754721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:25.755207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:25.755644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:25.756328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:25.756777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:25.757199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:25.787680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:25.788161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:25.788602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:25.789080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lazy-loading 'fault' on Instance uuid 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:47:25.829591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5420b3300fe74ac8bb6b8d3689c61aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264806e4036b413a9cff076742ed1463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:25.837993 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8bec8ff-9650-4f76-bb8f-4fb81ccec5db tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 200 len: 1304 microversion: 2.1 time: 0.095032 Oct 31 14:47:25.838591 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3281/6310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:25 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:26.869954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:26.870788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] [instance: 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:26.880379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:26.880879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:26.881323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:26.882060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:26.882544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:26.882974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:26.899559 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] HTTP exception thrown: Instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b could not be found. Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Request method failure captured: Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b HTTP/1.1 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX9_p6wJaZlLMVQ9xNFBkDmZkxVgQg0-JQTjIosd1Q3gQmFrWU1NhjGpOPPfLf0Q-nF1jEtZdjGRfFpDV8-nm5xgevcIy6hwYY65C8YNmwI-puMnyU5mzuOlrSC0_pbdxynW34LVSXFm81ZBIGsePrIuNTqnVQBEqF9z9uMkxfdwBbb0 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 264806e4036b413a9cff076742ed1463 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestServerAdvancedOps-1014361174 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264806e4036b413a9cff076742ed1463", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264806e4036b413a9cff076742ed1463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264806e4036b413a9cff076742ed1463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264806e4036b413a9cff076742ed1463"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestServerAdvancedOps-1014361174 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 264806e4036b413a9cff076742ed1463 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestServerAdvancedOps-1014361174 Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestServerAdvancedOps-1014361174-project Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 5420b3300fe74ac8bb6b8d3689c61aad Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestServerAdvancedOps-1014361174-project Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b could not be found. Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '42490d7d-ffa8-43fa-b12e-00d98a8c1e4b'} Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b could not be found. Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b could not be found. Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:47:26.901192 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b could not be found. Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] Returning 404 to user: Instance 42490d7d-ffa8-43fa-b12e-00d98a8c1e4b could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-704ebf75-726c-4d85-a6dc-4db19cc58993 tempest-TestServerAdvancedOps-1014361174 tempest-TestServerAdvancedOps-1014361174-project] 10.222.0.27 "GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b" status: 404 len: 111 microversion: 2.1 time: 0.038592 Oct 31 14:47:26.906910 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3030/6311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:26 2022] GET /compute/v2.1/servers/42490d7d-ffa8-43fa-b12e-00d98a8c1e4b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:47:34.748246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:34.750641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:34.754494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:34.759838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:34.760328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:34.760763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:34.761458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:34.761905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:34.762355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:34.820652 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a911918-e8c4-4903-b368-7f6e87886dae tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74/action" status: 200 len: 24567 microversion: 2.1 time: 0.076186 Oct 31 14:47:34.821906 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3282/6312] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:47:34 2022] POST /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74/action => generated 24567 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:47:40.722680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-262185767", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1a911fef-eb26-4626-ae44-2ad309e5299f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:40.745537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.746320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.791638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:47:41.187435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:47:41.187863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:47:41.188514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:47:41.188955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:47:41.189418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:47:41.198542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:41.199030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:41.199468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:41.200198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:41.200658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:41.201084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:41.218368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:47:41.224393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:47:41.284944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:47:41.286985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a911fef-eb26-4626-ae44-2ad309e5299f',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:47:41.419473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f56beb79-0dc5-4a05-9b7c-b40af1c34586 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701190 Oct 31 14:47:41.420448 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3031/6313] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:47:41.432362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-556c62c7-275f-4f69-b07f-34ea32e92e9f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:41.433631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-556c62c7-275f-4f69-b07f-34ea32e92e9f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:41.496063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-556c62c7-275f-4f69-b07f-34ea32e92e9f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:41.504650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-556c62c7-275f-4f69-b07f-34ea32e92e9f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1056 microversion: 2.1 time: 0.076686 Oct 31 14:47:41.519339 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3283/6314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:41 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1056 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:42.530474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:42.531111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:42.539270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:42.539967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:42.540612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:42.541741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:42.542448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:42.544036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:42.622710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:42.631926 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a386750d-b025-4530-aaed-ab1ff8b7b8db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1172 microversion: 2.1 time: 0.106375 Oct 31 14:47:42.633014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3032/6315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:42 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1172 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:43.657168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:43.657785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:43.669607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:43.670127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:43.670597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:43.671311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:43.671766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:43.672191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:43.885714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:43.894804 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28b1f3b9-8cdc-4b1b-beb0-ffe900680bce tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1214 microversion: 2.1 time: 0.241480 Oct 31 14:47:43.895485 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3284/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:43 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:44.025070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-39da71d4-9724-460d-81a7-950bd84ae170 req-97721ef1-6e38-45b9-8b61-34277efee2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564f01f8-039c-4b6c-9dcf-fefdbcd524f3", "tag": "1737d8ac-7fbb-41e6-a0cc-db51128b3535"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:44.037002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-39da71d4-9724-460d-81a7-950bd84ae170 req-97721ef1-6e38-45b9-8b61-34277efee2e5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:44.037495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-39da71d4-9724-460d-81a7-950bd84ae170 req-97721ef1-6e38-45b9-8b61-34277efee2e5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:44.037937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-39da71d4-9724-460d-81a7-950bd84ae170 req-97721ef1-6e38-45b9-8b61-34277efee2e5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:44.065944 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-39da71d4-9724-460d-81a7-950bd84ae170 req-97721ef1-6e38-45b9-8b61-34277efee2e5 service nova] Creating event network-changed:1737d8ac-7fbb-41e6-a0cc-db51128b3535 for instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 on n-h1-863052-1 Oct 31 14:47:44.072322 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-39da71d4-9724-460d-81a7-950bd84ae170 req-97721ef1-6e38-45b9-8b61-34277efee2e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050399 Oct 31 14:47:44.074309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3033/6317] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:44.918523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:44.919159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:44.928253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:44.928758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:44.929248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:44.930195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:44.930663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:44.931248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:45.173955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:45.184710 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98556564-a35e-4512-a2e5-a86e9d3ff021 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1214 microversion: 2.1 time: 0.269971 Oct 31 14:47:45.200555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3285/6318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:44 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:45.916790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:45.919679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:45.926494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:45.926986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:45.927425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:45.928131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:45.928588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:45.929018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.007239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:47:46.007594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:47:46.008076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:47:46.008489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:47:46.008900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:47:46.069672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:46.075842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:46.076461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:46.077013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.077893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:46.078496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:46.079424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.107246 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0790aab9-f221-4573-9350-d0c25414fccc tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74/action" status: 202 len: 1138 microversion: 2.1 time: 0.195529 Oct 31 14:47:46.122297 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3034/6319] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:47:45 2022] POST /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74/action => generated 1138 bytes in 198 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 14:47:46.128549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:46.129168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:46.137459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:46.138152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:46.139017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.140103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:46.140808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:46.141369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.212264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:46.213004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:46.220208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:46.220830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:46.221365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.222895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:46.223471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:46.223997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:46.298376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:46.310487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-768ffbdc-7c89-4bdf-bf2b-56f0489c48ff tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.186074 Oct 31 14:47:46.311277 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3286/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:46 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:46.370829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:46.379620 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae0a42c3-91e7-4eb7-a1f8-1fb1a26d5bc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1214 microversion: 2.1 time: 0.171462 Oct 31 14:47:46.380202 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3035/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:46 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:47.336047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:47.336693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:47.343619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:47.344105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:47.344545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:47.345234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:47.345689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:47.346119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:47.401965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:47.402928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:47.411830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:47.412331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:47.412809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:47.413707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:47.415008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:47.415449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:47.491887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:47.500685 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8091010-80c4-43f8-bc05-cb81cffb35e2 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.169027 Oct 31 14:47:47.502093 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3287/6322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:47 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:47.559380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:47.567340 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd97ad39-f267-4c52-a468-c9a495a0ed79 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1214 microversion: 2.1 time: 0.169304 Oct 31 14:47:47.567908 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3036/6323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:47 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:48.526591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:48.527167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:48.533974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:48.535059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:48.535500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:48.536190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:48.536647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:48.537074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:48.591183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:48.591789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:48.598622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:48.599165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:48.599641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:48.600337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:48.600791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:48.601213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:48.673907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:48.681940 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bade721-1e89-48fb-aabc-57668fb5c402 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.159507 Oct 31 14:47:48.682235 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3288/6324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:48 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:48.733262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:48.741158 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80064ada-d50d-4938-990e-5274815d6e43 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.153897 Oct 31 14:47:48.741734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3037/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:48 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:49.705218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:49.706128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:49.713820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:49.714278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:49.714714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:49.715410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:49.716074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:49.716516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:49.765050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:49.765813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:49.772639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:49.773160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:49.773599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:49.774327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:49.774782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:49.775203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:49.851948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:49.859998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2412c590-a596-4ae0-b15f-5b3f70c35047 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.158696 Oct 31 14:47:49.860573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3289/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:49 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:49.906064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:49.913696 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-03967b55-0da5-4d34-a0b9-8759f451c25a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.152764 Oct 31 14:47:49.914280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3038/6327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:49 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:50.884699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:50.885306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:50.892358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:50.892843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:50.893277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:50.894574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:50.895023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:50.895443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:50.898249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.936990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:50.937636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:50.945024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:50.945518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:50.945955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:50.946687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:50.947138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:50.947564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:51.036911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:51.044642 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69a98e35-1c21-46f1-861b-188c717df20a tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.163810 Oct 31 14:47:51.045227 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3290/6328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:50 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:51.082963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:51.090558 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0cd92066-2d32-4860-ba37-8c8eaeb6e9ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.157400 Oct 31 14:47:51.091157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3039/6329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:50 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:52.068311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:52.068944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:52.070924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.077078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:52.077562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:52.077996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:52.078737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:52.079191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:52.079617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:52.113629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:52.114271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:52.116260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.117303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.124039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:52.124525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:52.124965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:52.125662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:52.126113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:52.126558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:52.213790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:52.221696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4613d212-c1bf-4055-acc8-819ba5accc31 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.157784 Oct 31 14:47:52.222289 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3291/6330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:52 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:52.256528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:52.264213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30f51aa8-9f2c-4ecc-b541-beeaaa02cb4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.154985 Oct 31 14:47:52.264774 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3040/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:52 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:53.245075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:53.245691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:53.252564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:53.253556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:53.254001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:53.254734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:53.255297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:53.255732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:53.287612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:53.288394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:53.295448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:53.295943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:53.296390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:53.297098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:53.297559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:53.298014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:53.413790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:53.421466 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70bb3bfd-aca4-4b1a-8818-fd7b94da54e6 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.180316 Oct 31 14:47:53.422036 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3292/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:53 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:53.429548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:53.437225 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c757a898-a1d4-4d32-a0eb-4077969b5e7a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.153726 Oct 31 14:47:53.437959 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3041/6333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:53 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:54.445533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:54.446142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:54.452801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:54.453224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:54.453690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:54.454399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:54.454875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:54.455298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:54.460426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:54.461042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:54.467774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:54.468262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:54.468701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:54.469394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:54.469847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:54.470299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:54.590090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:54.597709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c171d3ad-6ceb-4979-a0c3-6b9804b57321 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.156051 Oct 31 14:47:54.598426 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3293/6334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:54 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:54.761326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:54.768997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-933a8882-5b65-4c1f-9fea-668865526cdb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.312438 Oct 31 14:47:54.769567 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3042/6335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:54 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:55.621379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:55.621924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:55.629335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:55.629819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:55.630281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:55.630969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:55.631425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:55.631848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:55.769011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:55.776887 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb48a079-ed6a-4632-835e-87764bfb1e7c tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.159433 Oct 31 14:47:55.777469 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3294/6336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:55 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:55.797806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:55.798487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:55.805912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:55.806441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:55.806881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:55.807566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:55.808019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:55.808444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:55.946337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:55.954075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f219ec4-637e-4e07-aa50-29778b1e7c44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.160254 Oct 31 14:47:55.954685 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3043/6337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:55 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:56.800274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:56.801108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:56.808533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:56.809103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:56.809536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:56.810256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:56.810706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:56.811154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:56.950398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:56.958991 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08efe0b8-6bae-4664-8e16-80bd73984172 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.162569 Oct 31 14:47:56.959587 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3295/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:56 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:56.976870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:56.978022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:56.985189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:56.985677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:56.986115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:56.986838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:56.987331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:56.987756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:57.119180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:57.126804 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36cd9d03-2bef-4680-95f3-667099ebbf64 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.153802 Oct 31 14:47:57.127390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3044/6339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:56 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:57.858835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-438535cf-050e-43da-91b3-1775eb179e8a req-3310e7f7-f497-4e94-8e33-89ef8c0e9e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564f01f8-039c-4b6c-9dcf-fefdbcd524f3", "name": "network-vif-plugged", "status": "completed", "tag": "1737d8ac-7fbb-41e6-a0cc-db51128b3535"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:47:57.869591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-438535cf-050e-43da-91b3-1775eb179e8a req-3310e7f7-f497-4e94-8e33-89ef8c0e9e76 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:57.870075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-438535cf-050e-43da-91b3-1775eb179e8a req-3310e7f7-f497-4e94-8e33-89ef8c0e9e76 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:57.870567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-438535cf-050e-43da-91b3-1775eb179e8a req-3310e7f7-f497-4e94-8e33-89ef8c0e9e76 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:57.882022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-438535cf-050e-43da-91b3-1775eb179e8a req-3310e7f7-f497-4e94-8e33-89ef8c0e9e76 service nova] Creating event network-vif-plugged:1737d8ac-7fbb-41e6-a0cc-db51128b3535 for instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 on n-h1-863052-1 Oct 31 14:47:57.886942 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-438535cf-050e-43da-91b3-1775eb179e8a req-3310e7f7-f497-4e94-8e33-89ef8c0e9e76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Oct 31 14:47:57.887539 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3296/6340] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:57.983010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:57.983567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:57.991134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:57.991630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:57.992076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:57.992845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:57.993312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:57.993744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:58.126515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:58.135025 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-042dd843-96a4-42e5-a4ce-87a5a5acf642 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.156474 Oct 31 14:47:58.135605 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3045/6341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:57 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:58.150722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:58.151428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:58.157611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:58.158095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:58.158558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:58.159246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:58.159699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:58.160126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:58.294335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:58.302745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-090bd321-3e96-48c8-a2f5-29444c6e63fd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1202 microversion: 2.1 time: 0.156316 Oct 31 14:47:58.303320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3297/6342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:58 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:59.157540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:59.158155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:59.165196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.165687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.166133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.166848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.167307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.167743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.300674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:59.304157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.309651 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06322b54-1514-479d-8a9c-81bca1a5daa1 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.155947 Oct 31 14:47:59.310209 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3046/6343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:59 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:59.324811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:59.325517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:59.332935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.333415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.333849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.334592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.335039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.335460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.522803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:59.530585 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4de02550-23e2-466a-b968-8ee2f0eec8f0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1388 microversion: 2.1 time: 0.209672 Oct 31 14:47:59.531154 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3298/6344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:59 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1388 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:59.553292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:59.553913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:59.560910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.561336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.561775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.562506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.562965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.563420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.689116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:59.696849 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a92a9bdd-1a5b-4eed-ad2f-cc94ba8c28d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1388 microversion: 2.1 time: 0.147401 Oct 31 14:47:59.697427 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3047/6345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:59 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:59.719342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:59.719958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:59.726252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.726742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.727172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.727858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.728308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.728730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.854780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:47:59.863373 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e0a3ce2-8d53-40dd-b5bb-0804b84a5c13 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1388 microversion: 2.1 time: 0.148143 Oct 31 14:47:59.863963 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3299/6346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:59 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:59.885400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:59.885901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:47:59.891899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.892385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.892825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.893568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:59.894025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:59.894514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:59.918817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:47:59.990679 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b33456ec-b378-4ce0-bced-4108c096a35f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 204 len: 0 microversion: 2.1 time: 0.108871 Oct 31 14:47:59.991273 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3048/6347] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:47:59 2022] DELETE /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:00.000172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:00.000792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:00.006777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:00.007270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:00.007719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:00.008410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:00.008868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:00.009295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:00.140387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:00.148706 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3686b611-4f2c-4839-9c27-de1d01354e52 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1394 microversion: 2.1 time: 0.152439 Oct 31 14:48:00.149283 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3300/6348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:47:59 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1394 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:00.334020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:00.334756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:00.341524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:00.342010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:00.342489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:00.343180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:00.343634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:00.344057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:00.474938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:00.483059 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8770c8ef-03ba-4785-bdbf-590d7f925619 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.153884 Oct 31 14:48:00.483630 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3049/6349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:00 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:01.172878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:01.173422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:01.180892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:01.181371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:01.181803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:01.182514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:01.182963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:01.183384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:01.312120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:01.319916 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d996a65-493a-4078-ad2b-a42722d54810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1394 microversion: 2.1 time: 0.150985 Oct 31 14:48:01.320475 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3301/6350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:01 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1394 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:01.507681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:01.508289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:01.515049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:01.515541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:01.515986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:01.516681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:01.517137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:01.518189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:01.657177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:01.665246 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-685a3fcb-cb72-4692-a813-635594b51771 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1692 microversion: 2.1 time: 0.161404 Oct 31 14:48:01.665845 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3050/6351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:01 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:01.886325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-aa5f3b2a-5b0d-497d-9f55-fba65823577b req-f09040f3-6231-4986-92e4-64be035aeeab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564f01f8-039c-4b6c-9dcf-fefdbcd524f3", "name": "network-vif-deleted", "tag": "1737d8ac-7fbb-41e6-a0cc-db51128b3535"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:01.896917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-aa5f3b2a-5b0d-497d-9f55-fba65823577b req-f09040f3-6231-4986-92e4-64be035aeeab service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:01.897409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-aa5f3b2a-5b0d-497d-9f55-fba65823577b req-f09040f3-6231-4986-92e4-64be035aeeab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:01.897844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-aa5f3b2a-5b0d-497d-9f55-fba65823577b req-f09040f3-6231-4986-92e4-64be035aeeab service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:01.914787 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-aa5f3b2a-5b0d-497d-9f55-fba65823577b req-f09040f3-6231-4986-92e4-64be035aeeab service nova] Creating event network-vif-deleted:1737d8ac-7fbb-41e6-a0cc-db51128b3535 for instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 on n-h1-863052-1 Oct 31 14:48:01.920189 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-aa5f3b2a-5b0d-497d-9f55-fba65823577b req-f09040f3-6231-4986-92e4-64be035aeeab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038462 Oct 31 14:48:01.920832 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3302/6352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:48:02.342774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:02.343380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:02.349448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:02.349935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:02.350403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:02.351095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:02.351546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:02.351970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:02.413027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:02.420852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-adf48e6e-38a1-4c57-a53b-93048e9ff373 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1187 microversion: 2.1 time: 0.082059 Oct 31 14:48:02.421623 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3051/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:02 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:02.688896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:02.689610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:02.697600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:02.698090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:02.698551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:02.699256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:02.699735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:02.700156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:02.840555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:02.848623 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3864f81e-a60a-4b83-a73f-ca479174ed17 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1710 microversion: 2.1 time: 0.164109 Oct 31 14:48:02.849403 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3303/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:02 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:03.445029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:03.445566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:03.452510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:03.452999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:03.453447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:03.454257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:03.454814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:03.455250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:03.521339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:03.529425 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d511a7d2-5800-4e6c-ae90-e72d5d09d982 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1187 microversion: 2.1 time: 0.088909 Oct 31 14:48:03.530015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3052/6355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:03 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:03.872448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:03.873170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:03.880715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:03.881277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:03.881815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:03.882540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:03.882994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:03.883416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:04.015446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:04.023222 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dca10fa-85b1-424b-82f4-88895120b693 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1698 microversion: 2.1 time: 0.154663 Oct 31 14:48:04.023798 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3304/6356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:03 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:04.553046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:04.553778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:04.560737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:04.561150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:04.561596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:04.562315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:04.562773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:04.563201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:04.628499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:04.636344 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f0ba7641-5014-4af3-9e9e-b1b25709b71f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1187 microversion: 2.1 time: 0.087277 Oct 31 14:48:04.636917 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3053/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:04 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:05.047364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:05.047986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:05.051468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=48 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:05.056827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:05.057314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:05.057750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:05.058462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:05.058917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:05.059348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:05.204988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:05.213126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6df7e371-f335-47c7-b7d7-fd835c762ab0 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1683 microversion: 2.1 time: 0.169636 Oct 31 14:48:05.214200 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3305/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:05 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:05.659620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:05.660238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:05.667159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:05.667654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:05.668101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:05.668806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:05.669295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:05.669725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:05.731168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:05.740026 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9e589d9-a87a-43b1-a057-5ac717be808f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 200 len: 1187 microversion: 2.1 time: 0.084307 Oct 31 14:48:05.746508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3054/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:05 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:06.763859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:06.764425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 564f01f8-039c-4b6c-9dcf-fefdbcd524f3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:06.771976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:06.772462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:06.772902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:06.773591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:06.774046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:06.774497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:06.787665 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 could not be found. Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 HTTP/1.1 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 could not be found. Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '564f01f8-039c-4b6c-9dcf-fefdbcd524f3'} Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 could not be found. Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 could not be found. Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:48:06.789291 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 could not be found. Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 564f01f8-039c-4b6c-9dcf-fefdbcd524f3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28471a82-e3b0-43d7-bf73-7e11a588328c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3" status: 404 len: 111 microversion: 2.1 time: 0.030927 Oct 31 14:48:06.792825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3306/6360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:06 2022] GET /compute/v2.1/servers/564f01f8-039c-4b6c-9dcf-fefdbcd524f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:48:07.113003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7a15eaf9-319e-41b4-a4fa-8534c45aac1b req-e5f5942e-0bd4-41ea-ad74-a8e7b07ad897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "name": "network-vif-unplugged", "status": "completed", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:07.124807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7a15eaf9-319e-41b4-a4fa-8534c45aac1b req-e5f5942e-0bd4-41ea-ad74-a8e7b07ad897 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:07.125469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7a15eaf9-319e-41b4-a4fa-8534c45aac1b req-e5f5942e-0bd4-41ea-ad74-a8e7b07ad897 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:07.126003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7a15eaf9-319e-41b4-a4fa-8534c45aac1b req-e5f5942e-0bd4-41ea-ad74-a8e7b07ad897 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:07.140165 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7a15eaf9-319e-41b4-a4fa-8534c45aac1b req-e5f5942e-0bd4-41ea-ad74-a8e7b07ad897 service nova] Creating event network-vif-unplugged:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:48:07.146370 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7a15eaf9-319e-41b4-a4fa-8534c45aac1b req-e5f5942e-0bd4-41ea-ad74-a8e7b07ad897 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037775 Oct 31 14:48:07.147093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3055/6361] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:09.170784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fdaad8d3-0617-4fdc-96a0-f0388b0f30f8 req-eef03c15-f0bb-4cd4-af06-0a7d34ec4d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "name": "network-vif-plugged", "status": "completed", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:09.181628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fdaad8d3-0617-4fdc-96a0-f0388b0f30f8 req-eef03c15-f0bb-4cd4-af06-0a7d34ec4d17 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:09.182404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fdaad8d3-0617-4fdc-96a0-f0388b0f30f8 req-eef03c15-f0bb-4cd4-af06-0a7d34ec4d17 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:09.182840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fdaad8d3-0617-4fdc-96a0-f0388b0f30f8 req-eef03c15-f0bb-4cd4-af06-0a7d34ec4d17 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:09.195148 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fdaad8d3-0617-4fdc-96a0-f0388b0f30f8 req-eef03c15-f0bb-4cd4-af06-0a7d34ec4d17 service nova] Creating event network-vif-plugged:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:48:09.200715 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fdaad8d3-0617-4fdc-96a0-f0388b0f30f8 req-eef03c15-f0bb-4cd4-af06-0a7d34ec4d17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Oct 31 14:48:09.201505 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3307/6362] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:11.764670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1455329626", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "42c3ae9e-5b29-4ab8-a3ab-41ffcca9ff92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:11.776317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:11.828955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:48:12.196792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:48:12.197256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:48:12.197744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:48:12.198185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:48:12.198611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:48:12.207677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:12.208172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:12.208615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:12.209349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:12.209811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:12.210269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:12.226845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:48:12.232469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:48:12.289108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:48:12.291297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42c3ae9e-5b29-4ab8-a3ab-41ffcca9ff92',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:48:12.420594 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f9a1c9ca-59b6-4884-85dd-3fcb849b9d95 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660137 Oct 31 14:48:12.421240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3056/6363] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:48:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:48:12.434335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a2da1c5-7f57-4c37-90b5-1d008708672f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:12.435888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a2da1c5-7f57-4c37-90b5-1d008708672f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:12.489641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a2da1c5-7f57-4c37-90b5-1d008708672f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:12.497070 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a2da1c5-7f57-4c37-90b5-1d008708672f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1057 microversion: 2.1 time: 0.067843 Oct 31 14:48:12.497680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3308/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:12 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1057 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:13.520813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:13.521534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:13.529446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:13.530067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:13.530652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:13.531455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:13.532011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:13.532541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:13.604507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:13.613727 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d2ff80c-e075-4576-9b17-9498e04f61db tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1173 microversion: 2.1 time: 0.097187 Oct 31 14:48:13.622282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3057/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:13 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1173 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:14.639097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:14.640226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:14.648652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:14.649248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:14.649765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:14.650567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:14.651173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:14.651800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:14.852848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:14.861582 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89ec0e5f-e490-42d1-ad7a-666e290d3836 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1215 microversion: 2.1 time: 0.227552 Oct 31 14:48:14.867207 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3309/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:14 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:48:14.888718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-70a341c7-bc61-45bf-b901-e2e2b62ef13d req-c3cce52a-ea2a-4d82-8ce2-72de24c97b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e9f2ee-1640-4071-9501-22b6e1d17f2f", "tag": "751ffa96-5631-494b-b4b4-1cb5bce762fd"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:14.899142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-70a341c7-bc61-45bf-b901-e2e2b62ef13d req-c3cce52a-ea2a-4d82-8ce2-72de24c97b05 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:14.899770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-70a341c7-bc61-45bf-b901-e2e2b62ef13d req-c3cce52a-ea2a-4d82-8ce2-72de24c97b05 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:14.900315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-70a341c7-bc61-45bf-b901-e2e2b62ef13d req-c3cce52a-ea2a-4d82-8ce2-72de24c97b05 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:14.912563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-70a341c7-bc61-45bf-b901-e2e2b62ef13d req-c3cce52a-ea2a-4d82-8ce2-72de24c97b05 service nova] Creating event network-changed:751ffa96-5631-494b-b4b4-1cb5bce762fd for instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f on n-h1-863052-1 Oct 31 14:48:14.917776 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-70a341c7-bc61-45bf-b901-e2e2b62ef13d req-c3cce52a-ea2a-4d82-8ce2-72de24c97b05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115439 Oct 31 14:48:14.918876 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3058/6367] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:15.888951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:15.889603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:15.897197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:15.897688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:15.898123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:15.898840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:15.899294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:15.899721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:15.915315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.029295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:16.038000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c57c11ec-60bd-44cb-a283-7aef9572ee65 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1215 microversion: 2.1 time: 0.152843 Oct 31 14:48:16.038548 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3310/6368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:15 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:17.062876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:17.063590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:17.069831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:17.070364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:17.070810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:17.071514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:17.072053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:17.072391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:17.206486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:17.214294 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d60835dd-c0c6-4cde-ab4f-dd1fde669d35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1215 microversion: 2.1 time: 0.156628 Oct 31 14:48:17.214876 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3059/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:17 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:18.237536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:18.238430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:18.246579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:18.247071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:18.247535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:18.248679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:18.249136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:18.249554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:18.387494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:18.395415 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a68c03c6-c248-47e8-9da5-374a52e0a488 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1215 microversion: 2.1 time: 0.162277 Oct 31 14:48:18.395992 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3311/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:18 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:19.419576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:19.420127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:19.428152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:19.428643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:19.429080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:19.429772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:19.430274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:19.430705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:19.557891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:19.565558 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25dc9043-ed56-4c6d-82ff-2b8f80deb94d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.150300 Oct 31 14:48:19.566125 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3060/6371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:19 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:20.588801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:20.589350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:20.596354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:20.596842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:20.597283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:20.597979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:20.598470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:20.598904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:20.724770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:20.733379 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae09e156-1498-4203-9914-eca113d9735a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.148550 Oct 31 14:48:20.733948 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3312/6372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:20 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:21.757385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:21.757996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:21.764802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:21.765286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:21.765722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:21.766438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:21.766895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:21.767321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:21.894770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:21.902418 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0acff2dc-f08b-41b6-ba90-6e88791ddc08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.148947 Oct 31 14:48:21.902979 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3061/6373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:21 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:22.926394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:22.927037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:22.929523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.934931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:22.935425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:22.935868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:22.936553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:22.937005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:22.937431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:23.071268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:23.079280 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f8c6789-7ed4-403d-b20d-4b9924f601a6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.157391 Oct 31 14:48:23.079862 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3313/6374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:22 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:24.102131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:24.102769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:24.104745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.105400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.112428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:24.112913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:24.113349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:24.114039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:24.114522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:24.114946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:24.248355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:24.256674 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-127a15bf-1772-40d2-9e72-0e91b7ab1734 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.158437 Oct 31 14:48:24.257250 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3062/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:24 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:25.279567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:25.280105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:25.287425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:25.287914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:25.288354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:25.289057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:25.289509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:25.289937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:25.416549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:25.424987 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c57cb5a1-6462-4fd5-b0f9-277867f0c67d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.148804 Oct 31 14:48:25.425595 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3314/6376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:25 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:26.447725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:26.448344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:26.455227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:26.455720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:26.456158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:26.456852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:26.457309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:26.457738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:26.582852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:26.586299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.591475 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b78d7f2f-9e17-4fdc-88c7-cbe240d982f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.147668 Oct 31 14:48:26.592057 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3063/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:26 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:27.614857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:27.615475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:27.622369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:27.622858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:27.623303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:27.623990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:27.624447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:27.624874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:27.753975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:27.761763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3da67043-3951-4784-aa52-5ed7371c405c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.151433 Oct 31 14:48:27.762364 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3315/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:27 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:28.007864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3db0bc5d-c157-482d-8f48-0db31e559349 req-0997e6e2-fe68-4ab5-bd5f-d974a804622f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9f2ee-1640-4071-9501-22b6e1d17f2f", "name": "network-vif-plugged", "status": "completed", "tag": "751ffa96-5631-494b-b4b4-1cb5bce762fd"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:28.019809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3db0bc5d-c157-482d-8f48-0db31e559349 req-0997e6e2-fe68-4ab5-bd5f-d974a804622f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:28.020294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3db0bc5d-c157-482d-8f48-0db31e559349 req-0997e6e2-fe68-4ab5-bd5f-d974a804622f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:28.020719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3db0bc5d-c157-482d-8f48-0db31e559349 req-0997e6e2-fe68-4ab5-bd5f-d974a804622f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:28.031999 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3db0bc5d-c157-482d-8f48-0db31e559349 req-0997e6e2-fe68-4ab5-bd5f-d974a804622f service nova] Creating event network-vif-plugged:751ffa96-5631-494b-b4b4-1cb5bce762fd for instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f on n-h1-863052-1 Oct 31 14:48:28.036950 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3db0bc5d-c157-482d-8f48-0db31e559349 req-0997e6e2-fe68-4ab5-bd5f-d974a804622f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032921 Oct 31 14:48:28.037547 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3064/6379] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:28.785371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:28.786011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:28.792892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:28.793372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:28.793806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:28.794524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:28.794976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:28.795400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:28.923271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:28.931425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-698df9f9-93d4-4c8e-bcd5-c504104ab0b6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1203 microversion: 2.1 time: 0.150567 Oct 31 14:48:28.932006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3316/6380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:28 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:29.415958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:29.418190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:29.424426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:29.424915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:29.425356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:29.426048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:29.426536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:29.426989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:29.480050 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18a5b3c9-0b85-4de6-bf3a-d91e97696b83 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "POST /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74/action" status: 200 len: 24568 microversion: 2.1 time: 0.069254 Oct 31 14:48:29.480704 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3065/6381] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:48:29 2022] POST /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74/action => generated 24568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:48:29.954342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:29.955506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:29.962486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:29.962916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:29.963350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:29.964035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:29.964480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:29.964899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.098399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:30.106412 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01d52780-bead-44c0-99e4-4c9adb8d3315 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1389 microversion: 2.1 time: 0.156087 Oct 31 14:48:30.106990 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3317/6382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:29 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:30.142365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:30.143602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:30.151168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.151653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.152093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.152790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.153242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.153666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.296662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:30.305001 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ff5c2c9-fe1b-4288-8ec4-dc3bda759194 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1389 microversion: 2.1 time: 0.179229 Oct 31 14:48:30.305772 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3066/6383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:30 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1389 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:30.327040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:30.327797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:30.334368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.334850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.335284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.335962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.336408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.336826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.465040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:30.473480 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a53732ff-1099-49a6-9ca3-04b6c1776aba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1389 microversion: 2.1 time: 0.150227 Oct 31 14:48:30.473964 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3318/6384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:30 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:30.495779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:30.496282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:30.503469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.504645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.505090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.505797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.506284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.506723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.531926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:48:30.608848 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17494d1f-00f6-49f3-9e88-6458ac8a7215 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 204 len: 0 microversion: 2.1 time: 0.116479 Oct 31 14:48:30.610307 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3067/6385] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:48:30 2022] DELETE /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:30.618755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:30.619378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:30.626591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.627079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.628004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.628826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:30.629284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:30.629704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:30.764178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:30.773141 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-277da69c-4d33-42e3-8efb-9ce9fb294dc7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1395 microversion: 2.1 time: 0.158432 Oct 31 14:48:30.773731 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3319/6386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:30 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:31.797723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:31.798461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:31.806763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:31.807280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:31.807721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:31.808419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:31.808877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:31.809303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:31.935079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:31.943381 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0855b338-8ec4-4d11-bb50-40a6fabf3a78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1395 microversion: 2.1 time: 0.149931 Oct 31 14:48:31.943954 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3068/6387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:31 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1395 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:32.503660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-65163e8e-742f-48b2-a7f6-978ce759f3f0 req-5d5dafb6-fe92-4bfa-a818-b9c9e763a21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9f2ee-1640-4071-9501-22b6e1d17f2f", "name": "network-vif-deleted", "tag": "751ffa96-5631-494b-b4b4-1cb5bce762fd"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:32.520396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-65163e8e-742f-48b2-a7f6-978ce759f3f0 req-5d5dafb6-fe92-4bfa-a818-b9c9e763a21b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:32.520885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-65163e8e-742f-48b2-a7f6-978ce759f3f0 req-5d5dafb6-fe92-4bfa-a818-b9c9e763a21b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:32.521327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-65163e8e-742f-48b2-a7f6-978ce759f3f0 req-5d5dafb6-fe92-4bfa-a818-b9c9e763a21b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:32.533899 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-65163e8e-742f-48b2-a7f6-978ce759f3f0 req-5d5dafb6-fe92-4bfa-a818-b9c9e763a21b service nova] Creating event network-vif-deleted:751ffa96-5631-494b-b4b4-1cb5bce762fd for instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f on n-h1-863052-1 Oct 31 14:48:32.538975 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-65163e8e-742f-48b2-a7f6-978ce759f3f0 req-5d5dafb6-fe92-4bfa-a818-b9c9e763a21b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Oct 31 14:48:32.539730 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3320/6388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:32.966476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:32.967086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:32.974601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:32.975082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:32.975517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:32.976205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:32.976655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:32.977075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:33.038811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:33.052980 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28c6d558-a844-4b3a-94b6-31241fa3cdf8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1188 microversion: 2.1 time: 0.090347 Oct 31 14:48:33.053674 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3069/6389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:32 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:34.078044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:34.078798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:34.085570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:34.086055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:34.086517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:34.087215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:34.087665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:34.088090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:34.156113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:34.164241 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c81c610-1bcb-44cc-9a06-b007188307fc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1188 microversion: 2.1 time: 0.091370 Oct 31 14:48:34.164893 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3321/6390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:34 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:35.187451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:35.187950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:35.195077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:35.195566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:35.196007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:35.196700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:35.197153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:35.197576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:35.265245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:35.273287 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-53d06e2d-bf3a-448d-821c-f220e383bc24 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1188 microversion: 2.1 time: 0.089839 Oct 31 14:48:35.273885 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3070/6391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:35 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:36.297065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:36.297579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:36.307805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.309234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:36.309790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:36.310360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:36.311077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:36.311531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:36.311953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:36.443272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:36.451822 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2b59912-df4a-4c81-baf9-fede17b84254 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 200 len: 1188 microversion: 2.1 time: 0.158758 Oct 31 14:48:36.452443 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3322/6392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:36 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 1188 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:37.071454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:37.072820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:37.078675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0612710e-54c6-49e7-ba10-50e198c57594 req-516873c6-936b-40e7-8cc9-8258a84b3e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:37.082132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.083060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.083871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.085284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.085923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.086585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.103280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0612710e-54c6-49e7-ba10-50e198c57594 req-516873c6-936b-40e7-8cc9-8258a84b3e6b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.103932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0612710e-54c6-49e7-ba10-50e198c57594 req-516873c6-936b-40e7-8cc9-8258a84b3e6b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.104535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0612710e-54c6-49e7-ba10-50e198c57594 req-516873c6-936b-40e7-8cc9-8258a84b3e6b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.117577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:48:37.120668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0612710e-54c6-49e7-ba10-50e198c57594 req-516873c6-936b-40e7-8cc9-8258a84b3e6b service nova] Creating event network-changed:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:48:37.126297 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0612710e-54c6-49e7-ba10-50e198c57594 req-516873c6-936b-40e7-8cc9-8258a84b3e6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051544 Oct 31 14:48:37.127311 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3323/6393] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:48:37.201073 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78171b82-a5ae-43a8-b826-a1cfe4fa7710 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 204 len: 0 microversion: 2.1 time: 0.133163 Oct 31 14:48:37.201967 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3071/6394] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:48:37 2022] DELETE /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:37.213521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:37.214499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:37.221224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.221781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.222465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.223227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.223772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.224260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.360962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:37.369403 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6385dc0-393f-4008-9685-cf1d8637168e tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1689 microversion: 2.1 time: 0.162291 Oct 31 14:48:37.369981 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3324/6395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:37 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:37.476912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:37.477530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 36e9f2ee-1640-4071-9501-22b6e1d17f2f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:37.483858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.484346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.484784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.485481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:37.485931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:37.486377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:37.501349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f could not be found. Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f HTTP/1.1 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f could not be found. Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '36e9f2ee-1640-4071-9501-22b6e1d17f2f'} Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f could not be found. Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f could not be found. Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:48:37.503246 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f could not be found. Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 36e9f2ee-1640-4071-9501-22b6e1d17f2f could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24053618-a41f-42d9-8147-d3a84cc9b6df tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f" status: 404 len: 111 microversion: 2.1 time: 0.032205 Oct 31 14:48:37.506768 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3072/6396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:37 2022] GET /compute/v2.1/servers/36e9f2ee-1640-4071-9501-22b6e1d17f2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:48:38.393661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:38.394464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:38.402223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:38.402842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:38.403351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:38.404132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:38.404658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:38.405166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:38.639475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:38.651794 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-679c03b3-f4c0-460a-aaf1-dabc2ef9ac49 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1689 microversion: 2.1 time: 0.262085 Oct 31 14:48:38.666882 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3325/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:38 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1689 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:39.223653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7e4cc878-1e98-4a9e-8794-c828782e0ddc req-2f93ef87-17d3-4d9f-81d6-4de30061bb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12eb32c-3ec8-4332-9334-e43f19c8da74", "name": "network-vif-deleted", "tag": "2b0d2b9d-cc99-444f-a4e3-c339721fbcdb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:39.237576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7e4cc878-1e98-4a9e-8794-c828782e0ddc req-2f93ef87-17d3-4d9f-81d6-4de30061bb9c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:39.238113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7e4cc878-1e98-4a9e-8794-c828782e0ddc req-2f93ef87-17d3-4d9f-81d6-4de30061bb9c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:39.238761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7e4cc878-1e98-4a9e-8794-c828782e0ddc req-2f93ef87-17d3-4d9f-81d6-4de30061bb9c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:39.253233 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7e4cc878-1e98-4a9e-8794-c828782e0ddc req-2f93ef87-17d3-4d9f-81d6-4de30061bb9c service nova] Creating event network-vif-deleted:2b0d2b9d-cc99-444f-a4e3-c339721fbcdb for instance a12eb32c-3ec8-4332-9334-e43f19c8da74 on n-h2-863052-1 Oct 31 14:48:39.259133 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7e4cc878-1e98-4a9e-8794-c828782e0ddc req-2f93ef87-17d3-4d9f-81d6-4de30061bb9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040484 Oct 31 14:48:39.259905 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3073/6398] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:39.687566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:39.688809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:39.697903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:39.699010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:39.699660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:39.702081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:39.702768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:39.703407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:39.742567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:39.743279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:39.743722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:39.744173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lazy-loading 'fault' on Instance uuid a12eb32c-3ec8-4332-9334-e43f19c8da74 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:48:39.789613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540514132f50424ab738477360754cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f152314f7d4b67b90d8df1058173bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:39.796856 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9587277-4d87-4b9e-a5ad-82020e12628d tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 200 len: 1356 microversion: 2.1 time: 0.115722 Oct 31 14:48:39.797466 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3326/6399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:39 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:40.820884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:40.821589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] [instance: a12eb32c-3ec8-4332-9334-e43f19c8da74] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:40.828673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:40.829164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:40.829601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:40.830321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:40.830779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:40.831207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:40.844705 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] HTTP exception thrown: Instance a12eb32c-3ec8-4332-9334-e43f19c8da74 could not be found. Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Request method failure captured: Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 HTTP/1.1 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX96mgtaOTLtPuKtnhPLz3REpHeArWDPtiA00bG2Yd2IDjcqvZayMCsFTe0kjgn11Qua7g0ObEQKHarBlDqOl_Xg9vDsbjfScOTNmpsQarhkxLY89dgKSxTlNOGpUTO9FRnGb0w_I8aJo6PfdkWDhATS78BFCzz77MYeMJ6rcdUKmi-o Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7f152314f7d4b67b90d8df1058173bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7f152314f7d4b67b90d8df1058173bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b7f152314f7d4b67b90d8df1058173bd Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1022716069 Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 540514132f50424ab738477360754cca Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1022716069-project Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a12eb32c-3ec8-4332-9334-e43f19c8da74 could not be found. Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a12eb32c-3ec8-4332-9334-e43f19c8da74'} Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12eb32c-3ec8-4332-9334-e43f19c8da74 could not be found. Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12eb32c-3ec8-4332-9334-e43f19c8da74 could not be found. Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:40.846416 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12eb32c-3ec8-4332-9334-e43f19c8da74 could not be found. Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Returning 404 to user: Instance a12eb32c-3ec8-4332-9334-e43f19c8da74 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:48:40.850302 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea33d4bb-2ac7-4d60-b5e4-c2de9e2c81a8 tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74" status: 404 len: 111 microversion: 2.1 time: 0.031159 Oct 31 14:48:40.851911 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3074/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:40 2022] GET /compute/v2.1/servers/a12eb32c-3ec8-4332-9334-e43f19c8da74 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:48:44.317780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8dfcd7f-4d4f-4b19-b63e-6563af63e5de tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] Calling method '.version_select at 0x7fe1062283a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:44.343238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8dfcd7f-4d4f-4b19-b63e-6563af63e5de tempest-TestNetworkAdvancedServerOps-1022716069 tempest-TestNetworkAdvancedServerOps-1022716069-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-243644116" status: 202 len: 0 microversion: 2.1 time: 0.029802 Oct 31 14:48:44.344783 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3327/6401] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 14:48:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-243644116 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:48:57.300206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:57.300966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:57.645853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f074495-ceb7-458f-964f-0f89c2bef28e tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Action: 'create', calling method: .version_select at 0x7fe10c187ca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1182134520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU0srK2eTZlapnTOpD6c/Y+8HdzwfVWiDLFIjdgznyaRr+PPz1O5myFMNq3Hwfb53dRN8/k4myAkcCMEfVrzNmAT7cisuX2+aimaMriB3pEKvJKRsNg3o8FfU5RHCwa2w=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:57.662643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6f074495-ceb7-458f-964f-0f89c2bef28e tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Getting quotas for project 53dbf2d7231840f5bdb737a8c7c3b57b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:48:57.669920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6f074495-ceb7-458f-964f-0f89c2bef28e tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Getting quotas for user 1742fe6945cd4ed1a56bb085f36d693e and project 53dbf2d7231840f5bdb737a8c7c3b57b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:48:57.710388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f074495-ceb7-458f-964f-0f89c2bef28e tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.417115 Oct 31 14:48:57.711961 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3075/6402] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:48:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:48:58.821974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:58.823397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:58.827818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-331187430", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1182134520", "security_groups": [{"name": "tempest-secgroup-smoke-2066454515"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a26c198e-1cea-49b1-b92d-884516ce95cb"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:48:58.976695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] validate_networks() for [('a26c198e-1cea-49b1-b92d-884516ce95cb', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:48:59.588371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Getting quotas for project 53dbf2d7231840f5bdb737a8c7c3b57b. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:48:59.593815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Getting quotas for user 1742fe6945cd4ed1a56bb085f36d693e and project 53dbf2d7231840f5bdb737a8c7c3b57b. Resources: dict_keys(['metadata_items']) {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:48:59.607621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:48:59.608421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:48:59.608995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:48:59.609680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:48:59.610159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:48:59.619530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:59.620246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:59.620895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:59.621706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:48:59.622308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:48:59.622757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:48:59.641828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Getting quotas for project 53dbf2d7231840f5bdb737a8c7c3b57b. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:48:59.647395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Getting quotas for user 1742fe6945cd4ed1a56bb085f36d693e and project 53dbf2d7231840f5bdb737a8c7c3b57b. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:48:59.660342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:48:59.662889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:48:59.732530 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0269684-e0c6-4710-a024-241be2d144a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.912668 Oct 31 14:48:59.738123 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3328/6403] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:48:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:48:59.747284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b09d9be-c054-4373-9668-d33675204569 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:48:59.747916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b09d9be-c054-4373-9668-d33675204569 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:48:59.825987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b09d9be-c054-4373-9668-d33675204569 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:48:59.834147 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b09d9be-c054-4373-9668-d33675204569 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1302 microversion: 2.1 time: 0.092206 Oct 31 14:48:59.851246 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3076/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:48:59 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:00.858291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:00.859646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:00.870634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:00.871358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:00.871808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:00.872520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:00.873324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:00.874069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:01.034232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:01.052889 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-166affab-d12a-42ba-9541-beb3ae152bd0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1362 microversion: 2.1 time: 0.199710 Oct 31 14:49:01.065299 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3329/6405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:00 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:02.086353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:02.087724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:02.097563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:02.098423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:02.099792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:02.100728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:02.101410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:02.102046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:02.272008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:02.281645 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65530c55-c31c-4c8d-aca8-1cbb85a5933b tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.205436 Oct 31 14:49:02.291532 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3077/6406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:02 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:02.611059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-13db121d-d77e-4d28-8d69-df6efe4e65fd req-40fda12c-386e-4d2f-9c1a-10f1d6948942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6", "tag": "9eb17480-2131-4a92-b797-a357be1fc7ca"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:02.626253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-13db121d-d77e-4d28-8d69-df6efe4e65fd req-40fda12c-386e-4d2f-9c1a-10f1d6948942 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:02.627016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-13db121d-d77e-4d28-8d69-df6efe4e65fd req-40fda12c-386e-4d2f-9c1a-10f1d6948942 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:02.627660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-13db121d-d77e-4d28-8d69-df6efe4e65fd req-40fda12c-386e-4d2f-9c1a-10f1d6948942 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:02.647352 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-13db121d-d77e-4d28-8d69-df6efe4e65fd req-40fda12c-386e-4d2f-9c1a-10f1d6948942 service nova] Creating event network-changed:9eb17480-2131-4a92-b797-a357be1fc7ca for instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 on n-h2-863052-1 Oct 31 14:49:02.653706 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-13db121d-d77e-4d28-8d69-df6efe4e65fd req-40fda12c-386e-4d2f-9c1a-10f1d6948942 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049897 Oct 31 14:49:02.654621 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3330/6407] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:03.305972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:03.306705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:03.314114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:03.315360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:03.315874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:03.316658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:03.317185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:03.317729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:03.373715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-591091005", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "00e0139c-dedd-4ebd-a17e-a27bb8c23cdb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:03.468778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:49:03.469989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:03.481075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ccbfe6b5-85c9-4ba0-8053-d4bd9eff9159 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.179117 Oct 31 14:49:03.481792 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3078/6408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:03 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:03.834240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:49:03.835136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:49:03.835618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:49:03.836033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:49:03.836484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:49:03.846100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:03.846627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:03.847073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:03.847856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:03.848453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:03.848908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:03.866137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:49:03.871867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:49:03.885006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:49:03.887219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='00e0139c-dedd-4ebd-a17e-a27bb8c23cdb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:49:03.960714 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09116522-8c3d-40ce-8e11-14eccb77c9e6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591187 Oct 31 14:49:03.961385 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3331/6409] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:49:03.973752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aff49e7a-e9fd-49e5-9089-2a4636feb2d2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:03.974906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aff49e7a-e9fd-49e5-9089-2a4636feb2d2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:04.041672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aff49e7a-e9fd-49e5-9089-2a4636feb2d2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:04.049174 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aff49e7a-e9fd-49e5-9089-2a4636feb2d2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1056 microversion: 2.1 time: 0.079221 Oct 31 14:49:04.049746 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3079/6410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:03 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1056 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:04.506971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:04.507819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:04.515100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:04.515589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:04.516027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:04.516716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:04.517172 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:04.518205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:04.666395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:04.674765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ffc81dd1-b5f5-49ad-9d2e-31a8f8d07da2 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.174221 Oct 31 14:49:04.675335 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3332/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:04 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:05.071642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:05.073026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:05.084604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:05.086117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:05.086826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:05.090417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:05.090904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:05.091342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:05.166538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:05.174789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0bacc6d-6474-4bbe-8dcf-657a46944c1d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1126 microversion: 2.1 time: 0.106941 Oct 31 14:49:05.175873 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3080/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:05 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1126 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:05.697045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:05.704432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:05.711696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:05.712218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:05.712660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:05.713364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:05.714004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:05.714607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:05.986607 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:05.995022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-062d1483-ca09-479c-a8b1-e7123e5c0891 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.301888 Oct 31 14:49:05.995702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3333/6413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:05 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:06.200741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:06.201290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:06.209963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:06.210949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:06.211607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:06.213108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:06.214398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:06.215035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:06.386707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:06.394834 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac7e7f94-7370-48c4-beb3-5b7337b5137e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.198209 Oct 31 14:49:06.395912 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3081/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:06 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:06.453535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f532891e-7032-46d6-b9d7-001b1fad33ea req-9fae79fe-4d1f-4326-9717-fe33942df9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac039e28-226e-4174-b8a1-eb0d306129f0", "tag": "75fa02ab-5ab4-42d9-9b6b-afd6cab115bc"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:06.468506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f532891e-7032-46d6-b9d7-001b1fad33ea req-9fae79fe-4d1f-4326-9717-fe33942df9e0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:06.469792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f532891e-7032-46d6-b9d7-001b1fad33ea req-9fae79fe-4d1f-4326-9717-fe33942df9e0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:06.471173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f532891e-7032-46d6-b9d7-001b1fad33ea req-9fae79fe-4d1f-4326-9717-fe33942df9e0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:06.486776 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f532891e-7032-46d6-b9d7-001b1fad33ea req-9fae79fe-4d1f-4326-9717-fe33942df9e0 service nova] Creating event network-changed:75fa02ab-5ab4-42d9-9b6b-afd6cab115bc for instance ac039e28-226e-4174-b8a1-eb0d306129f0 on n-h1-863052-1 Oct 31 14:49:06.492992 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f532891e-7032-46d6-b9d7-001b1fad33ea req-9fae79fe-4d1f-4326-9717-fe33942df9e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Oct 31 14:49:06.493830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3334/6415] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:07.018076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:07.018805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:07.025300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:07.026614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:07.027174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:07.027998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:07.028563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:07.029101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:07.175683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:07.185975 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ffc62edc-9cb4-4ad2-a860-46bd3622e6b8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.171959 Oct 31 14:49:07.187001 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3082/6416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:07 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:07.417675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:07.419732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:07.434132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:07.434819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:07.435390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:07.436196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:07.438514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:07.439211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:07.691751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:07.704646 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76948d15-7cea-4e53-b809-02c7ebf8b0cb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.290488 Oct 31 14:49:07.705400 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3335/6417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:07 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:08.209967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:08.210626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:08.217700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:08.218218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:08.218668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:08.219399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:08.219859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:08.220292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:08.359811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:08.367734 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8d11a3c-4b98-4db8-a24c-b81ef3ca0f17 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.161770 Oct 31 14:49:08.368322 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3083/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:08 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:08.728766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:08.729745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:08.738093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:08.738700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:08.739369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:08.740337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:08.740940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:08.741626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:08.931888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:08.949322 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebc78931-a807-4881-ae60-1addfbbf768e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.222832 Oct 31 14:49:08.950664 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3336/6419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:08 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:09.383025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-862fd165-0fa9-46d5-a52d-a251ac6c61b0 req-139dda97-0d10-4184-9a9f-e34ec985580f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6", "name": "network-vif-plugged", "status": "completed", "tag": "9eb17480-2131-4a92-b797-a357be1fc7ca"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:09.400727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:09.402042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:09.408680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:09.409390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:09.409747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:09.410464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:09.410967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:09.411478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:09.420680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-862fd165-0fa9-46d5-a52d-a251ac6c61b0 req-139dda97-0d10-4184-9a9f-e34ec985580f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:09.422975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-862fd165-0fa9-46d5-a52d-a251ac6c61b0 req-139dda97-0d10-4184-9a9f-e34ec985580f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:09.427284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-862fd165-0fa9-46d5-a52d-a251ac6c61b0 req-139dda97-0d10-4184-9a9f-e34ec985580f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:09.445736 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-862fd165-0fa9-46d5-a52d-a251ac6c61b0 req-139dda97-0d10-4184-9a9f-e34ec985580f service nova] Creating event network-vif-plugged:9eb17480-2131-4a92-b797-a357be1fc7ca for instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 on n-h2-863052-1 Oct 31 14:49:09.455236 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-862fd165-0fa9-46d5-a52d-a251ac6c61b0 req-139dda97-0d10-4184-9a9f-e34ec985580f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079075 Oct 31 14:49:09.456283 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3084/6420] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:09.639333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:09.652488 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e05e949-28a4-4288-a522-bd22fe82e9b0 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1428 microversion: 2.1 time: 0.258770 Oct 31 14:49:09.653336 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3337/6421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:09 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1428 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:49:09.978425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:09.979177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:09.987504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:09.988323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:09.988784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:09.989499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:09.989966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:09.990422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:10.144451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:10.152167 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f9f457c-e526-4cf3-b1b9-4a53f8d61fdd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.178146 Oct 31 14:49:10.152740 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3085/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:09 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:10.683489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:10.683489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:10.695368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:10.696130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:10.696831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:10.697884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:10.698505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:10.700041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:10.900483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:10.909792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5a8f3ee-f002-44ef-b127-03a32774d4aa tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1608 microversion: 2.1 time: 0.233163 Oct 31 14:49:10.910618 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3338/6423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:10 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1608 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:10.938257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:10.938728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:10.945427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:10.946301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:10.947028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:10.947962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:10.948442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:10.948921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:11.132328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:11.148127 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37f09d35-1fcb-4fc9-b8b0-7873c2f105a8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1608 microversion: 2.1 time: 0.213909 Oct 31 14:49:11.149575 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3086/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:10 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1608 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:11.177828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:11.183736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:11.189659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:11.189788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:11.190322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:11.190710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:11.190833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:11.191847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:11.192319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:11.192752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:11.197503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:11.198024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:11.198488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:11.199212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:11.199713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:11.200271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:11.346224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:11.354951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f8df129-d131-4a8f-9678-8695627a80ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.172643 Oct 31 14:49:11.355984 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3087/6425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:11 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:11.364680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:11.372721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4847196c-a938-43e3-abea-94df57f581bc tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1608 microversion: 2.1 time: 0.202177 Oct 31 14:49:11.373334 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3339/6426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:11 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1608 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:12.384707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:12.385962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:12.394259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:12.394976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:12.395627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:12.396470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:12.397068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:12.397623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:12.665992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:12.674646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dcea746e-b6a2-4610-9d4b-09c8bad9aa78 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.295522 Oct 31 14:49:12.675162 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3088/6427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:12 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:13.311856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-499d5cd1-f6a1-404a-813f-f55dae996136 req-abe749ad-53df-4e4b-a60e-f2c2234ffded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6", "tag": "9eb17480-2131-4a92-b797-a357be1fc7ca"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:13.323335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-499d5cd1-f6a1-404a-813f-f55dae996136 req-abe749ad-53df-4e4b-a60e-f2c2234ffded service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:13.324024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-499d5cd1-f6a1-404a-813f-f55dae996136 req-abe749ad-53df-4e4b-a60e-f2c2234ffded service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:13.324661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-499d5cd1-f6a1-404a-813f-f55dae996136 req-abe749ad-53df-4e4b-a60e-f2c2234ffded service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:13.337275 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-499d5cd1-f6a1-404a-813f-f55dae996136 req-abe749ad-53df-4e4b-a60e-f2c2234ffded service nova] Creating event network-changed:9eb17480-2131-4a92-b797-a357be1fc7ca for instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 on n-h2-863052-1 Oct 31 14:49:13.343531 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-499d5cd1-f6a1-404a-813f-f55dae996136 req-abe749ad-53df-4e4b-a60e-f2c2234ffded service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039974 Oct 31 14:49:13.344172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3340/6428] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:13.700015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:13.700628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:13.712280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:13.712785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:13.713229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:13.713958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:13.717131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:13.720870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:13.904546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:13.915841 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22c72e0d-6de3-4add-bb4a-fd1be7736a44 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.220474 Oct 31 14:49:13.930967 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3089/6429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:13 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:14.937556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:14.938523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:14.944529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:14.945240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:14.952200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:14.952688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:14.953128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:14.953819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:14.954305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:14.955396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:15.095994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:15.110856 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae512544-82dd-43a1-b1ed-b4444209812b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.173988 Oct 31 14:49:15.112148 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3341/6430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:14 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:16.135744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:16.136356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:16.138408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:16.145232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:16.145723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:16.146161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:16.146896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:16.147354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:16.147778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:16.285362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:16.293827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aaef5962-72ce-48db-bf8b-c7d570b82c94 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.161979 Oct 31 14:49:16.294442 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3090/6431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:16 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:17.318052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:17.319082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:17.327779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:17.328464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:17.329085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:17.330006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:17.330517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:17.330953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:17.472151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:17.479872 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35d8fb06-1f1f-47c9-b6a1-16106e7f5810 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.166429 Oct 31 14:49:17.480437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3342/6432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:17 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:18.505172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:18.506416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:18.513666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:18.514156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:18.514622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:18.515321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:18.515772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:18.516193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:18.648861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:18.657058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bd76bc4a-a225-4a02-ab05-99e62be0026b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1168 microversion: 2.1 time: 0.157237 Oct 31 14:49:18.658150 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3091/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:18 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:19.680551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:19.681089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:19.688418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:19.689540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:19.689989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:19.690714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:19.691173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:19.691605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:19.828719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:19.836604 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e010b68d-e155-4501-83dc-85b994d4e848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.160060 Oct 31 14:49:19.837181 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3343/6434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:19 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:20.860532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:20.861200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:20.867735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:20.868228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:20.868664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:20.869349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:20.869800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:20.870250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:21.001046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:21.009234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8483d6c-8dc3-4b5c-a9b1-464eb6211308 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.152866 Oct 31 14:49:21.009803 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3092/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:20 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:22.033283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:22.033925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:22.040767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:22.041249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:22.041682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:22.042397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:22.042848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:22.043269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:22.173907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:22.181869 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f02e226-3863-4e65-a35c-94bb5829d24c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.153098 Oct 31 14:49:22.182465 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3344/6436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:22 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:23.205255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:23.205908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:23.212849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:23.213343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:23.213790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:23.214531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:23.214999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:23.215436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:23.347530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:23.355215 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c27688f0-6b62-40fe-88a4-3de63620a302 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.154571 Oct 31 14:49:23.355781 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3093/6437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:23 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:24.379022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:24.379627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:24.385751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:24.386256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:24.386693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:24.387376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:24.387827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:24.388249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:24.515958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:24.524241 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bd73b36-a955-4ae1-8fc8-eb2c1e0792e0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.149961 Oct 31 14:49:24.524844 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3345/6438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:24 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:25.547861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:25.548397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:25.555173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:25.555656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:25.556094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:25.556786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:25.557238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:25.557661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:25.684984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:25.693247 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-feb604d1-1e1f-4a1d-b36d-85dbd15689bc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.149342 Oct 31 14:49:25.693828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3094/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:25 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:26.716343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:26.716887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:26.723809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:26.724289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:26.724725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:26.725404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:26.725856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:26.726568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:26.859399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:26.867650 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af16dd9a-25e0-4355-8cce-439afffc2698 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.155257 Oct 31 14:49:26.868229 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3346/6440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:26 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:27.891044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:27.891662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:27.895148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.900825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:27.901317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:27.901760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:27.902490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:27.902957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:27.903385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:27.908260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:28.051171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:28.059639 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-831d4f00-170a-4424-aacf-c456e1561783 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.172458 Oct 31 14:49:28.060234 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3095/6441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:27 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:29.084538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:29.085174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:29.087904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:29.093755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:29.094290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:29.094736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:29.095830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:29.096581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:29.097280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:29.100550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:29.230110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:29.238393 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bb251e3-8dfd-478b-88b0-9e31103105e4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.157724 Oct 31 14:49:29.238974 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3347/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:29 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:30.262148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:30.263544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:30.272353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:30.272869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:30.273456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:30.274194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:30.274665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:30.275132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:30.357490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f36f18b8-9fc8-4f5a-a5d7-7a4c16cd3ef4 req-d955e725-9118-4076-8ffb-f8c498d9a7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac039e28-226e-4174-b8a1-eb0d306129f0", "name": "network-vif-plugged", "status": "completed", "tag": "75fa02ab-5ab4-42d9-9b6b-afd6cab115bc"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:30.368756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f36f18b8-9fc8-4f5a-a5d7-7a4c16cd3ef4 req-d955e725-9118-4076-8ffb-f8c498d9a7a3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:30.369192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f36f18b8-9fc8-4f5a-a5d7-7a4c16cd3ef4 req-d955e725-9118-4076-8ffb-f8c498d9a7a3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:30.369774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f36f18b8-9fc8-4f5a-a5d7-7a4c16cd3ef4 req-d955e725-9118-4076-8ffb-f8c498d9a7a3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:30.385101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f36f18b8-9fc8-4f5a-a5d7-7a4c16cd3ef4 req-d955e725-9118-4076-8ffb-f8c498d9a7a3 service nova] Creating event network-vif-plugged:75fa02ab-5ab4-42d9-9b6b-afd6cab115bc for instance ac039e28-226e-4174-b8a1-eb0d306129f0 on n-h1-863052-1 Oct 31 14:49:30.391488 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f36f18b8-9fc8-4f5a-a5d7-7a4c16cd3ef4 req-d955e725-9118-4076-8ffb-f8c498d9a7a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037812 Oct 31 14:49:30.393202 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3348/6443] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:49:30.430954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:30.443808 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86c36d8b-a39a-47ff-a56d-5cb3b48ccb9b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.184921 Oct 31 14:49:30.455038 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3096/6444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:30 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:31.470797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:31.471496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:31.479282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:31.479797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:31.480239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:31.480939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:31.481396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:31.481847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:31.622594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:31.631048 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efe4bc88-0b60-435c-98e3-d626216da579 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1202 microversion: 2.1 time: 0.165886 Oct 31 14:49:31.631622 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3349/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:31 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:32.655839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:32.656381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:32.663903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:32.664395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:32.664840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:32.665539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:32.665996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:32.666453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:32.802201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:32.810635 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c17a6fae-9654-467d-8797-17d2c8d62f3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1388 microversion: 2.1 time: 0.158778 Oct 31 14:49:32.811214 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3097/6446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:32 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1388 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:32.833929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:32.834578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:32.841529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:32.842008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:32.842482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:32.843163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:32.843611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:32.844030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:32.982660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:32.992308 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-405a8009-408a-488a-9e7e-fc37bc0f5647 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1388 microversion: 2.1 time: 0.162728 Oct 31 14:49:32.992942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3350/6447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:32 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1388 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:33.016764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:33.018068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:33.024515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:33.024999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:33.025438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:33.026127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:33.026607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:33.027112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:33.161060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:33.170638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2ce4436-d5a6-47e8-9f8c-1e6c35719409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1388 microversion: 2.1 time: 0.156990 Oct 31 14:49:33.171380 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3098/6448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:33 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:33.252887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:33.253393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:33.259477 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:33.259991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:33.260453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:33.261205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:33.261692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:33.262126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:33.286648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:49:33.369040 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-419091b8-71db-4bc3-b96f-c578e08c9bda tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 204 len: 0 microversion: 2.1 time: 0.119525 Oct 31 14:49:33.369929 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3351/6449] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:49:33 2022] DELETE /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:49:33.379534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:33.380168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:33.386250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:33.386743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:33.387186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:33.387864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:33.388315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:33.388740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:33.527774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:33.536239 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21f72acf-2001-46b1-b77c-eceef8924a6e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1394 microversion: 2.1 time: 0.161252 Oct 31 14:49:33.536815 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3099/6450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:33 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1394 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:34.561147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:34.561799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:34.569115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:34.569593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:34.570024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:34.570731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:34.571183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:34.571603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:34.703591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:34.711451 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a659e7e5-af2b-4744-8045-d6d2d800191e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1394 microversion: 2.1 time: 0.154679 Oct 31 14:49:34.712024 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3352/6451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:34 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:35.325173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-42ae4f34-df3c-4be6-86a9-5cf9ef5c9c97 req-519a45d0-b987-481e-a34a-9ad8ad8786ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac039e28-226e-4174-b8a1-eb0d306129f0", "name": "network-vif-deleted", "tag": "75fa02ab-5ab4-42d9-9b6b-afd6cab115bc"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:35.339507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-42ae4f34-df3c-4be6-86a9-5cf9ef5c9c97 req-519a45d0-b987-481e-a34a-9ad8ad8786ed service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:35.339996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-42ae4f34-df3c-4be6-86a9-5cf9ef5c9c97 req-519a45d0-b987-481e-a34a-9ad8ad8786ed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:35.340430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-42ae4f34-df3c-4be6-86a9-5cf9ef5c9c97 req-519a45d0-b987-481e-a34a-9ad8ad8786ed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:35.356130 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-42ae4f34-df3c-4be6-86a9-5cf9ef5c9c97 req-519a45d0-b987-481e-a34a-9ad8ad8786ed service nova] Creating event network-vif-deleted:75fa02ab-5ab4-42d9-9b6b-afd6cab115bc for instance ac039e28-226e-4174-b8a1-eb0d306129f0 on n-h1-863052-1 Oct 31 14:49:35.362348 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-42ae4f34-df3c-4be6-86a9-5cf9ef5c9c97 req-519a45d0-b987-481e-a34a-9ad8ad8786ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040743 Oct 31 14:49:35.366105 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3100/6452] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:35.739987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:35.740904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:35.752710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:35.753502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:35.754246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:35.755405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:35.756151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:35.756806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:35.872161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:35.885894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a415ce82-67e5-48cb-9534-d37978075689 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1187 microversion: 2.1 time: 0.153565 Oct 31 14:49:35.886918 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3353/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:35 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:36.921589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:36.922322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:36.929623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:36.930115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:36.930590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:36.931289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:36.931750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:36.932178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:36.995507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:37.003730 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a22a4ac0-5156-4f59-9d73-4db2d7739efd tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1187 microversion: 2.1 time: 0.086434 Oct 31 14:49:37.004307 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3101/6454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:36 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:38.028252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:38.028915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:38.039160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:38.039855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:38.040396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:38.041280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:38.041886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:38.042415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:38.120221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:38.129178 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31444877-ea76-486e-a34d-008c67db1597 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1187 microversion: 2.1 time: 0.105496 Oct 31 14:49:38.129954 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3354/6455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:38 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:39.152421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:39.153027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:39.160759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:39.161251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:39.161693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:39.162432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:39.162892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:39.163329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:39.227256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:39.235866 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5754871a-ce2d-4f23-bd1d-e8c30530aa2e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1187 microversion: 2.1 time: 0.087212 Oct 31 14:49:39.236448 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3102/6456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:39 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:40.259770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:40.260347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:40.268987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:40.269570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:40.270071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:40.270889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:40.271423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:40.272066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:40.324642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:40.325218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:40.325715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:40.326205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lazy-loading 'fault' on Instance uuid ac039e28-226e-4174-b8a1-eb0d306129f0 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:49:40.369289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:49:40.376433 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d450bc2e-2798-4ab6-875b-0b418e4c2b3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 200 len: 1146 microversion: 2.1 time: 0.120725 Oct 31 14:49:40.377016 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3355/6457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:40 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 1146 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:41.399270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:41.399813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:41.407032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:41.407690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:41.408134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:41.408838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:41.409300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:41.409726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:41.424010 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 HTTP/1.1 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'ac039e28-226e-4174-b8a1-eb0d306129f0'} Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:49:41.425689 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-25213921-6b48-467e-a25d-0a13f37c4cd1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 404 len: 111 microversion: 2.1 time: 0.031852 Oct 31 14:49:41.430014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3103/6458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:41 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:43.577567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:43.578080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:43.585657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:43.586143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:43.586616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:43.587312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:43.587767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:43.588197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:43.604376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 HTTP/1.1 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ac039e28-226e-4174-b8a1-eb0d306129f0'} Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:49:43.606040 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e960811-7b16-4ed7-8363-0a0f4b7737ae tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 404 len: 111 microversion: 2.1 time: 0.033830 Oct 31 14:49:43.610675 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3356/6459] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:49:43 2022] DELETE /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:43.616769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:43.617385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ac039e28-226e-4174-b8a1-eb0d306129f0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:43.623937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:43.624419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:43.624857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:43.625544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:43.626542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:43.626975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:43.642267 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 HTTP/1.1 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'ac039e28-226e-4174-b8a1-eb0d306129f0'} Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:49:43.643854 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance ac039e28-226e-4174-b8a1-eb0d306129f0 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44f0c980-3eff-4a97-b660-1bec92def90a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0" status: 404 len: 111 microversion: 2.1 time: 0.032603 Oct 31 14:49:43.647372 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3104/6460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:49:43 2022] GET /compute/v2.1/servers/ac039e28-226e-4174-b8a1-eb0d306129f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:49.774307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:49.776189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:49:49.783966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:49.784452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:49.784888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:49.785592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:49:49.786043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:49:49.786504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:49:49.813714 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb578f0c-7ed8-46e9-a9ca-a8af4b96c0a4 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043293 Oct 31 14:49:49.814740 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3357/6461] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 31 14:49:49 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:03.517167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-62885732", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8c86ee5a-ff87-4e7e-8cd5-6d18fdf8b6d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:03.527859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=19 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:03.528511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=47 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:03.582209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:50:03.954118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:50:03.954586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:50:03.955099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:50:03.955518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:50:03.955928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:50:03.965034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:03.965522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:03.965966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:03.966741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:03.967199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:03.967630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:03.985092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:50:03.991035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:50:04.049839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:50:04.052010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c86ee5a-ff87-4e7e-8cd5-6d18fdf8b6d2',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:50:04.188045 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92ef31e3-b429-4ebe-bf08-3d2d37632aa7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674927 Oct 31 14:50:04.188695 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3105/6462] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:50:04.200195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16fafcaa-3fe7-4667-9b0f-764bda1d6906 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:04.201038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16fafcaa-3fe7-4667-9b0f-764bda1d6906 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:04.204378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:04.204967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:04.268540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-16fafcaa-3fe7-4667-9b0f-764bda1d6906 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:04.275869 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16fafcaa-3fe7-4667-9b0f-764bda1d6906 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1069 microversion: 2.1 time: 0.079574 Oct 31 14:50:04.276389 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3358/6463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:04 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1069 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:05.301457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:05.302586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:05.309381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:05.310030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:05.310549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:05.311260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:05.311723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:05.312483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:05.393566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:05.402758 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-08ed94a3-12cb-4082-9c1f-205085c56f08 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1185 microversion: 2.1 time: 0.106918 Oct 31 14:50:05.404415 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3106/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:05 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:06.428422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:06.429202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:06.437850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:06.439189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:06.439729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:06.440484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:06.441043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:06.441560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:06.648108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e068bb59-5a36-432f-8258-7fd303b38e66 req-1e91f1ac-ee6a-4c8c-8835-33309b55f9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a119b24b-d789-4216-bc25-0bea154211f8", "tag": "d90a5066-921f-47af-a9a3-810f75b4a4b3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:06.649526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:06.662814 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31570e3c-2ceb-4d52-837d-d683ac46a172 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1227 microversion: 2.1 time: 0.238586 Oct 31 14:50:06.664133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e068bb59-5a36-432f-8258-7fd303b38e66 req-1e91f1ac-ee6a-4c8c-8835-33309b55f9f0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:06.665022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e068bb59-5a36-432f-8258-7fd303b38e66 req-1e91f1ac-ee6a-4c8c-8835-33309b55f9f0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:06.665677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e068bb59-5a36-432f-8258-7fd303b38e66 req-1e91f1ac-ee6a-4c8c-8835-33309b55f9f0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:06.676066 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3359/6465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:06 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1227 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:06.682647 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e068bb59-5a36-432f-8258-7fd303b38e66 req-1e91f1ac-ee6a-4c8c-8835-33309b55f9f0 service nova] Creating event network-changed:d90a5066-921f-47af-a9a3-810f75b4a4b3 for instance a119b24b-d789-4216-bc25-0bea154211f8 on n-h1-863052-1 Oct 31 14:50:06.688398 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e068bb59-5a36-432f-8258-7fd303b38e66 req-1e91f1ac-ee6a-4c8c-8835-33309b55f9f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045612 Oct 31 14:50:06.689444 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3107/6466] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:07.689558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:07.690264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:07.697273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:07.697848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:07.698401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:07.699170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:07.699702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:07.700306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:07.839767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:07.848501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9889aeb-f75c-4228-b24c-26d5316c357e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1227 microversion: 2.1 time: 0.163460 Oct 31 14:50:07.849086 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3360/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:07 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1227 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:08.873713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:08.874457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:08.881180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:08.881681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:08.882127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:08.882863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:08.883335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:08.883744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:09.027763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:09.036662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2d6c78a6-579f-470f-b9ed-1e507b19e867 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1227 microversion: 2.1 time: 0.168170 Oct 31 14:50:09.037262 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3108/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:08 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1227 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:10.059827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:10.062511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:10.067402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:10.067896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:10.068332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:10.069033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:10.069486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:10.069909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:10.222365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:10.231423 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e46a0d35-d396-4d30-aac5-27515b281557 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1227 microversion: 2.1 time: 0.175303 Oct 31 14:50:10.232162 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3361/6469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:10 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1227 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:11.257947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:11.258628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:11.266483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:11.267006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:11.267454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:11.268234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:11.268709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:11.269143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:11.405149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:11.413942 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b8f86793-36d3-4e37-91f9-f0e4cf12b439 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.161015 Oct 31 14:50:11.414567 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3109/6470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:11 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:12.439354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:12.440008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:12.446966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:12.447450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:12.447885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:12.448576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:12.449034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:12.449486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:12.629780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:12.641959 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-319d64ae-8298-4b76-a72d-a3dde8018852 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.206783 Oct 31 14:50:12.642948 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3362/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:12 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:13.670977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:13.671586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:13.678778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:13.679267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:13.679710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:13.680414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:13.680872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:13.681300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:13.819300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:13.827540 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3b39dd7-3c4c-4ee2-b4a4-d3ea51807d3d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.160635 Oct 31 14:50:13.828134 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3110/6472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:13 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:14.851649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:14.852328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:14.855059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:14.861365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:14.861974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:14.862439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:14.863947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:14.863947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:14.864199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:15.001166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:15.012593 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7abf269a-9e84-4531-8fb5-94e8470efe34 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.164933 Oct 31 14:50:15.013209 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3363/6473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:14 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:16.035635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:16.036242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:16.038335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:16.039011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:16.046236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:16.046733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:16.047717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:16.048449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:16.048911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:16.049343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:16.190769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:16.198906 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fae7a3f-eeed-46b2-a40e-286f165cfb76 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.167257 Oct 31 14:50:16.199531 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3111/6474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:16 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:17.227510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:17.228144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:17.236614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:17.237112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:17.237550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:17.238283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:17.238739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:17.239162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:17.387482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:17.395829 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a4a7585-5abc-4347-a2d8-352237f5efeb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.172265 Oct 31 14:50:17.396431 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3364/6475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:17 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:18.420182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:18.420788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:18.428662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:18.429296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:18.429734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:18.430466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:18.430922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:18.431421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:18.576498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:18.585405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab9e51bb-98ac-40bc-a973-99bde9fa97a1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.168975 Oct 31 14:50:18.586015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3112/6476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:18 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:19.610067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:19.610717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:19.617764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:19.618295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:19.618743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:19.619442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:19.619909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:19.620347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:19.760252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:19.768456 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fe10e66-2a84-4e69-9802-2e19a42a8ff8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.162562 Oct 31 14:50:19.769042 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3365/6477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:19 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:20.792153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:20.792824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:20.801502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:20.801997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:20.802498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:20.803200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:20.803654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:20.804077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:20.866395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6c80009b-1239-4d0e-bd74-0df6c0cbd010 req-b04e76c4-e5f2-4ea7-a43d-4fb734b0911f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a119b24b-d789-4216-bc25-0bea154211f8", "name": "network-vif-plugged", "status": "completed", "tag": "d90a5066-921f-47af-a9a3-810f75b4a4b3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:20.876789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6c80009b-1239-4d0e-bd74-0df6c0cbd010 req-b04e76c4-e5f2-4ea7-a43d-4fb734b0911f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:20.877272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6c80009b-1239-4d0e-bd74-0df6c0cbd010 req-b04e76c4-e5f2-4ea7-a43d-4fb734b0911f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:20.877708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6c80009b-1239-4d0e-bd74-0df6c0cbd010 req-b04e76c4-e5f2-4ea7-a43d-4fb734b0911f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:20.890712 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6c80009b-1239-4d0e-bd74-0df6c0cbd010 req-b04e76c4-e5f2-4ea7-a43d-4fb734b0911f service nova] Creating event network-vif-plugged:d90a5066-921f-47af-a9a3-810f75b4a4b3 for instance a119b24b-d789-4216-bc25-0bea154211f8 on n-h1-863052-1 Oct 31 14:50:20.897603 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6c80009b-1239-4d0e-bd74-0df6c0cbd010 req-b04e76c4-e5f2-4ea7-a43d-4fb734b0911f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122298 Oct 31 14:50:20.898273 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3113/6478] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:20.964417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:20.972408 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31d868f3-96d3-448d-9bbb-7a45a96ccfe5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.184532 Oct 31 14:50:20.973006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3366/6479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:20 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:21.996895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:21.997635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:22.004743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:22.005352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:22.005809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:22.006576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:22.007091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:22.007622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:22.151659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:22.160091 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89dacc33-fd07-4474-9c4d-27ca5c1144c9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1215 microversion: 2.1 time: 0.168280 Oct 31 14:50:22.160810 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3114/6480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:21 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:23.188799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:23.189404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:23.196515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:23.196979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:23.197679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:23.198412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:23.198867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:23.199282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:23.342596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:23.350894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2853f8d8-8dac-4187-a865-f4b5322c6ce1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1402 microversion: 2.1 time: 0.167907 Oct 31 14:50:23.351473 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3367/6481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:23 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:23.376008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:23.376661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:23.384066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:23.384633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:23.385103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:23.385849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:23.386373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:23.386830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:23.529832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:23.538820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b5b4880-ac2b-46da-bb5f-6db3c842c17f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1402 microversion: 2.1 time: 0.169339 Oct 31 14:50:23.539447 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3115/6482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:23 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1402 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:23.563554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2119689890"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:23.566696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:23.572869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:23.573348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:23.573788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:23.574508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:23.574959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:23.575385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:23.670653 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Attempting to quiesce instance before volume snapshot. Oct 31 14:50:23.719162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 31 14:50:23.793858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Creating snapshot from volume 8c86ee5a-ff87-4e7e-8cd5-6d18fdf8b6d2. {{(pid=120640) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 31 14:50:24.691472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e6989b2-1ebd-4ce2-9a2b-f382c2f26058 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8/action" status: 202 len: 0 microversion: 2.1 time: 1.132482 Oct 31 14:50:24.692540 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3368/6483] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:50:23 2022] POST /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 14:50:25.857533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1035082924", "imageRef": "c5cf4b61-53c6-4d2e-8704-180bb4d69b04", "flavorRef": "452", "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:25.916472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:50:26.604082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:50:26.604503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:50:26.605004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:50:26.605414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:50:26.605821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:50:26.615876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:26.616359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:26.616802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:26.617549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:26.618004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:26.618451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:26.635698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:50:26.641062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:50:26.655252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:50:26.657850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='09ad06d5-ff79-4bfe-a659-c3a5c596593e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:50:26.735962 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb91efc7-fd9b-4c41-b40c-8b4e8c8e289e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882198 Oct 31 14:50:26.736632 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3116/6484] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:50:26.749670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee7c09aa-ee65-46f4-a19d-38ee72731b1f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:26.751156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee7c09aa-ee65-46f4-a19d-38ee72731b1f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:26.813063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee7c09aa-ee65-46f4-a19d-38ee72731b1f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:26.821303 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee7c09aa-ee65-46f4-a19d-38ee72731b1f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1230 microversion: 2.1 time: 0.076960 Oct 31 14:50:26.821939 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3369/6485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:26 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1230 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:27.846467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:27.850512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:27.857416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:27.857916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:27.858385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:27.859646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:27.860100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:27.860523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:27.930646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:27.939837 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74da8374-86f2-4bac-89cc-c9c7129f9c46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1300 microversion: 2.1 time: 0.098447 Oct 31 14:50:27.940434 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3117/6486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:27 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:28.964070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:28.965339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:28.974272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:28.974800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:28.975556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:28.976330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:28.976825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:28.977287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:29.391664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:29.400401 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-166d0dfc-a883-400c-8e53-c372a7867497 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.440391 Oct 31 14:50:29.401224 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3370/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:28 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:29.746641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-62f4e933-bc4a-4d33-9d34-988c65b4e320 req-68481a94-f4e0-4948-9a7e-8c3c13bfdeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8a739c-bf5a-47da-97a1-8cf3cc7f84be", "tag": "3b01bf6b-1d48-49e8-9600-4a8379779baf"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:29.767799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-62f4e933-bc4a-4d33-9d34-988c65b4e320 req-68481a94-f4e0-4948-9a7e-8c3c13bfdeb3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:29.768499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-62f4e933-bc4a-4d33-9d34-988c65b4e320 req-68481a94-f4e0-4948-9a7e-8c3c13bfdeb3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:29.769203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-62f4e933-bc4a-4d33-9d34-988c65b4e320 req-68481a94-f4e0-4948-9a7e-8c3c13bfdeb3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:29.787994 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-62f4e933-bc4a-4d33-9d34-988c65b4e320 req-68481a94-f4e0-4948-9a7e-8c3c13bfdeb3 service nova] Creating event network-changed:3b01bf6b-1d48-49e8-9600-4a8379779baf for instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be on n-h2-863052-1 Oct 31 14:50:29.799784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-62f4e933-bc4a-4d33-9d34-988c65b4e320 req-68481a94-f4e0-4948-9a7e-8c3c13bfdeb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057849 Oct 31 14:50:29.800840 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3118/6488] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:30.426695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:30.428073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:30.435694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:30.436602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:30.437291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:30.438840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:30.439902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:30.440392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:30.662311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:30.670974 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-601c0d14-03b0-48f3-8853-7d1de76aa898 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.248689 Oct 31 14:50:30.683470 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3371/6489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:30 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:31.702750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:31.704607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:31.711336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:31.712102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:31.712541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:31.713472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:31.714117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:31.714685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:31.889419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:31.903549 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71c5ea38-d7c9-4f5f-9c73-d58e564a66cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.207210 Oct 31 14:50:31.904486 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3119/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:31 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:32.934099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:32.934715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:32.943178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:32.944060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:32.944597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:32.945471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:32.945978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:32.948036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:33.168655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:33.178348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e053150d-5d9c-4529-b231-998869ec739b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.249432 Oct 31 14:50:33.178935 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3372/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:32 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:34.206542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:34.207524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:34.211165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:34.217604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:34.218205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:34.218879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:34.219570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:34.220184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:34.220590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:34.224667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=71 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:34.393350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:34.404160 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-43deca45-ca78-4a50-b489-f2a6d004b40f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.202365 Oct 31 14:50:34.404785 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3120/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:34 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:35.430425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:35.431159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:35.434374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:35.441031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:35.441885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:35.442395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:35.443117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:35.443574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:35.444006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:35.447318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:35.602751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:35.611249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cdf7e0d-039a-4bb3-87cb-c24b6c8fd227 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.186510 Oct 31 14:50:35.624609 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3373/6493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:35 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:36.635944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:36.636559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:36.639542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:36.645742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:36.646409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:36.646978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:36.647952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:36.648509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:36.649054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:36.649581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:36.809977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:36.817728 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1af8bd5d-6d77-48dc-8fe2-3c839d2d1478 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.186301 Oct 31 14:50:36.818336 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3121/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:36 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:37.841188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:37.841903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:37.844754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:37.850413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:37.850914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:37.851360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:37.852280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:37.852936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:37.853571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:38.004732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:38.012880 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9acf17e4-4c41-418e-8947-69310689ce4a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.175612 Oct 31 14:50:38.013474 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3374/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:37 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:39.038053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:39.038661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:39.046126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:39.046665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:39.047116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:39.047851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:39.048320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:39.048752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:39.200049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:39.208343 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3888472-331d-4caa-980b-c73c8e1b2742 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.174930 Oct 31 14:50:39.209164 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3122/6496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:39 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:40.233449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:40.234547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:40.242331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:40.242986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:40.243432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:40.244154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:40.244618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:40.245132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:40.417114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:40.427503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-551c51dd-fcd9-4ca8-b2cf-a86c90e36275 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.198179 Oct 31 14:50:40.428230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3375/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:40 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:41.452501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:41.453152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:41.460665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:41.461187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:41.461667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:41.462440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:41.462932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:41.463395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:41.613371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:41.622033 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f9b9633-3072-43ca-8021-42276bbe8a8b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1342 microversion: 2.1 time: 0.174342 Oct 31 14:50:41.623240 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3123/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:41 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:42.648280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:42.649569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:42.659212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:42.659728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:42.660184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:42.660911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:42.661414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:42.661860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:42.815784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:42.824827 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b4a86b9-cb00-4346-9226-63fbbf4c7701 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.180520 Oct 31 14:50:42.825741 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3376/6499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:42 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:43.851500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:43.852169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:43.859577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:43.860071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:43.860509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:43.861213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:43.861669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:43.862089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:44.004957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:44.013959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-10aa8ae7-e450-4ee2-8386-b65ecb8238e1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.166937 Oct 31 14:50:44.014616 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3124/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:43 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:45.038161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:45.038843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:45.046128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:45.047189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:45.047648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:45.048362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:45.048888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:45.049326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:45.199417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:45.209148 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-123ec7ed-ccbb-4cd6-86ee-90380d07fdb1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.174820 Oct 31 14:50:45.209893 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3377/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:45 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:46.237695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:46.238443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:46.245797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:46.246320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:46.246808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:46.247602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:46.248110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:46.248529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:46.422483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:46.431740 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74039c9e-ff69-4f06-a8db-b353bcbdcc36 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.198729 Oct 31 14:50:46.432488 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3125/6502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:46 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:47.457345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:47.458257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:47.466301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:47.466820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:47.467248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:47.467965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:47.469031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:47.469479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:47.620126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:47.628717 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f05bd34b-1424-43b0-a8a2-4d645188320e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.175973 Oct 31 14:50:47.629361 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3378/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:47 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:48.653869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:48.654443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:48.662192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:48.662695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:48.663137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:48.663846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:48.664307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:48.664728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:48.811053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:48.819854 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa21130c-6b7f-4f8b-81d1-ebc81a457366 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.169747 Oct 31 14:50:48.820446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3126/6504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:48 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:49.844383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:49.845081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:49.852323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:49.852861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:49.853321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:49.854039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:49.854542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:49.854984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:49.996892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:50.006506 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d05cb375-961b-4031-8f80-d26f3293fa1e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.165885 Oct 31 14:50:50.007253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3379/6505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:49 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:51.029458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:51.030296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:51.038077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:51.038539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:51.039059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:51.039905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:51.040459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:51.040940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:51.209710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:51.221262 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1aaabeec-d75c-413c-a426-2a0cdcee41af tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.195949 Oct 31 14:50:51.222237 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3127/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:51 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:52.249295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:52.249961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:52.258652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:52.259180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:52.259611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:52.260449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:52.261126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:52.261876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:52.418512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:52.427867 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b813990b-56c4-4065-9b02-56ca9a13b76c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.182545 Oct 31 14:50:52.428560 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3380/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:52 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:53.455486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:53.456125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:53.465201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:53.465758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:53.466263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:53.467217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:53.467777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:53.468265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:53.621502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:53.632084 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3dc02603-d604-40e5-a81c-175649299969 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.181926 Oct 31 14:50:53.632895 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3128/6508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:53 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:53.966361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-949ef919-d941-4a50-97b7-57588553addd req-9177ce92-dd87-4a1c-bb11-03447b30ee23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8a739c-bf5a-47da-97a1-8cf3cc7f84be", "name": "network-vif-plugged", "status": "completed", "tag": "3b01bf6b-1d48-49e8-9600-4a8379779baf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:53.977820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-949ef919-d941-4a50-97b7-57588553addd req-9177ce92-dd87-4a1c-bb11-03447b30ee23 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:53.978374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-949ef919-d941-4a50-97b7-57588553addd req-9177ce92-dd87-4a1c-bb11-03447b30ee23 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:53.978847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-949ef919-d941-4a50-97b7-57588553addd req-9177ce92-dd87-4a1c-bb11-03447b30ee23 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:53.991900 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-949ef919-d941-4a50-97b7-57588553addd req-9177ce92-dd87-4a1c-bb11-03447b30ee23 service nova] Creating event network-vif-plugged:3b01bf6b-1d48-49e8-9600-4a8379779baf for instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be on n-h2-863052-1 Oct 31 14:50:53.997960 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-949ef919-d941-4a50-97b7-57588553addd req-9177ce92-dd87-4a1c-bb11-03447b30ee23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036897 Oct 31 14:50:53.998812 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3381/6509] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:54.658045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:54.658838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:54.666580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:54.667156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:54.667645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:54.668420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:54.668885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:54.669424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:54.804553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:54.812393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9551e7b2-7ca5-4dc1-a4f6-a3fa7865cac7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1376 microversion: 2.1 time: 0.159057 Oct 31 14:50:54.812963 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3129/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:54 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:55.837731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:55.838499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:55.846120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:55.846864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:55.847318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:55.848029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:55.848495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:55.848931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:55.991032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:55.999052 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0aa99c55-0779-4580-8a24-809ebe195484 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1563 microversion: 2.1 time: 0.166936 Oct 31 14:50:55.999641 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3382/6511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:55 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:56.022326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:56.022977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:56.029881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:56.030406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:56.030876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:56.031573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:56.032528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:56.032956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:56.175890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:56.183714 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-065a2942-0a2b-4dca-befc-9f1574478350 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1563 microversion: 2.1 time: 0.165393 Oct 31 14:50:56.184290 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3130/6512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:56 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:56.265593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:56.266112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:56.272669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:56.273162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:56.273609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:56.274331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:56.274797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:56.275234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:56.302115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:50:56.385064 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca4ea141-c0c2-487b-b3e6-9d2ede26437d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 204 len: 0 microversion: 2.1 time: 0.122676 Oct 31 14:50:56.385667 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3383/6513] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:50:56 2022] DELETE /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:50:56.394472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:56.395216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:56.401477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:56.401963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:56.402613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:56.403179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:56.403656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:56.404107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:56.546388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:56.554600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6800ae00-8b26-4dee-b6b2-05f1a1d4c06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1569 microversion: 2.1 time: 0.164267 Oct 31 14:50:56.555203 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3131/6514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:56 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:57.578917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:57.580260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:57.587070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:57.587575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:57.588022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:57.588717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:57.589177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:57.589608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:57.724262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:57.732030 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6f5815c-04f1-4977-bba6-2a29e08b792b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1569 microversion: 2.1 time: 0.157823 Oct 31 14:50:57.732600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3384/6515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:57 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:58.394252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8995cf70-40f6-4591-b86f-c4f653affe11 req-9ba47901-a102-4c9f-9190-ec3416f5bc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8a739c-bf5a-47da-97a1-8cf3cc7f84be", "name": "network-vif-deleted", "tag": "3b01bf6b-1d48-49e8-9600-4a8379779baf"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:58.405417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8995cf70-40f6-4591-b86f-c4f653affe11 req-9ba47901-a102-4c9f-9190-ec3416f5bc1b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:58.406220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8995cf70-40f6-4591-b86f-c4f653affe11 req-9ba47901-a102-4c9f-9190-ec3416f5bc1b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:58.407341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8995cf70-40f6-4591-b86f-c4f653affe11 req-9ba47901-a102-4c9f-9190-ec3416f5bc1b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:58.422017 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8995cf70-40f6-4591-b86f-c4f653affe11 req-9ba47901-a102-4c9f-9190-ec3416f5bc1b service nova] Creating event network-vif-deleted:3b01bf6b-1d48-49e8-9600-4a8379779baf for instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be on n-h2-863052-1 Oct 31 14:50:58.431240 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8995cf70-40f6-4591-b86f-c4f653affe11 req-9ba47901-a102-4c9f-9190-ec3416f5bc1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040346 Oct 31 14:50:58.432079 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3132/6516] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:58.756803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:58.757338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:58.764382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:58.764891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:58.765321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:58.766019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:58.767021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:58.767456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:58.832383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:58.840458 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-832c51db-c891-4a2f-b488-a0871b8ffee2 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1361 microversion: 2.1 time: 0.087922 Oct 31 14:50:58.841038 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3385/6517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:58 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:50:59.866650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:59.867487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:50:59.874111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:59.874636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:59.875081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:59.876274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:50:59.876731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:50:59.877158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:50:59.949009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:50:59.959053 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04359c5c-649b-4ab8-9722-1da2387413b1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1361 microversion: 2.1 time: 0.097686 Oct 31 14:50:59.959660 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3133/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:50:59 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1361 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:00.987352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:00.988832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:01.002081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:01.003434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:01.004328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:01.005804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:01.006664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:01.007419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:01.100561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:01.110086 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b9b9064-0b02-47f7-bba8-b12077ede93a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1361 microversion: 2.1 time: 0.130219 Oct 31 14:51:01.110716 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3386/6519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:00 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1361 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:02.135339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:02.135990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:02.143786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:02.144285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:02.144727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:02.145431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:02.145886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:02.146340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:02.222535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:02.232213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0aa2bd5d-495d-4f2c-a628-680a4dfe0ed5 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 200 len: 1361 microversion: 2.1 time: 0.102773 Oct 31 14:51:02.232813 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3134/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:02 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 1361 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:03.258641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:03.260317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:03.270860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:03.271719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:03.272438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:03.273393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:03.274885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:03.275644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:03.315542 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be HTTP/1.1 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ee8a739c-bf5a-47da-97a1-8cf3cc7f84be'} Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:03.317359 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:51:03.322062 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d1688be-a2f8-4534-9735-ff584a43cb56 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 404 len: 111 microversion: 2.1 time: 0.066064 Oct 31 14:51:03.323258 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3387/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:03 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:51:08.697823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:08.698371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:08.701254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=30 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.706613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:08.707103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:08.707535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:08.708228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:08.708683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:08.709110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:08.711934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=86 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.736821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:51:08.815527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebccfe45-021b-4c16-b56a-1dfcb15444aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 204 len: 0 microversion: 2.1 time: 0.121380 Oct 31 14:51:08.816126 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3135/6522] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:51:08 2022] DELETE /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:51:08.827239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:08.828984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:08.833287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.841253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:08.841948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:08.842627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:08.843686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:08.844874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:08.845522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:08.856905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:09.033287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:09.041607 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c022db5f-b106-4311-aa8e-8ebdd7f4494b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1408 microversion: 2.1 time: 0.220768 Oct 31 14:51:09.042227 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3388/6523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:08 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:10.066404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:10.067176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:10.074372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:10.074863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:10.075300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:10.076017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:10.076455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:10.076882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:10.212149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:10.220698 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3327c9d-2533-400e-ad21-e0f38ef5f400 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1408 microversion: 2.1 time: 0.158540 Oct 31 14:51:10.221278 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3136/6524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:10 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:10.916719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-dcf9d7ba-58be-4d64-af26-d524249dc4de req-dcf0196d-1757-4008-b008-80156fab381c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a119b24b-d789-4216-bc25-0bea154211f8", "name": "network-vif-deleted", "tag": "d90a5066-921f-47af-a9a3-810f75b4a4b3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:51:10.930484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dcf9d7ba-58be-4d64-af26-d524249dc4de req-dcf0196d-1757-4008-b008-80156fab381c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:10.931031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dcf9d7ba-58be-4d64-af26-d524249dc4de req-dcf0196d-1757-4008-b008-80156fab381c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:10.931519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dcf9d7ba-58be-4d64-af26-d524249dc4de req-dcf0196d-1757-4008-b008-80156fab381c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:10.946535 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-dcf9d7ba-58be-4d64-af26-d524249dc4de req-dcf0196d-1757-4008-b008-80156fab381c service nova] Creating event network-vif-deleted:d90a5066-921f-47af-a9a3-810f75b4a4b3 for instance a119b24b-d789-4216-bc25-0bea154211f8 on n-h1-863052-1 Oct 31 14:51:10.951666 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-dcf9d7ba-58be-4d64-af26-d524249dc4de req-dcf0196d-1757-4008-b008-80156fab381c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040843 Oct 31 14:51:10.952278 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3389/6525] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:51:11.244862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:11.245472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:11.253019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:11.253716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:11.254334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:11.255221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:11.255836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:11.256264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:11.325358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:11.333900 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-143da53b-25b6-48f4-9105-049ce9429f15 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1200 microversion: 2.1 time: 0.092852 Oct 31 14:51:11.334611 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3137/6526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:11 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:12.358560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:12.359545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:12.366581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:12.367090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:12.367546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:12.368259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:12.368732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:12.369211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:12.452222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:12.461238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-870725e4-a8f4-4c8e-8af7-d15ed62b1273 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1200 microversion: 2.1 time: 0.107971 Oct 31 14:51:12.461888 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3390/6527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:12 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:13.501083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:13.501691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:13.508872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:13.509488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:13.509982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:13.510705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:13.511200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:13.511637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:13.580598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:13.588696 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd20cb1a-8339-4e8f-ad12-064eeaab9125 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1200 microversion: 2.1 time: 0.091729 Oct 31 14:51:13.589373 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3138/6528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:13 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:14.612138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:14.612784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:14.620728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:14.621562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:14.622014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:14.622752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:14.623215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:14.623648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:14.689309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:14.697421 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1aac331-9713-4a03-94d9-497fb1c8355e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1200 microversion: 2.1 time: 0.089549 Oct 31 14:51:14.698003 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3391/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:14 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:15.722096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:15.722774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:15.730781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:15.731271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:15.731708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:15.732410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:15.732989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:15.733425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:15.766142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:15.766652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:15.767087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:15.767531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lazy-loading 'fault' on Instance uuid a119b24b-d789-4216-bc25-0bea154211f8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:51:15.812814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:15.821835 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9371965-6263-47bd-b484-064ee3c5fdb3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 200 len: 1205 microversion: 2.1 time: 0.104657 Oct 31 14:51:15.822458 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3139/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:15 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 1205 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:16.846649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:16.847372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:16.854095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:16.854627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:16.855087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:16.855790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:16.856258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:16.856695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:16.870405 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 HTTP/1.1 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a119b24b-d789-4216-bc25-0bea154211f8'} Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:16.872061 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:51:16.876343 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-938fd6a0-ecc7-432f-ac0b-f9031e0bd1b7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 404 len: 111 microversion: 2.1 time: 0.031473 Oct 31 14:51:16.879624 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3392/6531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:16 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:51:17.982280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:17.983149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:18.005647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.006363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.007088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.008280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.009079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.009785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.036217 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be HTTP/1.1 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'ee8a739c-bf5a-47da-97a1-8cf3cc7f84be'} Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:51:18.039143 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72790e4c-72eb-405a-bf18-84613e1afbc0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 404 len: 111 microversion: 2.1 time: 0.066676 Oct 31 14:51:18.045609 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3140/6532] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:51:17 2022] DELETE /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:51:18.056343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:18.057370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: ee8a739c-bf5a-47da-97a1-8cf3cc7f84be] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:18.069628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.070615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.071471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.072765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.073630 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.074515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.099327 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be HTTP/1.1 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ee8a739c-bf5a-47da-97a1-8cf3cc7f84be'} Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.102055 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance ee8a739c-bf5a-47da-97a1-8cf3cc7f84be could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:51:18.108011 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec16dabd-566c-40ee-b640-72cde79c7779 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be" status: 404 len: 111 microversion: 2.1 time: 0.054864 Oct 31 14:51:18.111191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3393/6533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:18 2022] GET /compute/v2.1/servers/ee8a739c-bf5a-47da-97a1-8cf3cc7f84be => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:51:18.706393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:18.706906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:18.714899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.715336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.715788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.716497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.716963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.717398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.737261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 HTTP/1.1 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a119b24b-d789-4216-bc25-0bea154211f8'} Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:51:18.738919 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c1f2c75-71f0-41cf-ab31-f43ab0643409 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 404 len: 111 microversion: 2.1 time: 0.038212 Oct 31 14:51:18.747796 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3141/6534] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:51:18 2022] DELETE /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:51:18.753776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:18.754439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: a119b24b-d789-4216-bc25-0bea154211f8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:18.762144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.762677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.763128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.763846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:18.764316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:18.764757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:18.781147 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 HTTP/1.1 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a119b24b-d789-4216-bc25-0bea154211f8'} Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:51:18.783269 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance a119b24b-d789-4216-bc25-0bea154211f8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9d18d07-4e78-4ff1-aebd-7b9ea72f0b87 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8" status: 404 len: 111 microversion: 2.1 time: 0.035069 Oct 31 14:51:18.787287 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3394/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:18 2022] GET /compute/v2.1/servers/a119b24b-d789-4216-bc25-0bea154211f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:51:18.859115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cc734556-7692-435a-9895-438956a190be tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: .version_select at 0x7fe10799de50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-767906490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqEUXdeytXW/2cHGXpDCFKOC+R8YDMf1zFrU/PrwLn1OovKDGNqq07oJZHnK0wdKATnGhRiWSfMDaFyDyknh2+PlOAiO7Yco6nvzF88GAt3FKvnj7bbFtg6GdeIX+VzyA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:51:18.877446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cc734556-7692-435a-9895-438956a190be tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:51:18.882747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cc734556-7692-435a-9895-438956a190be tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:51:18.906769 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cc734556-7692-435a-9895-438956a190be tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.052981 Oct 31 14:51:18.907390 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3142/6536] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 14:51:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:51:35.276679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1389248447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-767906490", "security_groups": [{"name": "tempest-secgroup-smoke-1764345971"}], "block_device_mapping_v2": [{"uuid": "06d02f6f-66a5-4324-9bd6-eee803c9a19c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:51:35.287716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=13 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:35.288390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=25 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:35.398193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:51:35.786935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:51:35.787390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:51:35.787871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:51:35.788292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:51:35.788710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:51:35.797631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:35.798118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:35.798597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:35.799328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:35.799794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:35.800227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:35.816749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:51:35.821941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:51:35.887075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:51:35.889243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06d02f6f-66a5-4324-9bd6-eee803c9a19c',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:51:36.023648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5049c9e-6452-4bdd-bab2-582e914bffcb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751192 Oct 31 14:51:36.024294 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3395/6537] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:51:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:51:36.034335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:36.035198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:36.035976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:36.040616 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dce1c340-17db-40f4-a2ee-a00ec40c551b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:36.041249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dce1c340-17db-40f4-a2ee-a00ec40c551b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:36.103994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dce1c340-17db-40f4-a2ee-a00ec40c551b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:36.111567 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dce1c340-17db-40f4-a2ee-a00ec40c551b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1094 microversion: 2.1 time: 0.079300 Oct 31 14:51:36.112141 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3143/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:36 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:37.136906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:37.137616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:37.145086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:37.145913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:37.146275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:37.147066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:37.147509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:37.147945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:37.231110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:37.240414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d874e104-771a-4e11-947c-0ae9f94a3edc tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1210 microversion: 2.1 time: 0.108846 Oct 31 14:51:37.254505 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3396/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:37 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:38.265911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:38.266663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:38.274910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:38.275409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:38.276529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:38.277248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:38.277709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:38.278136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:38.424895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:38.433695 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-667ffe30-fc40-414d-985d-da25f0f6f68a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1278 microversion: 2.1 time: 0.172370 Oct 31 14:51:38.434857 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3144/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:38 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:38.943782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6d25f6b2-1f41-4319-ab2b-9ab0028cda8d req-ee320ea2-1e1f-4edb-a363-6f3e89e30a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fc5b50-7887-4a8f-a608-753f5f88a93c", "tag": "923ed6aa-f489-4f2a-8407-3374b4b1f45c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:51:38.956917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6d25f6b2-1f41-4319-ab2b-9ab0028cda8d req-ee320ea2-1e1f-4edb-a363-6f3e89e30a9b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:38.957406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6d25f6b2-1f41-4319-ab2b-9ab0028cda8d req-ee320ea2-1e1f-4edb-a363-6f3e89e30a9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:38.958158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6d25f6b2-1f41-4319-ab2b-9ab0028cda8d req-ee320ea2-1e1f-4edb-a363-6f3e89e30a9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:38.974304 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6d25f6b2-1f41-4319-ab2b-9ab0028cda8d req-ee320ea2-1e1f-4edb-a363-6f3e89e30a9b service nova] Creating event network-changed:923ed6aa-f489-4f2a-8407-3374b4b1f45c for instance 07fc5b50-7887-4a8f-a608-753f5f88a93c on n-h1-863052-1 Oct 31 14:51:38.979426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6d25f6b2-1f41-4319-ab2b-9ab0028cda8d req-ee320ea2-1e1f-4edb-a363-6f3e89e30a9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039431 Oct 31 14:51:38.980040 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3397/6541] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:51:39.458205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:39.459179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:39.466617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:39.467126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:39.467575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:39.468296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:39.468808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:39.469475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:39.619694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:39.628758 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-85bb0245-6689-4b71-8f86-7d7876069d93 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1278 microversion: 2.1 time: 0.174578 Oct 31 14:51:39.629768 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3145/6542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:39 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:40.653498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:40.654336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:40.662460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:40.662967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:40.663426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:40.664278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:40.665927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:40.665927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:40.865103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:40.881801 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0867d262-8c44-4897-9a7a-72ec32919312 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1278 microversion: 2.1 time: 0.232608 Oct 31 14:51:40.882434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3398/6543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:40 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:51:41.904990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:41.905687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:41.913745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:41.914323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:41.914836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:41.915500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:41.915967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:41.916400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:42.079724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:42.090415 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f0805ae-b6e3-4fac-b540-e9bf12ccd370 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1278 microversion: 2.1 time: 0.189760 Oct 31 14:51:42.091373 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3146/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:41 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:43.115285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:43.115906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:43.125783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:43.126322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:43.126776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:43.127494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:43.127960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:43.128399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:43.274191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:43.283843 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e2be0b4-83d1-4d04-bcb2-d05dbe255487 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.172388 Oct 31 14:51:43.284452 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3399/6545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:43 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:44.307895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:44.308523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:44.316750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:44.317234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:44.317670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:44.318405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:44.318867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:44.319291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:44.460031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:44.468130 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b81c720-fe74-4cc9-a365-97783894d06f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.164350 Oct 31 14:51:44.469228 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3147/6546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:44 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:45.494338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:45.494872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:45.497829 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:51:45.497975 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c (ip 10.222.0.27) !!! Oct 31 14:51:45.505567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:45.506063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:45.506568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:45.507261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:45.507723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:45.508153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:45.650596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:45.658325 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba2a3457-9e5c-4e26-9183-8659ad0c7d46 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.169019 Oct 31 14:51:45.658897 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3400/6547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:45 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:46.684912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:46.685591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:46.688729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:46.694691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:46.695188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:46.695626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:46.696341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:46.696795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:46.697226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:46.869791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:46.877852 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f52607c1-ce4b-4daf-8a29-a163cd85e604 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.197098 Oct 31 14:51:46.878465 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3148/6548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:46 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:51:47.900932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:47.901746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:47.903806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:47.904514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:47.910981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:47.911481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:47.911936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:47.912670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:47.913255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:47.913604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:48.055871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:48.063841 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de94bc93-ff88-4ab8-b014-840a3f7ac573 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.166808 Oct 31 14:51:48.064636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3401/6549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:47 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:49.087536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:49.088160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:49.095738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:49.096234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:49.096686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:49.097410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:49.097875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:49.098416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:49.241007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:49.248961 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9d446fa-5eab-44f8-812a-186524a80f32 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.165499 Oct 31 14:51:49.249566 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3149/6550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:49 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:50.272285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:50.272912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:50.280145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:50.280653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:50.281116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:50.281843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:50.282343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:50.282783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:50.431340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:50.439018 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73c54f43-3782-4971-af61-b6c97fdd334d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.170723 Oct 31 14:51:50.439589 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3402/6551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:50 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:51.461899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:51.462612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:51.469527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:51.470023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:51.470524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:51.471240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:51.471700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:51.472125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:51.617980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:51.627482 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2fe51e2-7147-467d-b4c2-420222256b1b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.169523 Oct 31 14:51:51.628093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3150/6552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:51 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:52.652138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:52.653003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:52.661886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:52.662802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:52.663556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:52.664726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:52.665496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:52.666216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:52.808012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:52.815980 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ffb07862-ad6b-47bc-82ac-f8f250182b00 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.168929 Oct 31 14:51:52.816561 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3403/6553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:52 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:53.053488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3932e471-e660-4925-b2d2-3bd61c753a2a req-51348c49-6da5-40aa-8b9c-1d794cfa90e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fc5b50-7887-4a8f-a608-753f5f88a93c", "name": "network-vif-plugged", "status": "completed", "tag": "923ed6aa-f489-4f2a-8407-3374b4b1f45c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:51:53.067076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3932e471-e660-4925-b2d2-3bd61c753a2a req-51348c49-6da5-40aa-8b9c-1d794cfa90e1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:53.067575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3932e471-e660-4925-b2d2-3bd61c753a2a req-51348c49-6da5-40aa-8b9c-1d794cfa90e1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:53.068008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3932e471-e660-4925-b2d2-3bd61c753a2a req-51348c49-6da5-40aa-8b9c-1d794cfa90e1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:53.080868 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3932e471-e660-4925-b2d2-3bd61c753a2a req-51348c49-6da5-40aa-8b9c-1d794cfa90e1 service nova] Creating event network-vif-plugged:923ed6aa-f489-4f2a-8407-3374b4b1f45c for instance 07fc5b50-7887-4a8f-a608-753f5f88a93c on n-h1-863052-1 Oct 31 14:51:53.086203 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3932e471-e660-4925-b2d2-3bd61c753a2a req-51348c49-6da5-40aa-8b9c-1d794cfa90e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036486 Oct 31 14:51:53.087293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3151/6554] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:51:53.840122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:53.840682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:53.847651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:53.848157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:53.848596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:53.849296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:53.849757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:53.850214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:53.995981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:54.004461 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce500681-ccb1-4550-bf7c-c718ac10678c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1266 microversion: 2.1 time: 0.168574 Oct 31 14:51:54.005041 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3404/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:53 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:55.028431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:55.029139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:55.036316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:55.036808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:55.037253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:55.037958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:55.038447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:55.038881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:55.181831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:55.191686 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a9b189d-61df-4f0c-9d20-a5c00d342ea3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1453 microversion: 2.1 time: 0.167470 Oct 31 14:51:55.192504 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3152/6556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:55 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:55.215760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:55.216434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:51:55.226992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:55.227498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:55.227952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:55.228684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:55.229158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:55.229680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:55.380107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:51:55.388202 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f86115d-9f33-40d0-b3c5-d49406f218ba tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1453 microversion: 2.1 time: 0.176517 Oct 31 14:51:55.388799 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3405/6557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:51:55 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:51:57.106403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d1dd391e-5d95-491b-98d3-b83b67646c05 req-9bac7072-5c4b-490b-af55-9aba2db2e414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fc5b50-7887-4a8f-a608-753f5f88a93c", "tag": "923ed6aa-f489-4f2a-8407-3374b4b1f45c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:51:57.117602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d1dd391e-5d95-491b-98d3-b83b67646c05 req-9bac7072-5c4b-490b-af55-9aba2db2e414 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:51:57.118077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d1dd391e-5d95-491b-98d3-b83b67646c05 req-9bac7072-5c4b-490b-af55-9aba2db2e414 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:51:57.118531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d1dd391e-5d95-491b-98d3-b83b67646c05 req-9bac7072-5c4b-490b-af55-9aba2db2e414 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:51:57.131787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d1dd391e-5d95-491b-98d3-b83b67646c05 req-9bac7072-5c4b-490b-af55-9aba2db2e414 service nova] Creating event network-changed:923ed6aa-f489-4f2a-8407-3374b4b1f45c for instance 07fc5b50-7887-4a8f-a608-753f5f88a93c on n-h1-863052-1 Oct 31 14:51:57.142768 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d1dd391e-5d95-491b-98d3-b83b67646c05 req-9bac7072-5c4b-490b-af55-9aba2db2e414 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039968 Oct 31 14:51:57.143395 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3153/6558] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:53:53.320652 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 14:53:53.321264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:53.322017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=58 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:53.323842 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 31 14:53:53.324755 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 31 14:53:53.330351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:53.330861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:53.339363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:53.339853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:53.340382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:53.341082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:53.342932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:53.342932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:53.371264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:53:53.455209 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dfa40f26-72d5-4dfa-a9ad-05763ee499e8 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 204 len: 0 microversion: 2.1 time: 0.136388 Oct 31 14:53:53.455874 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3406/6559] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:53:53 2022] DELETE /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:53:53.463215 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 14:53:53.464272 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 14:53:53.464974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=24 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:53.465762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=52 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:53.467876 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:53:53.468105 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 14:53:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 (ip 10.222.0.27) !!! Oct 31 14:53:53.469567 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:53:53.469719 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 14:53:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 (ip 10.222.0.27) !!! Oct 31 14:53:53.477641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:53.478898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:53.494156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:53.494705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:53.495152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:53.495863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:53.496323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:53.496747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:53.821728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:53.830662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-738e3fad-8bb3-491c-a535-03778b5b12fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1733 microversion: 2.1 time: 0.369661 Oct 31 14:53:53.831256 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3154/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:53 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1733 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:53:54.608803 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 14:53:54.616255 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 49902. Oct 31 14:53:54.668915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:54.669565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:54.675709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:54.676206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:54.676649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:54.677351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:54.677811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:54.678275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:54.704315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:53:54.804665 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0507d303-b784-42d5-87f8-b8a3d9dfec7f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 204 len: 0 microversion: 2.1 time: 0.198845 Oct 31 14:53:54.804665 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3407/6561] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:53:54 2022] DELETE /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:53:54.813946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:54.814591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:54.823292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:54.823784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:54.824223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:54.824927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:54.825383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:54.826355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:54.833962 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 49908. Oct 31 14:53:54.848058 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 49906. Oct 31 14:53:54.862535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:54.863719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:54.874358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:54.875190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:54.875790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:54.876923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:54.877722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:54.878474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:55.004097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:55.012942 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2541cc45-81c2-4d34-bd9f-4e1e17b1c780 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1578 microversion: 2.1 time: 0.203234 Oct 31 14:53:55.014251 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3155/6562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:54 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:53:55.469682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1742fe6945cd4ed1a56bb085f36d693e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbf2d7231840f5bdb737a8c7c3b57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:55.477440 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ad5e135-e5c3-408c-8ade-334f2dffd6b5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 200 len: 1733 microversion: 2.1 time: 0.624810 Oct 31 14:53:55.478055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3408/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:54 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 1733 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:53:55.932251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9d741c67-370b-46f8-ad7a-05cc71073755 req-f171bb57-e721-426a-b81f-f27060455243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6", "name": "network-vif-deleted", "tag": "9eb17480-2131-4a92-b797-a357be1fc7ca"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:53:55.968316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9d741c67-370b-46f8-ad7a-05cc71073755 req-f171bb57-e721-426a-b81f-f27060455243 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:55.969162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9d741c67-370b-46f8-ad7a-05cc71073755 req-f171bb57-e721-426a-b81f-f27060455243 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:55.969680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9d741c67-370b-46f8-ad7a-05cc71073755 req-f171bb57-e721-426a-b81f-f27060455243 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:55.985056 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9d741c67-370b-46f8-ad7a-05cc71073755 req-f171bb57-e721-426a-b81f-f27060455243 service nova] Creating event network-vif-deleted:9eb17480-2131-4a92-b797-a357be1fc7ca for instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 on n-h2-863052-1 Oct 31 14:53:55.991369 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9d741c67-370b-46f8-ad7a-05cc71073755 req-f171bb57-e721-426a-b81f-f27060455243 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176578 Oct 31 14:53:55.992560 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3156/6564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:53:56.037235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:56.038120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:56.047329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:56.047934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:56.048464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:56.049261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:56.049816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:56.050419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:56.056820 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 49922. Oct 31 14:53:56.195664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:56.204614 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17f1128f-45fa-4020-94d2-b5882c620056 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1578 microversion: 2.1 time: 0.171645 Oct 31 14:53:56.205198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3409/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:56 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:53:56.504251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:56.504963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:56.511384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:56.511873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:56.512310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:56.513013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:56.514227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:56.514661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:56.530034 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] HTTP exception thrown: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Request method failure captured: Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 HTTP/1.1 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-BSlZtqIJcp9SkuzE5zwPx6yVaHndBHjBLhOT--roiedP8kPCyiInXe25pic15rYj1cCdLbEUwPY0afJbDI3cmvvg8o5Xdrh0gAWeUREYVhWcn8NoF8mQRRNPS7UWTsZcaNtLVUWrhJb7Xn3kT9_1iH3QyqimTqYtO3cMGIlVr5D54 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 53dbf2d7231840f5bdb737a8c7c3b57b Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestServerBasicOps-709195198 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53dbf2d7231840f5bdb737a8c7c3b57b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestServerBasicOps-709195198 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 53dbf2d7231840f5bdb737a8c7c3b57b Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestServerBasicOps-709195198 Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestServerBasicOps-709195198-project Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 1742fe6945cd4ed1a56bb085f36d693e Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestServerBasicOps-709195198-project Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6'} Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:53:56.532023 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Returning 404 to user: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:53:56.536465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a48aec73-b526-47f7-8c97-550bd6ec22d5 tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 404 len: 111 microversion: 2.1 time: 0.033587 Oct 31 14:53:56.537265 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3157/6566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:56 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:53:57.102786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:57.103309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:57.109846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:57.110633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:57.111101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:57.111821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:57.112439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:57.112890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:57.128589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] HTTP exception thrown: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Request method failure captured: Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 HTTP/1.1 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-BSlZtqIJcp9SkuzE5zwPx6yVaHndBHjBLhOT--roiedP8kPCyiInXe25pic15rYj1cCdLbEUwPY0afJbDI3cmvvg8o5Xdrh0gAWeUREYVhWcn8NoF8mQRRNPS7UWTsZcaNtLVUWrhJb7Xn3kT9_1iH3QyqimTqYtO3cMGIlVr5D54 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 53dbf2d7231840f5bdb737a8c7c3b57b Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestServerBasicOps-709195198 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53dbf2d7231840f5bdb737a8c7c3b57b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestServerBasicOps-709195198 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 53dbf2d7231840f5bdb737a8c7c3b57b Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestServerBasicOps-709195198 Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestServerBasicOps-709195198-project Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 1742fe6945cd4ed1a56bb085f36d693e Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestServerBasicOps-709195198-project Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6'} Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:53:57.130344 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.134668 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.135593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Returning 404 to user: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:53:57.136502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc6d9553-dd28-49e3-977e-f91dfbe447fd tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 404 len: 111 microversion: 2.1 time: 0.095209 Oct 31 14:53:57.137549 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3410/6567] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:53:57 2022] DELETE /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:53:57.145327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:57.146155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] [instance: c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:57.155332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:57.155834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:57.156426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:57.157146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:57.157611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:57.158045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:57.173382 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] HTTP exception thrown: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Request method failure captured: Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 HTTP/1.1 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-BSlZtqIJcp9SkuzE5zwPx6yVaHndBHjBLhOT--roiedP8kPCyiInXe25pic15rYj1cCdLbEUwPY0afJbDI3cmvvg8o5Xdrh0gAWeUREYVhWcn8NoF8mQRRNPS7UWTsZcaNtLVUWrhJb7Xn3kT9_1iH3QyqimTqYtO3cMGIlVr5D54 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 53dbf2d7231840f5bdb737a8c7c3b57b Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestServerBasicOps-709195198 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53dbf2d7231840f5bdb737a8c7c3b57b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53dbf2d7231840f5bdb737a8c7c3b57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestServerBasicOps-709195198 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 53dbf2d7231840f5bdb737a8c7c3b57b Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestServerBasicOps-709195198 Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestServerBasicOps-709195198-project Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 1742fe6945cd4ed1a56bb085f36d693e Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestServerBasicOps-709195198-project Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6'} Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:53:57.175025 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Returning 404 to user: Instance c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4680ec3-ebbe-4cb6-b850-a73a329b05fe tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6" status: 404 len: 111 microversion: 2.1 time: 0.035217 Oct 31 14:53:57.179097 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3158/6568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:57 2022] GET /compute/v2.1/servers/c20aa4dc-44b2-4630-97fb-6af4ab8ae4b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:53:57.231402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:57.232615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:57.241667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:57.242472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:57.243087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:57.244132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:57.245194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:57.245802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:57.346554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:57.356527 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-707cce05-c1b9-44b0-ad3e-fe68bd2ef331 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1225 microversion: 2.1 time: 0.128314 Oct 31 14:53:57.372155 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3411/6569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:57 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:53:57.423916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d4d9c93b-756c-42fd-b0f7-f0fe5c7d08de tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] Calling method '.version_select at 0x7fe10681af70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:57.471184 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d4d9c93b-756c-42fd-b0f7-f0fe5c7d08de tempest-TestServerBasicOps-709195198 tempest-TestServerBasicOps-709195198-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1182134520" status: 202 len: 0 microversion: 2.1 time: 0.051497 Oct 31 14:53:57.482508 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3159/6570] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 31 14:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1182134520 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:53:58.011710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-96892d6d-ee68-4812-a86d-b2d4355cd0c8 req-38ca067e-c079-455c-bdda-e2f2601d5cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fc5b50-7887-4a8f-a608-753f5f88a93c", "name": "network-vif-deleted", "tag": "923ed6aa-f489-4f2a-8407-3374b4b1f45c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:53:58.034558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-96892d6d-ee68-4812-a86d-b2d4355cd0c8 req-38ca067e-c079-455c-bdda-e2f2601d5cee service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:58.035245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-96892d6d-ee68-4812-a86d-b2d4355cd0c8 req-38ca067e-c079-455c-bdda-e2f2601d5cee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:58.035844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-96892d6d-ee68-4812-a86d-b2d4355cd0c8 req-38ca067e-c079-455c-bdda-e2f2601d5cee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:58.052035 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-96892d6d-ee68-4812-a86d-b2d4355cd0c8 req-38ca067e-c079-455c-bdda-e2f2601d5cee service nova] Creating event network-vif-deleted:923ed6aa-f489-4f2a-8407-3374b4b1f45c for instance 07fc5b50-7887-4a8f-a608-753f5f88a93c on n-h1-863052-1 Oct 31 14:53:58.061071 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-96892d6d-ee68-4812-a86d-b2d4355cd0c8 req-38ca067e-c079-455c-bdda-e2f2601d5cee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052513 Oct 31 14:53:58.065344 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3412/6571] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:53:58.384389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:58.385683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:58.393622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:58.394259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:58.394781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:58.395721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:58.396380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:58.397002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:58.473358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:58.484188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93a039a1-33e1-49d4-91c6-7262050faccf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1225 microversion: 2.1 time: 0.104421 Oct 31 14:53:58.484792 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3160/6572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:58 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:53:59.508687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:53:59.510069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:53:59.526139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:59.528553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:59.529266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:59.531919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:53:59.535398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:53:59.536125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:53:59.632474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:53:59.641363 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c20bfd3-9416-4f48-bdb9-df6120288da6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1225 microversion: 2.1 time: 0.136933 Oct 31 14:53:59.643139 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3413/6573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:53:59 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:00.668002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:00.673290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:00.684987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:00.685932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:00.686402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:00.687122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:00.687579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:00.688007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:00.776281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:00.787000 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d254506-8adc-48dc-b0cb-7d23a9dbbd27 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1225 microversion: 2.1 time: 0.122884 Oct 31 14:54:00.787719 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3161/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:00 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:01.812952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:01.813606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:01.820805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:01.821323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:01.821785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:01.822565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:01.823043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:01.823684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:01.908318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:01.916571 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dac1ebc-dea7-4d9b-8b30-5e7f950f88d4 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 200 len: 1225 microversion: 2.1 time: 0.109406 Oct 31 14:54:01.917441 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3414/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:01 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:02.939499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:02.940863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:02.948075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:02.948913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:02.949584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:02.951104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:02.951776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:02.952428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:02.968060 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c HTTP/1.1 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '07fc5b50-7887-4a8f-a608-753f5f88a93c'} Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:54:02.970013 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:54:02.973569 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:54:02.975493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:54:02.976571 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c93bf3fe-10f9-40cf-8417-4d4da0527f82 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 404 len: 111 microversion: 2.1 time: 0.041082 Oct 31 14:54:02.977248 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3162/6576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:02 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:54:03.032118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-364287600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-767906490", "security_groups": [{"name": "tempest-secgroup-smoke-1764345971"}], "block_device_mapping_v2": [{"uuid": "06d02f6f-66a5-4324-9bd6-eee803c9a19c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:54:03.170075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:54:03.701208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:54:03.701709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:54:03.702295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:54:03.702808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:54:03.703332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:54:03.712526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:03.713102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:03.713554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:03.714319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:03.714784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:03.715223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:03.733838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:54:03.739378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:54:03.801446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:54:03.804370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06d02f6f-66a5-4324-9bd6-eee803c9a19c',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:54:03.958826 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc70a722-b2e5-434c-a364-d785b7d7a285 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.930999 Oct 31 14:54:03.959399 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3415/6577] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:54:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:54:03.970837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ebc3f1fb-7f6a-4328-8ebe-016613516277 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:03.972124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ebc3f1fb-7f6a-4328-8ebe-016613516277 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:04.035980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ebc3f1fb-7f6a-4328-8ebe-016613516277 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:04.047692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ebc3f1fb-7f6a-4328-8ebe-016613516277 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1093 microversion: 2.1 time: 0.080625 Oct 31 14:54:04.048539 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3163/6578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:03 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:05.074310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:05.074952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:05.081975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:05.082524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:05.083054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:05.083775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:05.084242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:05.084684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:05.156427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:05.168631 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f44ba452-192a-4e43-8ded-50f76df6db5e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1191 microversion: 2.1 time: 0.099588 Oct 31 14:54:05.169739 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3416/6579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:05 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:06.195566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:06.197653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:06.207394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:06.208487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:06.209171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:06.210311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:06.210981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:06.211612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:06.314602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:06.324659 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c39a8b9-563f-4090-a094-e74cf9024848 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1209 microversion: 2.1 time: 0.133788 Oct 31 14:54:06.328463 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3164/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:06 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:07.310534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ebe2cd3d-c3b7-4a4e-9882-8a79cf821f47 req-a2384450-42a3-4832-a2d8-e06b993e9c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f45aa4e-445c-4897-81ad-c79d5e4a1523", "tag": "04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:54:07.332766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ebe2cd3d-c3b7-4a4e-9882-8a79cf821f47 req-a2384450-42a3-4832-a2d8-e06b993e9c41 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:07.334500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ebe2cd3d-c3b7-4a4e-9882-8a79cf821f47 req-a2384450-42a3-4832-a2d8-e06b993e9c41 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:07.335212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ebe2cd3d-c3b7-4a4e-9882-8a79cf821f47 req-a2384450-42a3-4832-a2d8-e06b993e9c41 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:07.349013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:07.349563 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ebe2cd3d-c3b7-4a4e-9882-8a79cf821f47 req-a2384450-42a3-4832-a2d8-e06b993e9c41 service nova] Creating event network-changed:04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6 for instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 on n-h2-863052-1 Oct 31 14:54:07.350981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:07.358433 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ebe2cd3d-c3b7-4a4e-9882-8a79cf821f47 req-a2384450-42a3-4832-a2d8-e06b993e9c41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050572 Oct 31 14:54:07.359712 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3417/6581] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:54:07.366287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:07.366938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:07.367738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:07.368705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:07.369380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:07.370027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:07.587126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:07.597381 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-accd12b9-b531-4ddd-9c6d-d23eb6efc94a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1277 microversion: 2.1 time: 0.252609 Oct 31 14:54:07.598708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3165/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:07 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:54:08.626989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:08.627732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:08.640398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:08.641846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:08.642621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:08.643695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:08.644466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:08.645280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:08.849315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:08.857701 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdcc2ce4-a76a-431c-9e39-79c9ccfcd444 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1277 microversion: 2.1 time: 0.236305 Oct 31 14:54:08.858858 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3418/6583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:08 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:09.884234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:09.885563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:09.894548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:09.895314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:09.895963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:09.896893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:09.897822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:09.898605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:10.078526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:10.087051 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e9afba2-9dd8-4647-9da1-305ccae2444a tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1277 microversion: 2.1 time: 0.206798 Oct 31 14:54:10.102190 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3166/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:09 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:11.112045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:11.113416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:11.121431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:11.122043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:11.122640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:11.123579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:11.124125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:11.124861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:11.341612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:11.354284 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-259ff4ee-67f7-4708-8bcb-2f4f5080a874 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.246558 Oct 31 14:54:11.355134 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3419/6585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:11 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:12.378441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:12.379059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:12.385874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:12.386398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:12.386840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:12.387538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:12.388019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:12.388448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:12.528148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:12.537257 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d864a60-db60-45c2-9c9c-17649bd65d60 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.162621 Oct 31 14:54:12.537851 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3167/6586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:12 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:54:13.561290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:13.562563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:13.570431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:13.571270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:13.571987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:13.572873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:13.573489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:13.574102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:13.722350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:13.746537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:13.796904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:13.807892 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86a41aa1-35a8-477e-b03c-380c734124e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.250948 Oct 31 14:54:13.814117 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3420/6587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:13 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:14.841783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:14.844556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:14.851639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:14.854001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:14.854744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:14.855521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:14.856390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:14.863192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:14.863985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:15.022970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:15.032807 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9dd77b92-37cd-45f3-a4e3-1172703ad640 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.195469 Oct 31 14:54:15.033396 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3168/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:14 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:16.056569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:16.057198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:16.065449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:16.066119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:16.066937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:16.068250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:16.069131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:16.069932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:16.297641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:16.308454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:16.322726 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3d1f04e-133e-4fd4-8576-d2d4324377a0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.269429 Oct 31 14:54:16.324122 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3421/6589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:16 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:17.347580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:17.348197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:17.355508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:17.356003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:17.356512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:17.357229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:17.357691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:17.358117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:17.503411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:17.511551 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c031c1f1-9dc4-4a01-83c8-8396a68a65da tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.167878 Oct 31 14:54:17.512225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3169/6590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:17 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:18.536164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:18.536903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:18.545325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:18.545835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:18.546326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:18.547051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:18.547528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:18.547971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:18.692219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:18.700369 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c74231c-3114-4fb7-967b-1cbd105fbceb tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.168540 Oct 31 14:54:18.700986 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3422/6591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:18 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:19.723259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:19.723850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:19.731207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:19.731694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:19.732131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:19.732851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:19.733286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:19.733709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:19.877593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:19.886397 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4624268-c87f-4da3-820b-cb50464bc3cf tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.166992 Oct 31 14:54:19.886987 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3170/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:19 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:20.911054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:20.911696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:20.918687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:20.919198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:20.919655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:20.920376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:20.920847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:20.921295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:20.970781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-45c5e1d1-10d2-46dd-bd7e-55ebdebc3e41 req-3ada29f5-967f-436f-b0e2-31e8d3e41f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f45aa4e-445c-4897-81ad-c79d5e4a1523", "name": "network-vif-plugged", "status": "completed", "tag": "04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:54:20.982862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45c5e1d1-10d2-46dd-bd7e-55ebdebc3e41 req-3ada29f5-967f-436f-b0e2-31e8d3e41f3d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:20.982862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45c5e1d1-10d2-46dd-bd7e-55ebdebc3e41 req-3ada29f5-967f-436f-b0e2-31e8d3e41f3d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:20.983121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45c5e1d1-10d2-46dd-bd7e-55ebdebc3e41 req-3ada29f5-967f-436f-b0e2-31e8d3e41f3d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:21.004057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-45c5e1d1-10d2-46dd-bd7e-55ebdebc3e41 req-3ada29f5-967f-436f-b0e2-31e8d3e41f3d service nova] Creating event network-vif-plugged:04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6 for instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 on n-h2-863052-1 Oct 31 14:54:21.009575 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-45c5e1d1-10d2-46dd-bd7e-55ebdebc3e41 req-3ada29f5-967f-436f-b0e2-31e8d3e41f3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043375 Oct 31 14:54:21.010452 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3171/6593] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:54:21.083125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:21.094046 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c019e688-9faf-41f7-99c7-0d19ff10d296 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.186765 Oct 31 14:54:21.095031 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3423/6594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:20 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:22.118533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:22.119250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:22.127552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:22.128139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:22.128590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:22.129314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:22.129776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:22.130225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:22.280504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:22.288896 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7bd81a0e-7acc-499c-a8f9-bb6f443e8871 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1265 microversion: 2.1 time: 0.174752 Oct 31 14:54:22.289491 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3172/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:22 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:23.314074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:23.314743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:23.321715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:23.322252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:23.322705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:23.323420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:23.323888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:23.324330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:23.460407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:23.468745 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-453613cb-f988-421b-8e6a-598aff11e5e7 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1451 microversion: 2.1 time: 0.159228 Oct 31 14:54:23.469340 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3424/6596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:23 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:23.491817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:23.492429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:54:23.495218 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:23.500653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:23.501139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:23.501576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:23.502304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:23.502755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:23.503177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:23.506540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=83 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:23.644746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:54:23.652724 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e7ae9dc-e974-4d35-bc36-166054c95298 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1451 microversion: 2.1 time: 0.164745 Oct 31 14:54:23.653296 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3173/6597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:54:23 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:25.454378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2bf53353-4916-4e9c-a1af-ca709ee708f5 req-f9459790-f44d-4cb1-b7fb-38020f524668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f45aa4e-445c-4897-81ad-c79d5e4a1523", "tag": "04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:54:25.461163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:25.465493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2bf53353-4916-4e9c-a1af-ca709ee708f5 req-f9459790-f44d-4cb1-b7fb-38020f524668 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:25.466092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2bf53353-4916-4e9c-a1af-ca709ee708f5 req-f9459790-f44d-4cb1-b7fb-38020f524668 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:25.466778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2bf53353-4916-4e9c-a1af-ca709ee708f5 req-f9459790-f44d-4cb1-b7fb-38020f524668 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:25.478904 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2bf53353-4916-4e9c-a1af-ca709ee708f5 req-f9459790-f44d-4cb1-b7fb-38020f524668 service nova] Creating event network-changed:04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6 for instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 on n-h2-863052-1 Oct 31 14:54:25.485221 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2bf53353-4916-4e9c-a1af-ca709ee708f5 req-f9459790-f44d-4cb1-b7fb-38020f524668 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034605 Oct 31 14:54:25.486182 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3425/6598] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:56:04.344778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:04.345532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:04.350656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1940113352", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-767906490", "security_groups": [{"name": "tempest-secgroup-smoke-1764345971"}], "block_device_mapping_v2": [{"uuid": "0866ecf5-d4cd-4b2e-bfe4-8e9517e21f12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8bf175b-00f6-4cc8-9e5e-fea0baf4e647"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:04.471128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] validate_networks() for [('f8bf175b-00f6-4cc8-9e5e-fea0baf4e647', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:56:04.915592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:56:04.916086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:56:04.916566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:56:04.916980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:56:04.917398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:56:04.927066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:04.927571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:04.928023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:04.928799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:04.929263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:04.929699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:04.948204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:04.953738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Getting quotas for user 4caf5a29a30c49968c1ba461297e3dc8 and project a520c2de1bc742ce8afd2b13bae0bc75. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:05.014651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:56:05.017017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0866ecf5-d4cd-4b2e-bfe4-8e9517e21f12',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:56:05.148278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e8ff9bd7-0696-4468-ac73-75012774e142 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805368 Oct 31 14:56:05.148967 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3174/6599] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:56:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:56:05.161223 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 14:56:05.161825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=20 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:05.162791 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:56:05.163005 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 (ip 10.222.0.27) !!! Oct 31 14:56:05.180602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-560736be-85ac-4b83-ad2b-8391d9e2b232 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:05.181344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-560736be-85ac-4b83-ad2b-8391d9e2b232 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:05.241303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-560736be-85ac-4b83-ad2b-8391d9e2b232 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:05.248501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-560736be-85ac-4b83-ad2b-8391d9e2b232 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1094 microversion: 2.1 time: 0.091610 Oct 31 14:56:05.249099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3426/6600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:05 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:06.272237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:06.272864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:06.280481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:06.280972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:06.281408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:06.282143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:06.282625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:06.283052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:06.360788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:06.369956 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-66b95991-499e-4b49-bf0b-ddd57b5907b3 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1200 microversion: 2.1 time: 0.101614 Oct 31 14:56:06.370828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3175/6601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:06 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:07.395389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:07.396983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:07.406264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:07.407155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:07.407691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:07.408528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:07.409106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:07.409652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:07.427901 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50258. Oct 31 14:56:07.656251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:07.665026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91f1b139-58c4-4b0d-893a-37191ce802aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1278 microversion: 2.1 time: 0.273453 Oct 31 14:56:07.666517 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3427/6602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:07 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:08.257289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9a2c1f5b-ff5b-4d2a-b014-66db94171131 req-c32bac86-0037-433a-92f2-ab4dcfd9dc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f91862d-ac7e-41ea-b919-2bd83c3194d7", "tag": "240523f8-b75b-45c9-a77c-6914056620c0"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:08.270073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9a2c1f5b-ff5b-4d2a-b014-66db94171131 req-c32bac86-0037-433a-92f2-ab4dcfd9dc26 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:08.270847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9a2c1f5b-ff5b-4d2a-b014-66db94171131 req-c32bac86-0037-433a-92f2-ab4dcfd9dc26 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:08.271448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9a2c1f5b-ff5b-4d2a-b014-66db94171131 req-c32bac86-0037-433a-92f2-ab4dcfd9dc26 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:08.294597 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9a2c1f5b-ff5b-4d2a-b014-66db94171131 req-c32bac86-0037-433a-92f2-ab4dcfd9dc26 service nova] Creating event network-changed:240523f8-b75b-45c9-a77c-6914056620c0 for instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 on n-h1-863052-1 Oct 31 14:56:08.305148 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9a2c1f5b-ff5b-4d2a-b014-66db94171131 req-c32bac86-0037-433a-92f2-ab4dcfd9dc26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050598 Oct 31 14:56:08.305148 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3176/6603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:56:08.689736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:08.690598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:08.698141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:08.698765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:08.699791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:08.700558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:08.701015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:08.701466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:08.949718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:08.961328 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-facecc28-23eb-4aa2-b94a-d7db985e1031 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1278 microversion: 2.1 time: 0.275828 Oct 31 14:56:08.963352 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3428/6604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:08 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1278 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:09.988288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:09.989223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:09.995936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:09.996411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:09.996868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:09.997595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:09.998065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:09.998516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:10.149088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:10.159060 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70d87193-8360-4f7c-9355-3bf146cfb5ef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1278 microversion: 2.1 time: 0.176188 Oct 31 14:56:10.159643 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3177/6605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:09 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:11.183040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:11.183823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:11.192369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:11.193066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:11.196492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:11.196492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:11.196492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:11.196492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:11.371663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:11.380542 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be42b9b8-76d5-4de7-895f-5e794842c17d tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1278 microversion: 2.1 time: 0.201948 Oct 31 14:56:11.381298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3429/6606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:11 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:56:12.410198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:12.410846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:12.418350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:12.418845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:12.419285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:12.419995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:12.420450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:12.420946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:12.580997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:12.589693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-962d5dd1-4303-4a2d-916c-80d85b65c01e tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.183622 Oct 31 14:56:12.590400 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3178/6607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:12 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:13.617016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:13.617566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:13.625057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:13.625562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:13.626020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:13.626767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:13.627244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:13.627688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:13.762138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:13.769959 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ebd9eb8-fff5-4527-a18d-13c88bf48723 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.157033 Oct 31 14:56:13.770603 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3430/6608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:13 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:14.793414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:14.793975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:14.801225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:14.802373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:14.802827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:14.803538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:14.804004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:14.804435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:14.936917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:14.960799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:14.969068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:14.977402 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8eff752-4a61-4803-939a-8784c2e5d5aa tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.188020 Oct 31 14:56:14.977990 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3179/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:14 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:16.001346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:16.002991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:16.004855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:16.011937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:16.012502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:16.012969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:16.013715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:16.014226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:16.014685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:16.165732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:16.174032 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff54e0ad-7577-48e1-ba94-538a0cde9902 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.176773 Oct 31 14:56:16.174706 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3431/6610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:15 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:17.197656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:17.198447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:17.205642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:17.206148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:17.206625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:17.207349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:17.207817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:17.208327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:17.359627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:17.369046 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1dc42ae-d247-4550-b097-5c93a4feb3f6 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.175232 Oct 31 14:56:17.369652 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3180/6611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:17 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:18.392808 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:18.393463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:18.400343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:18.400837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:18.401569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:18.402304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:18.402773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:18.403212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:18.533605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:18.542764 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2cb5664-3209-40d0-a52b-967f7d8b5f6b tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.153859 Oct 31 14:56:18.543353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3432/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:18 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:19.565093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:19.565706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:19.573343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:19.573829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:19.574306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:19.575001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:19.575460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:19.575882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:19.708834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:19.715784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58ad27bd-8cbd-4dcf-baf8-cc992af75327 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.154654 Oct 31 14:56:19.716371 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3181/6613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:19 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:20.739975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:20.740540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:20.747621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:20.748137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:20.748591 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:20.749321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:20.749852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:20.750283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:20.907660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:20.916102 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cee82d2-b32e-41cb-804d-8bf50e11f047 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.180461 Oct 31 14:56:20.916706 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3433/6614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:20 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:21.939637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:21.940469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:21.948362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:21.948867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:21.949320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:21.950045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:21.950543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:21.950979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:22.098879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:22.107237 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-764ad992-0a9c-494f-8e39-14402db7ef0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.171612 Oct 31 14:56:22.107841 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3182/6615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:21 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:22.553578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6115d978-589b-481e-82fc-0ab1325fabee req-1b248083-f450-456e-b329-33e9211f926b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f91862d-ac7e-41ea-b919-2bd83c3194d7", "name": "network-vif-plugged", "status": "completed", "tag": "240523f8-b75b-45c9-a77c-6914056620c0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:22.564219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6115d978-589b-481e-82fc-0ab1325fabee req-1b248083-f450-456e-b329-33e9211f926b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:22.564852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6115d978-589b-481e-82fc-0ab1325fabee req-1b248083-f450-456e-b329-33e9211f926b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:22.565400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6115d978-589b-481e-82fc-0ab1325fabee req-1b248083-f450-456e-b329-33e9211f926b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:22.578443 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6115d978-589b-481e-82fc-0ab1325fabee req-1b248083-f450-456e-b329-33e9211f926b service nova] Creating event network-vif-plugged:240523f8-b75b-45c9-a77c-6914056620c0 for instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 on n-h1-863052-1 Oct 31 14:56:22.584716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6115d978-589b-481e-82fc-0ab1325fabee req-1b248083-f450-456e-b329-33e9211f926b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190315 Oct 31 14:56:22.585350 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3434/6616] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:56:23.130908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:23.131538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:23.139039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:23.139527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:23.139978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:23.140713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:23.141184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:23.142281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:23.303195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:23.312240 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9577764a-c51d-4824-8fa2-57dc4ce98df1 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1266 microversion: 2.1 time: 0.185215 Oct 31 14:56:23.312828 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3183/6617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:23 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:24.337524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:24.338340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:24.344779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:24.345293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:24.345752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:24.346700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:24.347082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:24.347844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:24.498958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:24.507235 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb193878-ffd8-455b-83db-7a58707a0a18 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1452 microversion: 2.1 time: 0.174877 Oct 31 14:56:24.507835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3435/6618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:24 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:24.530650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:24.531271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:24.539002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:24.539611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:24.541035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:24.542100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:24.542716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:24.543156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:24.692309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:24.701205 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-08154243-3af4-422f-80c0-5450ed50c319 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1452 microversion: 2.1 time: 0.174437 Oct 31 14:56:24.701807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3184/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:24 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:26.885969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4a71cdda-a31b-4598-9d18-7da215ee3e02 req-af6fd81d-7fb1-49fe-a842-0a5a0d0bb83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f91862d-ac7e-41ea-b919-2bd83c3194d7", "tag": "240523f8-b75b-45c9-a77c-6914056620c0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:26.895982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4a71cdda-a31b-4598-9d18-7da215ee3e02 req-af6fd81d-7fb1-49fe-a842-0a5a0d0bb83c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:26.896478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4a71cdda-a31b-4598-9d18-7da215ee3e02 req-af6fd81d-7fb1-49fe-a842-0a5a0d0bb83c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:26.896931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4a71cdda-a31b-4598-9d18-7da215ee3e02 req-af6fd81d-7fb1-49fe-a842-0a5a0d0bb83c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:26.911658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4a71cdda-a31b-4598-9d18-7da215ee3e02 req-af6fd81d-7fb1-49fe-a842-0a5a0d0bb83c service nova] Creating event network-changed:240523f8-b75b-45c9-a77c-6914056620c0 for instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 on n-h1-863052-1 Oct 31 14:56:26.917020 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4a71cdda-a31b-4598-9d18-7da215ee3e02 req-af6fd81d-7fb1-49fe-a842-0a5a0d0bb83c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102787 Oct 31 14:56:26.917653 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3436/6620] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:55.899175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=25 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:55.899940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=52 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:55.903855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:55.904920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:55.905695 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:57:55.906089 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 14:57:55.907647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:55.909207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=58 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:55.910863 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:57:55.911009 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 14:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 (ip 10.222.0.27) !!! Oct 31 14:57:55.913886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0982add3-c522-4aa3-8f74-a6fe05f1c90d req-fe2ad922-40e0-4e11-8eca-f2e8599c4186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f91862d-ac7e-41ea-b919-2bd83c3194d7", "tag": "240523f8-b75b-45c9-a77c-6914056620c0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:55.923127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:55.923629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:55.924078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:55.925301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:55.925645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0982add3-c522-4aa3-8f74-a6fe05f1c90d req-fe2ad922-40e0-4e11-8eca-f2e8599c4186 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:55.925757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:55.926214 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:55.926358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0982add3-c522-4aa3-8f74-a6fe05f1c90d req-fe2ad922-40e0-4e11-8eca-f2e8599c4186 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:55.927134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0982add3-c522-4aa3-8f74-a6fe05f1c90d req-fe2ad922-40e0-4e11-8eca-f2e8599c4186 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:55.939421 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0982add3-c522-4aa3-8f74-a6fe05f1c90d req-fe2ad922-40e0-4e11-8eca-f2e8599c4186 service nova] Creating event network-changed:240523f8-b75b-45c9-a77c-6914056620c0 for instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 on n-h1-863052-1 Oct 31 14:57:55.944620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0982add3-c522-4aa3-8f74-a6fe05f1c90d req-fe2ad922-40e0-4e11-8eca-f2e8599c4186 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048357 Oct 31 14:57:55.945625 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3437/6621] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:55.958467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:57:56.045819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ae6978b-093c-470d-b3aa-f2a4830e3c0f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 204 len: 0 microversion: 2.1 time: 0.152241 Oct 31 14:57:56.046903 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3185/6622] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:57:55 2022] DELETE /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:57:56.059936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:56.061005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:56.069920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:56.070570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:56.071221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:56.072179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:56.072728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:56.073344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:56.224163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:56.232737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f268241-b044-4f67-a4ff-03d90937702f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1577 microversion: 2.1 time: 0.180634 Oct 31 14:57:56.233321 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3438/6623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:56 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:57.257974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:57.258823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:57.266489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:57.266974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:57.267406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:57.268105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:57.268681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:57.269111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:57.407932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:57.415819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2428dc1-66dd-4af3-9a9c-52a9d300bb57 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1577 microversion: 2.1 time: 0.162617 Oct 31 14:57:57.416372 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3186/6624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:57 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:58.009150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-dd743fa3-45bb-420d-af0d-b46a82cebd01 req-72c5e0e0-85d7-4588-9834-f17a9bdb576c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f91862d-ac7e-41ea-b919-2bd83c3194d7", "name": "network-vif-deleted", "tag": "240523f8-b75b-45c9-a77c-6914056620c0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:58.023107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dd743fa3-45bb-420d-af0d-b46a82cebd01 req-72c5e0e0-85d7-4588-9834-f17a9bdb576c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:58.023646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dd743fa3-45bb-420d-af0d-b46a82cebd01 req-72c5e0e0-85d7-4588-9834-f17a9bdb576c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:58.024028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-dd743fa3-45bb-420d-af0d-b46a82cebd01 req-72c5e0e0-85d7-4588-9834-f17a9bdb576c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:58.038014 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-dd743fa3-45bb-420d-af0d-b46a82cebd01 req-72c5e0e0-85d7-4588-9834-f17a9bdb576c service nova] Creating event network-vif-deleted:240523f8-b75b-45c9-a77c-6914056620c0 for instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 on n-h1-863052-1 Oct 31 14:57:58.043260 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-dd743fa3-45bb-420d-af0d-b46a82cebd01 req-72c5e0e0-85d7-4588-9834-f17a9bdb576c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038680 Oct 31 14:57:58.043874 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3439/6625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:58.439400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:58.441428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:58.449015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:58.449507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:58.449949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:58.450679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:58.451143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:58.451570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:58.516541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:58.524404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c39f2e19-87b7-4aaa-aeb6-419c7f4e4f35 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1225 microversion: 2.1 time: 0.088963 Oct 31 14:57:58.524974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3187/6626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:58 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:59.548641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:59.549420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:59.557472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:59.557913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:59.558397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:59.559098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:59.559564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:59.560004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:59.628784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:59.637179 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a72070f-02e2-4133-8da5-82147ef31380 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1225 microversion: 2.1 time: 0.093311 Oct 31 14:57:59.637784 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3440/6627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:59 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:00.661262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:00.661812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:00.669313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:00.669803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:00.670266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:00.670972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:00.671430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:00.671851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:00.739792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:00.747922 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d32edcbd-b05a-4408-8f95-fb05f426ba71 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1225 microversion: 2.1 time: 0.090613 Oct 31 14:58:00.748515 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3188/6628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:00 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:01.771532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:01.772659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:01.779664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:01.780175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:01.780633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:01.781382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:01.781856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:01.782331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:01.845475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:01.853395 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ae49ac3-6c18-4427-9112-13cda47c9813 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 200 len: 1225 microversion: 2.1 time: 0.085954 Oct 31 14:58:01.853974 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3441/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:01 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:02.876136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:02.876753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 9f91862d-ac7e-41ea-b919-2bd83c3194d7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:02.884166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:02.884651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:02.885090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:02.885781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:02.886265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:02.886694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:02.900466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 could not be found. Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 HTTP/1.1 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 could not be found. Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '9f91862d-ac7e-41ea-b919-2bd83c3194d7'} Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 could not be found. Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 could not be found. Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:02.902100 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 could not be found. Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 9f91862d-ac7e-41ea-b919-2bd83c3194d7 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3f58a8d1-cdb3-42b3-8d98-a6e750808d6f tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7" status: 404 len: 111 microversion: 2.1 time: 0.031287 Oct 31 14:58:02.906225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3189/6630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:02 2022] GET /compute/v2.1/servers/9f91862d-ac7e-41ea-b919-2bd83c3194d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:09.122777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:09.123307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:09.124828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5369440d-db0f-4d2a-96fa-2c5b2f3cdd16 req-67956514-32dd-44b0-b7c5-28c71fc66115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f45aa4e-445c-4897-81ad-c79d5e4a1523", "tag": "04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:09.130260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.131309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.131767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.132485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.132956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.133632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.136848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5369440d-db0f-4d2a-96fa-2c5b2f3cdd16 req-67956514-32dd-44b0-b7c5-28c71fc66115 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.137524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5369440d-db0f-4d2a-96fa-2c5b2f3cdd16 req-67956514-32dd-44b0-b7c5-28c71fc66115 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.138282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5369440d-db0f-4d2a-96fa-2c5b2f3cdd16 req-67956514-32dd-44b0-b7c5-28c71fc66115 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.151180 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5369440d-db0f-4d2a-96fa-2c5b2f3cdd16 req-67956514-32dd-44b0-b7c5-28c71fc66115 service nova] Creating event network-changed:04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6 for instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 on n-h2-863052-1 Oct 31 14:58:09.156735 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5369440d-db0f-4d2a-96fa-2c5b2f3cdd16 req-67956514-32dd-44b0-b7c5-28c71fc66115 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035681 Oct 31 14:58:09.157334 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3190/6631] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:09.160861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:58:09.244514 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4bf95b92-36cc-4ff7-a2b4-fafffdf61ea8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 204 len: 0 microversion: 2.1 time: 0.125587 Oct 31 14:58:09.245501 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3442/6632] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:58:09 2022] DELETE /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:58:09.254385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:09.255192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:09.261551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.262125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.262718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.263536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.264242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.264750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.404483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:09.412461 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-394465f6-9513-41e3-90e9-a9c03b1767e9 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1575 microversion: 2.1 time: 0.162417 Oct 31 14:58:09.413041 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3191/6633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:09 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:10.437798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:10.438635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:10.446010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:10.446556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:10.447013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:10.447756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:10.448257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:10.448781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:10.608328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:10.620696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc30d886-55b8-467f-a106-8550a6f44306 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1575 microversion: 2.1 time: 0.187130 Oct 31 14:58:10.621298 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3443/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:10 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:11.277758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a5bf666c-b337-4770-ae6a-3d20bf8a3ac3 req-93c00c04-0a82-41a4-a6db-63fd5a177547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f45aa4e-445c-4897-81ad-c79d5e4a1523", "name": "network-vif-deleted", "tag": "04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:11.289514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a5bf666c-b337-4770-ae6a-3d20bf8a3ac3 req-93c00c04-0a82-41a4-a6db-63fd5a177547 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.289994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a5bf666c-b337-4770-ae6a-3d20bf8a3ac3 req-93c00c04-0a82-41a4-a6db-63fd5a177547 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.290447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a5bf666c-b337-4770-ae6a-3d20bf8a3ac3 req-93c00c04-0a82-41a4-a6db-63fd5a177547 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.302526 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a5bf666c-b337-4770-ae6a-3d20bf8a3ac3 req-93c00c04-0a82-41a4-a6db-63fd5a177547 service nova] Creating event network-vif-deleted:04ddc8ea-5f00-47e9-b0f4-d55fc9a939e6 for instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 on n-h2-863052-1 Oct 31 14:58:11.308937 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a5bf666c-b337-4770-ae6a-3d20bf8a3ac3 req-93c00c04-0a82-41a4-a6db-63fd5a177547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034966 Oct 31 14:58:11.309564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3192/6635] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:11.645893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:11.647379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:11.655385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.655906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.656393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.657216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.657694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.658144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.727000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:11.735394 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-547e821c-3f6d-4a25-b06d-da7b390c139c tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1224 microversion: 2.1 time: 0.094114 Oct 31 14:58:11.735986 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3444/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:11 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:12.761028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:12.761663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:12.768088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:12.768562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:12.769004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:12.769707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:12.770180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:12.770615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:12.834468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:12.842553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e164cf1-98ab-4db1-bd41-0c194b54bed0 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1224 microversion: 2.1 time: 0.086721 Oct 31 14:58:12.843133 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3193/6637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:12 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:13.867223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:13.867869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:13.875112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:13.875697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:13.876164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:13.876894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:13.877371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:13.877822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:13.944191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:13.952132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82eae521-138d-4538-abd3-e8b7908c6697 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1224 microversion: 2.1 time: 0.089421 Oct 31 14:58:13.966188 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3445/6638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:13 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:14.974764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:14.975307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:14.982400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:14.982895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:14.983331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:14.984035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:14.984489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:14.984904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:15.051381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4caf5a29a30c49968c1ba461297e3dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a520c2de1bc742ce8afd2b13bae0bc75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:15.059451 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-68e0e4e5-0c48-4850-8b75-2773353e9361 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 200 len: 1224 microversion: 2.1 time: 0.088671 Oct 31 14:58:15.060047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3194/6639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:14 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:16.083205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:16.083860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 5f45aa4e-445c-4897-81ad-c79d5e4a1523] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:16.091382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.091886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.092335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.093052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.093513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.093959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.108025 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 could not be found. Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 HTTP/1.1 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 could not be found. Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '5f45aa4e-445c-4897-81ad-c79d5e4a1523'} Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 could not be found. Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 could not be found. Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:16.109717 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 could not be found. Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 5f45aa4e-445c-4897-81ad-c79d5e4a1523 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:16.113732 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37acafca-0ba3-459d-b3d7-dec7a3a42988 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523" status: 404 len: 111 microversion: 2.1 time: 0.032058 Oct 31 14:58:16.115772 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3446/6640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:16 2022] GET /compute/v2.1/servers/5f45aa4e-445c-4897-81ad-c79d5e4a1523 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:58:16.585927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:16.586478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:16.593577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.594067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.594572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.595361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.595824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.596284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.610363 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c HTTP/1.1 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '07fc5b50-7887-4a8f-a608-753f5f88a93c'} Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:16.612308 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4546547c-2341-401c-af94-faee444705d8 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 404 len: 111 microversion: 2.1 time: 0.031759 Oct 31 14:58:16.617109 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3195/6641] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:58:16 2022] DELETE /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:16.623277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:16.623913 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] [instance: 07fc5b50-7887-4a8f-a608-753f5f88a93c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:16.630073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.630649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.631114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.631820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.632292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.632729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.647620 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] HTTP exception thrown: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Request method failure captured: Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c HTTP/1.1 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-AF228-pJXFPpWHppA58cSUexK9fPved8KQoFbLlqTfMhP_qtZYUE8UGRoFb7RHKBWrLN8wUhlcEsBxzq0-hAuReI2RMmT9fWrDWcCwgCwp89lVp4F_xBw0QdR--Ee9ArGn59_QXHnKypTaRoMXS9nASdLfEO6nJwGfUApXdkQ95Xc Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a520c2de1bc742ce8afd2b13bae0bc75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a520c2de1bc742ce8afd2b13bae0bc75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: a520c2de1bc742ce8afd2b13bae0bc75 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-425651284 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4caf5a29a30c49968c1ba461297e3dc8 Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-425651284-project Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '07fc5b50-7887-4a8f-a608-753f5f88a93c'} Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:16.649214 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Returning 404 to user: Instance 07fc5b50-7887-4a8f-a608-753f5f88a93c could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c91fdbd2-f041-48ef-9f43-5ba12fc9ceef tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c" status: 404 len: 111 microversion: 2.1 time: 0.031453 Oct 31 14:58:16.653387 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3447/6642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:16 2022] GET /compute/v2.1/servers/07fc5b50-7887-4a8f-a608-753f5f88a93c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:20.098619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71338c88-d53e-4e5e-b9c8-7c2f2741de37 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] Calling method '.version_select at 0x7fe1074b0b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:20.131108 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71338c88-d53e-4e5e-b9c8-7c2f2741de37 tempest-TestVolumeBootPattern-425651284 tempest-TestVolumeBootPattern-425651284-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-767906490" status: 202 len: 0 microversion: 2.1 time: 0.035220 Oct 31 14:58:20.132408 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3196/6643] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 31 14:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-767906490 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:58:38.876186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:38.876955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:39.002984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-457725894", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:39.060223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:58:39.259108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:58:39.259552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:58:39.260047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:58:39.260470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:58:39.260901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:58:39.271124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:39.271124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:39.271668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:39.272414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:39.272904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:39.273377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:39.292340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Getting quotas for project 42a22aefe55a45fd936ddf5d72135f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:39.297871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Getting quotas for user 28f11197ce194857ba71c6c162b5ef5d and project 42a22aefe55a45fd936ddf5d72135f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:39.310945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:58:39.313485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:58:39.363845 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75ba8178-00a2-45bf-b3f3-f62147b42a5d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492640 Oct 31 14:58:39.364668 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3448/6644] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:58:39.376714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:39.378223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:39.384000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ffdad86-5164-4efe-95f3-20a42609baf3 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:39.384000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3ffdad86-5164-4efe-95f3-20a42609baf3 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:39.443731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3ffdad86-5164-4efe-95f3-20a42609baf3 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:39.452117 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ffdad86-5164-4efe-95f3-20a42609baf3 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1221 microversion: 2.1 time: 0.076500 Oct 31 14:58:39.452117 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3197/6645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:39 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:40.477251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:40.478560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:40.487829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.488641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.489442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.490373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.491153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.491755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.575556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:40.583986 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d5ac066-89e1-44ef-9149-61ec207e742d tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1291 microversion: 2.1 time: 0.112452 Oct 31 14:58:40.584573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3449/6646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:40 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1291 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:41.608986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:41.609648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:41.620357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.620922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.621445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.622233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.622753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.623245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.767228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:41.775621 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd435d3c-407b-4c3b-814e-57bea1ff0d2c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.170948 Oct 31 14:58:41.776225 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3198/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:41 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:41.919476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e6c1b400-e99e-4dc9-afd4-2457ac621f3d req-63118d89-7bfa-4d95-a1a9-1c070e2bce1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973649e0-d163-4ea6-919a-477b8f53b4b2", "tag": "2a445df7-ea06-4c2b-8c8f-ccbdf31443d0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:41.945192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e6c1b400-e99e-4dc9-afd4-2457ac621f3d req-63118d89-7bfa-4d95-a1a9-1c070e2bce1a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.945800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e6c1b400-e99e-4dc9-afd4-2457ac621f3d req-63118d89-7bfa-4d95-a1a9-1c070e2bce1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.946345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e6c1b400-e99e-4dc9-afd4-2457ac621f3d req-63118d89-7bfa-4d95-a1a9-1c070e2bce1a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.958904 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e6c1b400-e99e-4dc9-afd4-2457ac621f3d req-63118d89-7bfa-4d95-a1a9-1c070e2bce1a service nova] Creating event network-changed:2a445df7-ea06-4c2b-8c8f-ccbdf31443d0 for instance 973649e0-d163-4ea6-919a-477b8f53b4b2 on n-h2-863052-1 Oct 31 14:58:41.964151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e6c1b400-e99e-4dc9-afd4-2457ac621f3d req-63118d89-7bfa-4d95-a1a9-1c070e2bce1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053005 Oct 31 14:58:41.964808 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3450/6648] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:42.799467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:42.800092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:42.807184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.807678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.808110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.808810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.809258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.809679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.947061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:42.955568 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-229b476c-379f-4a58-84e1-8d7d9e6eccd2 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.160240 Oct 31 14:58:42.956146 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3199/6649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:42 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:43.981604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:43.982352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:43.990943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.991465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.991925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.992653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.993131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.993579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.134000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.141874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-470a5457-2c91-45e1-b0d4-0041b9c08741 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.165743 Oct 31 14:58:44.142489 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3451/6650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:43 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:45.165103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:45.165696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:45.173273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.173761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.174231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.174933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.175384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.175807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.311709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:45.323730 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e5ffe9f-c495-4d48-953c-273267992840 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.162176 Oct 31 14:58:45.324746 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3200/6651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:45 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:46.362416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:46.363186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:46.372407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.372932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.373393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.374670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.375145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.375662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.508720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:46.516425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eeafccf2-3722-4729-8d92-34ec18cb4727 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.158303 Oct 31 14:58:46.517000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3452/6652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:46 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:47.539371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:47.539986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:47.547124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.547611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.548053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.548754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.549210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.549640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.693559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.701517 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4107f0ca-c5ff-4421-9c1b-b65b91a28285 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.166110 Oct 31 14:58:47.702088 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3201/6653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:47 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:48.346251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f5ff05ff-d379-4d93-a983-4ff0bc4c581c req-afe00f98-de3b-4a00-bbcf-8cb43ec965a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973649e0-d163-4ea6-919a-477b8f53b4b2", "name": "network-vif-plugged", "status": "completed", "tag": "2a445df7-ea06-4c2b-8c8f-ccbdf31443d0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:48.357192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5ff05ff-d379-4d93-a983-4ff0bc4c581c req-afe00f98-de3b-4a00-bbcf-8cb43ec965a5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.357691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5ff05ff-d379-4d93-a983-4ff0bc4c581c req-afe00f98-de3b-4a00-bbcf-8cb43ec965a5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.358137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f5ff05ff-d379-4d93-a983-4ff0bc4c581c req-afe00f98-de3b-4a00-bbcf-8cb43ec965a5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.370280 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f5ff05ff-d379-4d93-a983-4ff0bc4c581c req-afe00f98-de3b-4a00-bbcf-8cb43ec965a5 service nova] Creating event network-vif-plugged:2a445df7-ea06-4c2b-8c8f-ccbdf31443d0 for instance 973649e0-d163-4ea6-919a-477b8f53b4b2 on n-h2-863052-1 Oct 31 14:58:48.375370 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f5ff05ff-d379-4d93-a983-4ff0bc4c581c req-afe00f98-de3b-4a00-bbcf-8cb43ec965a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032885 Oct 31 14:58:48.375966 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3453/6654] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:48.725962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:48.726551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:48.733758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.734286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.734732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.735505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.735964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.736679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.874331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:48.882322 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0baa192b-779e-4a7b-88c5-abeaf5a5825c tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1321 microversion: 2.1 time: 0.161249 Oct 31 14:58:48.882903 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3202/6655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:48 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:49.902876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:49.903683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:49.908667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:49.909394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.917221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.917730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.918202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.918919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.919383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.919820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.054682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.063487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9cdda6a1-cca4-4bdb-b8e3-dcecb60518b4 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1470 microversion: 2.1 time: 0.161550 Oct 31 14:58:50.064151 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3454/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:49 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:50.092256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:50.150074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-816a1752-dbfa-4694-8762-a40d98d81426 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Calling method '.version_select at 0x7fe10d0d0ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.220725 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-816a1752-dbfa-4694-8762-a40d98d81426 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/32d931d9425143bdb769de601edf4e0b" status: 200 len: 371 microversion: 2.1 time: 0.132732 Oct 31 14:58:50.221773 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3203/6657] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/os-quota-sets/32d931d9425143bdb769de601edf4e0b => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:50.234640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ab92796-1498-4ec7-bf6a-6064b1a287a6 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-687660315", "id": 226250134, "os-flavor-access:is_public": "True"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:50.253712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ab92796-1498-4ec7-bf6a-6064b1a287a6 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.023074 Oct 31 14:58:50.254328 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3455/6658] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:50 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:50.266623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "226250134"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:50.268934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:50.275549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.276027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.276462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.277153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.277673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.278100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.366899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '682a482a1d704137bcd04a2a79dfaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d931d9425143bdb769de601edf4e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.373556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-687660315 {{(pid=120641) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:58:50.381159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.381638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.382083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.382829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.383286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.383733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.407246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Getting quotas for project 42a22aefe55a45fd936ddf5d72135f2a. Resources: {'cores', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:50.413340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Getting quotas for user 28f11197ce194857ba71c6c162b5ef5d and project 42a22aefe55a45fd936ddf5d72135f2a. Resources: {'cores', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:50.426193 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.compute.api [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] ram quota exceeded for 32d931d9425143bdb769de601edf4e0b, tried to resize instance. Oct 31 14:58:50.426746 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Request method failure captured: Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2/action HTTP/1.1 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 38 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-KeeFLc6O3lJsJBhCJHo5_iYiXCAUHH8PiAe5cJjvKm3dtW_KT0zdv4jcJvuU3DJ4OBI9mXvQgBFAhtaa_RtbGy1HLHID8i_zdTttNoxBBMl89zsOfx4Emv0OMAeSZLIbLfbyvmZ5kSah1G6vvgSYTSnEvYuFr9CzFeqJ_UXHa3kV8 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 32d931d9425143bdb769de601edf4e0b Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2145037178 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader,admin Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader,admin Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_32d931d9425143bdb769de601edf4e0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/32d931d9425143bdb769de601edf4e0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/32d931d9425143bdb769de601edf4e0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/32d931d9425143bdb769de601edf4e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2145037178 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 32d931d9425143bdb769de601edf4e0b Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2145037178 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersAdminNegativeTestJSON-2145037178-project-admin Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 682a482a1d704137bcd04a2a79dfaed0 Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2145037178-project-admin Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: {"resize": {"flavorRef": "226250134"}} Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '973649e0-d163-4ea6-919a-477b8f53b4b2', 'body': {'resize': {'flavorRef': '226250134'}}} Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:50.428710 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6375e2c-cd66-443b-8aa4-9a50e4f29666 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2/action" status: 403 len: 118 microversion: 2.1 time: 0.167394 Oct 31 14:58:50.433401 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3204/6659] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:58:50 2022] POST /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2/action => generated 118 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:58:50.439694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b95a626-a09f-49fe-a056-9c90bc875762 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.459073 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b95a626-a09f-49fe-a056-9c90bc875762 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/226250134" status: 202 len: 0 microversion: 2.1 time: 0.023652 Oct 31 14:58:50.459667 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3456/6660] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 31 14:58:50 2022] DELETE /compute/v2.1/flavors/226250134 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:58:50.467766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df3aa15b-edff-41fa-a136-8708c5c10d97 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.488638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df3aa15b-edff-41fa-a136-8708c5c10d97 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024499 Oct 31 14:58:50.489226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3205/6661] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:50.510240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fef51041-bbc0-4851-b3ab-d533e465b46b tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Calling method '.version_select at 0x7fe106182d30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.579908 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fef51041-bbc0-4851-b3ab-d533e465b46b tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/32d931d9425143bdb769de601edf4e0b" status: 200 len: 371 microversion: 2.1 time: 0.073410 Oct 31 14:58:50.580486 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3457/6662] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/os-quota-sets/32d931d9425143bdb769de601edf4e0b => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:50.593150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-759fd71e-aecf-4b6a-9ca6-a9f4d0379eb5 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2126672186", "id": 1174771453, "os-flavor-access:is_public": "True"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:50.611420 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-759fd71e-aecf-4b6a-9ca6-a9f4d0379eb5 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021640 Oct 31 14:58:50.612025 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3206/6663] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:50.624215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1174771453"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:50.626609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:50.633285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.633786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.634268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.634987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.635463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.635909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.720546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '682a482a1d704137bcd04a2a79dfaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d931d9425143bdb769de601edf4e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.726532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2126672186 {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:58:50.733220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.733730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.734439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.735306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.735925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.736621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.757193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Getting quotas for project 42a22aefe55a45fd936ddf5d72135f2a. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:50.762287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Getting quotas for user 28f11197ce194857ba71c6c162b5ef5d and project 42a22aefe55a45fd936ddf5d72135f2a. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:50.774896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.compute.api [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] cores quota exceeded for 32d931d9425143bdb769de601edf4e0b, tried to resize instance. Oct 31 14:58:50.775445 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Request method failure captured: Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2/action HTTP/1.1 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 39 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-KeeFLc6O3lJsJBhCJHo5_iYiXCAUHH8PiAe5cJjvKm3dtW_KT0zdv4jcJvuU3DJ4OBI9mXvQgBFAhtaa_RtbGy1HLHID8i_zdTttNoxBBMl89zsOfx4Emv0OMAeSZLIbLfbyvmZ5kSah1G6vvgSYTSnEvYuFr9CzFeqJ_UXHa3kV8 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 32d931d9425143bdb769de601edf4e0b Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2145037178 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader,admin Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader,admin Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_32d931d9425143bdb769de601edf4e0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/32d931d9425143bdb769de601edf4e0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/32d931d9425143bdb769de601edf4e0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/32d931d9425143bdb769de601edf4e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2145037178 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 32d931d9425143bdb769de601edf4e0b Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2145037178 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersAdminNegativeTestJSON-2145037178-project-admin Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 682a482a1d704137bcd04a2a79dfaed0 Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2145037178-project-admin Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: {"resize": {"flavorRef": "1174771453"}} Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '973649e0-d163-4ea6-919a-477b8f53b4b2', 'body': {'resize': {'flavorRef': '1174771453'}}} Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:50.777536 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ba3eff3-21ea-4550-b069-0bc9c9e08911 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2/action" status: 403 len: 113 microversion: 2.1 time: 0.158698 Oct 31 14:58:50.781775 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3458/6664] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:58:50 2022] POST /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2/action => generated 113 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:58:50.788378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbb061e2-bdd9-48ef-a8c3-d9055c06e09c tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.805315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbb061e2-bdd9-48ef-a8c3-d9055c06e09c tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1174771453" status: 202 len: 0 microversion: 2.1 time: 0.021231 Oct 31 14:58:50.805879 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3207/6665] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 31 14:58:50 2022] DELETE /compute/v2.1/flavors/1174771453 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:58:50.814003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69280c56-2ac4-4d02-b4f2-a159ae57b3c8 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.838177 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69280c56-2ac4-4d02-b4f2-a159ae57b3c8 tempest-ServersAdminNegativeTestJSON-2145037178 tempest-ServersAdminNegativeTestJSON-2145037178-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027934 Oct 31 14:58:50.838781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3459/6666] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:50.860289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.860793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:50.867054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.867541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.867984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.868681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.869136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.869561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.894521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:58:50.968910 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09990fc1-f573-41bf-b9b0-8f1cc661a584 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 204 len: 0 microversion: 2.1 time: 0.112121 Oct 31 14:58:50.969673 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3208/6667] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:58:50 2022] DELETE /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:58:50.978560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.979239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:50.986566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.987068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.987525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.988232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.988732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.989193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.126548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:51.134388 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f59e84b-bd4f-41b4-bd2a-0f9e97726e58 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1476 microversion: 2.1 time: 0.159834 Oct 31 14:58:51.134967 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3460/6668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:52.158523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:52.159219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:52.165976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.166490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.166933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.167617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.168066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.168486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.300446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f11197ce194857ba71c6c162b5ef5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a22aefe55a45fd936ddf5d72135f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:52.309384 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06653ecc-e1d3-4b1f-8d06-934adba812f1 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 200 len: 1476 microversion: 2.1 time: 0.155195 Oct 31 14:58:52.310062 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3209/6669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:52 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:52.676717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c1a7bead-5867-4e42-bbb4-b62ff060bb4e req-6dbf8693-6b21-490b-bad3-6f13087fb557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973649e0-d163-4ea6-919a-477b8f53b4b2", "name": "network-vif-deleted", "tag": "2a445df7-ea06-4c2b-8c8f-ccbdf31443d0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:52.689377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c1a7bead-5867-4e42-bbb4-b62ff060bb4e req-6dbf8693-6b21-490b-bad3-6f13087fb557 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.689864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c1a7bead-5867-4e42-bbb4-b62ff060bb4e req-6dbf8693-6b21-490b-bad3-6f13087fb557 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.690747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c1a7bead-5867-4e42-bbb4-b62ff060bb4e req-6dbf8693-6b21-490b-bad3-6f13087fb557 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.703749 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c1a7bead-5867-4e42-bbb4-b62ff060bb4e req-6dbf8693-6b21-490b-bad3-6f13087fb557 service nova] Creating event network-vif-deleted:2a445df7-ea06-4c2b-8c8f-ccbdf31443d0 for instance 973649e0-d163-4ea6-919a-477b8f53b4b2 on n-h2-863052-1 Oct 31 14:58:52.709454 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c1a7bead-5867-4e42-bbb4-b62ff060bb4e req-6dbf8693-6b21-490b-bad3-6f13087fb557 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036859 Oct 31 14:58:52.710073 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3461/6670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:53.333287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:53.333899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] [instance: 973649e0-d163-4ea6-919a-477b8f53b4b2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:53.340916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:53.341404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:53.341848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.342573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:53.343031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:53.343462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.357610 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] HTTP exception thrown: Instance 973649e0-d163-4ea6-919a-477b8f53b4b2 could not be found. Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Request method failure captured: Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 HTTP/1.1 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-KeG4F1WqTZE7A1KMA-IEr1hc_JO3sfya3fAdh3ASGQeMaMWyipecAIpmzrrOL7g9XcdTP61kq6E0uXy79UM_8FPArejFslHq_hwNRdv-h01e0DadixmPdV9zO7jatCm7DY5aKj8I-6HbEsarbYVvUByOO7TjaS1CWJCGvIFx5gN_4 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 42a22aefe55a45fd936ddf5d72135f2a Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-594969805 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42a22aefe55a45fd936ddf5d72135f2a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42a22aefe55a45fd936ddf5d72135f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42a22aefe55a45fd936ddf5d72135f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42a22aefe55a45fd936ddf5d72135f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersAdminNegativeTestJSON-594969805 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 42a22aefe55a45fd936ddf5d72135f2a Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-594969805 Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersAdminNegativeTestJSON-594969805-project Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 28f11197ce194857ba71c6c162b5ef5d Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersAdminNegativeTestJSON-594969805-project Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 973649e0-d163-4ea6-919a-477b8f53b4b2 could not be found. Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '973649e0-d163-4ea6-919a-477b8f53b4b2'} Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973649e0-d163-4ea6-919a-477b8f53b4b2 could not be found. Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973649e0-d163-4ea6-919a-477b8f53b4b2 could not be found. Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:53.359263 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973649e0-d163-4ea6-919a-477b8f53b4b2 could not be found. Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] Returning 404 to user: Instance 973649e0-d163-4ea6-919a-477b8f53b4b2 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3da9282e-2a6b-464a-96d2-df3a987d8e33 tempest-ServersAdminNegativeTestJSON-594969805 tempest-ServersAdminNegativeTestJSON-594969805-project] 10.222.0.27 "GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2" status: 404 len: 111 microversion: 2.1 time: 0.031744 Oct 31 14:58:53.363899 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3210/6671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:53 2022] GET /compute/v2.1/servers/973649e0-d163-4ea6-919a-477b8f53b4b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:59.606018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1960431726", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "1ce734df-45c9-46f3-8144-b0b8ce49017a"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:59.885608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] validate_networks() for [('1ce734df-45c9-46f3-8144-b0b8ce49017a', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:59:00.572193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:00.685245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:59:00.685824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:59:00.686154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:59:00.686594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:59:00.687038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:59:00.698494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.699116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.699610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.700397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.700904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.701348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.728699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Getting quotas for project 35f313edd5234725a58dfafb54d91036. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:59:00.735247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Getting quotas for user bd4438d9956e43a28a286c1b9b985305 and project 35f313edd5234725a58dfafb54d91036. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:59:00.751574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:59:00.754336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:59:00.806317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc9d4aff-4b83-43c9-98b2-4e8db50dfdca tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341835 Oct 31 14:59:00.807337 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3462/6672] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:59:00.820227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ffedf22-62d1-4224-b56a-8411997c4a6e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:00.820977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ffedf22-62d1-4224-b56a-8411997c4a6e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:00.823436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:00.824279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:00.952580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ffedf22-62d1-4224-b56a-8411997c4a6e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:00.962020 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ffedf22-62d1-4224-b56a-8411997c4a6e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1215 microversion: 2.1 time: 0.146867 Oct 31 14:59:00.962838 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3211/6673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:00 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:01.993426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:01.994903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:02.006917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.007975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.009670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.011389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.013256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.013783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.118107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:02.127923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc56a7d2-fe1f-4d12-825f-55dfb326efdf tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1285 microversion: 2.1 time: 0.139502 Oct 31 14:59:02.128638 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3463/6674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:01 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:03.152908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:03.153521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:03.161158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.161888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.162524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.163248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.163702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.164127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.326920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:03.336041 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e58ee8b-a721-49b1-afc4-213dce08c310 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1315 microversion: 2.1 time: 0.187052 Oct 31 14:59:03.343351 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3212/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:03 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:03.646519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-80e58d86-5326-4b77-9493-6e90737f9e97 req-35b6ad68-685b-4d1c-9093-fb5206472117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49db0dd-2539-4ca1-84c3-93379f9006d3", "tag": "23da33da-2f59-4ee8-bd09-64eff52d2e85"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:03.664767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80e58d86-5326-4b77-9493-6e90737f9e97 req-35b6ad68-685b-4d1c-9093-fb5206472117 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.665592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80e58d86-5326-4b77-9493-6e90737f9e97 req-35b6ad68-685b-4d1c-9093-fb5206472117 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.666886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80e58d86-5326-4b77-9493-6e90737f9e97 req-35b6ad68-685b-4d1c-9093-fb5206472117 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.681862 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-80e58d86-5326-4b77-9493-6e90737f9e97 req-35b6ad68-685b-4d1c-9093-fb5206472117 service nova] Creating event network-changed:23da33da-2f59-4ee8-bd09-64eff52d2e85 for instance a49db0dd-2539-4ca1-84c3-93379f9006d3 on n-h2-863052-1 Oct 31 14:59:03.689066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-80e58d86-5326-4b77-9493-6e90737f9e97 req-35b6ad68-685b-4d1c-9093-fb5206472117 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145545 Oct 31 14:59:03.689697 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3464/6676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:04.360507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:04.361562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:04.369920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.370456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.370911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.371615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.372076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.372509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.521051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:04.535229 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e8362236-70b9-4798-8f81-14a3e07b4457 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1315 microversion: 2.1 time: 0.179413 Oct 31 14:59:04.535859 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3213/6677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:04 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:05.564287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:05.565190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:05.574625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:05.575147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:05.575606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:05.584171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:05.584171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:05.584171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:05.737169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:05.745476 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3cc7cce-513a-48a9-b8af-046eb33c9754 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1315 microversion: 2.1 time: 0.186854 Oct 31 14:59:05.746072 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3465/6678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:05 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:06.770870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:06.771900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:06.780819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.781314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.781760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.782839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.783304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.783755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.955785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:06.971376 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93cecad4-9989-4f22-b302-f5457ac947f0 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1315 microversion: 2.1 time: 0.206164 Oct 31 14:59:06.972016 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3214/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:06 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:07.996603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:07.997242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:08.004092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.004610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.005342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.006074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.006582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.007030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.156859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:08.166569 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ccbabad0-129b-4b18-a51d-8f8fb2e4e63b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1315 microversion: 2.1 time: 0.174870 Oct 31 14:59:08.167184 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3466/6680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:07 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:08.535117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-879dfb89-4e28-4444-87c4-44be74a8d56f req-85aa70a3-e78f-438a-9d92-1d40763c3529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49db0dd-2539-4ca1-84c3-93379f9006d3", "name": "network-vif-plugged", "status": "completed", "tag": "23da33da-2f59-4ee8-bd09-64eff52d2e85"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:08.548075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-879dfb89-4e28-4444-87c4-44be74a8d56f req-85aa70a3-e78f-438a-9d92-1d40763c3529 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.548584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-879dfb89-4e28-4444-87c4-44be74a8d56f req-85aa70a3-e78f-438a-9d92-1d40763c3529 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.549023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-879dfb89-4e28-4444-87c4-44be74a8d56f req-85aa70a3-e78f-438a-9d92-1d40763c3529 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.569689 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-879dfb89-4e28-4444-87c4-44be74a8d56f req-85aa70a3-e78f-438a-9d92-1d40763c3529 service nova] Creating event network-vif-plugged:23da33da-2f59-4ee8-bd09-64eff52d2e85 for instance a49db0dd-2539-4ca1-84c3-93379f9006d3 on n-h2-863052-1 Oct 31 14:59:08.570193 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-879dfb89-4e28-4444-87c4-44be74a8d56f req-85aa70a3-e78f-438a-9d92-1d40763c3529 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039128 Oct 31 14:59:08.571190 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3215/6681] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:09.190850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:09.191515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:09.194916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:09.200284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:09.200848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:09.201319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:09.202075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:09.202625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:09.203093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:09.206924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=74 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:09.365011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:09.376262 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a351fafc-42da-40b2-835f-1bcad1997926 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1315 microversion: 2.1 time: 0.189429 Oct 31 14:59:09.376873 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3467/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:09 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:10.404057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:10.404857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:10.406813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:10.413132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:10.413428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:10.413853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:10.414582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:10.415082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:10.415468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:10.418728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:10.575917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:10.583868 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ecf78cd-26b0-4420-9ab0-d107dce005a5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1501 microversion: 2.1 time: 0.185088 Oct 31 14:59:10.584427 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3216/6683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:10 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:10.606924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:10.609610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:10.617778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:10.618314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:10.618796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:10.619523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:10.619993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:10.620466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:10.650983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:10.657048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Old instance type m1.heat2, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 14:59:10.665629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:59:10.666092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:59:10.666580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:59:10.667012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:59:10.667447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:59:10.713109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:10.745742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:10.747427 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e8b61ae-cfb1-4e86-b42e-d574e9ea668b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "POST /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3/action" status: 202 len: 0 microversion: 2.1 time: 0.144649 Oct 31 14:59:10.748236 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3468/6684] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 14:59:10 2022] POST /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:59:10.756715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:10.757387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:10.765949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:10.766773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:10.767487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:10.768607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:10.769159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:10.769660 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:10.958477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:10.996373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:11.005480 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-280a2d5f-34f0-482f-8420-1ec9da477260 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1510 microversion: 2.1 time: 0.252717 Oct 31 14:59:11.006393 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3217/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:10 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:12.030633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:12.031280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:12.039447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:12.039961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:12.040419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:12.041189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:12.041651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:12.042062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:12.201404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:12.212138 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-590acada-023a-4219-bdbb-f63cd8489c8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1510 microversion: 2.1 time: 0.186309 Oct 31 14:59:12.212781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3469/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:12 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:13.238675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:13.239879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:13.247945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:13.248415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:13.248861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:13.249566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:13.250029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:13.250542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:13.398464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:13.406269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7c5f8e7-cfbb-4427-b054-6378d3df59e9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.172202 Oct 31 14:59:13.407399 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3218/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:13 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:14.433633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:14.434305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:14.441566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.442602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.443057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.443850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.444320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.444765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.581191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.589696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77e61746-d2a5-42fe-a295-1675626cfe54 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.160416 Oct 31 14:59:14.590301 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3470/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:14 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:15.613499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:15.614020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:15.621128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:15.621614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:15.622057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:15.622887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:15.624509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:15.624947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:15.764630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:15.773063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a84b4349-8ae4-4f58-b07b-fbcd0261e557 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.163660 Oct 31 14:59:15.773529 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3219/6689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:15 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:16.795735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:16.796337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:16.803351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.803848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.804592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.805299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.805764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.806222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.948461 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:16.956499 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-575aef4a-ab53-4472-b6b6-3c9a786eabf5 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.164826 Oct 31 14:59:16.957085 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3471/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:16 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:17.980511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:17.981121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:17.988300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.989284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.989717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.990438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.990890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.991308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.127654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:18.139881 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb75362d-12f5-4e34-8d29-61e4b65cdd98 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.163054 Oct 31 14:59:18.140722 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3220/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:17 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:19.173671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:19.174307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:19.181611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.182351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.182614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.183342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.183820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.184267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.425814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.434461 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50e25f47-8563-4e13-aad9-db0dc01521f9 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.264800 Oct 31 14:59:19.435066 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3472/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:19 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:20.459624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:20.460263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:20.467253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.467750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.468195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.468896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.469353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.469780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.625522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:20.638764 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d41a2acb-9224-4730-b5bb-bef0b4c8d6e1 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.183513 Oct 31 14:59:20.639382 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3221/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:20 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:21.664539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:21.665236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:21.675294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.675647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.678220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:21.678220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.678220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.678220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:21.824625 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:21.835708 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74154ee5-181a-47f3-ac00-2da86fc9fa38 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.176275 Oct 31 14:59:21.836530 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3473/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:21 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:22.859965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:22.860573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:22.868515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:22.869002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:22.869444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:22.870142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:22.870618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:22.871044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.019045 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:23.027536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fcf0f17a-c53b-4caf-8786-8078b3b75061 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.171371 Oct 31 14:59:23.028121 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3222/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:22 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:24.053296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:24.053933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:24.061222 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.061729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.062207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.062934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.063409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.063855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.206045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:24.214154 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b123032b-e7eb-4965-9439-ac3296504a3c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.165809 Oct 31 14:59:24.214758 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3474/6696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:24 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:25.238600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:25.239271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:25.245515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.245995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.246457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.247147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.247633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.248061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.392399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:25.400382 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-456ca374-3075-471f-8542-9f00e468ef21 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.166301 Oct 31 14:59:25.400972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3223/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:25 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:26.424399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:26.425032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:26.432143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:26.432719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:26.433168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:26.433928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:26.434431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:26.434873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:26.580063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:26.589981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4325db3-2cf0-463d-9261-d193e14b1b8e tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.169775 Oct 31 14:59:26.590609 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3475/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:26 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:27.614281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:27.614899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:27.621949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:27.622503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:27.622919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:27.623633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:27.624086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:27.624517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:27.763182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:27.771546 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e90fd7b6-f203-43da-9d4b-b0976b297a29 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.162150 Oct 31 14:59:27.772133 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3224/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:27 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:28.804879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:28.805506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:28.812498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.812993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.813444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.814144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.814634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.815070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.959715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:28.967885 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14de27fe-c049-4306-afcf-cab804d1299d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.167032 Oct 31 14:59:28.968685 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3476/6700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:28 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:29.991545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:29.992078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:29.999212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:30.000458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:30.000458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.000924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:30.001425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:30.002586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.174261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:30.179010 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0665ea5b-6ea9-462f-915b-6514df32546a tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.191388 Oct 31 14:59:30.179777 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3225/6701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:29 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:31.203430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:31.204000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:31.211654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:31.212174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:31.212653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:31.213374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:31.213841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:31.214308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:31.349509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:31.357470 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c072954a-c47a-4544-960a-da575c9b4089 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.158210 Oct 31 14:59:31.358055 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3477/6702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:31 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:32.381650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:32.382659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:32.390685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.391180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.391628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.392334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.392791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.393223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.534912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:32.543671 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1f952bd-07f3-4266-9b9a-f207f18ecc7d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.166455 Oct 31 14:59:32.544253 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3226/6703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:32 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:33.568089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:33.568722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:33.575750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.576247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.576691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.577398 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.577858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.578330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.724907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:33.732894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9abe2180-cb9b-4a6f-880c-09ceb9ba7fc4 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.168644 Oct 31 14:59:33.733486 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3478/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:33 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:34.759187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:34.759758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:34.771642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.771642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.771642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.771642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.771642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.772200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.909009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:34.917075 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5a08871-8ca9-4247-89e9-0f9cd7727a1b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.161916 Oct 31 14:59:34.917943 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3227/6705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:34 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:35.942256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:35.943250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:35.946132 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:59:35.946301 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 14:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 (ip 10.222.0.27) !!! Oct 31 14:59:35.954827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:35.955333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:35.955791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:35.956539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:35.957551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:35.957999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:36.088179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:36.096141 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47a6a1ad-a33f-46c8-8fe5-0b1037639270 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.158974 Oct 31 14:59:36.096761 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3479/6706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:35 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:37.120025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:37.120639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:37.123623 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 14:59:37.123769 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 14:59:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 (ip 10.222.0.27) !!! Oct 31 14:59:37.130268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.130756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.131195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.131889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.132342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.132770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.267624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:37.275334 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-afb78383-2f2c-4752-962d-f4abf1399063 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.159227 Oct 31 14:59:37.275912 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3228/6707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:37 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:38.298799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:38.299425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:38.306688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.307184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.307632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.308341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.308802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.309236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.439929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:38.448168 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77767fc7-0183-4827-9256-db0a77e16deb tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.153414 Oct 31 14:59:38.448736 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3480/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:38 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:39.471279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:39.471923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:39.478977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:39.479472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:39.479937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:39.480632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:39.481098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:39.481529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:39.609972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:39.618392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-85a091e6-11d4-4a17-8665-c1d6cc4d8935 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1515 microversion: 2.1 time: 0.150997 Oct 31 14:59:39.618962 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3229/6709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:39 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:40.509903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49db0dd-2539-4ca1-84c3-93379f9006d3", "name": "network-vif-unplugged", "status": "completed", "tag": "23da33da-2f59-4ee8-bd09-64eff52d2e85"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:40.515772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=32 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:40.521871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:40.522479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:40.523037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:40.527078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:40.536582 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] Creating event network-vif-unplugged:23da33da-2f59-4ee8-bd09-64eff52d2e85 for instance a49db0dd-2539-4ca1-84c3-93379f9006d3 on n-h1-863052-1 Oct 31 14:59:40.543006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:59:40.555632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4cafbbff-4c29-473b-a7d7-98d445e8eee4 req-81670200-8f9e-426c-a961-5f4c0470ccd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049361 Oct 31 14:59:40.556317 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3481/6710] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:40.642293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:40.642915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:40.645716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=28 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:40.651008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:40.651498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:40.651941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:40.652636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:40.653096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:40.653513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:40.657719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=84 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:40.836803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:40.845233 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8845fbb8-35ff-42e8-8a21-b8f3cc2d4339 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1514 microversion: 2.1 time: 0.206976 Oct 31 14:59:40.846146 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3230/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:40 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:41.870513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:41.871150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:41.879419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:41.879915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:41.880520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:41.881223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:41.881687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:41.882121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:42.012875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:42.021287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-335aaad1-63e8-4d26-a41f-6b4bb134ed45 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1512 microversion: 2.1 time: 0.155277 Oct 31 14:59:42.021857 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3482/6712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:41 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:42.582037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49db0dd-2539-4ca1-84c3-93379f9006d3", "tag": "23da33da-2f59-4ee8-bd09-64eff52d2e85"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:42.592367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:42.592842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:42.593268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:42.604647 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] Creating event network-changed:23da33da-2f59-4ee8-bd09-64eff52d2e85 for instance a49db0dd-2539-4ca1-84c3-93379f9006d3 on n-h1-863052-1 Oct 31 14:59:42.609823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 14:59:42.621256 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0240afae-afc5-49cf-a955-cd8c0c15fea3 req-c5720617-05e5-4035-86aa-8ae564cc5865 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042891 Oct 31 14:59:42.621884 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3231/6713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:43.045417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:43.046146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:43.053916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:43.054459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:43.054916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:43.055650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:43.056123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:43.056567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:43.245967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:43.256172 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36c06869-74f2-4fc8-b7a2-e3c8e43f817f tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1509 microversion: 2.1 time: 0.214946 Oct 31 14:59:43.257203 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3483/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:43 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:43.281047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:43.281752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:43.288592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:43.289194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:43.289738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:43.290975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:43.291772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:43.292425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:43.323579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:59:43.379194 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.compute.api [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Found an unconfirmed migration during delete, id: 16, status: finished Oct 31 14:59:44.714643 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78e421fa-0dbe-4b12-bda6-96d96125d76c tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 204 len: 0 microversion: 2.1 time: 1.437645 Oct 31 14:59:44.715367 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3232/6715] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:59:43 2022] DELETE /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 0 bytes in 1439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:59:44.723900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:44.724540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:44.739404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:44.739915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:44.740462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:44.741295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:44.741785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:44.742295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:44.876847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:44.885276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ada95f9-fb02-4529-9be2-c7a08adfc50b tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1501 microversion: 2.1 time: 0.165587 Oct 31 14:59:44.885892 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3484/6716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:44 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:45.300322 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-db7679f3-d1d4-4e46-a628-881611abf031 req-a8d377bc-1bda-4978-b735-781d0f7c034e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49db0dd-2539-4ca1-84c3-93379f9006d3", "name": "network-vif-plugged", "status": "completed", "tag": "23da33da-2f59-4ee8-bd09-64eff52d2e85"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:45.311522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-db7679f3-d1d4-4e46-a628-881611abf031 req-a8d377bc-1bda-4978-b735-781d0f7c034e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:45.312011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-db7679f3-d1d4-4e46-a628-881611abf031 req-a8d377bc-1bda-4978-b735-781d0f7c034e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:45.312452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-db7679f3-d1d4-4e46-a628-881611abf031 req-a8d377bc-1bda-4978-b735-781d0f7c034e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:45.323630 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-db7679f3-d1d4-4e46-a628-881611abf031 req-a8d377bc-1bda-4978-b735-781d0f7c034e service nova] Creating event network-vif-plugged:23da33da-2f59-4ee8-bd09-64eff52d2e85 for instance a49db0dd-2539-4ca1-84c3-93379f9006d3 on n-h1-863052-1 Oct 31 14:59:45.328393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-db7679f3-d1d4-4e46-a628-881611abf031 req-a8d377bc-1bda-4978-b735-781d0f7c034e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032200 Oct 31 14:59:45.328994 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3233/6717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:45.908056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:45.908850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:45.916116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:45.916613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:45.917065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:45.917767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:45.918255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:45.918696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:46.056259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4438d9956e43a28a286c1b9b985305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f313edd5234725a58dfafb54d91036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:46.064250 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f856585-3046-46a3-a39d-840ac407360d tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 200 len: 1501 microversion: 2.1 time: 0.160377 Oct 31 14:59:46.064840 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3485/6718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:45 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:46.476320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-762e1376-290c-462d-9b9a-71738169a201 req-6dd110a8-e2b7-4b14-8d99-0315a2ba4a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49db0dd-2539-4ca1-84c3-93379f9006d3", "name": "network-vif-deleted", "tag": "23da33da-2f59-4ee8-bd09-64eff52d2e85"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:46.485995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-762e1376-290c-462d-9b9a-71738169a201 req-6dd110a8-e2b7-4b14-8d99-0315a2ba4a3d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:46.486743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-762e1376-290c-462d-9b9a-71738169a201 req-6dd110a8-e2b7-4b14-8d99-0315a2ba4a3d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:46.487174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-762e1376-290c-462d-9b9a-71738169a201 req-6dd110a8-e2b7-4b14-8d99-0315a2ba4a3d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:46.498889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-762e1376-290c-462d-9b9a-71738169a201 req-6dd110a8-e2b7-4b14-8d99-0315a2ba4a3d service nova] Creating event network-vif-deleted:23da33da-2f59-4ee8-bd09-64eff52d2e85 for instance a49db0dd-2539-4ca1-84c3-93379f9006d3 on n-h1-863052-1 Oct 31 14:59:46.503914 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-762e1376-290c-462d-9b9a-71738169a201 req-6dd110a8-e2b7-4b14-8d99-0315a2ba4a3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Oct 31 14:59:46.504524 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3234/6719] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:47.087489 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:47.088124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:47.094973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:47.095480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:47.095932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.096637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:47.097106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:47.097546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.111700 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] HTTP exception thrown: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Request method failure captured: Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 HTTP/1.1 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-KzkidlPy_WxD5k_A4IOibTWYrODp987dSWZBiZ-vR0UHivEmcdHsexTguoHifPyjXuOalV2N2QEV5IIuncbQFod5l8-WOjaP6RB9Xcco6VkcPQDfoonNlUCNo-Fl37Lo3_fm4mknNVv3YKdtyGUUp1ktSBYRhPSD_1VC3H-8qgX88 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 35f313edd5234725a58dfafb54d91036 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35f313edd5234725a58dfafb54d91036", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35f313edd5234725a58dfafb54d91036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35f313edd5234725a58dfafb54d91036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35f313edd5234725a58dfafb54d91036"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 35f313edd5234725a58dfafb54d91036 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1476461530-project Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bd4438d9956e43a28a286c1b9b985305 Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1476461530-project Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a49db0dd-2539-4ca1-84c3-93379f9006d3'} Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:47.113396 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Returning 404 to user: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-735c27d5-5361-4bb9-8f4c-3c9fb7f11a05 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 404 len: 111 microversion: 2.1 time: 0.031278 Oct 31 14:59:47.117975 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3486/6720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:47 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:59:47.131212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:47.131800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:47.137977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:47.138494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:47.138935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.139615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:47.140067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:47.140488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.154102 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] HTTP exception thrown: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Request method failure captured: Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 HTTP/1.1 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-KzkidlPy_WxD5k_A4IOibTWYrODp987dSWZBiZ-vR0UHivEmcdHsexTguoHifPyjXuOalV2N2QEV5IIuncbQFod5l8-WOjaP6RB9Xcco6VkcPQDfoonNlUCNo-Fl37Lo3_fm4mknNVv3YKdtyGUUp1ktSBYRhPSD_1VC3H-8qgX88 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 35f313edd5234725a58dfafb54d91036 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35f313edd5234725a58dfafb54d91036", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35f313edd5234725a58dfafb54d91036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35f313edd5234725a58dfafb54d91036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35f313edd5234725a58dfafb54d91036"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 35f313edd5234725a58dfafb54d91036 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-1476461530-project Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: bd4438d9956e43a28a286c1b9b985305 Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-1476461530-project Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'a49db0dd-2539-4ca1-84c3-93379f9006d3'} Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:59:47.155738 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Returning 404 to user: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4596438-255a-46be-9b99-3fc98e509169 tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 404 len: 111 microversion: 2.1 time: 0.030602 Oct 31 14:59:47.160141 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3235/6721] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 14:59:47 2022] DELETE /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:59:47.166129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:47.166781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] [instance: a49db0dd-2539-4ca1-84c3-93379f9006d3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:47.172700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:47.173191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:47.173640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.174442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:47.174910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:47.175345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.189270 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] HTTP exception thrown: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Request method failure captured: Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 HTTP/1.1 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-KzkidlPy_WxD5k_A4IOibTWYrODp987dSWZBiZ-vR0UHivEmcdHsexTguoHifPyjXuOalV2N2QEV5IIuncbQFod5l8-WOjaP6RB9Xcco6VkcPQDfoonNlUCNo-Fl37Lo3_fm4mknNVv3YKdtyGUUp1ktSBYRhPSD_1VC3H-8qgX88 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 35f313edd5234725a58dfafb54d91036 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_35f313edd5234725a58dfafb54d91036", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35f313edd5234725a58dfafb54d91036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/35f313edd5234725a58dfafb54d91036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/35f313edd5234725a58dfafb54d91036"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 35f313edd5234725a58dfafb54d91036 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476461530 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-1476461530-project Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: bd4438d9956e43a28a286c1b9b985305 Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-1476461530-project Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'a49db0dd-2539-4ca1-84c3-93379f9006d3'} Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:47.190827 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] Returning 404 to user: Instance a49db0dd-2539-4ca1-84c3-93379f9006d3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a2927f3-cead-4c94-b2e4-e0286024abaa tempest-DeleteServersTestJSON-1476461530 tempest-DeleteServersTestJSON-1476461530-project] 10.222.0.27 "GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3" status: 404 len: 111 microversion: 2.1 time: 0.030030 Oct 31 14:59:47.195846 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3487/6722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:47 2022] GET /compute/v2.1/servers/a49db0dd-2539-4ca1-84c3-93379f9006d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:59:55.978083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1874181764", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "1a6e0921-403f-47a8-8869-5b735318f599"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:56.036925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] validate_networks() for [('1a6e0921-403f-47a8-8869-5b735318f599', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:59:56.776406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:59:56.776909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:59:56.777498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:59:56.777980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:59:56.778505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:59:56.788826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:56.789323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:56.789841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:56.790704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:56.791239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:56.791734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:56.811041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Getting quotas for project 6f874291b72d4ead883b2f0cd48f739f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:59:56.817462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Getting quotas for user 228aecd55fe2417e9ba1e01153eb7874 and project 6f874291b72d4ead883b2f0cd48f739f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:59:56.831082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:59:56.833959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:59:56.883361 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dea97f35-3b8a-449e-85c7-d300c3ecb537 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067027 Oct 31 14:59:56.884398 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3236/6723] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 14:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:59:56.897316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d72ca5c-9074-46cc-9b79-d67742a10f8f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:56.898115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d72ca5c-9074-46cc-9b79-d67742a10f8f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:56.962749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d72ca5c-9074-46cc-9b79-d67742a10f8f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:56.970319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d72ca5c-9074-46cc-9b79-d67742a10f8f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1218 microversion: 2.1 time: 0.078514 Oct 31 14:59:56.971293 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3488/6724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:56 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:58.000421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:58.003761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:58.018685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:58.019454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:58.020740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:58.021920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:58.022895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:58.023609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:58.141144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:58.149585 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c2958f3a-38a0-4bc2-87a0-b02605c95b8e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1288 microversion: 2.1 time: 0.157052 Oct 31 14:59:58.150183 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3237/6725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:57 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:59.172980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:59.173924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:59.181193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=31 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:59.185600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:59.186439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:59.187118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:59.188075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:59.188951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:59.189618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:59.349760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:59.358370 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dab988d4-ed70-4237-a017-7e5a959ad3de tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.189491 Oct 31 14:59:59.359820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3489/6726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:59 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:59.652795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-afdbde82-0c52-4df5-9ee8-8d7e457c9924 req-13e24f29-26df-45f8-8e36-631b4c5a7ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8a5da8-e552-4514-a0d5-85eb93661d30", "tag": "bb62a933-5c6a-41cb-8f1b-d73c4f958cf8"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:59.671888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-afdbde82-0c52-4df5-9ee8-8d7e457c9924 req-13e24f29-26df-45f8-8e36-631b4c5a7ef2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:59.673217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-afdbde82-0c52-4df5-9ee8-8d7e457c9924 req-13e24f29-26df-45f8-8e36-631b4c5a7ef2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:59.673217 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-afdbde82-0c52-4df5-9ee8-8d7e457c9924 req-13e24f29-26df-45f8-8e36-631b4c5a7ef2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:59.690158 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-afdbde82-0c52-4df5-9ee8-8d7e457c9924 req-13e24f29-26df-45f8-8e36-631b4c5a7ef2 service nova] Creating event network-changed:bb62a933-5c6a-41cb-8f1b-d73c4f958cf8 for instance df8a5da8-e552-4514-a0d5-85eb93661d30 on n-h1-863052-1 Oct 31 14:59:59.696060 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-afdbde82-0c52-4df5-9ee8-8d7e457c9924 req-13e24f29-26df-45f8-8e36-631b4c5a7ef2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048698 Oct 31 14:59:59.697281 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3238/6727] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:00:00.384536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:00.385289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:00.392781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:00.393291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:00.393817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:00.394608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:00.395633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:00.396063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:00.532778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:00.542208 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74898ce0-36cd-4203-a359-b4b92e5a6225 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.160872 Oct 31 15:00:00.542208 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3490/6728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:00 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:01.568712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:01.569477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:01.576175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:01.576670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:01.577123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:01.577839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:01.578325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:01.578844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:01.724262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:01.732420 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b1a3eed-ad7a-4385-b5b3-d9a0422a37ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.170153 Oct 31 15:00:01.733027 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3239/6729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:01 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:02.756482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:02.757058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:02.764451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:02.764942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:02.765406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:02.766121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:02.766628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:02.767076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:02.904262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:02.913006 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-353fc535-6b1d-4684-b2e4-e381120efeef tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.160568 Oct 31 15:00:02.913583 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3491/6730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:02 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:03.938769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:03.939662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:03.948560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:03.949149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:03.949673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:03.950644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:03.951173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:03.951863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:04.103345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:04.111362 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a1b3346-4429-46a9-b483-e205b98ab8b5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.178201 Oct 31 15:00:04.111931 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3240/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:03 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:05.135601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:05.136261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:05.143126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:05.143626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:05.144080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:05.144788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:05.145964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:05.145964 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:05.283695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:05.293721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c3f5476-9a37-4ad7-8b1e-5c658744de16 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.161930 Oct 31 15:00:05.294454 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3492/6732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:05 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:05.387584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9e54e0e6-a793-469e-83ae-423384618295 req-59f6020a-6c01-46c4-ab5d-a816b4f1d0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8a5da8-e552-4514-a0d5-85eb93661d30", "name": "network-vif-plugged", "status": "completed", "tag": "bb62a933-5c6a-41cb-8f1b-d73c4f958cf8"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:05.398222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e54e0e6-a793-469e-83ae-423384618295 req-59f6020a-6c01-46c4-ab5d-a816b4f1d0df service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:05.398916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e54e0e6-a793-469e-83ae-423384618295 req-59f6020a-6c01-46c4-ab5d-a816b4f1d0df service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:05.399533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9e54e0e6-a793-469e-83ae-423384618295 req-59f6020a-6c01-46c4-ab5d-a816b4f1d0df service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:05.412605 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9e54e0e6-a793-469e-83ae-423384618295 req-59f6020a-6c01-46c4-ab5d-a816b4f1d0df service nova] Creating event network-vif-plugged:bb62a933-5c6a-41cb-8f1b-d73c4f958cf8 for instance df8a5da8-e552-4514-a0d5-85eb93661d30 on n-h1-863052-1 Oct 31 15:00:05.417563 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9e54e0e6-a793-469e-83ae-423384618295 req-59f6020a-6c01-46c4-ab5d-a816b4f1d0df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Oct 31 15:00:05.418157 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3241/6733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:06.318050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:06.318703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:06.325522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:06.326018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:06.326503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:06.327210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:06.327680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:06.328113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:06.471343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:06.479565 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68ad4fb5-6999-4810-a9a9-9cb3c0300f54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1318 microversion: 2.1 time: 0.165861 Oct 31 15:00:06.480352 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3493/6734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:06 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:07.503859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:07.504595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:07.507382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:07.508092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:07.514145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.514661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.515108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.515803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.516262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.516691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.648646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:07.656612 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a87c8eb6-f3ce-48be-9329-e55c42632d0c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1508 microversion: 2.1 time: 0.157052 Oct 31 15:00:07.657186 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3242/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:07 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:07.679364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:07.680003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:07.681954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:07.687933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.688434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.688893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.689631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.690102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.690575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.819113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:07.826887 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-271cda3c-5a2c-4e9a-b034-295115d56f9a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1508 microversion: 2.1 time: 0.151517 Oct 31 15:00:07.827466 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3494/6736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:07 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:07.849916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:07.852286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:07.858271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.858756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.859192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.859878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.860333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.860758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.929790 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40a78366-9c6a-4b34-b31c-aaef16d3a85e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "PUT /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1080 microversion: 2.1 time: 0.083845 Oct 31 15:00:07.930538 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3243/6737] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 31 15:00:07 2022] PUT /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1080 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:07.950535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:07.951163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:07.957199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.958383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.958836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.959536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.959999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.960434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.120383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:08.128621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2612ef80-a6c2-42a0-a530-76285486a949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1506 microversion: 2.1 time: 0.182037 Oct 31 15:00:08.129239 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3495/6738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:07 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:08.151479 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:08.152098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:08.158263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.158761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.159206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.159915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.160385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.160819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.293614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:08.302087 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a88a92b-fffd-44b3-a5cb-f84701dc864a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1506 microversion: 2.1 time: 0.153966 Oct 31 15:00:08.302708 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3244/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:08 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:08.325266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:08.327692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:08.333747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.334270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.334718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.335421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.335885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.336323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.366321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:08.372406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Old instance type m1.heat2, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:00:08.379203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:00:08.380279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:00:08.380767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:00:08.381190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:00:08.381617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:00:08.448119 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-661c3c40-a366-43dd-9e78-27ff426f088c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30/action" status: 202 len: 0 microversion: 2.1 time: 0.126561 Oct 31 15:00:08.448746 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3496/6740] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:08 2022] POST /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:08.457248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:08.458054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:08.464356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.464859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.465299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.466005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.466494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.466926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.634831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:08.643318 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4cae5514-8b22-434b-a424-bc6002ec57e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1517 microversion: 2.1 time: 0.190050 Oct 31 15:00:08.643976 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3245/6741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:08 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:09.667195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:09.667850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:09.675926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:09.676980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:09.677425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:09.678202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:09.678680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:09.679127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:09.814522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:09.823983 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e47d2eb0-b688-461c-bd69-377587388bae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1517 microversion: 2.1 time: 0.160593 Oct 31 15:00:09.824397 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3497/6742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:09 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:10.847241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:10.847908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:10.850573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:10.856436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:10.856916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:10.857361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:10.858068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:10.858561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:10.858989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:10.862450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:11.000632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:11.008987 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec981c9d-eb9f-45a6-94e1-d9b35bd3334a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.165625 Oct 31 15:00:11.009557 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3246/6743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:10 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:12.033361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:12.033909 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:12.037442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=40 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:12.046108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:12.047035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:12.047820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:12.049097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:12.049896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:12.050731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:12.224887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:12.233093 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-454bc1f6-5308-4915-9f22-e9ce85421f4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.203689 Oct 31 15:00:12.233684 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3498/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:12 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:13.258012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:13.258596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:13.265722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:13.266248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:13.266692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:13.267396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:13.267858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:13.268309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:13.415541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:13.423404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f25d42eb-698d-4348-9c90-886291d3ca93 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.169378 Oct 31 15:00:13.423982 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3247/6745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:13 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:14.448486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:14.449146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:14.456233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:14.456735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:14.457189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:14.457919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:14.458436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:14.458882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:14.590566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:14.598915 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-580e145c-434d-4638-a6b7-fde1f7af1f41 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.153820 Oct 31 15:00:14.599494 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3499/6746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:14 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:15.623811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:15.624437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:15.631469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:15.631966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:15.632410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:15.633117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:15.633576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:15.634004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:15.763862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:15.772173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a987000-5b41-49c1-9094-eadba54f91ea tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.152636 Oct 31 15:00:15.772749 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3248/6747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:15 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:16.796623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:16.797179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:16.804135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:16.804641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:16.805092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:16.805800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:16.806299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:16.806735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:16.936786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:16.945419 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d054672f-ccb3-4c13-906d-2084b85c4499 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.153299 Oct 31 15:00:16.945990 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3500/6748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:16 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:17.968828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:17.969436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:17.976992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:17.977475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:17.977907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:17.978626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:17.979075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:17.979514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:18.109685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:18.118082 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8aa80a9-9020-4945-a413-9cc78ad4ffac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.153118 Oct 31 15:00:18.118898 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3249/6749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:17 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:19.143193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:19.143996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:19.151331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:19.151837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:19.152288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:19.153012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:19.153480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:19.153921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:19.301559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:19.310976 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc46fa03-492d-49bd-932e-6202ae625763 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.172591 Oct 31 15:00:19.311687 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3501/6750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:19 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:20.335000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:20.335609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:20.342633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:20.343115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:20.343548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:20.344242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:20.344688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:20.345108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:20.485244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:20.494301 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c3efc675-3ae0-476d-a9c8-6b12b33fe261 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.163090 Oct 31 15:00:20.494876 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3250/6751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:20 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:21.517419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:21.517977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:21.525576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:21.526077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:21.526558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:21.527413 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:21.527910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:21.528349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:21.657803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:21.665705 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cdf6485-5bf7-47b5-99f0-974fb04526bf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.152268 Oct 31 15:00:21.666308 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3502/6752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:21 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:22.689959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:22.690563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:22.698141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:22.698654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:22.699094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:22.699789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:22.700241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:22.700662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:22.835237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:22.843100 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-530230cb-82d6-4e0e-8ac1-e5b49e2b6720 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.157108 Oct 31 15:00:22.843683 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3251/6753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:22 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:23.866839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:23.867416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:23.874713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.875223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.875681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.876407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.876878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.877321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:24.016099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:24.024637 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd5b913f-c110-4f34-ae26-2ac79adea5bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.161846 Oct 31 15:00:24.025226 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3503/6754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:23 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:25.047986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:25.048601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:25.055701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:25.056193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:25.056637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:25.057343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:25.057796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:25.058257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:25.203524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:25.212164 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d18a478c-df34-4a93-9008-86e6199499bd tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.167833 Oct 31 15:00:25.212812 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3252/6755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:25 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:26.237522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:26.238160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:26.245544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:26.246057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:26.246543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:26.247270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:26.247745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:26.248192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:26.252587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:26.397669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:26.409185 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-828e9ea9-da0e-442b-a04e-3aaf071d5af5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.175931 Oct 31 15:00:26.411228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3504/6756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:26 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:27.434116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:27.435009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:27.442522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:27.443013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:27.443450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:27.444164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:27.444619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:27.445048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:27.580041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:27.588429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49724810-11da-4e20-b51c-78b6604877d6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.158342 Oct 31 15:00:27.589005 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3253/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:27 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:28.612305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:28.612858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:28.620011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.620509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.620957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.621662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.622121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.622580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.760751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:28.768671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87ede1e1-ba20-448a-8ec9-40e08376fa5b tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.160604 Oct 31 15:00:28.769271 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3505/6758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:28 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:29.792560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:29.793357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:29.808133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:29.808757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:29.809341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:29.810279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:29.810817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:29.811315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:29.962849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:29.970985 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a4d11a9-9aef-4a1c-bb1e-eaa0b938aedf tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.182244 Oct 31 15:00:29.971575 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3254/6759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:29 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:30.995883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:30.996654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:31.003943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:31.004452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:31.004902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:31.005620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:31.006083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:31.006546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:31.144206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:31.152118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1279becc-4659-4fb8-a36b-e6afb65a3d31 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.160205 Oct 31 15:00:31.152697 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3506/6760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:30 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:32.176620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:32.179012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:32.184374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:32.184870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:32.185310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:32.186018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:32.186509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:32.186937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:32.326352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:32.334452 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3240f083-9b52-4c4b-9887-3d6dcdf12f20 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.162255 Oct 31 15:00:32.335037 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3255/6761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:32 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:33.357886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:33.358552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:33.366086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.366647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.367159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.368051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.368580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.369051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.505820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:33.513730 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa5ec75e-0421-4fbd-a7e8-b72e366cdea5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.159799 Oct 31 15:00:33.514354 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3507/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:33 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:34.537598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:34.538254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:34.545187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.545681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.546124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.546863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.547319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.547781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.681063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:34.688894 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ffae99d-3a66-4011-9756-3cea2f9e0c53 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.155859 Oct 31 15:00:34.689478 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3256/6763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:34 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:35.712779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:35.713407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:35.720962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.721784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.723130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.723961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.724544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.725044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.874612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:35.883938 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90896841-f32e-4d7f-9f74-f18866023f6f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.175037 Oct 31 15:00:35.884539 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3508/6764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:35 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:36.907968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:36.908574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:36.916467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:36.917023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:36.917497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:36.918237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:36.918699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:36.919124 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.153845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:37.163211 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f7f742a-dfee-4806-a250-68f7b7f27450 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1522 microversion: 2.1 time: 0.259095 Oct 31 15:00:37.164073 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3257/6765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:36 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:37.748746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8a5da8-e552-4514-a0d5-85eb93661d30", "name": "network-vif-unplugged", "status": "completed", "tag": "bb62a933-5c6a-41cb-8f1b-d73c4f958cf8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:37.761951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.762522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.763065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.776520 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] Creating event network-vif-unplugged:bb62a933-5c6a-41cb-8f1b-d73c4f958cf8 for instance df8a5da8-e552-4514-a0d5-85eb93661d30 on n-h2-863052-1 Oct 31 15:00:37.782703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] Instance df8a5da8-e552-4514-a0d5-85eb93661d30 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:00:37.794948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-67ddbd3e-0db8-4ff8-8d75-4cad9dd06906 req-5c664edb-477b-4b90-bfe2-99d9b6b39dc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049995 Oct 31 15:00:37.796093 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3509/6766] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:38.192145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:38.193001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:38.201695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:38.202213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:38.202661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:38.203369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:38.203826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:38.204252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:38.348474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:38.358231 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f129d6d-1e1b-4b32-8657-dade15e058b3 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1521 microversion: 2.1 time: 0.170582 Oct 31 15:00:38.358854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3258/6767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:38 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:39.384466 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:39.385181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:39.395948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.396431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.396880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.397590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.398052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.398537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.578905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:39.587053 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8dd5212a-7534-4b8b-984e-9ab87cab6911 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1519 microversion: 2.1 time: 0.206810 Oct 31 15:00:39.587643 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3510/6768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:39 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:39.825179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8a5da8-e552-4514-a0d5-85eb93661d30", "tag": "bb62a933-5c6a-41cb-8f1b-d73c4f958cf8"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:39.836326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.836731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.837167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.849916 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] Creating event network-changed:bb62a933-5c6a-41cb-8f1b-d73c4f958cf8 for instance df8a5da8-e552-4514-a0d5-85eb93661d30 on n-h2-863052-1 Oct 31 15:00:39.855516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] Instance df8a5da8-e552-4514-a0d5-85eb93661d30 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:00:39.866718 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-330df1c5-fb9c-44bc-a186-b839e309565d req-30c46df3-8105-4c26-84da-24bf8ec159ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045160 Oct 31 15:00:39.867340 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3259/6769] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:40.610295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:40.610940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:40.618670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.619165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.619617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.620318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.620785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.621223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.758592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:40.766827 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-beb65513-0153-4ba4-85dd-3c40ae78c132 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1516 microversion: 2.1 time: 0.160372 Oct 31 15:00:40.767443 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3511/6770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:40 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:40.790959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:40.791594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:40.798077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.798614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.799060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.799797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.800259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.801299 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.868195 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-566f58fa-cb9e-413c-a76a-2c7e373603ec tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30/action" status: 204 len: 0 microversion: 2.1 time: 0.081493 Oct 31 15:00:40.871818 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3260/6771] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:40 2022] POST /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:00:40.877042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:40.877676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:40.884187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.884691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.885137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.885856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.886371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.886788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:41.046244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:41.055242 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74693cb1-299d-4d0c-92eb-37c795fa84a5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1516 microversion: 2.1 time: 0.182016 Oct 31 15:00:41.056195 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3512/6772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:40 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:42.084273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:42.085190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:42.088167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=30 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:42.094591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:42.095171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:42.095674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.096447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:42.096999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:42.097991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.102429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:42.236684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.244523 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab3e9c40-7b1c-4684-aabb-f39ecc8f34ca tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1508 microversion: 2.1 time: 0.165083 Oct 31 15:00:42.245097 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3261/6773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:42 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:42.267606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:42.268162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:42.271619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:42.277175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:42.277670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:42.278118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.278838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:42.279299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:42.279732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.412959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.420963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b198a63b-a7f6-4b2b-a926-0edc07cfb44e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1508 microversion: 2.1 time: 0.157414 Oct 31 15:00:42.421573 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3513/6774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:42 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:42.446827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cec925fb-38bb-4724-9c96-bb1bea90b326 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'create', calling method: .version_select at 0x7fe10d11bee0>, body: {"keypair": {"name": "tempest-keypair-188719481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLADD35SPBo7U4NUTA6LGLXuYigQKOrXayklhMka4qNaGggyIjvRel7zfyJKkg3C83OcyzHvrzxy+MXI2m1RRjFWM3TI3Z7EhAfZnzF9cgmpPTMCX+66vwdiqcA9e9Taaw=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:42.462646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cec925fb-38bb-4724-9c96-bb1bea90b326 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Getting quotas for project 6f874291b72d4ead883b2f0cd48f739f. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:42.467833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cec925fb-38bb-4724-9c96-bb1bea90b326 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Getting quotas for user 228aecd55fe2417e9ba1e01153eb7874 and project 6f874291b72d4ead883b2f0cd48f739f. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:42.492492 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cec925fb-38bb-4724-9c96-bb1bea90b326 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049504 Oct 31 15:00:42.493099 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3262/6775] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:00:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:43.001457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d41ef32a-7369-4374-a5c6-e3702453c414 req-682fc686-616b-45af-8526-a29ac493e301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8a5da8-e552-4514-a0d5-85eb93661d30", "name": "network-vif-plugged", "status": "completed", "tag": "bb62a933-5c6a-41cb-8f1b-d73c4f958cf8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:43.016298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d41ef32a-7369-4374-a5c6-e3702453c414 req-682fc686-616b-45af-8526-a29ac493e301 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.017752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d41ef32a-7369-4374-a5c6-e3702453c414 req-682fc686-616b-45af-8526-a29ac493e301 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.018479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d41ef32a-7369-4374-a5c6-e3702453c414 req-682fc686-616b-45af-8526-a29ac493e301 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.032039 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d41ef32a-7369-4374-a5c6-e3702453c414 req-682fc686-616b-45af-8526-a29ac493e301 service nova] Creating event network-vif-plugged:bb62a933-5c6a-41cb-8f1b-d73c4f958cf8 for instance df8a5da8-e552-4514-a0d5-85eb93661d30 on n-h2-863052-1 Oct 31 15:00:43.038975 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d41ef32a-7369-4374-a5c6-e3702453c414 req-682fc686-616b-45af-8526-a29ac493e301 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042691 Oct 31 15:00:43.040014 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3514/6776] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:44.021454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:44.022075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:44.029021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.029525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.029946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.030673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.031125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.031548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.164620 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:44.172693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e163279a-baa0-4e3f-b431-07d5c49ca64a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 200 len: 1508 microversion: 2.1 time: 0.156471 Oct 31 15:00:44.173204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3263/6777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:44 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:44.197789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:44.198582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:44.205046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.205537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.205986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.206823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.207285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.207721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.236488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:00:44.317848 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fea03e8-f807-498b-939e-920851c54204 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 204 len: 0 microversion: 2.1 time: 0.124951 Oct 31 15:00:44.318823 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3515/6778] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:00:44 2022] DELETE /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:00:44.379116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1333586328", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "1a6e0921-403f-47a8-8869-5b735318f599"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:44.435402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] validate_networks() for [('1a6e0921-403f-47a8-8869-5b735318f599', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:00:44.817752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:00:44.818196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:00:44.818733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:00:44.819195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:00:44.819636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:00:44.828712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.829197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.829661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.830502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.831002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.831442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.850030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Getting quotas for project 6f874291b72d4ead883b2f0cd48f739f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:44.855542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Getting quotas for user 228aecd55fe2417e9ba1e01153eb7874 and project 6f874291b72d4ead883b2f0cd48f739f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:44.868683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:00:44.871042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:00:44.916933 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d12cb01-b43d-4efd-a779-137f691230b2 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542227 Oct 31 15:00:44.917600 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3264/6779] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:00:44.929925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d53930b3-171e-41a3-81d4-be1f16b74ca6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:44.930682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d53930b3-171e-41a3-81d4-be1f16b74ca6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:44.989576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d53930b3-171e-41a3-81d4-be1f16b74ca6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:44.996687 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d53930b3-171e-41a3-81d4-be1f16b74ca6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1218 microversion: 2.1 time: 0.071026 Oct 31 15:00:44.997289 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3516/6780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:44 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:46.027298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:46.030560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:46.052086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.053454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.054097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.055484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.056390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.057241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.190458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7bd943e7-d9ec-42f6-9458-1845f9511163 req-0c730025-8a71-4c85-8f3e-69afcd23f3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8a5da8-e552-4514-a0d5-85eb93661d30", "name": "network-vif-deleted", "tag": "bb62a933-5c6a-41cb-8f1b-d73c4f958cf8"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:46.214196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7bd943e7-d9ec-42f6-9458-1845f9511163 req-0c730025-8a71-4c85-8f3e-69afcd23f3c1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.215246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7bd943e7-d9ec-42f6-9458-1845f9511163 req-0c730025-8a71-4c85-8f3e-69afcd23f3c1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.216362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7bd943e7-d9ec-42f6-9458-1845f9511163 req-0c730025-8a71-4c85-8f3e-69afcd23f3c1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.241463 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7bd943e7-d9ec-42f6-9458-1845f9511163 req-0c730025-8a71-4c85-8f3e-69afcd23f3c1 service nova] Creating event network-vif-deleted:bb62a933-5c6a-41cb-8f1b-d73c4f958cf8 for instance df8a5da8-e552-4514-a0d5-85eb93661d30 on n-h2-863052-1 Oct 31 15:00:46.249724 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7bd943e7-d9ec-42f6-9458-1845f9511163 req-0c730025-8a71-4c85-8f3e-69afcd23f3c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066525 Oct 31 15:00:46.250879 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3517/6781] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:00:46.274493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:46.284951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80817822-d609-4a3e-8b2f-bdb8cb444e54 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1278 microversion: 2.1 time: 0.267958 Oct 31 15:00:46.290119 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3265/6782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:46 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:47.310878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:47.311609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:47.319083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.319589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.320043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.320753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.321215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.321654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.852758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:47.860657 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fca556e0-8f35-44ac-9340-08f4530326a6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1318 microversion: 2.1 time: 0.555055 Oct 31 15:00:47.861555 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3518/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:47 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:48.290843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c9b1e94b-07bc-4086-be62-4f0b11f55156 req-27d77a50-02bb-4af2-8b38-bb4747b65a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2491f247-1501-47e0-af6f-6d7c5a7f651a", "tag": "2e5c8259-bc25-4dbc-aca5-a5fc04d066a7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:48.301959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c9b1e94b-07bc-4086-be62-4f0b11f55156 req-27d77a50-02bb-4af2-8b38-bb4747b65a7e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.302461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c9b1e94b-07bc-4086-be62-4f0b11f55156 req-27d77a50-02bb-4af2-8b38-bb4747b65a7e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.302890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c9b1e94b-07bc-4086-be62-4f0b11f55156 req-27d77a50-02bb-4af2-8b38-bb4747b65a7e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:48.317815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c9b1e94b-07bc-4086-be62-4f0b11f55156 req-27d77a50-02bb-4af2-8b38-bb4747b65a7e service nova] Creating event network-changed:2e5c8259-bc25-4dbc-aca5-a5fc04d066a7 for instance 2491f247-1501-47e0-af6f-6d7c5a7f651a on n-h2-863052-1 Oct 31 15:00:48.322928 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c9b1e94b-07bc-4086-be62-4f0b11f55156 req-27d77a50-02bb-4af2-8b38-bb4747b65a7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035737 Oct 31 15:00:48.323561 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3266/6784] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:48.885348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:48.885983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:48.893211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.893707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.894160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:48.894898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.895366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.895807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.116269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:49.124150 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9b9f2ea-7f1d-4fd2-97c9-3886d06ffd8d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1318 microversion: 2.1 time: 0.242716 Oct 31 15:00:49.124733 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3519/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:48 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:50.148925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:50.149627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:50.156120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.156611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.157053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.157750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.158244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.158735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.291515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:50.299478 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04852061-f9b4-4915-aa13-224c94ae517a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1318 microversion: 2.1 time: 0.155617 Oct 31 15:00:50.300750 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3267/6786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:50 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:51.323596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:51.324317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:51.332658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.333415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.333878 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.334724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.335273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.335744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.484448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:51.493573 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2a1084d-d416-447c-94c5-f4e14e07ed28 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1318 microversion: 2.1 time: 0.173981 Oct 31 15:00:51.494191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3520/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:51 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:52.517226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:52.517850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:52.524953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.525435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.525954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.527607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.527607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.527607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.666113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.674001 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-571e2974-4a57-4a58-a216-d4b69796227a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1318 microversion: 2.1 time: 0.160663 Oct 31 15:00:52.674607 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3268/6788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:52 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:53.114916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-86d5ad57-9b28-41d6-9847-24188e6b8e63 req-d3f88f17-49be-4687-aa24-4db6156c31fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2491f247-1501-47e0-af6f-6d7c5a7f651a", "name": "network-vif-plugged", "status": "completed", "tag": "2e5c8259-bc25-4dbc-aca5-a5fc04d066a7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:53.125690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-86d5ad57-9b28-41d6-9847-24188e6b8e63 req-d3f88f17-49be-4687-aa24-4db6156c31fe service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.126075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-86d5ad57-9b28-41d6-9847-24188e6b8e63 req-d3f88f17-49be-4687-aa24-4db6156c31fe service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.126694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-86d5ad57-9b28-41d6-9847-24188e6b8e63 req-d3f88f17-49be-4687-aa24-4db6156c31fe service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.139222 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-86d5ad57-9b28-41d6-9847-24188e6b8e63 req-d3f88f17-49be-4687-aa24-4db6156c31fe service nova] Creating event network-vif-plugged:2e5c8259-bc25-4dbc-aca5-a5fc04d066a7 for instance 2491f247-1501-47e0-af6f-6d7c5a7f651a on n-h2-863052-1 Oct 31 15:00:53.146871 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-86d5ad57-9b28-41d6-9847-24188e6b8e63 req-d3f88f17-49be-4687-aa24-4db6156c31fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Oct 31 15:00:53.146871 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3521/6789] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:53.697871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:53.698563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:53.705526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.706012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.707064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.707767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.708224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.708651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.842964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:53.850880 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f91b1e7-829d-4dff-985c-e758f20d1be4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1318 microversion: 2.1 time: 0.156889 Oct 31 15:00:53.851660 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3269/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:53 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:54.876646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:54.877356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:54.884646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.885144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.885592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.886320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.886785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.887219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.906773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:54.993972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:55.025112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:55.033160 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-305f8b12-aeac-4090-bfc1-d26f192e7fe5 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1508 microversion: 2.1 time: 0.161727 Oct 31 15:00:55.033756 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3522/6791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:54 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:55.055931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:55.056550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:55.058941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:55.059710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:55.067131 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.067626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.068066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.068779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.069243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.069672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.207251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:55.215685 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1e23c3e-1269-44f7-a3d2-4204ea86049e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1508 microversion: 2.1 time: 0.163271 Oct 31 15:00:55.216494 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3270/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:55 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:55.241708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:55.244169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:55.250778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.251285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.251735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.252456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.252928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.253857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.283866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:55.290155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:00:55.297234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:00:55.297669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:00:55.298190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:00:55.298629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:00:55.299057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:00:55.367437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63dacc6f-d844-42ef-920f-74079bd01002 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a/action" status: 202 len: 0 microversion: 2.1 time: 0.129934 Oct 31 15:00:55.368734 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3523/6793] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:55 2022] POST /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:55.378935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:55.379556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:55.385947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.386893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.387587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.388002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.388514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.388956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.550634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:55.560179 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a0955c99-819f-4063-be5f-a9668caa467a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1515 microversion: 2.1 time: 0.186208 Oct 31 15:00:55.561083 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3271/6794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:55 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:56.587668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:56.588486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:56.598616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.599139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.599634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.600427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.600924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.601404 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.751554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:56.760405 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-512236e8-e5da-403e-85c6-feda57f29dd8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1515 microversion: 2.1 time: 0.177491 Oct 31 15:00:56.761094 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3524/6795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:56 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:57.784867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:57.785476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:57.792490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.792988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.793427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.794277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.794618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.795049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.936253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:57.944116 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e66fc60-ba5f-44ee-a043-69324b2e36c8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.163180 Oct 31 15:00:57.944696 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3272/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:57 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:58.968095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:58.968647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:58.976582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:58.977085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:58.977530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:58.978288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:58.978753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:58.979204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:59.117876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:59.125913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1ac10a3-d089-47c5-93ff-810a863da80c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.161789 Oct 31 15:00:59.126532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3525/6797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:58 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:00.150937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:00.151554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:00.158574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.159061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.159500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.160201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.160658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.161083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.296591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:00.304726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c7b532a-f7d4-4643-b46a-ad661d8e3ad9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.157643 Oct 31 15:01:00.305322 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3273/6798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:00 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:01.328332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:01.328961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:01.337424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:01.337858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:01.338393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:01.339118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:01.339583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:01.340018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:01.488767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:01.496712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-170eacb6-fd59-4ece-81a8-4347be7c2684 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.172282 Oct 31 15:01:01.497310 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3526/6799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:01 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:02.519673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:02.520292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:02.527271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:02.527761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:02.528211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:02.528916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:02.529377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:02.529808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:02.668257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:02.676794 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d07a6ab-0e7d-4a43-ba97-9455e85af412 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.161021 Oct 31 15:01:02.677363 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3274/6800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:02 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:03.700417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:03.701029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:03.708151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:03.708667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:03.709116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:03.709830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:03.710333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:03.710775 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:03.845519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:03.853503 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fd60f90-d1c9-4b5b-8a3c-5d9ff20d04e8 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.157191 Oct 31 15:01:03.854084 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3527/6801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:03 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:04.877029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:04.877638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:04.885144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:04.885641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:04.886088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:04.886824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:04.887283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:04.887710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:05.022359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:05.030347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-512a4cd4-c080-4a39-9e82-04a75ef4f815 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.157222 Oct 31 15:01:05.033676 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3275/6802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:04 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:06.054365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:06.054992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:06.062269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:06.062766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:06.063214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:06.063917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:06.064379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:06.064813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:06.199491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:06.207981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06fd0e7b-2dbd-4a28-8f22-5c101a5a0fc9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.157590 Oct 31 15:01:06.208561 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3528/6803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:06 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:07.231380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:07.231990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:07.239834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:07.240315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:07.240753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:07.241443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:07.241890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:07.242351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:07.377372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:07.385253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34c48399-7c96-4c90-af98-18a445bf0723 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.157695 Oct 31 15:01:07.385837 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3276/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:07 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:08.410213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:08.410832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:08.417562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:08.418056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:08.418548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:08.419258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:08.419720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:08.420160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:08.565687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:08.575613 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0589c158-d6a0-4448-886b-c4dfe1ee1b4f tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.169915 Oct 31 15:01:08.576197 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3529/6805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:08 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:09.599884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:09.600504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:09.607760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:09.608249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:09.608687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:09.609393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:09.610249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:09.610366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:09.748072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:09.755942 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a810423e-3f41-4cf3-8115-90afc77a5949 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.160630 Oct 31 15:01:09.756524 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3277/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:09 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:10.780166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:10.780695 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:10.788228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:10.788746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:10.789191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:10.789912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:10.790410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:10.790852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:10.923986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:10.932501 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0535a6b-48e0-42b2-8969-8fd7b55d2d11 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.156444 Oct 31 15:01:10.933083 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3530/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:10 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:11.957247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:11.957887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:11.964547 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:11.965028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:11.967010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:11.967010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:11.967010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:11.967010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:12.100192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:12.108385 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b78d7d4b-3a74-4dd7-915b-c1219dca0448 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.155554 Oct 31 15:01:12.108984 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3278/6808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:11 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:13.132603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:13.133234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:13.136056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:13.141827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:13.142367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:13.142823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:13.143536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:13.144000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:13.144437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:13.287432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:13.295578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ced34858-c7f3-4e52-820f-b3a01965522a tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.166873 Oct 31 15:01:13.296172 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3531/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:13 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:14.319415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:14.320065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:14.322821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:14.328276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:14.328771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:14.329212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:14.329918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:14.330400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:14.330918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:14.334497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=94 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:14.483096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:14.492155 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d452821f-668f-4a21-bced-e901eb82706e tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.177261 Oct 31 15:01:14.492744 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3279/6810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:14 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:15.514963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:15.515617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:15.523378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:15.523877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:15.524325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:15.525037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:15.525503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:15.525939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:15.666700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:15.675437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b56e03c-2ffe-44db-8a05-63abefb671ed tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.164321 Oct 31 15:01:15.676037 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3532/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:15 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:16.699574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:16.700117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:16.707672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:16.708213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:16.708650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:16.709348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:16.709800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:16.710316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:16.848528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:16.856406 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7bc3892-f24a-4708-80fe-82bfca29fcfc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.160838 Oct 31 15:01:16.857000 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3280/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:16 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:17.880274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:17.880838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:17.888546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:17.889052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:17.889503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:17.890243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:17.890720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:17.891160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:18.028356 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:18.036902 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c54d28c-e8c4-47e3-9d15-fd0433686d8c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.160610 Oct 31 15:01:18.037488 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3533/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:17 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:19.060311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:19.060956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:19.068887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:19.069372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:19.069810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:19.070541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:19.070992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:19.073591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:19.210376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:19.218465 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0592ea99-18d1-4044-95da-8194bec65de6 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.161954 Oct 31 15:01:19.219064 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3281/6814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:19 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:20.243707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:20.244314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:20.251274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:20.251785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:20.252839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:20.253559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:20.254025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:20.254485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:20.392810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:20.400746 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7e2d612-ab81-4845-9080-8bea871e2351 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.161112 Oct 31 15:01:20.401373 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3534/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:20 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:21.424849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:21.425463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:21.432593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:21.433080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:21.433517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:21.434237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:21.434693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:21.435118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:21.571530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:21.579506 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa092b59-a640-4437-b03d-6d5b614b50e1 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.158532 Oct 31 15:01:21.580084 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3282/6816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:21 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:22.603150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:22.603758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:22.611147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:22.612152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:22.612604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:22.613306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:22.613768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:22.614220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:22.750432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:22.758467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-241771b3-6f38-4edf-ac11-aadf6f0e0f7c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.159607 Oct 31 15:01:22.759057 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3535/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:22 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:23.782087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:23.782734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:23.793338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:23.793338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:23.793338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:23.793338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:23.793338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:23.793860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:23.930028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:23.948827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fdfed752-ddbd-47a7-9e9b-496a09e177b0 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1520 microversion: 2.1 time: 0.168707 Oct 31 15:01:23.948827 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3283/6818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:23 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:24.920529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2491f247-1501-47e0-af6f-6d7c5a7f651a", "name": "network-vif-unplugged", "status": "completed", "tag": "2e5c8259-bc25-4dbc-aca5-a5fc04d066a7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:24.930728 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:24.931365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:24.931823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:24.934631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:24.949046 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] Creating event network-vif-unplugged:2e5c8259-bc25-4dbc-aca5-a5fc04d066a7 for instance 2491f247-1501-47e0-af6f-6d7c5a7f651a on n-h1-863052-1 Oct 31 15:01:24.956707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:01:24.968796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cbda5789-bfe9-446a-90cf-5f2cb931bfe0 req-0238d937-8d39-459b-83fe-97dc6c20430d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108467 Oct 31 15:01:24.969717 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3536/6819] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:24.972365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:24.973007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:24.979645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:24.980285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:24.980834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:24.981659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:24.982220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:24.982924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:25.185900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:25.196341 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f715cce0-b84b-47d5-8e41-1e36aff51234 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1519 microversion: 2.1 time: 0.228396 Oct 31 15:01:25.196914 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3284/6820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:24 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:26.230946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:26.231655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:26.238332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:26.238835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:26.239281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:26.240001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:26.240465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:26.240894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:26.383621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:26.391674 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-647436e6-cb18-4241-9da2-2dcd8c5fcf19 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1517 microversion: 2.1 time: 0.165965 Oct 31 15:01:26.392267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3537/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:26 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:26.985437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2491f247-1501-47e0-af6f-6d7c5a7f651a", "tag": "2e5c8259-bc25-4dbc-aca5-a5fc04d066a7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:26.996672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:26.997155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:26.997588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:27.010268 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] Creating event network-changed:2e5c8259-bc25-4dbc-aca5-a5fc04d066a7 for instance 2491f247-1501-47e0-af6f-6d7c5a7f651a on n-h1-863052-1 Oct 31 15:01:27.015880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:01:27.026822 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f8c30562-5816-44fb-adfc-8a7a3004f62a req-386c11b5-4fcb-488c-8362-5e30dc8adb9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045007 Oct 31 15:01:27.027428 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3285/6822] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:27.418039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:27.419559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:27.427998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:27.430262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:27.430262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:27.430262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:27.430577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:27.431070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:27.648119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:27.656013 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff1f65ca-8aa1-4d46-8900-40985b0863cc tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1514 microversion: 2.1 time: 0.243694 Oct 31 15:01:27.656603 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3538/6823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:27 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:27.680019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:27.680653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:27.687434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:27.687929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:27.688368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:27.689070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:27.689561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:27.689984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:27.756557 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d383919d-a11b-4c83-af6c-74a245f8fb87 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "POST /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a/action" status: 204 len: 0 microversion: 2.1 time: 0.080770 Oct 31 15:01:27.760821 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3286/6824] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:01:27 2022] POST /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:27.766520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:27.767411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:27.774743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:27.775239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:27.775707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:27.776420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:27.776925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:27.777368 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:28.006915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:28.015126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-433eef75-64c3-40bf-a45b-6055f14a69aa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1514 microversion: 2.1 time: 0.252669 Oct 31 15:01:28.015760 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3539/6825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:27 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:29.039927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:29.040634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:29.048042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.048544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.048988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.049704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.050188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.050612 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.205797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:29.213746 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99aaac00-28de-4851-a432-1af7b7cdbc4c tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1506 microversion: 2.1 time: 0.178209 Oct 31 15:01:29.214360 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3287/6826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:29 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:29.238161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:29.238888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:29.245996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.246539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.246998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.247712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.248184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.248670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.391437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:29.399942 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-554edd46-12e1-47c0-9f12-fafc9ab9ebf4 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1506 microversion: 2.1 time: 0.166108 Oct 31 15:01:29.400532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3540/6827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:29 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:29.422229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:29.422879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:29.429022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.429516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.429954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.430716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.431175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.431600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.571285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:29.579095 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3cc7d17-da71-4ad3-b183-7199e586664d tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1506 microversion: 2.1 time: 0.160842 Oct 31 15:01:29.579680 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3288/6828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:29 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:29.602245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:29.602769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:29.608965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.609468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.609922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.610668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.611440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.611885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.639163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:01:29.735376 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34ad5641-87e2-4db9-8dc5-12d83daa32ac tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 204 len: 0 microversion: 2.1 time: 0.136496 Oct 31 15:01:29.739890 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3541/6829] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:29 2022] DELETE /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:29.757899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:29.759023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:29.765916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.766724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.767396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.768821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.769422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.770001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.800562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:01:29.856412 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.compute.api [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Instance is already in deleting state, ignoring this request Oct 31 15:01:29.857418 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f151ed07-5f5c-476e-8bae-fae6ba78baae tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 204 len: 0 microversion: 2.1 time: 0.103731 Oct 31 15:01:29.862064 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3289/6830] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:29 2022] DELETE /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:29.868900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:29.870983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:29.879252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.879770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.880777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:29.881696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:29.882204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:29.882641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:30.016184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-415852c7-ac9b-4b8b-b8e4-fc13bce21db1 req-4f2e5f02-1f6e-4b10-9541-0a6ee750cb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2491f247-1501-47e0-af6f-6d7c5a7f651a", "name": "network-vif-plugged", "status": "completed", "tag": "2e5c8259-bc25-4dbc-aca5-a5fc04d066a7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:30.026858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-415852c7-ac9b-4b8b-b8e4-fc13bce21db1 req-4f2e5f02-1f6e-4b10-9541-0a6ee750cb02 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:30.027509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-415852c7-ac9b-4b8b-b8e4-fc13bce21db1 req-4f2e5f02-1f6e-4b10-9541-0a6ee750cb02 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:30.028060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-415852c7-ac9b-4b8b-b8e4-fc13bce21db1 req-4f2e5f02-1f6e-4b10-9541-0a6ee750cb02 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:30.040261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-415852c7-ac9b-4b8b-b8e4-fc13bce21db1 req-4f2e5f02-1f6e-4b10-9541-0a6ee750cb02 service nova] Creating event network-vif-plugged:2e5c8259-bc25-4dbc-aca5-a5fc04d066a7 for instance 2491f247-1501-47e0-af6f-6d7c5a7f651a on n-h1-863052-1 Oct 31 15:01:30.042530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:30.046202 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-415852c7-ac9b-4b8b-b8e4-fc13bce21db1 req-4f2e5f02-1f6e-4b10-9541-0a6ee750cb02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094477 Oct 31 15:01:30.046945 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3290/6831] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:30.055435 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e08a659-c960-4489-8070-d007e32dfc14 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1512 microversion: 2.1 time: 0.191710 Oct 31 15:01:30.056323 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3542/6832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:29 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:31.084963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:31.085331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:31.091945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:31.092459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:31.092902 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:31.093672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:31.094156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:31.094609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:31.356390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228aecd55fe2417e9ba1e01153eb7874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f874291b72d4ead883b2f0cd48f739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:31.366980 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5721ac7d-c992-4eb2-b0b6-0f05147b0d17 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 200 len: 1512 microversion: 2.1 time: 0.287946 Oct 31 15:01:31.367923 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3291/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:31 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:31.642528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e0b4871b-f688-4073-bdba-ea2f07e4fc1a req-109f71ee-01a0-471a-9b01-4974fe444583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2491f247-1501-47e0-af6f-6d7c5a7f651a", "name": "network-vif-deleted", "tag": "2e5c8259-bc25-4dbc-aca5-a5fc04d066a7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:31.653987 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e0b4871b-f688-4073-bdba-ea2f07e4fc1a req-109f71ee-01a0-471a-9b01-4974fe444583 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:31.654624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e0b4871b-f688-4073-bdba-ea2f07e4fc1a req-109f71ee-01a0-471a-9b01-4974fe444583 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:31.655073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e0b4871b-f688-4073-bdba-ea2f07e4fc1a req-109f71ee-01a0-471a-9b01-4974fe444583 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:31.667718 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e0b4871b-f688-4073-bdba-ea2f07e4fc1a req-109f71ee-01a0-471a-9b01-4974fe444583 service nova] Creating event network-vif-deleted:2e5c8259-bc25-4dbc-aca5-a5fc04d066a7 for instance 2491f247-1501-47e0-af6f-6d7c5a7f651a on n-h1-863052-1 Oct 31 15:01:31.672894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e0b4871b-f688-4073-bdba-ea2f07e4fc1a req-109f71ee-01a0-471a-9b01-4974fe444583 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Oct 31 15:01:31.673519 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3543/6834] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:32.391676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:32.392288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: 2491f247-1501-47e0-af6f-6d7c5a7f651a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:32.400053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:32.400556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:32.400973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:32.401670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:32.402121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:32.402572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:32.415884 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] HTTP exception thrown: Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a could not be found. Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Request method failure captured: Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a HTTP/1.1 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-Lr1J75HqdSIb3wrBsRM4FhOwHPKqmbqRJ6SIaTbHAlE5iA3qhtmHL7RfLk36itLFPJd1f0YJ2J2aXcxPJn0mWsoqgd6-Tj7zEcYt4Sudrax7EXmaB56MpMXw958WQ7XxdFH5ABnQJoRc8E9QwL1nGhyhO_WN2U_n54uS-kDh2XLkY Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6f874291b72d4ead883b2f0cd48f739f Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f874291b72d4ead883b2f0cd48f739f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6f874291b72d4ead883b2f0cd48f739f Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerDiskConfigTestJSON-1642738246-project Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 228aecd55fe2417e9ba1e01153eb7874 Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerDiskConfigTestJSON-1642738246-project Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a could not be found. Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '2491f247-1501-47e0-af6f-6d7c5a7f651a'} Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a could not be found. Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a could not be found. Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:32.417513 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a could not be found. Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Returning 404 to user: Instance 2491f247-1501-47e0-af6f-6d7c5a7f651a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0794e42f-9f52-4a13-9293-e774211c06fa tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a" status: 404 len: 111 microversion: 2.1 time: 0.031246 Oct 31 15:01:32.422265 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3292/6835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:32 2022] GET /compute/v2.1/servers/2491f247-1501-47e0-af6f-6d7c5a7f651a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:01:32.428453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c2f700c-59e2-4bc7-a31a-971a7fa58dbb tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '.version_select at 0x7fe1065da700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:32.452625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c2f700c-59e2-4bc7-a31a-971a7fa58dbb tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188719481" status: 202 len: 0 microversion: 2.1 time: 0.028409 Oct 31 15:01:32.453202 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3544/6836] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 31 15:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188719481 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:01:33.067318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:33.067855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:33.073881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:33.074401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:33.074840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:33.075544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:33.075989 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:33.076418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:33.089860 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] HTTP exception thrown: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Request method failure captured: Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 HTTP/1.1 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-Lr1J75HqdSIb3wrBsRM4FhOwHPKqmbqRJ6SIaTbHAlE5iA3qhtmHL7RfLk36itLFPJd1f0YJ2J2aXcxPJn0mWsoqgd6-Tj7zEcYt4Sudrax7EXmaB56MpMXw958WQ7XxdFH5ABnQJoRc8E9QwL1nGhyhO_WN2U_n54uS-kDh2XLkY Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 6f874291b72d4ead883b2f0cd48f739f Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f874291b72d4ead883b2f0cd48f739f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 6f874291b72d4ead883b2f0cd48f739f Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerDiskConfigTestJSON-1642738246-project Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 228aecd55fe2417e9ba1e01153eb7874 Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerDiskConfigTestJSON-1642738246-project Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'df8a5da8-e552-4514-a0d5-85eb93661d30'} Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:01:33.091431 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Returning 404 to user: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-804f36da-aa0d-46db-927e-b36d5ea9e580 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 404 len: 111 microversion: 2.1 time: 0.030288 Oct 31 15:01:33.095384 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3293/6837] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:33 2022] DELETE /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:01:33.102543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:33.103305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] [instance: df8a5da8-e552-4514-a0d5-85eb93661d30] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:33.110088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:33.110626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:33.111841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:33.112549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:33.113022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:33.113467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:33.130137 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] HTTP exception thrown: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Request method failure captured: Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 HTTP/1.1 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-Lr1J75HqdSIb3wrBsRM4FhOwHPKqmbqRJ6SIaTbHAlE5iA3qhtmHL7RfLk36itLFPJd1f0YJ2J2aXcxPJn0mWsoqgd6-Tj7zEcYt4Sudrax7EXmaB56MpMXw958WQ7XxdFH5ABnQJoRc8E9QwL1nGhyhO_WN2U_n54uS-kDh2XLkY Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 6f874291b72d4ead883b2f0cd48f739f Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f874291b72d4ead883b2f0cd48f739f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f874291b72d4ead883b2f0cd48f739f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 6f874291b72d4ead883b2f0cd48f739f Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1642738246 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerDiskConfigTestJSON-1642738246-project Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 228aecd55fe2417e9ba1e01153eb7874 Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerDiskConfigTestJSON-1642738246-project Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'df8a5da8-e552-4514-a0d5-85eb93661d30'} Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:33.131865 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] Returning 404 to user: Instance df8a5da8-e552-4514-a0d5-85eb93661d30 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7529a1fc-b4e3-4f21-afd3-b1274955f8b9 tempest-ServerDiskConfigTestJSON-1642738246 tempest-ServerDiskConfigTestJSON-1642738246-project] 10.222.0.27 "GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30" status: 404 len: 111 microversion: 2.1 time: 0.035669 Oct 31 15:01:33.136430 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3545/6838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:33 2022] GET /compute/v2.1/servers/df8a5da8-e552-4514-a0d5-85eb93661d30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:01:42.243968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f397a1f7-b0fb-49d0-8b4a-ded324707073 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'create', calling method: .version_select at 0x7fe10684a9d0>, body: {"keypair": {"name": "tempest-keypair-1116627112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIRqayY4LpkjOXeCOP6kGxpfT64M+JCSvWt8++JysuLrfSqpBGK0tZMW3spKhFtYSjtETz4Pa2ggy7LLelh+Y3YrvqgjPehFjzIXf2qcGF+aDToMNeE6AkMKvIUXr/kIQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:42.260560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f397a1f7-b0fb-49d0-8b4a-ded324707073 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:01:42.267249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f397a1f7-b0fb-49d0-8b4a-ded324707073 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:01:42.296519 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f397a1f7-b0fb-49d0-8b4a-ded324707073 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181050 Oct 31 15:01:42.297341 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3294/6839] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:01:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:43.625421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-703111423", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56cc6ccd-8a67-4218-9fa7-40b2c084c66b"}], "security_groups": [{"name": "tempest-securitygroup--1643702335"}], "key_name": "tempest-keypair-1116627112", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:43.637141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:43.637425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:43.758741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] validate_networks() for [('56cc6ccd-8a67-4218-9fa7-40b2c084c66b', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:01:44.261676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:01:44.262148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:01:44.262750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:01:44.263205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:01:44.263668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:01:44.273898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:44.274437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:44.274898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.275643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:44.276120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:44.276561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.299212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:01:44.305106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:01:44.319272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:01:44.321700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:01:44.380659 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8309d284-2ec2-4889-acf9-78c411747204 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.759638 Oct 31 15:01:44.381606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3546/6840] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:01:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:01:44.390101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:44.397232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e04f3cb1-e898-4c0f-b7bc-aa918cc58c79 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:44.398160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e04f3cb1-e898-4c0f-b7bc-aa918cc58c79 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:44.400508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:44.464286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e04f3cb1-e898-4c0f-b7bc-aa918cc58c79 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:44.472260 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e04f3cb1-e898-4c0f-b7bc-aa918cc58c79 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1238 microversion: 2.1 time: 0.083178 Oct 31 15:01:44.473131 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3295/6841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:44 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:45.496863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:45.497523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:45.505144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:45.505659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:45.506117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:45.506873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:45.507347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:45.507788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:45.593236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:45.604077 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-abeb846f-0f66-400b-b0a7-43e376a3f50c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1290 microversion: 2.1 time: 0.111922 Oct 31 15:01:45.605617 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3547/6842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:45 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:46.629611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:46.630436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:46.640498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.640992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.641459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.642253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.642713 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.643134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.792606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:46.800694 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2012dcfc-c8bf-4557-aedf-b3f93587c80d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1364 microversion: 2.1 time: 0.175618 Oct 31 15:01:46.801279 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3296/6843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:46 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:47.350134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d06be8fa-6404-41a3-a270-6cf0ac4af416 req-08a27735-1744-47e9-b6be-860e60af3c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:47.362525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d06be8fa-6404-41a3-a270-6cf0ac4af416 req-08a27735-1744-47e9-b6be-860e60af3c81 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.363011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d06be8fa-6404-41a3-a270-6cf0ac4af416 req-08a27735-1744-47e9-b6be-860e60af3c81 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.363452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d06be8fa-6404-41a3-a270-6cf0ac4af416 req-08a27735-1744-47e9-b6be-860e60af3c81 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.378264 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d06be8fa-6404-41a3-a270-6cf0ac4af416 req-08a27735-1744-47e9-b6be-860e60af3c81 service nova] Creating event network-changed:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h2-863052-1 Oct 31 15:01:47.383766 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d06be8fa-6404-41a3-a270-6cf0ac4af416 req-08a27735-1744-47e9-b6be-860e60af3c81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094469 Oct 31 15:01:47.384750 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3548/6844] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:47.823967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:47.824666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:47.832083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.832578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.833022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.833728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.834201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.834634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.971451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:47.979567 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c76cd4fa-2608-4d33-a556-407b66047aa8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1364 microversion: 2.1 time: 0.159414 Oct 31 15:01:47.980111 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3297/6845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:47 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:49.003550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:49.004268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:49.011539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:49.012046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:49.012493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:49.013211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:49.013673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:49.016447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:49.243754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:49.251995 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e51b0a86-7f4a-4504-afc5-5087dccb03dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1364 microversion: 2.1 time: 0.252666 Oct 31 15:01:49.252868 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3549/6846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:48 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:50.276367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:50.277013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:50.284816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.285315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.285760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.286493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.286952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.287380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.427590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:50.437117 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a89cd07b-ca7c-4fb3-94fa-8cf713559d39 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1364 microversion: 2.1 time: 0.164618 Oct 31 15:01:50.437718 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3298/6847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:50 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:51.290976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b3406c76-83a4-4f0c-a7d1-5c4aeb070795 req-ebbb9a44-fa40-4700-a5c9-24c22d280013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "name": "network-vif-plugged", "status": "completed", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:51.309385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b3406c76-83a4-4f0c-a7d1-5c4aeb070795 req-ebbb9a44-fa40-4700-a5c9-24c22d280013 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.310904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b3406c76-83a4-4f0c-a7d1-5c4aeb070795 req-ebbb9a44-fa40-4700-a5c9-24c22d280013 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.310904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b3406c76-83a4-4f0c-a7d1-5c4aeb070795 req-ebbb9a44-fa40-4700-a5c9-24c22d280013 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:51.323857 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b3406c76-83a4-4f0c-a7d1-5c4aeb070795 req-ebbb9a44-fa40-4700-a5c9-24c22d280013 service nova] Creating event network-vif-plugged:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h2-863052-1 Oct 31 15:01:51.329407 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b3406c76-83a4-4f0c-a7d1-5c4aeb070795 req-ebbb9a44-fa40-4700-a5c9-24c22d280013 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044746 Oct 31 15:01:51.330593 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3550/6848] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:51.460198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:51.461065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:51.473451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.474043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.474521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:51.475260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.475714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.476136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:51.617695 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:51.625799 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa155b96-db0c-4267-813e-fb4fc4c242ec tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1364 microversion: 2.1 time: 0.169412 Oct 31 15:01:51.627137 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3299/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:51 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:52.651152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:52.651841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:52.658518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:52.659030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:52.659486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.660202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:52.660671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:52.661111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.800051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:52.808130 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4570d6d7-f29c-42f5-9870-a0961c971ab9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1549 microversion: 2.1 time: 0.162313 Oct 31 15:01:52.808720 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3551/6850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:52 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:52.832169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:52.832701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:52.840031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:52.840524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:52.840966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.841672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:52.842127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:52.842586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.924917 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-34e42792-d243-4522-a549-cd9de0b91799 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097407 Oct 31 15:01:52.925545 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3300/6851] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 15:01:52 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:54.250787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cdc83c46-ca44-4384-b5db-abdd89e387a4 req-02b49666-6254-43dd-af92-82ff8b3242b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:54.261846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cdc83c46-ca44-4384-b5db-abdd89e387a4 req-02b49666-6254-43dd-af92-82ff8b3242b2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.262389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cdc83c46-ca44-4384-b5db-abdd89e387a4 req-02b49666-6254-43dd-af92-82ff8b3242b2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.262834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cdc83c46-ca44-4384-b5db-abdd89e387a4 req-02b49666-6254-43dd-af92-82ff8b3242b2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.275362 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cdc83c46-ca44-4384-b5db-abdd89e387a4 req-02b49666-6254-43dd-af92-82ff8b3242b2 service nova] Creating event network-changed:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h2-863052-1 Oct 31 15:01:54.280651 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cdc83c46-ca44-4384-b5db-abdd89e387a4 req-02b49666-6254-43dd-af92-82ff8b3242b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033406 Oct 31 15:01:54.281277 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3552/6852] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:23.800279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.801284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=13 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.802122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=28 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.807435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:23.808056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:23.816242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:23.816731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:23.817170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:23.817864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:23.818354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:23.818782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:23.949862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:23.957815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ee65573-4107-480a-aefc-43bc3c7f08d8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1668 microversion: 2.1 time: 0.159346 Oct 31 15:02:23.958426 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3301/6853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:23 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:23.978072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.978912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.980950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.981654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=26 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.987411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:23.988138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:23.996203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:23.996708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:23.997164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:23.997884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:23.998382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:23.998826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.139568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.147562 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2028bc15-b481-4db3-8337-48f521dd645b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1668 microversion: 2.1 time: 0.170428 Oct 31 15:02:24.148153 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3553/6854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:23 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:24.169870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:24.170515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:24.179235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.179725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.180165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.180859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.181312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.181737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.316189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.323959 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-60aeacb2-78ef-4227-9a60-72865f3984b0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1668 microversion: 2.1 time: 0.157901 Oct 31 15:02:24.324527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3302/6855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:24 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:24.347351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:24.349646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:24.355658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.356164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.356617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.357321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.357788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.358320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.386746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.392194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:02:24.398668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:02:24.399104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:02:24.399592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:02:24.400016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:02:24.400443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:02:24.461494 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8be16fa0-af43-4d0b-9051-83d6db5d3dcd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e/action" status: 202 len: 0 microversion: 2.1 time: 0.118620 Oct 31 15:02:24.462343 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3554/6856] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:02:24 2022] POST /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:02:24.470734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:24.471452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:24.477614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.477999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.478493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.479247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.479648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.480064 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.635923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.644364 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-651b7288-bddb-4592-b30f-2f91c375acb3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1677 microversion: 2.1 time: 0.177999 Oct 31 15:02:24.644947 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3303/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:24 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:25.670009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:25.670681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:25.678603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.679113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:25.679570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:25.680285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.680776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:25.681207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:25.885810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:25.893659 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d9be617-9a8a-4e36-8d8d-581d32b48e45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1677 microversion: 2.1 time: 0.228608 Oct 31 15:02:25.894453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3555/6858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:25 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:26.918481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:26.919262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:26.926073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.926601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.927042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:26.927776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.928260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.928688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:27.061688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:27.069993 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a39ee738-a3c4-47a0-9e57-97db285464c0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.155684 Oct 31 15:02:27.070642 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3304/6859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:26 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:28.094782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:28.095553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:28.103134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:28.103639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:28.104096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:28.104813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:28.105285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:28.105731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:28.244616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:28.252938 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce4b5dc9-5016-4b49-8257-b622e4299fdc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.162323 Oct 31 15:02:28.253510 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3556/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:28 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:29.277036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:29.277662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:29.284725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:29.285220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:29.285668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:29.286415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:29.286877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:29.287314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:29.421229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:29.429600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1daf92fb-e637-4469-b386-a1a2b3de18e8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.156492 Oct 31 15:02:29.430186 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3305/6861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:29 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:30.452939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:30.454154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:30.461232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.461730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.462200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.462905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.463370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.463805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.597000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:30.605008 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39715b51-cc4c-4e4c-96de-4c4f4029aeba tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.155994 Oct 31 15:02:30.605589 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3557/6862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:30 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:31.629853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:31.630577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:31.637333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:31.637822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:31.638298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:31.638992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:31.639448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:31.639878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:31.769623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:31.777238 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d581bc36-ec82-4e51-a022-c4a33e6c6501 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.151839 Oct 31 15:02:31.777813 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3306/6863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:31 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:32.800133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:32.800769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:32.807841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.808338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.808790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.809491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.809960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.810434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.947241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:32.954978 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9dbf1e5f-cb80-4998-a4ef-d914647a1cb8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.158752 Oct 31 15:02:32.955561 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3558/6864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:32 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:33.978372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:33.978911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:33.986876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:33.987368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:33.987806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:33.988503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:33.988960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:33.989388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:34.116812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:34.124485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a6c2264-3e40-41d3-9f90-5c3ff8596aea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.150115 Oct 31 15:02:34.125111 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3307/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:33 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:35.147912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:35.148549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:35.155606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:35.156746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:35.157246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:35.157943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:35.158437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:35.158875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:35.296163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:35.304014 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5237f99c-cc71-4ca9-b6b4-826911970b75 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.159977 Oct 31 15:02:35.304814 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3559/6866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:35 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:36.326741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:36.327364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:36.334333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:36.334828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:36.335264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:36.335951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:36.336406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:36.336833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:36.470957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:36.478606 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a3645d4-6c6f-45cd-91c2-06d7b80a5bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.155828 Oct 31 15:02:36.479191 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3308/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:36 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:37.502879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:37.503507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:37.510197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:37.510697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:37.511148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:37.511850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:37.512321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:37.512765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:37.641631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:37.649402 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1aebea5-6693-4fae-96d9-bdfbdd4834ae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1682 microversion: 2.1 time: 0.151094 Oct 31 15:02:37.649976 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3560/6868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:37 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:38.568196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:38.579400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:38.579876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:38.580309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:38.591963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] Creating event network-vif-unplugged:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h1-863052-1 Oct 31 15:02:38.597774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:02:38.608554 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-88c9d663-c53d-4182-bb8e-3dcfe8c7230b req-338799b4-6f37-435d-923d-53b0562d4c96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044151 Oct 31 15:02:38.609755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3309/6869] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:38.673448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:38.674216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:38.681165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:38.681636 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:38.682089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:38.682824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:38.683295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:38.683737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:38.818428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:38.826763 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c1151dd-6c00-49f4-a804-959c3ef2816b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1681 microversion: 2.1 time: 0.157968 Oct 31 15:02:38.827351 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3561/6870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:38 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:39.852975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:39.853680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:39.859937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:39.860426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:39.861167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:39.861850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:39.862335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:39.862760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:39.993368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:40.001718 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6154e4a8-6d3d-409d-89ae-c4edbe3e6bae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1679 microversion: 2.1 time: 0.153766 Oct 31 15:02:40.002356 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3310/6871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:39 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:40.646211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:40.656520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:40.657006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:40.657452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:40.668929 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] Creating event network-changed:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h1-863052-1 Oct 31 15:02:40.674339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:02:40.685381 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ab18dda2-64a4-4a92-99d5-d4ffb2313391 req-2afc9006-2368-4959-b91a-767882f9a2e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042915 Oct 31 15:02:40.686005 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3562/6872] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:41.026206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:41.027435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:41.034544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:41.035257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:41.035855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:41.036743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:41.037359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:41.038150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:41.265890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:41.273815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bf3ac7c-4ef3-4404-90c5-b2500d07b466 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1679 microversion: 2.1 time: 0.251386 Oct 31 15:02:41.274420 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3311/6873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:41 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:42.299267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:42.299952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:42.306308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.306751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.307199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.307897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.308355 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.308788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.440086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:42.448228 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a51af0ad-545d-4cf9-b80a-bb7bc5409fd8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1676 microversion: 2.1 time: 0.154678 Oct 31 15:02:42.449003 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3563/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:42 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:42.471321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:42.471953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:42.481068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.481558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.482002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.482726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.483180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.483668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.543084 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f6ecd3a6-bc56-4fdc-8959-9fa1b1dca64f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e/action" status: 204 len: 0 microversion: 2.1 time: 0.076135 Oct 31 15:02:42.543889 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3312/6875] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:02:42 2022] POST /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:02:42.552514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:42.553416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:42.559554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.560091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.560605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.561579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.562058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.562503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.777511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:42.785883 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83e8d337-cafb-4cdf-8293-4d3af16d1ee9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1676 microversion: 2.1 time: 0.237815 Oct 31 15:02:42.786500 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3564/6876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:42 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:43.810397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:43.811096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:43.819456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:43.819943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:43.820384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:43.821075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:43.821524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:43.821944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:43.955304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:43.963159 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e690f8d4-8a25-4698-abde-4a787fbe3883 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1668 microversion: 2.1 time: 0.157569 Oct 31 15:02:43.964254 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3313/6877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:43 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:43.987997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:43.988635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:43.997850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:43.998411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:43.998860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:43.999574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.000047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.000488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.141211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:44.149218 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6fc8310-1571-4077-a36f-296edbe061dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1668 microversion: 2.1 time: 0.166164 Oct 31 15:02:44.149898 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3565/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:43 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:44.172683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:44.173300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:44.179518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.180228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.180669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.181716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.182202 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.182637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.187165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-747d73ed-42b3-487f-bc0c-753a2228c72e req-290adfaf-1838-482f-ba60-495545c1de12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "name": "network-vif-plugged", "status": "completed", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:44.200523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-747d73ed-42b3-487f-bc0c-753a2228c72e req-290adfaf-1838-482f-ba60-495545c1de12 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.200708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-747d73ed-42b3-487f-bc0c-753a2228c72e req-290adfaf-1838-482f-ba60-495545c1de12 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.201129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-747d73ed-42b3-487f-bc0c-753a2228c72e req-290adfaf-1838-482f-ba60-495545c1de12 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.216584 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-747d73ed-42b3-487f-bc0c-753a2228c72e req-290adfaf-1838-482f-ba60-495545c1de12 service nova] Creating event network-vif-plugged:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h1-863052-1 Oct 31 15:02:44.222774 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-747d73ed-42b3-487f-bc0c-753a2228c72e req-290adfaf-1838-482f-ba60-495545c1de12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040248 Oct 31 15:02:44.223391 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3566/6879] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:44.322259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:44.330572 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65839ecd-bf7a-4740-b7bb-beb76b7c50db tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1668 microversion: 2.1 time: 0.161857 Oct 31 15:02:44.331138 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3314/6880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:44 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:44.353927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:44.354562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:44.361178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.361672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.362117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.362832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.363295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.363731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.388692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:02:44.433628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:44.466964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56f49e1d-83e6-4395-9ced-7f2155d62c88 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 204 len: 0 microversion: 2.1 time: 0.116844 Oct 31 15:02:44.467805 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3567/6881] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:02:44 2022] DELETE /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:02:44.476013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:44.476767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:44.482933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.483418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.483884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.484576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:44.485035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:44.485483 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:44.616572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:44.624902 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b4f2239-39ac-4317-9eff-47fef11e474d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1674 microversion: 2.1 time: 0.152450 Oct 31 15:02:44.625484 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3315/6882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:44 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:45.650019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:45.650864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:45.658525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:45.659036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:45.659471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:45.660169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:45.660633 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:45.661068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:45.795922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:45.804065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0aeac87-9ea6-4470-a742-9285d6edc7fd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 200 len: 1674 microversion: 2.1 time: 0.158326 Oct 31 15:02:45.804646 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3568/6883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:45 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:46.571815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-311961f2-8cca-4179-bbfd-6ce478dfe6de req-5a6e4cf8-6867-49c3-9786-721d12697cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e", "name": "network-vif-deleted", "tag": "0b80476d-0b5a-439c-ad96-8d1ef879566e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:46.585462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-311961f2-8cca-4179-bbfd-6ce478dfe6de req-5a6e4cf8-6867-49c3-9786-721d12697cdc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:46.585953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-311961f2-8cca-4179-bbfd-6ce478dfe6de req-5a6e4cf8-6867-49c3-9786-721d12697cdc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:46.586424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-311961f2-8cca-4179-bbfd-6ce478dfe6de req-5a6e4cf8-6867-49c3-9786-721d12697cdc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:46.599906 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-311961f2-8cca-4179-bbfd-6ce478dfe6de req-5a6e4cf8-6867-49c3-9786-721d12697cdc service nova] Creating event network-vif-deleted:0b80476d-0b5a-439c-ad96-8d1ef879566e for instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e on n-h1-863052-1 Oct 31 15:02:46.605815 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-311961f2-8cca-4179-bbfd-6ce478dfe6de req-5a6e4cf8-6867-49c3-9786-721d12697cdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039099 Oct 31 15:02:46.606766 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3316/6884] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:46.828593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:46.829215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:46.836654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:46.837195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:46.837650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:46.838408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:46.838883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:46.839354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:46.854336 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e HTTP/1.1 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e'} Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:46.856515 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0ef291e-452f-4043-a931-aef5be5b331b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 404 len: 111 microversion: 2.1 time: 0.033631 Oct 31 15:02:46.862306 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3569/6885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:46 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:02:46.875150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:46.875858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:46.882684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:46.883173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:46.883607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:46.884313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:46.884760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:46.885182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:46.899628 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e HTTP/1.1 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e'} Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:46.901297 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:46.906434 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1300592e-cf2a-4405-be69-5e3d65c058cb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 404 len: 111 microversion: 2.1 time: 0.032795 Oct 31 15:02:46.907535 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3317/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:46 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:02:46.955684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1273658016", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "56cc6ccd-8a67-4218-9fa7-40b2c084c66b"}], "security_groups": [{"name": "tempest-securitygroup--1643702335"}], "key_name": "tempest-keypair-1116627112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:47.063207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] validate_networks() for [('56cc6ccd-8a67-4218-9fa7-40b2c084c66b', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:02:47.446107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:02:47.446584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:02:47.447081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:02:47.447507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:02:47.447936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:02:47.460757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:47.461344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:47.461855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:47.462690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:47.463221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:47.463724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:47.484100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:02:47.489970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:02:47.504304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:02:47.506841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:02:47.554997 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b341b7cc-14d0-4de1-acb3-bf46601ee1fc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.603315 Oct 31 15:02:47.562445 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3570/6887] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:02:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:02:47.568191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-513bd63b-4158-433d-bcd2-517864e511dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:47.568900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-513bd63b-4158-433d-bcd2-517864e511dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:47.631716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-513bd63b-4158-433d-bcd2-517864e511dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:47.647519 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-513bd63b-4158-433d-bcd2-517864e511dd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1239 microversion: 2.1 time: 0.083596 Oct 31 15:02:47.648123 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3318/6888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:47 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:48.671564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:48.672275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:48.680391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:48.680900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:48.681357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:48.682072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:48.682573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:48.683145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:48.748453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:48.757043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f6519bd-c2f1-403d-8e8c-dde8e8ee7273 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1297 microversion: 2.1 time: 0.089424 Oct 31 15:02:48.757635 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3571/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:48 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:49.781985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:49.782623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:49.789319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:49.789785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:49.790253 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:49.790946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:49.791398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:49.791821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:49.794517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:49.997677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:50.006284 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efde2b8e-60e3-4090-977b-8cb40daa9398 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.228672 Oct 31 15:02:50.007670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3319/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:49 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:50.294662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-656863ba-1e83-455d-886f-ce0b750de086 req-5d927ad1-e58f-4c53-a9a3-4c495dad5ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:50.306072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-656863ba-1e83-455d-886f-ce0b750de086 req-5d927ad1-e58f-4c53-a9a3-4c495dad5ddc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:50.306868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-656863ba-1e83-455d-886f-ce0b750de086 req-5d927ad1-e58f-4c53-a9a3-4c495dad5ddc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:50.307312 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-656863ba-1e83-455d-886f-ce0b750de086 req-5d927ad1-e58f-4c53-a9a3-4c495dad5ddc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:50.320201 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-656863ba-1e83-455d-886f-ce0b750de086 req-5d927ad1-e58f-4c53-a9a3-4c495dad5ddc service nova] Creating event network-changed:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h1-863052-1 Oct 31 15:02:50.325283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-656863ba-1e83-455d-886f-ce0b750de086 req-5d927ad1-e58f-4c53-a9a3-4c495dad5ddc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034313 Oct 31 15:02:50.325892 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3572/6891] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:51.033412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:51.033988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:51.041133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:51.041621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:51.042063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:51.042789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:51.043249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:51.043677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:51.174963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:51.182721 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16d0571e-5a57-4440-a40d-5910647fc5b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.153576 Oct 31 15:02:51.183285 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3320/6892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:51 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:52.207348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:52.208058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:52.214433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:52.214927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:52.215423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:52.216090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:52.216575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:52.217007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:52.350565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:52.358784 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a5f6da3-e5d0-411a-b71b-d724cb18aca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.156608 Oct 31 15:02:52.359356 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3573/6893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:52 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:53.382386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:53.382996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:53.389936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:53.390453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:53.390884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:53.391565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:53.392013 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:53.392433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:53.520875 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:53.528454 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5470fde2-7a6d-4b15-871b-b0869e68f5b6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.150104 Oct 31 15:02:53.529025 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3321/6894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:53 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:54.551933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:54.552563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:54.557857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:54.564750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:54.565251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:54.565699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:54.566502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:54.566965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:54.567399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:54.705718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:54.713408 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e372abb-acaa-448d-a133-eebc8c5e1d70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.165418 Oct 31 15:02:54.714006 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3574/6895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:54 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:55.736803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:55.737423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:55.739559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=45 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:55.744737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:55.745226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:55.745666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:55.746393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:55.746847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:55.747282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:55.879005 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:55.886945 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-23e2d23b-eb45-4e04-8374-5bedb8a11b91 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.154590 Oct 31 15:02:55.887510 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3322/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:55 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:56.259471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-cd212adb-429b-4316-8c01-3a5714c7789c req-86869727-0d1a-41f4-8496-0a452876de92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "name": "network-vif-plugged", "status": "completed", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:56.272738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cd212adb-429b-4316-8c01-3a5714c7789c req-86869727-0d1a-41f4-8496-0a452876de92 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:56.273241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cd212adb-429b-4316-8c01-3a5714c7789c req-86869727-0d1a-41f4-8496-0a452876de92 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:56.273719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-cd212adb-429b-4316-8c01-3a5714c7789c req-86869727-0d1a-41f4-8496-0a452876de92 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:56.285559 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-cd212adb-429b-4316-8c01-3a5714c7789c req-86869727-0d1a-41f4-8496-0a452876de92 service nova] Creating event network-vif-plugged:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h1-863052-1 Oct 31 15:02:56.290632 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-cd212adb-429b-4316-8c01-3a5714c7789c req-86869727-0d1a-41f4-8496-0a452876de92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035015 Oct 31 15:02:56.291249 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3575/6897] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:56.911072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:56.911711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:56.918592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:56.919075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:56.919508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:56.920193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:56.920643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:56.921065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:57.054282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:57.062566 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92f54d13-2777-45a8-9dd4-3933c2cc88e1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1365 microversion: 2.1 time: 0.154688 Oct 31 15:02:57.063139 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3323/6898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:56 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:58.087893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:58.089126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:58.094335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:58.095050 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:58.102328 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:58.102825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:58.103273 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:58.103966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:58.104433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:58.104867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:58.238721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:58.246793 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e45b6f36-13bd-4c0e-8b8e-d90d01b3ecae tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1551 microversion: 2.1 time: 0.162476 Oct 31 15:02:58.247589 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3576/6899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:58 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:58.270799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:58.271383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:58.273701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:58.279733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:58.280223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:58.280658 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:58.281352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:58.281805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:58.282259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:58.359813 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eeef96b7-4165-4db4-b05a-9aab2b0f5977 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092885 Oct 31 15:02:58.360434 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3324/6900] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 15:02:58 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:59.287167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-07e1e87b-32bd-4d51-b375-e6e5f13dee33 req-1e8a6990-ea30-40e5-af0b-67a149515a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:59.298787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-07e1e87b-32bd-4d51-b375-e6e5f13dee33 req-1e8a6990-ea30-40e5-af0b-67a149515a5c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:59.299392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-07e1e87b-32bd-4d51-b375-e6e5f13dee33 req-1e8a6990-ea30-40e5-af0b-67a149515a5c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:59.299845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-07e1e87b-32bd-4d51-b375-e6e5f13dee33 req-1e8a6990-ea30-40e5-af0b-67a149515a5c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:59.326249 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-07e1e87b-32bd-4d51-b375-e6e5f13dee33 req-1e8a6990-ea30-40e5-af0b-67a149515a5c service nova] Creating event network-changed:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h1-863052-1 Oct 31 15:02:59.331729 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-07e1e87b-32bd-4d51-b375-e6e5f13dee33 req-1e8a6990-ea30-40e5-af0b-67a149515a5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048120 Oct 31 15:02:59.332352 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3577/6901] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:03:32.228838 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 31 15:03:32.230663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:32.231480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=33 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:32.236745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-977cf5a7-1e9a-42fd-9f09-4fb9f29ce8b4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:32.244911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-977cf5a7-1e9a-42fd-9f09-4fb9f29ce8b4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:32.245396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-977cf5a7-1e9a-42fd-9f09-4fb9f29ce8b4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:32.245835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-977cf5a7-1e9a-42fd-9f09-4fb9f29ce8b4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:32.270591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-977cf5a7-1e9a-42fd-9f09-4fb9f29ce8b4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:03:32.314258 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-977cf5a7-1e9a-42fd-9f09-4fb9f29ce8b4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action" status: 202 len: 0 microversion: 2.1 time: 0.086447 Oct 31 15:03:32.314901 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3325/6902] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:03:32 2022] POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:03:32.323951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:32.324846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:32.326982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=7 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:32.327715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:32.336729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:32.337258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:32.337707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:32.338473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:32.338936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:32.339377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:32.469903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:32.478065 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2dd7986-5483-408d-8321-35f5e61e6b50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.158759 Oct 31 15:03:32.478676 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3578/6903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:32 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:33.503745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:33.504446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:33.510719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:33.511206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:33.511647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:33.512339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:33.512795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:33.513220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:33.646457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:33.654216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4133bb6a-2880-46bb-9706-6cddf70a4ca1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.155594 Oct 31 15:03:33.654784 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3326/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:33 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:03:34.679170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:34.679706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:34.686667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:34.687154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:34.687596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:34.688294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:34.688755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:34.689185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:34.821002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:34.828898 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c31f4fed-8db1-4722-b9d0-8b9a1e03fb62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.153653 Oct 31 15:03:34.829470 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3579/6905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:34 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:35.853456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:35.854073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:35.861149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:35.861637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:35.862133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:35.862855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:35.863312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:35.863739 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:35.993121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:36.000868 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b075f127-689c-4b8d-b807-4d8d0fba7db4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.151279 Oct 31 15:03:36.001446 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3327/6906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:35 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:37.025094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:37.025623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:37.032506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:37.032997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:37.033444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:37.034141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:37.034696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:37.035133 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:37.167718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:37.175550 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37c7ae13-fe5c-4ff7-96c6-661138c4b604 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.154510 Oct 31 15:03:37.176132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3580/6907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:37 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:38.199449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:38.200061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:38.207336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:38.207824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:38.208263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:38.208948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:38.209397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:38.209816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:38.339163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:38.346832 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2938333-4d03-415b-aece-f9758bcffbd7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.151310 Oct 31 15:03:38.347402 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3328/6908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:38 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:39.370797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:39.371435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:39.378410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:39.378956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:39.379405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:39.380125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:39.380595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:39.381030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:39.512699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:39.520869 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1172c35-1947-4053-a55e-78c834a5a73f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.154252 Oct 31 15:03:39.521468 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3581/6909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:39 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:40.544767 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:40.545370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:40.553289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:40.553867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:40.554460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:40.555242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:40.555771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:40.556310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:40.683859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:40.691578 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30db4205-228c-473f-88c1-2d7050b31893 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.150693 Oct 31 15:03:40.692155 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3329/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:40 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:41.714274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:41.714901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:41.721747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:41.722281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:41.722729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:41.723425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:41.723886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:41.724320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:41.857037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:41.865132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89238e53-47f7-4835-b87a-e3933b463cf7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.154852 Oct 31 15:03:41.865712 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3582/6911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:41 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:42.888601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:42.889285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:42.896852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:42.897343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:42.897794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:42.898523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:42.898980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:42.899410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:43.030091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:43.037794 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bce90bfe-5242-4a54-8c8b-339ca5fc0591 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1657 microversion: 2.1 time: 0.153257 Oct 31 15:03:43.038406 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3330/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:42 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:43.060375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:43.063200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:43.070276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:43.070783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:43.071229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:43.071927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:43.072515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:43.072954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:43.101095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:43.106409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Old instance type m1.heat2, new instance type m1.heat {{(pid=120640) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:03:43.113399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:03:43.113841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:03:43.114380 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:03:43.114812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:03:43.115241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:03:43.177475 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8f754b4-86e0-4cb1-be38-fc8c6b44d5d7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action" status: 202 len: 0 microversion: 2.1 time: 0.120990 Oct 31 15:03:43.178057 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3583/6913] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:03:43 2022] POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:03:43.186031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:43.186669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:43.193389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:43.193876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:43.194372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:43.195089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:43.195543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:43.195962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:43.374307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:43.382545 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-948e2a3f-85a0-4948-a1cb-2f4196feafcf tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.200328 Oct 31 15:03:43.383129 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3331/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:43 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:44.409609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:44.411392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:44.419855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:44.420488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:44.421196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:44.421923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:44.422423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:44.422859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:44.557906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:44.566662 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb1a312f-f242-43a2-8aa4-fa2b1b80f8be tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1680 microversion: 2.1 time: 0.161878 Oct 31 15:03:44.567286 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3584/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:44 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:45.593109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:45.594368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:45.600934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:45.601416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:45.601850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:45.602556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:45.603009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:45.603437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:46.048432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:46.056188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3354b8ba-099e-47dd-80b8-f4e1e05ac315 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1685 microversion: 2.1 time: 0.467062 Oct 31 15:03:46.056758 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3332/6916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:45 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1685 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:47.081621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:47.082295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:47.090274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:47.091185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:47.091821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:47.093120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:47.093680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:47.094579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:47.305276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:47.311548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fffdd0b1-91d5-486d-857c-212eb4ca3bbe tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1684 microversion: 2.1 time: 0.234963 Oct 31 15:03:47.316460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "name": "network-vif-unplugged", "status": "completed", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:47.326643 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3585/6917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:47 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1684 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:47.327829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:47.329110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:47.329539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:47.341677 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] Creating event network-vif-unplugged:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h2-863052-1 Oct 31 15:03:47.347216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] Instance 71668d81-d04a-4ca5-9866-d9207a00e488 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:03:47.358405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d12a482e-bbb5-4b02-91db-1e788a37af02 req-ecbf1152-8d27-4756-9e5c-c70aebdd2031 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046568 Oct 31 15:03:47.359013 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3333/6918] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:48.337340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:48.337952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:48.345276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:48.345782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:48.346249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:48.346966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:48.347429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:48.347863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:48.654590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:48.662276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6d23352-c8e7-4744-8b28-39e4b4c29941 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1684 microversion: 2.1 time: 0.328837 Oct 31 15:03:48.662853 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3586/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:48 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1684 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:49.398267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:49.408716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:49.409198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:49.409637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:49.421392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] Creating event network-changed:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h2-863052-1 Oct 31 15:03:49.428241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] Instance 71668d81-d04a-4ca5-9866-d9207a00e488 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:03:49.440067 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-40b11081-cb12-4caf-b3cf-5fa7cc2b2a0f req-9bc4f90c-5136-4218-9c5e-aa08f51f7094 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046188 Oct 31 15:03:49.440678 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3334/6920] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:49.687476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:49.688109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:49.694967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:49.695465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:49.695907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:49.696614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:49.697076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:49.697510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:49.895253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:49.909563 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01ad8817-f1c0-4946-bef6-62c481087706 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1682 microversion: 2.1 time: 0.225860 Oct 31 15:03:49.911238 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3587/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:49 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:50.936592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:50.937345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:50.945072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:50.945552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:50.945988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:50.946703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:50.947155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:50.947577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:51.092807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:51.101432 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d9aef5e-7092-4d31-a01d-bd3a0cbd1392 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1678 microversion: 2.1 time: 0.169093 Oct 31 15:03:51.102015 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3335/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:50 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:51.126900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:51.127559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:51.135717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:51.136323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:51.136953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:51.137716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:51.138318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:51.138891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:51.201033 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43aad2ef-9b32-48c2-9a3c-5057d900e3ff tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action" status: 204 len: 0 microversion: 2.1 time: 0.078604 Oct 31 15:03:51.201639 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3588/6923] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:03:51 2022] POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:03:51.210075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:51.210717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:51.217208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:51.217704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:51.218139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:51.219409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:51.219874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:51.220298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:51.435593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:51.443316 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26d96177-b893-4887-b714-18080d39b48f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1678 microversion: 2.1 time: 0.237058 Oct 31 15:03:51.443908 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3336/6924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:51 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:52.470554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:52.471479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:52.478828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.479377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.479997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:52.480772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.481272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.481741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:52.630149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:52.638034 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20837ff1-ca57-46c8-b204-afa5316e3449 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1657 microversion: 2.1 time: 0.173763 Oct 31 15:03:52.638635 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3589/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:52 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:52.662277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:52.662970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:52.669803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.670399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.670771 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:52.671466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.672512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.672938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:52.802306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:52.810280 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02010208-9755-4ccb-9204-5c48373e12d4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1657 microversion: 2.1 time: 0.151866 Oct 31 15:03:52.810850 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3337/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:52 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:52.832530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee47cb6c-16d7-4fc7-bfa1-d58917d2fccd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:52.838737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee47cb6c-16d7-4fc7-bfa1-d58917d2fccd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.839238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee47cb6c-16d7-4fc7-bfa1-d58917d2fccd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.839690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee47cb6c-16d7-4fc7-bfa1-d58917d2fccd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:52.863522 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee47cb6c-16d7-4fc7-bfa1-d58917d2fccd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:03:52.908348 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee47cb6c-16d7-4fc7-bfa1-d58917d2fccd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action" status: 202 len: 0 microversion: 2.1 time: 0.079545 Oct 31 15:03:52.909151 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3590/6927] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:03:52 2022] POST /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:03:52.918880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:52.919936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:52.926864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.927538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.928132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:52.929000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:52.929468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:52.930070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:53.068323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:53.079473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-61bc31fe-4a3b-4aa2-8186-905e72d507a4 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1666 microversion: 2.1 time: 0.165212 Oct 31 15:03:53.080204 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3338/6928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:52 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:53.914963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-19ab3632-da92-4985-b75d-d286f2056ed9 req-f8065423-b6aa-446a-b52a-3688806725bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "name": "network-vif-plugged", "status": "completed", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:53.930485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-19ab3632-da92-4985-b75d-d286f2056ed9 req-f8065423-b6aa-446a-b52a-3688806725bb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:53.931042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-19ab3632-da92-4985-b75d-d286f2056ed9 req-f8065423-b6aa-446a-b52a-3688806725bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:53.931539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-19ab3632-da92-4985-b75d-d286f2056ed9 req-f8065423-b6aa-446a-b52a-3688806725bb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:53.938060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:53.948720 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-19ab3632-da92-4985-b75d-d286f2056ed9 req-f8065423-b6aa-446a-b52a-3688806725bb service nova] Creating event network-vif-plugged:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h2-863052-1 Oct 31 15:03:53.954043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-19ab3632-da92-4985-b75d-d286f2056ed9 req-f8065423-b6aa-446a-b52a-3688806725bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046176 Oct 31 15:03:53.954961 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3591/6929] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:54.106593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:54.107212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:54.115220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:54.115747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:54.116187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:54.116893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:54.117349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:54.117781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:54.255095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:54.262927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ebf1b72-bdae-4a85-a51c-c3d88ce3da70 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1670 microversion: 2.1 time: 0.160211 Oct 31 15:03:54.263505 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3339/6930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:54 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:54.287433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:54.288033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:54.294616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:54.295114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:54.295561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:54.296261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:54.297437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:54.297877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:54.323483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:03:54.399197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a24d7a58-e2ae-4bcc-9758-cf62d52b7012 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 204 len: 0 microversion: 2.1 time: 0.116589 Oct 31 15:03:54.399710 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3592/6931] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:03:54 2022] DELETE /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:03:54.409599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:54.410256 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:54.416443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:54.416931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:54.417374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:54.418080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:54.418568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:54.418998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:54.549689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:54.558433 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4980fa5b-1ca5-4bea-9757-9358f056724f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1676 microversion: 2.1 time: 0.153441 Oct 31 15:03:54.559168 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3340/6932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:54 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:55.583800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:55.584432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:55.590836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:55.591332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:55.591777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:55.592471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:55.592932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:55.593370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:55.849345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:55.857490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5352819e-e538-4177-9092-52aede36ae19 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 200 len: 1676 microversion: 2.1 time: 0.278301 Oct 31 15:03:55.858191 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3593/6933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:55 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:56.587295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0d08cdec-c737-4f22-b8bc-6ba4fbee068c req-da3e9051-7ba3-44e9-aec7-0605c8d6ea6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71668d81-d04a-4ca5-9866-d9207a00e488", "name": "network-vif-deleted", "tag": "eca1c106-0be9-4248-87c2-8efaadfbc80e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:56.602142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d08cdec-c737-4f22-b8bc-6ba4fbee068c req-da3e9051-7ba3-44e9-aec7-0605c8d6ea6e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:56.602687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d08cdec-c737-4f22-b8bc-6ba4fbee068c req-da3e9051-7ba3-44e9-aec7-0605c8d6ea6e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:56.603121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0d08cdec-c737-4f22-b8bc-6ba4fbee068c req-da3e9051-7ba3-44e9-aec7-0605c8d6ea6e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:56.607842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:56.619599 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0d08cdec-c737-4f22-b8bc-6ba4fbee068c req-da3e9051-7ba3-44e9-aec7-0605c8d6ea6e service nova] Creating event network-vif-deleted:eca1c106-0be9-4248-87c2-8efaadfbc80e for instance 71668d81-d04a-4ca5-9866-d9207a00e488 on n-h2-863052-1 Oct 31 15:03:56.626347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0d08cdec-c737-4f22-b8bc-6ba4fbee068c req-da3e9051-7ba3-44e9-aec7-0605c8d6ea6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042959 Oct 31 15:03:56.627656 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3341/6934] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:03:56.889225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:56.889809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:56.897044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:56.897546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:56.898002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:56.898803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:56.899215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:56.899654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:56.913288 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 HTTP/1.1 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '71668d81-d04a-4ca5-9866-d9207a00e488'} Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:56.915018 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a58d86a-75eb-4b7f-8fa3-bf06b351b40a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 404 len: 111 microversion: 2.1 time: 0.031351 Oct 31 15:03:56.923956 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3594/6935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:56 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:56.933436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:56.934142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:56.943229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:56.943758 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:56.944203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:56.944914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:56.945370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:56.945794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:56.959706 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 HTTP/1.1 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '71668d81-d04a-4ca5-9866-d9207a00e488'} Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:56.961364 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1af2167f-2c3e-4ecc-9278-9c3214f33f0b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 404 len: 111 microversion: 2.1 time: 0.033608 Oct 31 15:03:56.965438 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3342/6936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:56 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:57.013846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1154240549", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "56cc6ccd-8a67-4218-9fa7-40b2c084c66b"}], "security_groups": [{"name": "tempest-securitygroup--1643702335"}], "key_name": "tempest-keypair-1116627112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:57.130741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] validate_networks() for [('56cc6ccd-8a67-4218-9fa7-40b2c084c66b', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:03:57.524390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:03:57.524898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:03:57.525453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:03:57.525951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:03:57.526463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:03:57.536242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:57.536831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:57.537370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:57.538451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:57.538790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:57.539291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:57.557298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:03:57.563155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:03:57.580340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:03:57.583364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:03:57.644924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a74b99e-1033-432d-8460-fb16fb3affea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.634813 Oct 31 15:03:57.645983 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3595/6937] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:03:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:03:57.660401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58b6fa22-2686-40a8-9737-efaa674c018a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:57.661039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58b6fa22-2686-40a8-9737-efaa674c018a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:57.726505 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-58b6fa22-2686-40a8-9737-efaa674c018a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:57.740188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58b6fa22-2686-40a8-9737-efaa674c018a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1239 microversion: 2.1 time: 0.084610 Oct 31 15:03:57.741097 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3343/6938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:57 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:03:58.776333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:58.777110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:58.787011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:58.787660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:58.788338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:58.789459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:58.790112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:58.790725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:58.855179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:58.863917 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3b690b2-26c4-4d65-9820-60e7a0ef973c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1297 microversion: 2.1 time: 0.092596 Oct 31 15:03:58.864687 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3596/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:58 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:59.891734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:59.892556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:59.900319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:59.900943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:59.901500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:59.902536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:59.903225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:59.903787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:00.110468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:00.118851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c139a201-b495-43f9-a4cd-6a2eaa0c5944 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1365 microversion: 2.1 time: 0.232105 Oct 31 15:04:00.119438 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3344/6940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:59 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:00.201644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9ad1e25e-d9f2-4c4b-b220-12d61c8afce0 req-c87cc216-e0d6-4e16-a293-f4f3adde1e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:00.214815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ad1e25e-d9f2-4c4b-b220-12d61c8afce0 req-c87cc216-e0d6-4e16-a293-f4f3adde1e4f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:00.215572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ad1e25e-d9f2-4c4b-b220-12d61c8afce0 req-c87cc216-e0d6-4e16-a293-f4f3adde1e4f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:00.216019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ad1e25e-d9f2-4c4b-b220-12d61c8afce0 req-c87cc216-e0d6-4e16-a293-f4f3adde1e4f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:00.231208 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9ad1e25e-d9f2-4c4b-b220-12d61c8afce0 req-c87cc216-e0d6-4e16-a293-f4f3adde1e4f service nova] Creating event network-changed:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:04:00.237344 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9ad1e25e-d9f2-4c4b-b220-12d61c8afce0 req-c87cc216-e0d6-4e16-a293-f4f3adde1e4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039429 Oct 31 15:04:00.238153 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3597/6941] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:01.146621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:01.147710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:01.157072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:01.157604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:01.158096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:01.158925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:01.159426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:01.159892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:01.311983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:01.320094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3b7af78-32fa-4258-9c58-68f0d3ff7683 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1365 microversion: 2.1 time: 0.180933 Oct 31 15:04:01.320669 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3345/6942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:01 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:02.345545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:02.346320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:02.349165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:02.354679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:02.355225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:02.355623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:02.356326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:02.356791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:02.357224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:02.510249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:02.518907 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-915a656c-43cc-4583-84c0-528a782336d5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1365 microversion: 2.1 time: 0.178261 Oct 31 15:04:02.519489 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3598/6943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:02 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:03.542987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:03.543595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:03.547039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=45 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:03.552459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:03.552942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:03.553378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:03.554061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:03.554539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:03.554970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:03.686184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:03.694486 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ec15766-f414-40bb-ada1-5a48d7b7fe29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1365 microversion: 2.1 time: 0.155437 Oct 31 15:04:03.695067 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3346/6944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:03 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:04.646449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-65e095c9-30ec-4baa-9d4c-2c02936e4299 req-50bf6be3-b116-4efb-acd8-e2716c8551eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "name": "network-vif-plugged", "status": "completed", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:04.658950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-65e095c9-30ec-4baa-9d4c-2c02936e4299 req-50bf6be3-b116-4efb-acd8-e2716c8551eb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:04.659451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-65e095c9-30ec-4baa-9d4c-2c02936e4299 req-50bf6be3-b116-4efb-acd8-e2716c8551eb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:04.659898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-65e095c9-30ec-4baa-9d4c-2c02936e4299 req-50bf6be3-b116-4efb-acd8-e2716c8551eb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:04.672709 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-65e095c9-30ec-4baa-9d4c-2c02936e4299 req-50bf6be3-b116-4efb-acd8-e2716c8551eb service nova] Creating event network-vif-plugged:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:04:04.677796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-65e095c9-30ec-4baa-9d4c-2c02936e4299 req-50bf6be3-b116-4efb-acd8-e2716c8551eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Oct 31 15:04:04.678532 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3599/6945] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:04.719353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:04.720145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:04.727831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:04.728488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:04.728973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:04.729756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:04.730295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:04.730793 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:04.908091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:04.915869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cfbe482b-9c36-4f02-9b31-c6e0848c39e5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1365 microversion: 2.1 time: 0.202152 Oct 31 15:04:04.916477 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3347/6946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:04 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:05.944744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:05.945622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:05.953656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:05.954347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:05.954805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:05.955525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:05.955995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:05.956438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:06.093936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:06.101874 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a09cc5c2-8099-46a8-9eea-75e0ca22919d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1550 microversion: 2.1 time: 0.162054 Oct 31 15:04:06.102563 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3600/6947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:05 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:06.125593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:06.126108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:06.132874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:06.133379 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:06.133832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:06.134545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:06.135001 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:06.135423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:06.211925 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e9e3a36-fd98-49cb-97fd-28ad04493bc6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090585 Oct 31 15:04:06.212565 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3348/6948] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 15:04:06 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:07.475707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3849c9f1-d7d2-44f9-99e6-9e08b49980b7 req-6e26eb58-817e-45ed-9e2c-87692dae6585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:07.487221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3849c9f1-d7d2-44f9-99e6-9e08b49980b7 req-6e26eb58-817e-45ed-9e2c-87692dae6585 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:07.487824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3849c9f1-d7d2-44f9-99e6-9e08b49980b7 req-6e26eb58-817e-45ed-9e2c-87692dae6585 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:07.488362 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3849c9f1-d7d2-44f9-99e6-9e08b49980b7 req-6e26eb58-817e-45ed-9e2c-87692dae6585 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:07.503553 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3849c9f1-d7d2-44f9-99e6-9e08b49980b7 req-6e26eb58-817e-45ed-9e2c-87692dae6585 service nova] Creating event network-changed:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:04:07.508860 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3849c9f1-d7d2-44f9-99e6-9e08b49980b7 req-6e26eb58-817e-45ed-9e2c-87692dae6585 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037684 Oct 31 15:04:07.509627 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3601/6949] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:37.700580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.701945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.702608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=30 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.706586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:37.708831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:37.716262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:37.716756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:37.717201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:37.717895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:37.718385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:37.718817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:37.793316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:37.799466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Old instance type m1.heat2, new instance type m1.heat {{(pid=120641) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:04:37.806501 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:04:37.806928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:04:37.807406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:04:37.807819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:04:37.808233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:04:37.920191 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba43d1d0-4b7b-4844-935d-ec4a676a7a35 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd/action" status: 202 len: 0 microversion: 2.1 time: 0.221264 Oct 31 15:04:37.920807 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3349/6950] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:04:37 2022] POST /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:04:37.926849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.928446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.930958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=7 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.931934 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:37.939177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:37.940047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:37.948649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:37.949164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:37.949641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:37.950414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:37.950954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:37.951920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:38.098529 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:04:38.098728 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd (ip 10.222.0.27) !!! Oct 31 15:04:38.105224 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:38.119645 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8b56975-beea-4e1c-aaed-3ec5d53e2027 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1678 microversion: 2.1 time: 0.194028 Oct 31 15:04:38.120365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3602/6951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:37 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:39.149611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:39.150251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:39.157588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:39.158070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:39.158540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:39.159396 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:39.159781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:39.160180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:39.298711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:39.307176 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ef0ab65-df01-4376-8bef-c7b49fbef4ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1678 microversion: 2.1 time: 0.162090 Oct 31 15:04:39.307751 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3350/6952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:39 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:40.331978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:40.332645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:40.340282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:40.340781 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:40.341239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:40.342592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:40.343077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:40.343525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:40.480720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:40.488889 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0fe134c-bc2e-43b3-bb23-10687b3e8aaa tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.161055 Oct 31 15:04:40.489471 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3603/6953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:40 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:41.512392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:41.513093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:41.520094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:41.520595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:41.521052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:41.521766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:41.522254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:41.522686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:41.660502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:41.668388 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01c2e898-b46a-4bf8-a118-2832f3793598 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.159894 Oct 31 15:04:41.669014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3351/6954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:41 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:42.692858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:42.693393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:42.700261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:42.700761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:42.701209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:42.701907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:42.702399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:42.702858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:42.837223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:42.846190 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bd6e8bd-5240-41b8-bd09-790fa2227717 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.157378 Oct 31 15:04:42.846914 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3604/6955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:42 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:43.871856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:43.872460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:43.879618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:43.880444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:43.880897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:43.881601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:43.882083 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:43.882732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:44.018725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:44.026666 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d80cfeef-6a37-4a04-81ae-68cf33f4c930 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.158674 Oct 31 15:04:44.027246 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3352/6956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:43 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:45.051908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:45.052538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:45.059504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:45.060014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:45.061102 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:45.061817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:45.062385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:45.062827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:45.200070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:45.207971 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-555269ab-04f4-4359-99bc-fbf8cc18144f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.160090 Oct 31 15:04:45.208544 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3605/6957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:45 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:46.232539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:46.233077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:46.240307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:46.240796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:46.241237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:46.241932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:46.242429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:46.242859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:46.377852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:46.385999 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a62fa45b-7344-498d-a66a-02eb9b67f851 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.157407 Oct 31 15:04:46.386625 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3353/6958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:46 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:47.411220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:47.411876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:47.418919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:47.419422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:47.420402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:47.421106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:47.421572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:47.422009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:47.567621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:47.575603 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2aa537e8-a090-4a6a-b985-c1f71ebc742a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.168497 Oct 31 15:04:47.576189 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3606/6959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:47 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:48.599972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:48.600543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:48.608035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:48.608525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:48.608970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:48.609670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:48.610127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:48.610849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:48.740359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:48.748862 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f1078260-97ae-427a-888e-f6b4eeab1b74 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.152822 Oct 31 15:04:48.749443 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3354/6960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:48 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:49.774556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:49.774556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:49.781060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:49.781564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:49.782017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:49.782765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:49.783236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:49.783678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:49.933107 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:49.942471 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ee789d8-f049-4920-a68d-5785b0e42578 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.173362 Oct 31 15:04:49.943133 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3607/6961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:49 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:50.966090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:50.966659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:50.973827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:50.974367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:50.974834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:50.975529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:50.975982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:50.976407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:51.115448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:51.123331 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46479020-d2a2-4902-8801-941c4ccbab38 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1683 microversion: 2.1 time: 0.161176 Oct 31 15:04:51.123907 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3355/6962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:50 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:52.147770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:52.148566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:52.155508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:52.156001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:52.156570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:52.157148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:52.157638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:52.158072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:52.385498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:52.395361 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed9e78b7-3212-4af2-8168-779874567638 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1682 microversion: 2.1 time: 0.251872 Oct 31 15:04:52.395962 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3608/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:52 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:52.436526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "name": "network-vif-unplugged", "status": "completed", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:52.449234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:52.449888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:52.451127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:52.464178 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] Creating event network-vif-unplugged:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h2-863052-1 Oct 31 15:04:52.470354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] Instance ee55f720-05d1-4591-b642-523c0b47fecd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:04:52.482863 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c20447ab-e8e3-4b0a-b6aa-26225646f029 req-47f119cc-780f-436c-aa1b-9954f4e37082 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051869 Oct 31 15:04:52.483546 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3356/6964] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:04:53.421540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:53.422347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:53.429962 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:53.430593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:53.431053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:53.431776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:53.432252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:53.432698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:53.631129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:53.639417 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d57ffef4-6e67-4088-a728-fd50dae3f2a3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1682 microversion: 2.1 time: 0.222359 Oct 31 15:04:53.640004 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3609/6965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:53 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:54.516576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:54.527106 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:54.527590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:54.528023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:54.542445 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] Creating event network-changed:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h2-863052-1 Oct 31 15:04:54.549014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] Instance ee55f720-05d1-4591-b642-523c0b47fecd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:04:54.559694 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ec265779-a764-472c-9923-c1602095a0ca req-33f23761-2d15-4e2a-9bea-43a457f85441 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047199 Oct 31 15:04:54.560940 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3357/6966] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:54.665155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:54.665891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:54.672896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:54.673400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:54.674040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:54.674802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:54.675275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:54.675713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:54.911643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:54.927606 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92ad7a92-cea5-4cfc-996c-5c30420a7643 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1680 microversion: 2.1 time: 0.266222 Oct 31 15:04:54.942232 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3610/6967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:54 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:55.954744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:55.955609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:55.961846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:55.962373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:55.962811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:55.963496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:55.963944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:55.964372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.101948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:56.111133 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a9306da-9044-45a1-887d-55d733b18bab tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1677 microversion: 2.1 time: 0.162164 Oct 31 15:04:56.111734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3358/6968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:55 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:56.136001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:56.136655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:56.143794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:56.144388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:56.144912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.145710 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:56.146276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:56.146786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.187419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:56.188044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:56.188500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.189250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:56.189727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:56.190192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.211412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:04:56.216786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:04:56.338777 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dd7f90d-aee5-4e33-a51d-9b396a070371 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd/action" status: 202 len: 0 microversion: 2.1 time: 0.206602 Oct 31 15:04:56.339405 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3611/6969] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:04:56 2022] POST /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:04:56.348271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:56.348892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:56.355840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:56.356752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:56.358024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.358843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:56.359275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:56.359866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:56.508701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:56.519119 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52323ae9-780f-4ee9-b3c3-4c3ea85fed58 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1676 microversion: 2.1 time: 0.174723 Oct 31 15:04:56.520129 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3359/6970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:56 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:57.551141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:57.551851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:57.558994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:57.559432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:57.560485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:57.561200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:57.561664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:57.562101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:57.693846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:57.701719 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c47775a-d106-41ce-a8ff-9a550e24a791 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1676 microversion: 2.1 time: 0.155916 Oct 31 15:04:57.702320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3612/6971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:57 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:58.440626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "name": "network-vif-plugged", "status": "completed", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:58.457705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:58.458592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:58.459376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:58.483227 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] Creating event network-vif-plugged:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h2-863052-1 Oct 31 15:04:58.493535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] Instance ee55f720-05d1-4591-b642-523c0b47fecd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:04:58.514538 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-43f1733a-a347-4286-a8d7-8bc4acac6ac9 req-d7140517-4dd6-4989-af0a-933a08e5f711 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080613 Oct 31 15:04:58.515623 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3360/6972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:58.725755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:58.727142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:58.738073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:58.739346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:58.739816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:58.740550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:58.741019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:58.741468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:58.896091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:58.904022 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-677dbab7-c943-4df4-aa70-ca062a55b9eb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1676 microversion: 2.1 time: 0.182390 Oct 31 15:04:58.904607 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3613/6973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:58 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:59.408718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "name": "network-vif-unplugged", "status": "completed", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:59.419082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:59.419652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:59.420085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:59.432850 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] Creating event network-vif-unplugged:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:04:59.438824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] Instance ee55f720-05d1-4591-b642-523c0b47fecd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:04:59.449693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b97dae2b-4bd6-4da6-8897-1cc1bc00b5ee req-2971a051-4cb3-421d-bc9d-3ba086c5adb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045395 Oct 31 15:04:59.451229 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3361/6974] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:59.928941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:59.929663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:59.939782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:59.940542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:59.940923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:59.941642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:59.942187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:59.943037 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:00.126573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:00.134668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-766c2851-b4b1-46d8-b11d-2447ac525a13 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1676 microversion: 2.1 time: 0.210119 Oct 31 15:05:00.135252 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3614/6975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:59 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:05:01.162417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:01.163155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:01.171418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:01.171911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:01.172352 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:01.173051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:01.173506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:01.173934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:01.319606 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:01.327964 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a01d7f18-9a85-44f1-a70e-14cbb9ab6dd3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1676 microversion: 2.1 time: 0.171435 Oct 31 15:05:01.328530 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3362/6976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:01 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:01.467058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:01.477841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:01.478454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:01.478911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:01.493356 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] Creating event network-changed:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:05:01.496635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:01.502031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] Instance ee55f720-05d1-4591-b642-523c0b47fecd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:05:01.514363 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3179fff9-8736-4287-9164-dcba87b47667 req-63cc539e-1073-47a1-8581-dff3f97ba51f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052726 Oct 31 15:05:01.515015 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3615/6977] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:02.357868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:02.358760 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:02.366562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.367068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.367515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.368231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.368690 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.369120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.509657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:02.517800 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-270c90e2-f897-4ce6-ba07-56ac633c8b45 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1669 microversion: 2.1 time: 0.167423 Oct 31 15:05:02.518537 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3363/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:02 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:02.542377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:02.543100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:02.550406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.550914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.551369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.552079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.552562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.552998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.685342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:02.693205 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb0b0d68-886f-4f50-bbd3-45cdae37589f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1669 microversion: 2.1 time: 0.156024 Oct 31 15:05:02.693781 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3616/6979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:02 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:02.716637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:02.717287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:02.723260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.723744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.724176 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.725015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.725474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.725892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.860782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:02.868960 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac04f324-c510-4c47-912d-fe24f1f87eed tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1669 microversion: 2.1 time: 0.156711 Oct 31 15:05:02.869691 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3364/6980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:02 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:02.891975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:02.892608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:02.898774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.899275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.899717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.900430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:02.900894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:02.901504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:02.928213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:05:03.030986 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-938cd453-798e-45b6-b991-618ac971d809 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 204 len: 0 microversion: 2.1 time: 0.141279 Oct 31 15:05:03.032347 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3617/6981] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:05:02 2022] DELETE /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:05:03.041571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:03.042204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:03.048251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:03.048900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:03.049339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:03.050027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:03.050510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:03.050933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:03.070070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:03.195306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:03.203869 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-097ff851-d299-4126-b012-f96430108394 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1675 microversion: 2.1 time: 0.166210 Oct 31 15:05:03.204496 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3365/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:03 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:04.228679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:04.229411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:04.237069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:04.237567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:04.238023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:04.238758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:04.239221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:04.239667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:04.385796 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:04.395944 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5450bdd-d425-47f2-86c3-9b061d6b9462 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1675 microversion: 2.1 time: 0.171603 Oct 31 15:05:04.396539 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3618/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:04 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:04.956853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8446ab2f-ce06-4b92-b0c4-bcdaaa6fbaa4 req-13ec3422-7269-4134-8447-f65f46e2d749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "name": "network-vif-plugged", "status": "completed", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:04.970719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8446ab2f-ce06-4b92-b0c4-bcdaaa6fbaa4 req-13ec3422-7269-4134-8447-f65f46e2d749 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:04.971520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8446ab2f-ce06-4b92-b0c4-bcdaaa6fbaa4 req-13ec3422-7269-4134-8447-f65f46e2d749 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:04.972068 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8446ab2f-ce06-4b92-b0c4-bcdaaa6fbaa4 req-13ec3422-7269-4134-8447-f65f46e2d749 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:05.250541 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8446ab2f-ce06-4b92-b0c4-bcdaaa6fbaa4 req-13ec3422-7269-4134-8447-f65f46e2d749 service nova] Creating event network-vif-plugged:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:05:05.256556 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8446ab2f-ce06-4b92-b0c4-bcdaaa6fbaa4 req-13ec3422-7269-4134-8447-f65f46e2d749 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302838 Oct 31 15:05:05.257755 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3366/6984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:05.421545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:05.422430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:05.436325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:05.436840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:05.437327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:05.438161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:05.438670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:05.439116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:05.525915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:05.534716 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30dfbebd-636d-47dd-aeeb-cd59004bebe5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 200 len: 1607 microversion: 2.1 time: 0.118346 Oct 31 15:05:05.535316 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3619/6985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:05 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 1607 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:05.553832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-55699607-8148-4d9b-a2df-5422b8ad9f2e req-68216ea3-3b5c-40d9-95e8-2770b66664de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee55f720-05d1-4591-b642-523c0b47fecd", "name": "network-vif-deleted", "tag": "b2bd3409-a98f-4cb2-b728-6f0a15b8ca59"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:05.568022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-55699607-8148-4d9b-a2df-5422b8ad9f2e req-68216ea3-3b5c-40d9-95e8-2770b66664de service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:05.568525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-55699607-8148-4d9b-a2df-5422b8ad9f2e req-68216ea3-3b5c-40d9-95e8-2770b66664de service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:05.568956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-55699607-8148-4d9b-a2df-5422b8ad9f2e req-68216ea3-3b5c-40d9-95e8-2770b66664de service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:05.591838 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-55699607-8148-4d9b-a2df-5422b8ad9f2e req-68216ea3-3b5c-40d9-95e8-2770b66664de service nova] Creating event network-vif-deleted:b2bd3409-a98f-4cb2-b728-6f0a15b8ca59 for instance ee55f720-05d1-4591-b642-523c0b47fecd on n-h1-863052-1 Oct 31 15:05:05.602992 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-55699607-8148-4d9b-a2df-5422b8ad9f2e req-68216ea3-3b5c-40d9-95e8-2770b66664de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053545 Oct 31 15:05:05.604076 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3367/6986] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:05:06.563973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:06.564709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:06.567191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:06.577003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:06.577242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:06.577881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:06.578773 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:06.579243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:06.579687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:06.597233 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd HTTP/1.1 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ee55f720-05d1-4591-b642-523c0b47fecd'} Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:06.599227 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:05:06.603947 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20dfb43a-1768-405a-bafc-e77d0a37ba29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 404 len: 111 microversion: 2.1 time: 0.040828 Oct 31 15:05:06.605057 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3620/6987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:06 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:05:06.617709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:06.618408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:06.625777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:06.626296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:06.626879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:06.627631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:06.628088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:06.628513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:06.642508 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd HTTP/1.1 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'ee55f720-05d1-4591-b642-523c0b47fecd'} Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:06.644126 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7be3f9f6-8fdf-4dc4-956f-03bc25bd0516 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 404 len: 111 microversion: 2.1 time: 0.032636 Oct 31 15:05:06.648670 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3368/6988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:06 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:05:06.703481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-124377722", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "56cc6ccd-8a67-4218-9fa7-40b2c084c66b"}], "security_groups": [{"name": "tempest-securitygroup--1643702335"}], "key_name": "tempest-keypair-1116627112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:06.815139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] validate_networks() for [('56cc6ccd-8a67-4218-9fa7-40b2c084c66b', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:05:07.195521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:05:07.195960 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:05:07.196471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:05:07.196892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:05:07.197311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:05:07.207401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:07.207925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:07.208371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:07.209103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:07.209567 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:07.210001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:07.226850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:05:07.233018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:05:07.246113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:05:07.248992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:05:07.296458 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9de28729-7a39-4169-a156-5df3a8f7d388 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.597161 Oct 31 15:05:07.297121 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3621/6989] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:05:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:05:07.308757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a83fddbd-e207-4068-8e6b-735ee55a9937 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:07.309374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a83fddbd-e207-4068-8e6b-735ee55a9937 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:07.365384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a83fddbd-e207-4068-8e6b-735ee55a9937 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:07.374316 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a83fddbd-e207-4068-8e6b-735ee55a9937 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1238 microversion: 2.1 time: 0.069323 Oct 31 15:05:07.374898 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3369/6990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:07 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:05:08.397115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:08.398708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:08.401596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:08.407894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:08.408415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:08.408874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:08.409810 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:08.410321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:08.410765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:08.493718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:08.504357 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1ac8ca4-97bb-45ed-bdaf-0f44a7dfc8d3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1298 microversion: 2.1 time: 0.110960 Oct 31 15:05:08.518495 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3622/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:08 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:09.529318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:09.529910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:09.532922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=49 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:09.538527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:09.539020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:09.539463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:09.540168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:09.540623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:09.541055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:09.678978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:09.687739 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3cdc92f-0579-48be-8690-7a149091b4b1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1364 microversion: 2.1 time: 0.162402 Oct 31 15:05:09.688325 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3370/6992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:09 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:09.920004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2483f254-6ab0-4987-8748-8b946a6974f6 req-ea2fbae3-f6e7-41f8-a297-ef1a4aae5d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:09.931199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2483f254-6ab0-4987-8748-8b946a6974f6 req-ea2fbae3-f6e7-41f8-a297-ef1a4aae5d6d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:09.931798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2483f254-6ab0-4987-8748-8b946a6974f6 req-ea2fbae3-f6e7-41f8-a297-ef1a4aae5d6d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:09.932608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2483f254-6ab0-4987-8748-8b946a6974f6 req-ea2fbae3-f6e7-41f8-a297-ef1a4aae5d6d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:09.945811 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2483f254-6ab0-4987-8748-8b946a6974f6 req-ea2fbae3-f6e7-41f8-a297-ef1a4aae5d6d service nova] Creating event network-changed:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:05:09.951670 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2483f254-6ab0-4987-8748-8b946a6974f6 req-ea2fbae3-f6e7-41f8-a297-ef1a4aae5d6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Oct 31 15:05:09.952275 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3623/6993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:10.713826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:10.714465 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:10.721949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:10.722472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:10.722915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:10.723608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:10.724067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:10.724492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:10.865422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:10.873329 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fc77431a-07f9-41b3-ad1f-cc6a901f794d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1364 microversion: 2.1 time: 0.163430 Oct 31 15:05:10.873936 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3371/6994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:10 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:11.898548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:11.899260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:11.905594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:11.906097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:11.906570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:11.907266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:11.907751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:11.908271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:12.042039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:12.050606 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca776397-2860-4633-95c7-0dc3fe67f393 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1364 microversion: 2.1 time: 0.157143 Oct 31 15:05:12.051171 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3624/6995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:11 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:13.074915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:13.076120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:13.079146 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:05:13.079337 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 (ip 10.222.0.27) !!! Oct 31 15:05:13.085926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:13.086446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:13.086889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:13.087595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:13.088051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:13.088478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:13.220289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:13.228261 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-736c77b4-bf67-422b-98cb-a012cd068a6c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1364 microversion: 2.1 time: 0.157231 Oct 31 15:05:13.228838 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3372/6996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:13 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:14.252837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:14.253495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:14.260770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:14.261282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:14.261743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:14.263029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:14.263509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:14.263956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:14.296471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-861c9574-f8b1-46d3-9e7a-1873f2e9e0f4 req-ed384b57-b534-4bcb-8b17-9337575297e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "name": "network-vif-plugged", "status": "completed", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:14.315228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-861c9574-f8b1-46d3-9e7a-1873f2e9e0f4 req-ed384b57-b534-4bcb-8b17-9337575297e2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:14.316097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-861c9574-f8b1-46d3-9e7a-1873f2e9e0f4 req-ed384b57-b534-4bcb-8b17-9337575297e2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:14.316656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-861c9574-f8b1-46d3-9e7a-1873f2e9e0f4 req-ed384b57-b534-4bcb-8b17-9337575297e2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:14.329845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-861c9574-f8b1-46d3-9e7a-1873f2e9e0f4 req-ed384b57-b534-4bcb-8b17-9337575297e2 service nova] Creating event network-vif-plugged:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:05:14.335480 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-861c9574-f8b1-46d3-9e7a-1873f2e9e0f4 req-ed384b57-b534-4bcb-8b17-9337575297e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042613 Oct 31 15:05:14.336398 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3373/6997] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:14.419976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:14.428049 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad4b5dd8-4172-497e-a88c-5a40981d511b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1364 microversion: 2.1 time: 0.179143 Oct 31 15:05:14.428830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3625/6998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:14 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:15.453167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:15.453871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:15.461136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:15.461630 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:15.462076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:15.462810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:15.463273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:15.463726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:15.613213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:15.621059 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed5f6f7f-ce7e-46d0-a8b5-fa391914ca16 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1364 microversion: 2.1 time: 0.172766 Oct 31 15:05:15.621651 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3374/6999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:15 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:16.647131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:16.647864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:16.656033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:16.656776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:16.657425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:16.662109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:16.662109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:16.662109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:16.797493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:16.806508 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88562216-b86b-4c76-bf5d-eca7569b68a5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1550 microversion: 2.1 time: 0.164166 Oct 31 15:05:16.807087 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3626/7000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:16 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:16.830824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:16.831409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:16.838085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:16.838593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:16.839026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:16.839708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:16.840182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:16.840575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:16.925476 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8b31699a-0941-44bc-aef1-3b58cf06a4bc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098182 Oct 31 15:05:16.926284 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3375/7001] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 31 15:05:16 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:17.899544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-652ef302-2722-4f41-a557-308adccbe53e req-828413f7-4f6f-4c00-9ba7-b62617c044c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:17.905201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:17.905894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:17.913360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-652ef302-2722-4f41-a557-308adccbe53e req-828413f7-4f6f-4c00-9ba7-b62617c044c6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:17.913857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-652ef302-2722-4f41-a557-308adccbe53e req-828413f7-4f6f-4c00-9ba7-b62617c044c6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:17.914338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-652ef302-2722-4f41-a557-308adccbe53e req-828413f7-4f6f-4c00-9ba7-b62617c044c6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:17.928226 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-652ef302-2722-4f41-a557-308adccbe53e req-828413f7-4f6f-4c00-9ba7-b62617c044c6 service nova] Creating event network-changed:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:05:17.933131 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-652ef302-2722-4f41-a557-308adccbe53e req-828413f7-4f6f-4c00-9ba7-b62617c044c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Oct 31 15:05:17.934388 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3627/7002] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:52.215151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.217707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=11 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.218431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.223417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:52.224038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:52.231510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.231942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.232405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.233137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.233594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.234026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.428077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:52.435837 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-432b224e-ce68-47c5-b784-0eb1287bd0c2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1669 microversion: 2.1 time: 0.221630 Oct 31 15:05:52.436400 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3376/7003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:52 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1669 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:52.456948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=11 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.457758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.462247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93d89a0c-d43b-4a24-b8be-9000ec3ee6f9"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:52.464691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:52.472485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.472991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.473473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.474198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.474688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.475123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.910663 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b045b75-9d06-45d4-9370-4dba6b20d7a7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455170 Oct 31 15:05:52.916802 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3628/7004] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 15:05:52 2022] POST /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:06:03.667458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:03.669715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:03.672080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.672733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.678225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:03.678714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:03.679168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:03.679844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:03.680290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:03.680710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:03.709851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:03.715510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Old instance type m1.heat2, new instance type m1.heat {{(pid=120641) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:06:03.722582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:06:03.722997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:06:03.723463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:06:03.723865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:06:03.724271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:06:03.790500 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7fba6fd8-8665-4f40-ae02-bea5d2be1c3b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/action" status: 202 len: 0 microversion: 2.1 time: 0.126900 Oct 31 15:06:03.791118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3377/7005] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:06:03 2022] POST /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:06:03.797638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.798499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.803088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:03.804503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:03.811699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:03.812190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:03.812647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:03.813373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:03.813848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:03.814342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:03.979842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:03.990084 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b23c7c00-e966-4282-b5fb-7734fc8c5b62 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1724 microversion: 2.1 time: 0.194299 Oct 31 15:06:03.991008 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3629/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:03 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:05.026446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:05.026969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:05.034042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:05.034569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:05.035136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:05.035829 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:05.036288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:05.036764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:05.173356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:05.182610 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-668d473e-be9b-4292-a620-15c0ad260fda tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1724 microversion: 2.1 time: 0.161216 Oct 31 15:06:05.183340 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3378/7007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:05 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:06.207425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:06.208094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:06.215077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:06.215570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:06.216021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:06.216755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:06.217193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:06.217628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:06.354863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:06.363533 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6090d30-5d6f-45e9-bc0b-a236c41a6ea3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.160097 Oct 31 15:06:06.364108 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3630/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:06 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:07.386935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:07.387558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:07.394403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:07.394895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:07.395335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:07.396030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:07.396487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:07.396915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:07.530683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:07.539802 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8165e186-4f57-46ec-9ffd-2c1c7f47f05a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.156756 Oct 31 15:06:07.540465 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3379/7009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:07 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:08.564249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:08.564802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:08.571408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:08.571905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:08.572353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:08.573053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:08.573515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:08.573949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:08.704637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:08.713556 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96212fbd-a1c8-4e6b-b4b2-a1e967dfdc29 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.153335 Oct 31 15:06:08.714193 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3631/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:08 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:09.739035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:09.739666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:09.746450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:09.746938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:09.747372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:09.748067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:09.748516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:09.748938 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:09.883958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:09.892496 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d598dd5b-8918-4d2b-9908-81148faef4f5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.158421 Oct 31 15:06:09.893088 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3380/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:09 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:10.915874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:10.916505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:10.925076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:10.925639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:10.926042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:10.926787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:10.927259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:10.927701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:11.064168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:11.073214 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1b2b805-57f9-48d2-b0d1-f0c94501714f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.161340 Oct 31 15:06:11.073804 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3632/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:10 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:12.097338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:12.097958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:12.104936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:12.105429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:12.105877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:12.106619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:12.107086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:12.107518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:12.248751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:12.257208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4df8cbef-67c8-4b8a-b8ef-3b5e18710be7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.164311 Oct 31 15:06:12.257792 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3381/7013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:12 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:13.281551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:13.282110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:13.289241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:13.289761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:13.290321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:13.291068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:13.291544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:13.291981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:13.432198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:13.440589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3afa65f4-67b8-4b43-a254-d14f42471c31 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.163482 Oct 31 15:06:13.441270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3633/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:13 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:14.464338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:14.464983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:14.472440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:14.473009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:14.473401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:14.474081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:14.474569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:14.474999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:14.605925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:14.614392 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d705a4c3-6bda-4c82-b8af-e55bf8378674 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.153968 Oct 31 15:06:14.614986 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3382/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:14 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:15.638431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:15.639059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:15.646678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:15.647173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:15.647667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:15.648316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:15.648779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:15.649217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:15.783612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:15.792325 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d893f6f-d74e-4c36-ade9-00d809f176ac tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.157857 Oct 31 15:06:15.792910 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3634/7016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:15 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:16.815687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:16.816350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:16.823229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:16.823718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:16.824159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:16.824853 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:16.825311 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:16.825744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:16.952911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:16.961136 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70e5f7bd-dff1-416b-b653-5df8035c679d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.150078 Oct 31 15:06:16.961705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3383/7017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:16 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:17.984605 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:17.985531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:17.992845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:17.993360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:17.993821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:17.994577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:17.995054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:17.995506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:18.132752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:18.142724 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ff22ec0-06e5-4ec2-9813-88f2631c3d2d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.162052 Oct 31 15:06:18.143947 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3635/7018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:17 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:19.167592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:19.168239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:19.175339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:19.175831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:19.176277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:19.176980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:19.177456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:19.177872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:19.311113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:19.319642 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c2e861cd-ada5-40b2-98fb-410b7d3bebf1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.156218 Oct 31 15:06:19.320397 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3384/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:19 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:20.344409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:20.345038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:20.352160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:20.352655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:20.353100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:20.353798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:20.354291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:20.354726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:20.488056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:20.496450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f0443c4-71a3-4e7c-8474-23ded72d72bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.156083 Oct 31 15:06:20.497038 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3636/7020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:20 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:21.520656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:21.521274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:21.528149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:21.528639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:21.529079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:21.529777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:21.530259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:21.530688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:21.659736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:21.668734 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1568e0e-251b-499a-818b-8fbe1179cb1f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.151963 Oct 31 15:06:21.669310 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3385/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:21 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:22.692716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:22.693325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:22.700255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:22.700745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:22.701190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:22.701882 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:22.702436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:22.702928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:22.839235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:22.849066 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0483ae91-dbf1-4b03-a9e1-7b48c13bf3ea tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.160325 Oct 31 15:06:22.849659 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3637/7022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:22 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:23.873273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:23.873800 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:23.885104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:23.885865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:23.886399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:23.887179 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:23.887704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:23.888406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:24.031233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:24.040837 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a15f975-7ff0-49a2-ba11-27939059bc9c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1729 microversion: 2.1 time: 0.171563 Oct 31 15:06:24.044060 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3386/7023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:23 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:25.065759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:25.066543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:25.073095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:25.073602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:25.074615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:25.075085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:25.075262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:25.075704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:25.234650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "name": "network-vif-unplugged", "status": "completed", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:25.249567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:25.250354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:25.251105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:25.266159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:25.280211 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd46a9f8-a049-4bdf-ad82-c108dae96a20 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1728 microversion: 2.1 time: 0.219015 Oct 31 15:06:25.281125 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3638/7024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:25 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:25.281263 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] Creating event network-vif-unplugged:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h1-863052-1 Oct 31 15:06:25.303487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:06:25.317978 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-2e380ac8-0577-41d8-a6e1-c62ccce1a2ad req-9b38a8a4-3f3f-4357-b250-7735ea36f2cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158629 Oct 31 15:06:25.318632 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3387/7025] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:26.305253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:26.305967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:26.312938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:26.313438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:26.313888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:26.315754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:26.316219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:26.316659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:26.455115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:26.464159 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77e345cd-5974-490c-a8b2-bf98e9a07334 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.162771 Oct 31 15:06:26.464737 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3639/7026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:26 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:27.349899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:27.359839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:27.360580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:27.361020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:27.373928 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] Creating event network-changed:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h1-863052-1 Oct 31 15:06:27.380278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:06:27.393706 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e88cc5fc-4406-45ad-b051-6508a16f2c55 req-85b20bf9-c108-4f67-9b43-2c1643bcf1b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049066 Oct 31 15:06:27.394592 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3388/7027] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:27.489106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:27.489738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:27.497922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:27.498450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:27.498902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:27.499686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:27.500156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:27.500596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:27.725378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:27.737258 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5f4c31d-784c-4552-b3e9-45e4c2ffb125 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.252252 Oct 31 15:06:27.738007 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3640/7028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:27 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:28.763082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:28.763784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:28.770655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:28.771149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:28.771588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:28.772282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:28.772737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:28.773154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:28.916446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:28.925791 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e24f02ae-78a5-4c45-8c7f-dd39146f8f51 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.167760 Oct 31 15:06:28.926417 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3389/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:28 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:29.951052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:29.951876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:29.960500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:29.961369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:29.961853 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:29.962749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:29.963227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:29.963670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:30.123947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:30.135339 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cf6a9f0-a862-46c7-a02e-65ff21cd5549 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.187932 Oct 31 15:06:30.136345 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3641/7030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:29 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:31.160174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:31.160832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:31.167843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:31.168334 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:31.168778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:31.169486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:31.169949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:31.170403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:31.318911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:31.327304 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-111730d7-b53d-4dc4-9602-6c44eee38c5f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.171052 Oct 31 15:06:31.327908 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3390/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:31 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:32.351899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:32.352551 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:32.359445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:32.359948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:32.360658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:32.361367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:32.362526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:32.362979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:32.493212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:32.501446 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dffb115-abf0-4ea7-be4f-03e1d0175ec3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.153556 Oct 31 15:06:32.502132 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3642/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:32 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:33.525186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:33.525804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:33.532708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:33.533196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:33.534342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:33.535035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:33.535489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:33.535914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:33.663652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:33.672165 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-476e2daf-c838-4d66-85b7-6adfd070a541 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.150924 Oct 31 15:06:33.672738 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3391/7033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:33 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:34.696917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:34.697472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:34.700200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=29 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:34.706542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:34.707041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:34.707490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:34.708189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:34.708652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:34.709085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:34.711782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=85 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:34.842621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:34.851412 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1787f94e-2853-4ae4-b19a-af0ccb954c0f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.158569 Oct 31 15:06:34.851984 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3643/7034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:34 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:35.875190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:35.875802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:35.879272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=35 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:35.884842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:35.885321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:35.885754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:35.886477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:35.886927 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:35.887604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:35.890579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:36.022348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:36.030579 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9395b5bd-a901-49af-9db3-9984043e1217 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.159292 Oct 31 15:06:36.031149 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3392/7035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:35 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:37.054707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:37.055349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:37.066801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:37.067323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:37.067789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:37.068544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:37.069027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:37.069481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:37.214832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:37.223834 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86d30d76-dc16-494b-8187-71e90083826a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1726 microversion: 2.1 time: 0.173101 Oct 31 15:06:37.224403 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3644/7036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:37 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:38.248209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:38.248848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:38.255686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.256169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.256602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.257285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.257734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.258154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.392274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:38.400405 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9f047fa-dcd3-4b2f-9e4d-66ba5eb8599f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1723 microversion: 2.1 time: 0.156171 Oct 31 15:06:38.400978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3393/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:38 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:38.424384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:38.424930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:38.431531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.432036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.432493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.433220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.433686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.434130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.474793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.475285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.475740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.476482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.476955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.477397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.497992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:06:38.503317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Getting quotas for user b01406785b6d4937885d661c03511cae and project 515081eee70948cb95a7636bd181833f. Resources: {'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:06:38.604320 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e3c21cb2-c401-4f83-a27d-105811a46e9f tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "POST /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/action" status: 202 len: 0 microversion: 2.1 time: 0.184213 Oct 31 15:06:38.605013 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3645/7038] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:06:38 2022] POST /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:06:38.614226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:38.614885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:38.620895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.621428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.621889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.622567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:38.623074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:38.623587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:38.815787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:38.824365 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-811cfa1a-8835-4361-8003-69d2bb26e747 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.214900 Oct 31 15:06:38.825162 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3394/7039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:38 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:39.850394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:39.851149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:39.857361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:39.857880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:39.858374 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:39.859088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:39.859564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:39.860268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:39.995483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:40.003914 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73c9bea4-4076-4769-8b41-54fe33607102 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.158895 Oct 31 15:06:40.004496 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3646/7040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:39 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:41.028076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:41.028687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:41.036136 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:41.036621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:41.037066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:41.037788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:41.038270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:41.038698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:41.172234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:41.181693 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37cdd93f-837a-48dc-a695-dbef06e7bf50 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.157502 Oct 31 15:06:41.182322 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3395/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:41 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:41.407376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "name": "network-vif-plugged", "status": "completed", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:41.418905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:41.419449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:41.419912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:41.432920 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] Creating event network-vif-plugged:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h1-863052-1 Oct 31 15:06:41.438663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:06:41.450725 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c831bda2-f43d-48ff-99bd-df4ec150a719 req-f27183c0-9aaf-45f4-93e9-2fde648c4863 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111543 Oct 31 15:06:41.451374 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3647/7042] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:42.252122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:42.252745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:42.258731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:42.259223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:42.259666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:42.260362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:42.260818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:42.261244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:42.393934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:42.402403 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa7982ab-bda5-472c-9ea2-ac39c8bd8aa0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.201308 Oct 31 15:06:42.402978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3396/7043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:42 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:43.428047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:43.428817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:43.435245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:43.435751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:43.436202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:43.436908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:43.437379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:43.437823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:43.571297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:43.579698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0da39c4-8404-4d11-951c-bc2825d90ead tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.157410 Oct 31 15:06:43.580280 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3648/7044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:43 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:44.024898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "name": "network-vif-unplugged", "status": "completed", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:44.037511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:44.038039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:44.038512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:44.051019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] Creating event network-vif-unplugged:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:06:44.056351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:06:44.068660 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-efe7c29c-44b6-4ad0-a764-858eff939677 req-2ed8069b-2d39-43d7-ab41-0b77652f4396 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048059 Oct 31 15:06:44.069269 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3397/7045] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:44.604486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:44.605140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:44.612778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:44.613283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:44.613738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:44.614476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:44.614945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:44.615384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:44.825557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:44.834056 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-220ffc48-3bbe-43d6-ae54-ec40ad41e668 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.233582 Oct 31 15:06:44.834673 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3649/7046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:44 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:45.857651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:45.858394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:45.865716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:45.866240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:45.866688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:45.867383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:45.867841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:45.868270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:46.005012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:46.013444 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1302d309-f8c2-4c4f-b0a9-ef4228346f8d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.160116 Oct 31 15:06:46.014026 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3398/7047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:45 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:46.101986 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:46.113125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:46.113621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:46.114069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:46.125829 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] Creating event network-changed:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:06:46.131815 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:06:46.142528 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-015e7edf-f465-4748-a1dc-8ea27538f8c6 req-28bfe75d-a619-40f7-b438-f16d3e6544e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044189 Oct 31 15:06:46.143142 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3650/7048] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:47.037113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:47.037834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:47.044858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.045345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.045784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.046605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.047059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.047486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.183678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:47.192151 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b816477a-8475-43d0-880a-9dbf3b500ca8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.159097 Oct 31 15:06:47.192730 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3399/7049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:47 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:48.218486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:48.219199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:48.225559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:48.226054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:48.226532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:48.227238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:48.227698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:48.228129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:48.361665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:48.369927 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e97d646-34f3-496c-b40a-4685f67430f7 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.156989 Oct 31 15:06:48.370526 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3651/7050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:48 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:49.395877 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:49.396495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:49.403516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:49.404008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:49.404449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.405153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:49.405609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:49.406032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.537486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:49.546449 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca5e49a5-05c8-4030-b3e8-1857df022e23 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.155217 Oct 31 15:06:49.547055 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3400/7051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:49 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:50.570426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:50.570978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:50.573029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:50.579190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.580190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.580666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.581364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.581830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.582294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.718725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:50.727589 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a797459-1fe4-4c9b-baef-51ce44f59c6a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.161208 Oct 31 15:06:50.728166 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3652/7052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:50 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:51.752190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:51.752815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:51.759570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.760053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.760494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.761175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.761626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.762046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.898092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:51.906381 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa39dbe0-3efe-4385-a312-ac585409257d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.158608 Oct 31 15:06:51.906975 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3401/7053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:51 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:52.931302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:52.931925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:52.939113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:52.939603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:52.940053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:52.940745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:52.941208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:52.941641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:53.074730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:53.083798 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a3cf567-b23c-4763-a97d-99b835c6cfd9 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.156394 Oct 31 15:06:53.084408 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3653/7054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:52 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:54.107772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:54.108386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:54.116095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.116574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.117028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.117823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.118211 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.118636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.248762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:54.257063 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-158d9d1a-ae7d-42bd-8a55-92e8d0320af0 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.153398 Oct 31 15:06:54.257626 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3402/7055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:54 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:55.281017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:55.281669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:55.288442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.288937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.289381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.290082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.290573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.291006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.422370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:55.431218 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8074d5d-e8aa-49c4-8c91-c3ab77f6b84c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.154139 Oct 31 15:06:55.431792 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3654/7056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:55 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:56.456029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:56.456851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:56.464255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:56.464759 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:56.465206 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:56.465935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:56.466429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:56.466860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:56.615376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:56.631456 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-057d53cc-c1e2-47ca-ab34-aaafaa042346 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1722 microversion: 2.1 time: 0.179436 Oct 31 15:06:56.632720 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3403/7057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:56 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:57.665051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:57.665697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:57.673945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.674524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.674977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.675717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.676192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.676632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.814081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:57.822840 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-729e1fbc-8aff-4c29-8128-8ad53f197ebd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1715 microversion: 2.1 time: 0.161776 Oct 31 15:06:57.823491 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3655/7058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:57 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:57.846044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:57.846691 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:57.853626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.854157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.854626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.855408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.855892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.856321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.994591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:58.003380 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2bdfa9eb-7c7f-4527-acd6-ee2028279567 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1715 microversion: 2.1 time: 0.161666 Oct 31 15:06:58.003997 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3404/7059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:57 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:58.026945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:58.027580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:58.034500 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.035066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.035516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.036226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.036689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.037125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.170465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:58.179645 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee898a97-4092-4c3e-bdb0-55e47fe1d4b8 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1715 microversion: 2.1 time: 0.156668 Oct 31 15:06:58.180158 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3656/7060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:58 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:58.203209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:58.203706 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:58.209832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.210359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.210798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.211489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.211939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.212363 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.237940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:06:58.318915 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0178a952-b9a9-4296-a2f1-d853262c25cc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 204 len: 0 microversion: 2.1 time: 0.119276 Oct 31 15:06:58.319487 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3405/7061] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:06:58 2022] DELETE /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:06:58.328338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:58.328972 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:58.335818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.336394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.336843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.337554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.338017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.338483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.354854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:58.478692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:58.487414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d72f8b7b-1343-4a04-a1e9-2be3437fb798 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1721 microversion: 2.1 time: 0.163167 Oct 31 15:06:58.487999 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3657/7062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:58 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:58.758388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ea4072d2-9df7-4b43-b750-cad2d449235e req-f19d0e26-db81-4fa6-b046-b109597a48fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "name": "network-vif-plugged", "status": "completed", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:58.769239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ea4072d2-9df7-4b43-b750-cad2d449235e req-f19d0e26-db81-4fa6-b046-b109597a48fa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.770261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ea4072d2-9df7-4b43-b750-cad2d449235e req-f19d0e26-db81-4fa6-b046-b109597a48fa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.770261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ea4072d2-9df7-4b43-b750-cad2d449235e req-f19d0e26-db81-4fa6-b046-b109597a48fa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.785408 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ea4072d2-9df7-4b43-b750-cad2d449235e req-f19d0e26-db81-4fa6-b046-b109597a48fa service nova] Creating event network-vif-plugged:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:06:58.794052 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ea4072d2-9df7-4b43-b750-cad2d449235e req-f19d0e26-db81-4fa6-b046-b109597a48fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037870 Oct 31 15:06:58.794052 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3406/7063] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:59.512247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:59.512888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:59.520529 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.521030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.521483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.522225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.522697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.523136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.662481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:59.670769 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a801156-6203-4a02-939c-43b9f5dd74b5 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1721 microversion: 2.1 time: 0.162562 Oct 31 15:06:59.671360 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3658/7064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:59 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:00.694984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:00.695639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:00.705787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.708383 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.709067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.709998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.710508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.710953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.762350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-16e50270-add7-4660-af4c-a705768c77db req-df72ebc2-ed92-49b5-9ee5-b1b459ebf4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3", "name": "network-vif-deleted", "tag": "0aa3180e-022f-41bd-9fbc-8b4689c376d6"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:00.775472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-16e50270-add7-4660-af4c-a705768c77db req-df72ebc2-ed92-49b5-9ee5-b1b459ebf4c6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.776459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-16e50270-add7-4660-af4c-a705768c77db req-df72ebc2-ed92-49b5-9ee5-b1b459ebf4c6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.777123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-16e50270-add7-4660-af4c-a705768c77db req-df72ebc2-ed92-49b5-9ee5-b1b459ebf4c6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.789598 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-16e50270-add7-4660-af4c-a705768c77db req-df72ebc2-ed92-49b5-9ee5-b1b459ebf4c6 service nova] Creating event network-vif-deleted:0aa3180e-022f-41bd-9fbc-8b4689c376d6 for instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 on n-h2-863052-1 Oct 31 15:07:00.792736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:00.796096 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-16e50270-add7-4660-af4c-a705768c77db req-df72ebc2-ed92-49b5-9ee5-b1b459ebf4c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117978 Oct 31 15:07:00.797362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3407/7065] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:00.803513 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c91f7e1-a6ac-4892-9aa4-b0d35064f83a tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1369 microversion: 2.1 time: 0.112664 Oct 31 15:07:00.804359 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3659/7066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:00 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:01.828905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:01.830075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:01.836294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.836785 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.837227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.838012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.838534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.838965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.904539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:01.906909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:01.915516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f163d3ae-003a-4bf2-8cc3-1f6318fa85a6 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1369 microversion: 2.1 time: 0.091913 Oct 31 15:07:01.916098 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3408/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:01 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:02.942416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:02.943423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:02.953988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.954531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.954990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.955717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.956191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.956662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.033457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:03.042633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad738183-6c91-4cd9-b8d3-6d343724d2a2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1369 microversion: 2.1 time: 0.106295 Oct 31 15:07:03.043239 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3660/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:02 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:04.067220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:04.067906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:04.079608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.080114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.080561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.081285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.081751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.082195 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.152815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01406785b6d4937885d661c03511cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515081eee70948cb95a7636bd181833f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:04.169140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-562c1d29-9e69-49bd-84a6-726ecd0c886d tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 200 len: 1369 microversion: 2.1 time: 0.104993 Oct 31 15:07:04.174506 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3409/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:04 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:05.193442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:05.194098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:05.197128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:05.202822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.203397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.203907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.204658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.205195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.205688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.220827 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 HTTP/1.1 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3'} Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:05.222612 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:05.227011 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e06b4cc-fb7d-4d61-932d-d9884cf59aa3 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 404 len: 111 microversion: 2.1 time: 0.034988 Oct 31 15:07:05.227805 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3661/7070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:05 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:05.289194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:05.292032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:05.299639 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.300129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.300684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.301385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.301831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.302280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.315259 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-volume_attachments HTTP/1.1 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': 'b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3'} Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:05.316949 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9ea6e64-540c-40c2-9bbf-06fdb36c1bce tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033409 Oct 31 15:07:05.321090 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3410/7071] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:07:05 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.644821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.645390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.652514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.653106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.653472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.654435 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.654906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.655344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.670313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 HTTP/1.1 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3'} Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.671895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83080d75-0f93-4a1b-936b-4dac224ac1dc tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 404 len: 111 microversion: 2.1 time: 0.033185 Oct 31 15:07:08.676463 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3662/7072] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:08 2022] DELETE /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.682137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.682774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.685735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:08.691034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.691525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.691961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.692869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.693326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.693751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.709828 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 HTTP/1.1 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3'} Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.711554 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1beaf413-cd40-4b95-8b7c-bb953617478c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3" status: 404 len: 111 microversion: 2.1 time: 0.034705 Oct 31 15:07:08.715991 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3411/7073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/b2f4d5b2-4a61-40f6-abfb-e7aef0bbb5e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.722581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.723119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.729542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.730063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.730561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.731299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.731774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.732226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.747795 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd HTTP/1.1 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'ee55f720-05d1-4591-b642-523c0b47fecd'} Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.749425 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6874b2d-f655-4ea9-88a7-9ebc4870f9c1 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 404 len: 111 microversion: 2.1 time: 0.032988 Oct 31 15:07:08.753799 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3663/7074] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:08 2022] DELETE /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.759925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.760557 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: ee55f720-05d1-4591-b642-523c0b47fecd] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.767425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.767960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.768454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.769242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.769763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.770232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.785868 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd HTTP/1.1 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'ee55f720-05d1-4591-b642-523c0b47fecd'} Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.787493 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance ee55f720-05d1-4591-b642-523c0b47fecd could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f2fa9ba-0246-4d13-a286-3e31955386bb tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd" status: 404 len: 111 microversion: 2.1 time: 0.032982 Oct 31 15:07:08.791856 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3412/7075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/ee55f720-05d1-4591-b642-523c0b47fecd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.797831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.798722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.805065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.805576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.806068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.806901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.807377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.807823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.822317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 HTTP/1.1 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '71668d81-d04a-4ca5-9866-d9207a00e488'} Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.823920 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b4a43fe-cb30-469e-bb93-74184020e02c tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 404 len: 111 microversion: 2.1 time: 0.031615 Oct 31 15:07:08.838895 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3664/7076] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:08 2022] DELETE /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.840619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.840619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 71668d81-d04a-4ca5-9866-d9207a00e488] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.848647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.849231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.849940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.850649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.851108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.851553 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.866701 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 HTTP/1.1 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '71668d81-d04a-4ca5-9866-d9207a00e488'} Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.868474 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 71668d81-d04a-4ca5-9866-d9207a00e488 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6fb88d88-2e06-47f2-aae4-7428fd11c3e2 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488" status: 404 len: 111 microversion: 2.1 time: 0.038335 Oct 31 15:07:08.876912 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3413/7077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/71668d81-d04a-4ca5-9866-d9207a00e488 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.879237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.879753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.885786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.886323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.886756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.887463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.888126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.888568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.903023 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e HTTP/1.1 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e'} Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.904632 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81da480c-0ff0-41ca-86a4-1e582c3637bd tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 404 len: 111 microversion: 2.1 time: 0.031305 Oct 31 15:07:08.908481 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3665/7078] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:08 2022] DELETE /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:07:08.914666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.915283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] [instance: 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.921678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.922225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.922662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.923357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.923808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.924230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.938689 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] HTTP exception thrown: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Request method failure captured: Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e HTTP/1.1 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-NWrdv7pPnGwKE8XL2fa9sZGwU1YCRPu2X6SfODLEBE48fb4D0yX5QSQf8lcJynPf0jfqqQq4xoDxj4KH2ieAh59s4f5bK66vUkZyiyekxojAgVNRxjEh77IVZWxiZ7wNegqrnxiomwVoqIvWIXbckl8Jco_KPYteOhquDguPrMAB4 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_515081eee70948cb95a7636bd181833f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/515081eee70948cb95a7636bd181833f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/515081eee70948cb95a7636bd181833f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 515081eee70948cb95a7636bd181833f Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992885807 Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: b01406785b6d4937885d661c03511cae Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServerActionsTestJSON-1992885807-project Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e'} Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:08.940242 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Returning 404 to user: Instance 00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:08.944887 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-650371f5-1c15-49b0-80a7-7ac2252daf1b tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e" status: 404 len: 111 microversion: 2.1 time: 0.030907 Oct 31 15:07:08.946258 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3414/7079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/00ed84b0-6bf5-441e-94d6-2d78dfe9fb3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:08.950457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52f3333b-ef15-43a5-be1a-e1ed0327b107 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] Calling method '.version_select at 0x7fe1066ea820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.978132 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52f3333b-ef15-43a5-be1a-e1ed0327b107 tempest-ServerActionsTestJSON-1992885807 tempest-ServerActionsTestJSON-1992885807-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116627112" status: 202 len: 0 microversion: 2.1 time: 0.031606 Oct 31 15:07:08.979218 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3666/7080] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 31 15:07:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116627112 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:07:18.816535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053421821", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "cca839c3-62a9-4f87-a25d-8e7802ef7844"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:18.883298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] validate_networks() for [('cca839c3-62a9-4f87-a25d-8e7802ef7844', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:07:18.929476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=17 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:19.372240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:07:19.373186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:07:19.373907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:07:19.374588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:07:19.376198 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:07:19.391074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:19.392051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:19.393226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:19.393973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:19.394486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:19.394920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:19.416213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Getting quotas for project 25cdf2f64e1a4be3bb7ab6a5a75ee9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:07:19.421541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Getting quotas for user 4b6efc286eee41a6ad20c48e4f678d8c and project 25cdf2f64e1a4be3bb7ab6a5a75ee9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:07:19.434834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:07:19.437515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:07:19.488932 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-513bd6f2-b71e-43f1-8efe-26d5f925c2b7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807642 Oct 31 15:07:19.489598 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3415/7081] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:07:19.498842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=31 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:19.499612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:19.504752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-201f54fa-fb66-40f6-8780-78b40dfc49b3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:19.506334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-201f54fa-fb66-40f6-8780-78b40dfc49b3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:19.576324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-201f54fa-fb66-40f6-8780-78b40dfc49b3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:19.586419 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-201f54fa-fb66-40f6-8780-78b40dfc49b3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1217 microversion: 2.1 time: 0.089226 Oct 31 15:07:19.587234 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3667/7082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:19 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:20.624235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:20.624884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:20.635871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:20.636466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:20.637032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:20.638078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:20.638680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:20.639372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:20.717666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:20.736031 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6282dbf7-5f90-40fd-92cf-35e898fce239 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1269 microversion: 2.1 time: 0.114477 Oct 31 15:07:20.737112 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3416/7083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:20 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:21.760118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:21.761473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:21.770971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.771806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.772431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.773846 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.774843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.775495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.994919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:22.004692 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57295e66-4370-402b-8057-13615dc4e7fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1317 microversion: 2.1 time: 0.248617 Oct 31 15:07:22.005294 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3668/7084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:21 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:22.462889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5a4353d9-8273-430d-88b9-a9f2ac6234fc req-ad442863-97bb-4d33-9927-d635a1f0f3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ef1b2f-8557-4176-81d4-d7be126128a2", "tag": "e0dd6751-0f56-4b62-a0e1-ecec01ab049b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:22.475595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5a4353d9-8273-430d-88b9-a9f2ac6234fc req-ad442863-97bb-4d33-9927-d635a1f0f3ec service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:22.476204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5a4353d9-8273-430d-88b9-a9f2ac6234fc req-ad442863-97bb-4d33-9927-d635a1f0f3ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:22.476719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5a4353d9-8273-430d-88b9-a9f2ac6234fc req-ad442863-97bb-4d33-9927-d635a1f0f3ec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:22.490334 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5a4353d9-8273-430d-88b9-a9f2ac6234fc req-ad442863-97bb-4d33-9927-d635a1f0f3ec service nova] Creating event network-changed:e0dd6751-0f56-4b62-a0e1-ecec01ab049b for instance 39ef1b2f-8557-4176-81d4-d7be126128a2 on n-h1-863052-1 Oct 31 15:07:22.497130 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5a4353d9-8273-430d-88b9-a9f2ac6234fc req-ad442863-97bb-4d33-9927-d635a1f0f3ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038021 Oct 31 15:07:22.498046 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3417/7085] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:23.029526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:23.030076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:23.037060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:23.037615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:23.038126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:23.038945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:23.039470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:23.039956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:23.173823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:23.181697 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c7e1707-37b7-4919-a867-fe87ffd93ac2 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1317 microversion: 2.1 time: 0.156174 Oct 31 15:07:23.182309 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3669/7086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:23 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:24.207183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:24.207881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:24.214021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:24.214533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:24.214972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:24.215655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:24.216108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:24.216531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:24.346422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:24.354135 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab47df30-7832-4aba-8c35-c92c6d2ab806 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1317 microversion: 2.1 time: 0.152910 Oct 31 15:07:24.354735 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3418/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:24 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:25.378084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:25.378674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:25.385329 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:25.385828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:25.386317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:25.387029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:25.387499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:25.387938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:25.525293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:25.538989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09d436b6-56e5-4df2-b771-44183b2b7a52 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1317 microversion: 2.1 time: 0.165409 Oct 31 15:07:25.539849 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3670/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:25 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:26.565940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:26.566583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:26.572609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:26.573099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:26.573539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:26.574279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:26.574731 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:26.575151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:26.710999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:26.719335 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d8bd8b6-72ed-4f98-8d3c-7229e17156be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1317 microversion: 2.1 time: 0.158135 Oct 31 15:07:26.719964 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3419/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:26 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:27.634259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1fe1b3f4-f9a3-48c5-9e79-5e130f2c89b3 req-219b6815-486a-4bd9-9f7b-f63f3dd32ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ef1b2f-8557-4176-81d4-d7be126128a2", "name": "network-vif-plugged", "status": "completed", "tag": "e0dd6751-0f56-4b62-a0e1-ecec01ab049b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:27.645801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1fe1b3f4-f9a3-48c5-9e79-5e130f2c89b3 req-219b6815-486a-4bd9-9f7b-f63f3dd32ca5 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:27.646557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1fe1b3f4-f9a3-48c5-9e79-5e130f2c89b3 req-219b6815-486a-4bd9-9f7b-f63f3dd32ca5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:27.646988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1fe1b3f4-f9a3-48c5-9e79-5e130f2c89b3 req-219b6815-486a-4bd9-9f7b-f63f3dd32ca5 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:27.659234 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1fe1b3f4-f9a3-48c5-9e79-5e130f2c89b3 req-219b6815-486a-4bd9-9f7b-f63f3dd32ca5 service nova] Creating event network-vif-plugged:e0dd6751-0f56-4b62-a0e1-ecec01ab049b for instance 39ef1b2f-8557-4176-81d4-d7be126128a2 on n-h1-863052-1 Oct 31 15:07:27.664437 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1fe1b3f4-f9a3-48c5-9e79-5e130f2c89b3 req-219b6815-486a-4bd9-9f7b-f63f3dd32ca5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033941 Oct 31 15:07:27.665046 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3671/7090] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:27.743466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:27.744185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:27.751885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:27.752446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:27.752946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:27.753712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:27.754285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:27.754796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:27.909429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:27.917295 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eab31c0c-ef83-4bfd-a821-eab15a6fcc42 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1317 microversion: 2.1 time: 0.177758 Oct 31 15:07:27.917873 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3420/7091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:27 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:28.942360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:28.943081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:28.949569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:28.950074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:28.950555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:28.951263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:28.951726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:28.952162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:29.086448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:29.094578 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-249a444f-06e5-4da1-b965-8bb42b2aa657 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.157665 Oct 31 15:07:29.095689 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3672/7092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:28 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:29.160212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-589994814", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "cca839c3-62a9-4f87-a25d-8e7802ef7844"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:29.214242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] validate_networks() for [('cca839c3-62a9-4f87-a25d-8e7802ef7844', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:07:29.407583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:29.428966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:29.595368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:07:29.595888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:07:29.596319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:07:29.596723 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:07:29.597134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:07:29.606145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:29.606668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:29.607095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:29.607827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:29.608274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:29.608697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:29.626947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Getting quotas for project 25cdf2f64e1a4be3bb7ab6a5a75ee9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:07:29.632329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Getting quotas for user 4b6efc286eee41a6ad20c48e4f678d8c and project 25cdf2f64e1a4be3bb7ab6a5a75ee9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:07:29.644923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:07:29.647260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:07:29.695094 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea05f60c-3734-4da1-9596-e3dadb75c55e tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538831 Oct 31 15:07:29.695938 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3421/7093] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:07:29.707197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1025e98e-1f7b-4880-891e-d3f54278c7fe tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:29.707837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1025e98e-1f7b-4880-891e-d3f54278c7fe tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:29.713024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:29.772918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1025e98e-1f7b-4880-891e-d3f54278c7fe tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:29.780723 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1025e98e-1f7b-4880-891e-d3f54278c7fe tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1216 microversion: 2.1 time: 0.077339 Oct 31 15:07:29.781363 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3673/7094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:29 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:30.808637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:30.809296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:30.817841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:30.818729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:30.819278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:30.820189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:30.820656 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:30.821086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:30.894194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:30.902347 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e586ef56-087c-4302-96c7-b44d4c5da3d3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1286 microversion: 2.1 time: 0.100821 Oct 31 15:07:30.903020 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3422/7095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:30 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:31.925392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:31.926279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:31.934111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:31.934740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:31.935252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:31.935961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:31.936454 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:31.936886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:32.141038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:32.150108 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94c12054-3644-4e92-968b-57687c257b6b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1316 microversion: 2.1 time: 0.228860 Oct 31 15:07:32.150821 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3674/7096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:31 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:32.277207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9efe182f-90dc-4daf-9771-6cf1fc819ae2 req-8e9e1e72-4ca5-4f87-8ebc-d43ca3a36d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eeea86-e24a-4ff9-9cf4-fd3617b2be82", "tag": "719c598a-f139-48e5-bb1b-519e1f6efa2a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:32.289377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9efe182f-90dc-4daf-9771-6cf1fc819ae2 req-8e9e1e72-4ca5-4f87-8ebc-d43ca3a36d88 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:32.291859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9efe182f-90dc-4daf-9771-6cf1fc819ae2 req-8e9e1e72-4ca5-4f87-8ebc-d43ca3a36d88 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:32.292614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9efe182f-90dc-4daf-9771-6cf1fc819ae2 req-8e9e1e72-4ca5-4f87-8ebc-d43ca3a36d88 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:32.305324 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9efe182f-90dc-4daf-9771-6cf1fc819ae2 req-8e9e1e72-4ca5-4f87-8ebc-d43ca3a36d88 service nova] Creating event network-changed:719c598a-f139-48e5-bb1b-519e1f6efa2a for instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 on n-h2-863052-1 Oct 31 15:07:32.311475 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9efe182f-90dc-4daf-9771-6cf1fc819ae2 req-8e9e1e72-4ca5-4f87-8ebc-d43ca3a36d88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038292 Oct 31 15:07:32.312162 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3423/7097] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:33.173688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:33.174469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:33.181670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:33.182181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:33.182644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:33.183363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:33.183826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:33.184263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:33.317164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:33.325226 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd171174-4af0-4625-bd20-619737c3d7d8 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1316 microversion: 2.1 time: 0.156013 Oct 31 15:07:33.325812 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3675/7098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:33 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:34.350890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:34.351593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:34.357915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:34.358434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:34.358874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:34.359584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:34.360295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:34.361387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:34.496319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:34.507745 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a31e6317-b58f-4636-9d1e-e92686943e10 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1316 microversion: 2.1 time: 0.161508 Oct 31 15:07:34.508045 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3424/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:34 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:35.530869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:35.531501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:35.538581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:35.539083 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:35.539534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:35.540247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:35.540715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:35.541152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:35.683965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:35.692627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6146153-4dbe-4e2c-aeee-b051cc9133a3 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1316 microversion: 2.1 time: 0.165604 Oct 31 15:07:35.693237 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3676/7100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:35 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:36.715744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:36.716371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:36.726026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:36.726975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:36.727784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:36.729061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:36.729905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:36.730741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:36.895752 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:36.896803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-98774a7e-1ad4-4b21-98d0-44ba5a21947f req-1bc2747b-1c0d-4b12-b6f1-bd275f77740e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eeea86-e24a-4ff9-9cf4-fd3617b2be82", "name": "network-vif-plugged", "status": "completed", "tag": "719c598a-f139-48e5-bb1b-519e1f6efa2a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:36.903968 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c34b080b-f59c-4b39-9cbc-e7d2aade1db6 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1316 microversion: 2.1 time: 0.192163 Oct 31 15:07:36.908431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-98774a7e-1ad4-4b21-98d0-44ba5a21947f req-1bc2747b-1c0d-4b12-b6f1-bd275f77740e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:36.908933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-98774a7e-1ad4-4b21-98d0-44ba5a21947f req-1bc2747b-1c0d-4b12-b6f1-bd275f77740e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:36.909373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-98774a7e-1ad4-4b21-98d0-44ba5a21947f req-1bc2747b-1c0d-4b12-b6f1-bd275f77740e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:36.919483 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3425/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:36 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:36.925633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-98774a7e-1ad4-4b21-98d0-44ba5a21947f req-1bc2747b-1c0d-4b12-b6f1-bd275f77740e service nova] Creating event network-vif-plugged:719c598a-f139-48e5-bb1b-519e1f6efa2a for instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 on n-h2-863052-1 Oct 31 15:07:36.930789 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-98774a7e-1ad4-4b21-98d0-44ba5a21947f req-1bc2747b-1c0d-4b12-b6f1-bd275f77740e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038998 Oct 31 15:07:36.931395 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3677/7102] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:07:37.927316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:37.927936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:37.934934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:37.935427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:37.935870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:37.936579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:37.937035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:37.937461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:38.076095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:38.084490 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-792b146b-8480-4fe9-aac4-47dd884b70be tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1316 microversion: 2.1 time: 0.161092 Oct 31 15:07:38.085079 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3426/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:37 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:39.110188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:39.111483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:39.117848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:39.118402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:39.118864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:39.119587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:39.120061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:39.120504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:39.258931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:39.267630 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b98a69ec-cde8-4584-b590-98da1038e318 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1504 microversion: 2.1 time: 0.162917 Oct 31 15:07:39.268224 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3678/7104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:39 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:39.294948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:39.294948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:39.295980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:39.301646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:39.302145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:39.302603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:39.303357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:39.303815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:39.304241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:39.332338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:07:39.419349 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c85efd88-3b40-4631-8d79-b3b07b4d1d84 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 204 len: 0 microversion: 2.1 time: 0.132012 Oct 31 15:07:39.420246 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3427/7105] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:39 2022] DELETE /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:07:39.428177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:39.428825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:39.435008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:39.435513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:39.436056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:39.438214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:39.438214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:39.438214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:39.576519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:39.585102 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be0ef245-aa8a-4adc-adba-97592fe60e70 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1510 microversion: 2.1 time: 0.160763 Oct 31 15:07:39.585691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3679/7106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:39 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:40.607243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:40.608166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:40.614135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:40.614882 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:40.621836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:40.622361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:40.622808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:40.623514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:40.623977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:40.624404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:40.767580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:40.776412 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3205a418-b049-4857-ab1f-1817bc123d80 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 200 len: 1510 microversion: 2.1 time: 0.170099 Oct 31 15:07:40.776980 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3428/7107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:40 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:41.224628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d32959c1-0828-4754-8195-d83c6645c4a7 req-19569f0d-2ded-40e7-a5f5-f8c71eb28e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eeea86-e24a-4ff9-9cf4-fd3617b2be82", "name": "network-vif-deleted", "tag": "719c598a-f139-48e5-bb1b-519e1f6efa2a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:41.229750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:41.239131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d32959c1-0828-4754-8195-d83c6645c4a7 req-19569f0d-2ded-40e7-a5f5-f8c71eb28e34 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:41.240204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d32959c1-0828-4754-8195-d83c6645c4a7 req-19569f0d-2ded-40e7-a5f5-f8c71eb28e34 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:41.240693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d32959c1-0828-4754-8195-d83c6645c4a7 req-19569f0d-2ded-40e7-a5f5-f8c71eb28e34 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:41.256575 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d32959c1-0828-4754-8195-d83c6645c4a7 req-19569f0d-2ded-40e7-a5f5-f8c71eb28e34 service nova] Creating event network-vif-deleted:719c598a-f139-48e5-bb1b-519e1f6efa2a for instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 on n-h2-863052-1 Oct 31 15:07:41.262849 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d32959c1-0828-4754-8195-d83c6645c4a7 req-19569f0d-2ded-40e7-a5f5-f8c71eb28e34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041459 Oct 31 15:07:41.263702 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3680/7108] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:41.799390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:41.800022 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:41.807543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:41.808033 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:41.808482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:41.809181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:41.809641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:41.810082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:41.823397 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] HTTP exception thrown: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 HTTP/1.1 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '82eeea86-e24a-4ff9-9cf4-fd3617b2be82'} Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:41.825042 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 404 to user: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-109bfcab-ec9b-40a9-aba6-3ec6f5eb508b tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 404 len: 111 microversion: 2.1 time: 0.031034 Oct 31 15:07:41.830453 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3429/7109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:41 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:41.836163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:41.836875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:41.843204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:41.843697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:41.844142 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:41.844838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:41.845304 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:41.845743 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:41.975581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:41.983314 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ec3fe99-6064-48cf-a104-7f016de55710 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.151439 Oct 31 15:07:41.983890 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3681/7110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:41 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:42.006449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8896c888-7783-41af-a89d-8b9f52a33edd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:42.008868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8896c888-7783-41af-a89d-8b9f52a33edd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: b760314c-2bb6-45e2-89d2-610a7071369f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.014479 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-8896c888-7783-41af-a89d-8b9f52a33edd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] HTTP exception thrown: Instance b760314c-2bb6-45e2-89d2-610a7071369f could not be found. Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8896c888-7783-41af-a89d-8b9f52a33edd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/b760314c-2bb6-45e2-89d2-610a7071369f/action HTTP/1.1 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 32 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: {"resize": {"flavorRef": "452"}} Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance b760314c-2bb6-45e2-89d2-610a7071369f could not be found. Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'b760314c-2bb6-45e2-89d2-610a7071369f', 'body': {'resize': {'flavorRef': '452'}}} Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b760314c-2bb6-45e2-89d2-610a7071369f could not be found. Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:42.016039 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b760314c-2bb6-45e2-89d2-610a7071369f could not be found. Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b760314c-2bb6-45e2-89d2-610a7071369f could not be found. Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8896c888-7783-41af-a89d-8b9f52a33edd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 404 to user: Instance b760314c-2bb6-45e2-89d2-610a7071369f could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8896c888-7783-41af-a89d-8b9f52a33edd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "POST /compute/v2.1/servers/b760314c-2bb6-45e2-89d2-610a7071369f/action" status: 404 len: 111 microversion: 2.1 time: 0.015023 Oct 31 15:07:42.020175 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3430/7111] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:07:42 2022] POST /compute/v2.1/servers/b760314c-2bb6-45e2-89d2-610a7071369f/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:07:42.026002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:42.026653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.032644 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.033139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.033587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.034311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.035286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.035729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.166446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:42.175721 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f618626-06ee-4109-bb4b-204ea434d075 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.153296 Oct 31 15:07:42.176233 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3682/7112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:42 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:42.198455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:42.199071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.206008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.206540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.207512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.208209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.208661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.209088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.354867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:42.362989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-69c5179a-1b4a-45ed-99e0-31d7b5bec577 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.168437 Oct 31 15:07:42.363566 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3431/7113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:42 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:42.385627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "85304324-6e6d-4b84-acc6-eb82495462d9"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:42.387939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.395411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.395912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.396367 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.397085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.397555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.397995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.428023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:42.433061 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] HTTP exception thrown: Flavor 85304324-6e6d-4b84-acc6-eb82495462d9 could not be found. Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2/action HTTP/1.1 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 65 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: {"resize": {"flavorRef": "85304324-6e6d-4b84-acc6-eb82495462d9"}} Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: exception: Flavor 85304324-6e6d-4b84-acc6-eb82495462d9 could not be found. Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '39ef1b2f-8557-4176-81d4-d7be126128a2', 'body': {'resize': {'flavorRef': '85304324-6e6d-4b84-acc6-eb82495462d9'}}} Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:42.435194 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 85304324-6e6d-4b84-acc6-eb82495462d9 could not be found. Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 85304324-6e6d-4b84-acc6-eb82495462d9 could not be found. Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 85304324-6e6d-4b84-acc6-eb82495462d9 could not be found. Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 400 to user: Flavor 85304324-6e6d-4b84-acc6-eb82495462d9 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:42.439792 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8562f7a1-c82e-448f-a0bd-e946851d4cd7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "POST /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2/action" status: 400 len: 107 microversion: 2.1 time: 0.055052 Oct 31 15:07:42.441887 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3683/7114] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:07:42 2022] POST /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2/action => generated 107 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:07:42.445642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:42.446303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.452561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.453047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.453490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.454242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.454694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.455126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.593765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:42.602114 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a0ab54e-c5d3-4e5d-bf17-acb579f3b0bf tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.160293 Oct 31 15:07:42.602743 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3432/7115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:42 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:42.629330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:42.630397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.639701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.640540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.641267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.642458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.642991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.643433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.784886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:42.792820 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32e47304-226a-4288-982c-b8ad44275382 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.170439 Oct 31 15:07:42.793407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3684/7116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:42 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:42.815204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2efdaacc-518a-41e7-848d-d7321150a6fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2efdaacc-518a-41e7-848d-d7321150a6fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2/action HTTP/1.1 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 29 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: {"resize": {"flavorRef": ""}} Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '39ef1b2f-8557-4176-81d4-d7be126128a2', 'body': {'resize': {'flavorRef': ''}}} Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi '' Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.819323 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2efdaacc-518a-41e7-848d-d7321150a6fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2efdaacc-518a-41e7-848d-d7321150a6fd tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "POST /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2/action" status: 400 len: 113 microversion: 2.1 time: 0.009607 Oct 31 15:07:42.823558 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3433/7117] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:07:42 2022] POST /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:07:42.829629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:42.830289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:42.837104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.837624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.845691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.846509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:42.847008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:42.847465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:42.979821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:42.988548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-266f0ab4-e36b-45f0-9e52-ac303bb3a6e9 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1506 microversion: 2.1 time: 0.162190 Oct 31 15:07:42.989072 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3685/7118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:42 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:43.015832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:43.016344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:43.023732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.024260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.024710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.025427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.025890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.026370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.040253 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] HTTP exception thrown: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 HTTP/1.1 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '82eeea86-e24a-4ff9-9cf4-fd3617b2be82'} Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:43.041844 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 404 to user: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd29e6d5-e031-4c06-a383-1b62f2e68836 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 404 len: 111 microversion: 2.1 time: 0.032203 Oct 31 15:07:43.046142 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3434/7119] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:43 2022] DELETE /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:07:43.052384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:43.053012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 82eeea86-e24a-4ff9-9cf4-fd3617b2be82] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:43.059100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.059596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.060046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.060758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.061227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.061668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.076337 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] HTTP exception thrown: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 HTTP/1.1 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '82eeea86-e24a-4ff9-9cf4-fd3617b2be82'} Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:43.077945 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 404 to user: Instance 82eeea86-e24a-4ff9-9cf4-fd3617b2be82 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be3004eb-88ef-4e6e-a560-f29496a3ff93 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82" status: 404 len: 111 microversion: 2.1 time: 0.031415 Oct 31 15:07:43.083151 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3686/7120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:43 2022] GET /compute/v2.1/servers/82eeea86-e24a-4ff9-9cf4-fd3617b2be82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:07:43.088019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:43.088518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:43.094637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.095129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.095567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.096264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.096717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.097149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.123891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:07:43.126970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:43.208049 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f990e04-5bc2-4e31-883d-a6c067322269 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 204 len: 0 microversion: 2.1 time: 0.123340 Oct 31 15:07:43.209280 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3435/7121] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:07:43 2022] DELETE /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:07:43.217518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:43.218228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:43.224376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.224880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.225384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.226095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:43.226642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:43.227080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:43.366401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:43.374277 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15553776-f06d-4374-b57c-9ce2520141c7 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1512 microversion: 2.1 time: 0.160661 Oct 31 15:07:43.374858 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3687/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:43 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:44.398796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:44.399494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:44.406992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:44.407475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:44.407916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:44.408605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:44.409050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:44.409471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:44.540574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:44.548663 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3818eac4-9de4-4173-b581-288b5c2f292d tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1512 microversion: 2.1 time: 0.154825 Oct 31 15:07:44.549314 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3436/7123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:44 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:45.387747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-23d96a1d-4265-42a1-8004-41b0c9e9697c req-b73692c9-c221-4484-abe8-66d2550531ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ef1b2f-8557-4176-81d4-d7be126128a2", "name": "network-vif-deleted", "tag": "e0dd6751-0f56-4b62-a0e1-ecec01ab049b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:45.400563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23d96a1d-4265-42a1-8004-41b0c9e9697c req-b73692c9-c221-4484-abe8-66d2550531ed service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:45.401298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23d96a1d-4265-42a1-8004-41b0c9e9697c req-b73692c9-c221-4484-abe8-66d2550531ed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:45.401877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23d96a1d-4265-42a1-8004-41b0c9e9697c req-b73692c9-c221-4484-abe8-66d2550531ed service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:45.423358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-23d96a1d-4265-42a1-8004-41b0c9e9697c req-b73692c9-c221-4484-abe8-66d2550531ed service nova] Creating event network-vif-deleted:e0dd6751-0f56-4b62-a0e1-ecec01ab049b for instance 39ef1b2f-8557-4176-81d4-d7be126128a2 on n-h1-863052-1 Oct 31 15:07:45.429129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-23d96a1d-4265-42a1-8004-41b0c9e9697c req-b73692c9-c221-4484-abe8-66d2550531ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045743 Oct 31 15:07:45.430085 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3688/7124] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:45.572718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:45.573268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:45.580562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:45.581058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:45.581500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:45.582241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:45.582696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:45.583119 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:45.620783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:45.620783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:45.621162 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:45.621617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lazy-loading 'fault' on Instance uuid 39ef1b2f-8557-4176-81d4-d7be126128a2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:07:45.664496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6efc286eee41a6ad20c48e4f678d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cdf2f64e1a4be3bb7ab6a5a75ee9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:45.672646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f69d9442-64a5-4b98-ab55-ed2060d7b81c tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 200 len: 1307 microversion: 2.1 time: 0.103941 Oct 31 15:07:45.673227 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3437/7125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:45 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:46.699099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:46.699729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] [instance: 39ef1b2f-8557-4176-81d4-d7be126128a2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:46.705966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:46.706535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:46.706991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:46.707697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:46.708170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:46.708609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:46.712742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:46.722803 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] HTTP exception thrown: Instance 39ef1b2f-8557-4176-81d4-d7be126128a2 could not be found. Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Request method failure captured: Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 HTTP/1.1 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-SmY7XiYH0W-H8lg8eb-Q2MjGlnpJHrWizlYo9uhQ_xfyfjhofrWlZI01U6fm_XqHr_fqXDaPJTeaUNT9TXaHnhAL5qQmpO_K-5LF9k1iTsu8v00tsgygNLRQpyMr0FCgyVsA9P4WTA397aSXyC3c881Mrhihkpo_NrexYkQazd2XY Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25cdf2f64e1a4be3bb7ab6a5a75ee9e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25cdf2f64e1a4be3bb7ab6a5a75ee9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 25cdf2f64e1a4be3bb7ab6a5a75ee9e8 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793319717 Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 4b6efc286eee41a6ad20c48e4f678d8c Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-ServersNegativeTestJSON-1793319717-project Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 39ef1b2f-8557-4176-81d4-d7be126128a2 could not be found. Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '39ef1b2f-8557-4176-81d4-d7be126128a2'} Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ef1b2f-8557-4176-81d4-d7be126128a2 could not be found. Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ef1b2f-8557-4176-81d4-d7be126128a2 could not be found. Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:46.724460 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ef1b2f-8557-4176-81d4-d7be126128a2 could not be found. Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] Returning 404 to user: Instance 39ef1b2f-8557-4176-81d4-d7be126128a2 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62bc8693-cbae-466b-a579-7a3ba1bb9960 tempest-ServersNegativeTestJSON-1793319717 tempest-ServersNegativeTestJSON-1793319717-project] 10.222.0.27 "GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2" status: 404 len: 111 microversion: 2.1 time: 0.032324 Oct 31 15:07:46.728922 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3689/7126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:46 2022] GET /compute/v2.1/servers/39ef1b2f-8557-4176-81d4-d7be126128a2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:08:18.610276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:18.611448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:18.827344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f05b040-be34-4527-a922-f472dfe0b97d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: .version_select at 0x7fe10c480ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1378070225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4XhJ1053DBZg/m3apE67Z+PXzjsE5WFB0xO0LVN8BRKajcleZ0hKhzr9EMw5kcdyNvTr3jDrRUkA5+xzeyJGH4ryLaDbjZS6VCrDp+YZLw0p/1NGc5R1syYVXEIxA4kA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:18.846478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6f05b040-be34-4527-a922-f472dfe0b97d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:08:18.852959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6f05b040-be34-4527-a922-f472dfe0b97d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for user 73f7faf531af426a8f4c702dc089e8da and project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:08:18.871760 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6f05b040-be34-4527-a922-f472dfe0b97d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [003a9747-ccdc-4070-9420-e4d492900acf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:08:19.880163 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [None req-6f05b040-be34-4527-a922-f472dfe0b97d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [003a9747-ccdc-4070-9420-e4d492900acf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52584. Oct 31 15:08:19.906188 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f05b040-be34-4527-a922-f472dfe0b97d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.298283 Oct 31 15:08:19.906188 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3438/7127] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:08:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:19.970139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1932718267", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1378070225", "networks": [{"uuid": "e313d9ea-6db4-4810-8ab1-b7f7003b815d"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:19.979776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=52 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:19.980862 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:08:19.981244 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 31 15:08:20.037164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] validate_networks() for [('e313d9ea-6db4-4810-8ab1-b7f7003b815d', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:08:20.577946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:08:20.578536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:08:20.579033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:08:20.579453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:08:20.579874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:08:20.593382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:20.594202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:20.594444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:20.595748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:20.596243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:20.596687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:20.618053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:08:20.624122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for user 73f7faf531af426a8f4c702dc089e8da and project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:08:20.638055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:08:20.640456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:08:20.691241 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fbed5ce-1bd7-4c23-9ab2-07856a18d896 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724201 Oct 31 15:08:20.694341 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3690/7128] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:08:20.703275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5959437-42ae-4697-8495-e24bf455be5e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:20.703899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5959437-42ae-4697-8495-e24bf455be5e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:20.789023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5959437-42ae-4697-8495-e24bf455be5e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:20.796366 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5959437-42ae-4697-8495-e24bf455be5e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1263 microversion: 2.1 time: 0.097749 Oct 31 15:08:20.797161 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3439/7129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:20 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:21.820739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:21.822011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:21.833033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:21.833798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:21.835654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:21.836606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:21.837250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:21.838017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:21.944462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:21.954281 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc9cb059-fce3-4eed-aef2-3d0658d21c06 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1323 microversion: 2.1 time: 0.137383 Oct 31 15:08:21.972419 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3691/7130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:21 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:22.980134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:22.980872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:22.988787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:22.989282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:22.989796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:22.990602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:22.991118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:22.991608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:23.140981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:23.149784 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-032b3791-5a2f-400e-ae34-c3d449329a9e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.173732 Oct 31 15:08:23.150448 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3440/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:22 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:23.376457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9140c516-bd99-4fe7-9d61-4b1b261215d2 req-f376b09d-8455-4581-afc3-22e6867fdafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003d1778-79d4-478a-8c7a-06e561323ac2", "tag": "9a546866-42b9-40d6-b413-89e2afba4adf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:23.390124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9140c516-bd99-4fe7-9d61-4b1b261215d2 req-f376b09d-8455-4581-afc3-22e6867fdafd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:23.390653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9140c516-bd99-4fe7-9d61-4b1b261215d2 req-f376b09d-8455-4581-afc3-22e6867fdafd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:23.391104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9140c516-bd99-4fe7-9d61-4b1b261215d2 req-f376b09d-8455-4581-afc3-22e6867fdafd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:23.406389 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9140c516-bd99-4fe7-9d61-4b1b261215d2 req-f376b09d-8455-4581-afc3-22e6867fdafd service nova] Creating event network-changed:9a546866-42b9-40d6-b413-89e2afba4adf for instance 003d1778-79d4-478a-8c7a-06e561323ac2 on n-h2-863052-1 Oct 31 15:08:23.411832 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9140c516-bd99-4fe7-9d61-4b1b261215d2 req-f376b09d-8455-4581-afc3-22e6867fdafd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039080 Oct 31 15:08:23.412450 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3692/7132] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:24.174876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:24.175492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:24.182463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:24.182953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:24.183388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:24.184087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:24.184530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:24.184952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:24.335034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:24.342972 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b24af277-fac0-4669-9411-966aa0a085f0 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.172514 Oct 31 15:08:24.343559 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3441/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:24 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:25.368209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:25.368992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:25.375993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:25.376499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:25.376953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:25.377670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:25.378137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:25.378600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:25.519597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:25.527439 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce294ebb-52be-4359-b78c-1b347ef9260d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.163723 Oct 31 15:08:25.528015 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3693/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:25 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:26.552137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:26.552749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:26.558937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:26.559358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:26.559790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:26.560480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:26.560944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:26.561349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:26.695809 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:26.703604 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3eab0ca-bc49-4842-890e-21eee4b0a294 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.156196 Oct 31 15:08:26.704188 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3442/7135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:26 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:27.727180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:27.728528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:27.736064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:27.737158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:27.737611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:27.738516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:27.738869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:27.739375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:27.878258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:27.885989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b24ae4e8-96ba-4a62-b7e8-8ce5d2134c0e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.162693 Oct 31 15:08:27.886600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3694/7136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:27 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:28.908988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:28.909611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:28.916554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:28.917048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:28.917493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:28.918204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:28.918665 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:28.919097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:29.055631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:29.063694 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b906cb2-326e-4611-b203-ac126bff7bff tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.158613 Oct 31 15:08:29.064282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3443/7137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:28 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:29.160088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a88372eb-9fba-400f-8aed-6b497c3e877a req-73615cef-c98e-4863-be51-2f5f5d495108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003d1778-79d4-478a-8c7a-06e561323ac2", "name": "network-vif-plugged", "status": "completed", "tag": "9a546866-42b9-40d6-b413-89e2afba4adf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:29.172514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a88372eb-9fba-400f-8aed-6b497c3e877a req-73615cef-c98e-4863-be51-2f5f5d495108 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:29.173019 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a88372eb-9fba-400f-8aed-6b497c3e877a req-73615cef-c98e-4863-be51-2f5f5d495108 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:29.173458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a88372eb-9fba-400f-8aed-6b497c3e877a req-73615cef-c98e-4863-be51-2f5f5d495108 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:29.185654 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a88372eb-9fba-400f-8aed-6b497c3e877a req-73615cef-c98e-4863-be51-2f5f5d495108 service nova] Creating event network-vif-plugged:9a546866-42b9-40d6-b413-89e2afba4adf for instance 003d1778-79d4-478a-8c7a-06e561323ac2 on n-h2-863052-1 Oct 31 15:08:29.191082 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a88372eb-9fba-400f-8aed-6b497c3e877a req-73615cef-c98e-4863-be51-2f5f5d495108 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035167 Oct 31 15:08:29.192136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3695/7138] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:30.087504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:30.088187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:30.094944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:30.095433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:30.096370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:30.097063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:30.097517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:30.097946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:30.228103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:30.235978 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac8cdb01-7c2f-412e-9f60-e12758329d09 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1363 microversion: 2.1 time: 0.152388 Oct 31 15:08:30.236543 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3444/7139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:30 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:31.259981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:31.260624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:31.263547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:31.264257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:31.270686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:31.271203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:31.271733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:31.272386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:31.281530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:31.281530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:31.415945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:31.424414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc19bcaf-2c74-43e2-b773-9ab55a533f2e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1555 microversion: 2.1 time: 0.168183 Oct 31 15:08:31.425004 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3696/7140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:31 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:31.446876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:31.447504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:31.449385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:31.455683 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:31.456178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:31.456628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:31.457342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:31.457811 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:31.458296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:31.593407 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:31.601973 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-100b2f6d-1ad7-4f22-83d5-9e6656061eaf tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1555 microversion: 2.1 time: 0.158944 Oct 31 15:08:31.602628 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3445/7141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:31 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:33.453349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae1d2726-ea6e-409a-83be-2ddab3b501eb"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:33.455881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:33.462767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:33.463275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:33.463724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:33.464436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:33.464901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:33.465343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:33.716628 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f79c05f4-16d4-4347-8415-3eaf864e54ba tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267258 Oct 31 15:08:33.717253 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3697/7142] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 15:08:33 2022] POST /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:44.446288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:44.446827 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:44.450319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:44.451150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=36 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:44.458466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:44.458958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:44.459430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:44.460139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:44.460600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:44.461155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:44.544328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lazy-loading 'services' on Instance uuid 003d1778-79d4-478a-8c7a-06e561323ac2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:08:44.625327 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49ff6d4c-251a-438c-90c7-78be0d517638 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments/ae1d2726-ea6e-409a-83be-2ddab3b501eb" status: 202 len: 0 microversion: 2.1 time: 0.182877 Oct 31 15:08:44.625956 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3446/7143] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:08:44 2022] DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments/ae1d2726-ea6e-409a-83be-2ddab3b501eb => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:08:44.633675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:44.634646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:44.639409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:44.642432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:44.651488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:44.652016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:44.652471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:44.653182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:44.653643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:44.654076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:44.688391 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f72e1a87-1e34-490f-8310-c76fe33872d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056689 Oct 31 15:08:44.689557 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3698/7144] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:44 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:45.702555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:45.705605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:45.712768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:45.713272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:45.713700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:45.714443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:45.714888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:45.715314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:45.746516 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ff61aba7-af57-47a8-91b5-68ced58f6beb tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048350 Oct 31 15:08:45.747100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3447/7145] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:45 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:46.759156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:46.761862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:46.769049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:46.769544 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:46.769990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:46.770732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:46.771193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:46.771626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:46.806057 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b389f5b0-a55d-4a0e-a35d-e8ef138ced4c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050897 Oct 31 15:08:46.806671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3699/7146] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:46 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:47.819069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:47.821386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:47.828246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:47.828729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:47.829163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:47.829857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:47.830337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:47.830766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:47.862838 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80033287-dac0-4dfb-9ebb-5edf4b56e2e1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 Oct 31 15:08:47.863628 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3448/7147] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:47 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:48.877059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:48.879421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:48.886764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:48.887298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:48.887753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:48.888471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:48.888941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:48.889376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:48.922621 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a1ec52e-fc4e-4987-b8e2-175242e9de40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050545 Oct 31 15:08:48.923953 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3700/7148] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:48 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:49.935412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:49.937602 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:49.945009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:49.945495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:49.945926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:49.946645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:49.947094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:49.947515 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:49.976566 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37cd4429-3d66-49fd-8925-ef99b863fb20 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045133 Oct 31 15:08:49.977134 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3449/7149] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:49 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:08:49.988999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:49.989511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:49.996293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:49.996788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:49.997235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:49.997933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:49.998422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:49.998861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:50.075604 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] HTTP exception thrown: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 is not attached to volume ae1d2726-ea6e-409a-83be-2ddab3b501eb Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Request method failure captured: Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments/ae1d2726-ea6e-409a-83be-2ddab3b501eb HTTP/1.1 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-TdWNUqYkSnh1xBARFAtvi7wEMFwyQ5KMCvCctnhaICGW9krzy0LxVM-ppWuxJnHOzKCjtSeX5IACN-rHCxBHDEwJJMItNg48-aEMkpOqV-fO3vS86kPzNYkgduW2iLwBKiQ6ErvrgkN4cxn6bBP446BN9bRSP1kRwhS_91yS1rXaQ Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54bfa020dc904dbd9fe545acf4c692c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 73f7faf531af426a8f4c702dc089e8da Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 is not attached to volume ae1d2726-ea6e-409a-83be-2ddab3b501eb Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': '003d1778-79d4-478a-8c7a-06e561323ac2', 'id': 'ae1d2726-ea6e-409a-83be-2ddab3b501eb'} Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ae1d2726-ea6e-409a-83be-2ddab3b501eb. Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 is not attached to volume ae1d2726-ea6e-409a-83be-2ddab3b501eb Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:50.081382 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 is not attached to volume ae1d2726-ea6e-409a-83be-2ddab3b501eb Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Returning 404 to user: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 is not attached to volume ae1d2726-ea6e-409a-83be-2ddab3b501eb {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32d9a0da-fa0a-4593-87fb-049450cd1734 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments/ae1d2726-ea6e-409a-83be-2ddab3b501eb" status: 404 len: 154 microversion: 2.1 time: 0.099325 Oct 31 15:08:50.086331 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3701/7150] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:08:49 2022] DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2/os-volume_attachments/ae1d2726-ea6e-409a-83be-2ddab3b501eb => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:08:53.436477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:53.437065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:53.444284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:53.444784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:53.445232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:53.445985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:53.446471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:53.446916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:53.475674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:08:53.558797 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89c8f899-6ded-4d3c-a2c0-5577310375ac tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 204 len: 0 microversion: 2.1 time: 0.125606 Oct 31 15:08:53.559468 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3450/7151] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:08:53 2022] DELETE /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:08:53.568297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:53.568924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:53.577737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:53.578283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:53.578744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:53.579555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:53.580029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:53.580473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:53.719915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:53.727820 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de4bc76e-4e83-43c4-acb8-4fb06d0568ec tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1561 microversion: 2.1 time: 0.164041 Oct 31 15:08:53.728395 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3702/7152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:53 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:54.752320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:54.753024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:54.760122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:54.760604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:54.761041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:54.761732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:54.762210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:54.762636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:54.899456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:54.908221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-898f9a60-778b-47e1-86bc-19e6ef8e9505 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1561 microversion: 2.1 time: 0.159609 Oct 31 15:08:54.908803 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3451/7153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:54 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:55.613819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1e4117f0-ea83-4e12-9d6c-97b21e5156e3 req-2c3aac99-0ace-4675-9986-99d2173e5a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003d1778-79d4-478a-8c7a-06e561323ac2", "name": "network-vif-deleted", "tag": "9a546866-42b9-40d6-b413-89e2afba4adf"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:55.627434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1e4117f0-ea83-4e12-9d6c-97b21e5156e3 req-2c3aac99-0ace-4675-9986-99d2173e5a46 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:55.627928 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1e4117f0-ea83-4e12-9d6c-97b21e5156e3 req-2c3aac99-0ace-4675-9986-99d2173e5a46 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:55.628381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1e4117f0-ea83-4e12-9d6c-97b21e5156e3 req-2c3aac99-0ace-4675-9986-99d2173e5a46 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:55.641575 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1e4117f0-ea83-4e12-9d6c-97b21e5156e3 req-2c3aac99-0ace-4675-9986-99d2173e5a46 service nova] Creating event network-vif-deleted:9a546866-42b9-40d6-b413-89e2afba4adf for instance 003d1778-79d4-478a-8c7a-06e561323ac2 on n-h2-863052-1 Oct 31 15:08:55.647478 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1e4117f0-ea83-4e12-9d6c-97b21e5156e3 req-2c3aac99-0ace-4675-9986-99d2173e5a46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037791 Oct 31 15:08:55.648088 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3703/7154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:55.933337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:55.934092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:55.946115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:55.946647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:55.947087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:55.947791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:55.948243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:55.948663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:55.987459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:55.987949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:55.988389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:55.988849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lazy-loading 'fault' on Instance uuid 003d1778-79d4-478a-8c7a-06e561323ac2 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:08:56.033238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:56.041904 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f13124c-3bc7-4107-88f1-3afbe43e5f8b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 200 len: 1353 microversion: 2.1 time: 0.112869 Oct 31 15:08:56.042535 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3452/7155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:55 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 1353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:57.067397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:57.068128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 003d1778-79d4-478a-8c7a-06e561323ac2] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:57.075239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:57.075730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:57.076180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:57.076877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:57.077338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:57.077772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:57.091549 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] HTTP exception thrown: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 could not be found. Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Request method failure captured: Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 HTTP/1.1 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-TdWNUqYkSnh1xBARFAtvi7wEMFwyQ5KMCvCctnhaICGW9krzy0LxVM-ppWuxJnHOzKCjtSeX5IACN-rHCxBHDEwJJMItNg48-aEMkpOqV-fO3vS86kPzNYkgduW2iLwBKiQ6ErvrgkN4cxn6bBP446BN9bRSP1kRwhS_91yS1rXaQ Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54bfa020dc904dbd9fe545acf4c692c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 73f7faf531af426a8f4c702dc089e8da Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 could not be found. Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '003d1778-79d4-478a-8c7a-06e561323ac2'} Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 could not be found. Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 could not be found. Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:57.093154 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 could not be found. Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Returning 404 to user: Instance 003d1778-79d4-478a-8c7a-06e561323ac2 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ac94540-0f30-4b95-8a24-6b47e03a65c7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2" status: 404 len: 111 microversion: 2.1 time: 0.032032 Oct 31 15:08:57.098207 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3704/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:57 2022] GET /compute/v2.1/servers/003d1778-79d4-478a-8c7a-06e561323ac2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:08:57.103559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd1fe02b-ebcb-4ed7-bd88-aac8a2b29e46 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '.version_select at 0x7fe107eb1b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:57.123727 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd1fe02b-ebcb-4ed7-bd88-aac8a2b29e46 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1378070225" status: 202 len: 0 microversion: 2.1 time: 0.024051 Oct 31 15:08:57.124331 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3453/7157] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 31 15:08:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1378070225 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:08:57.142319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85953fdc-3300-400b-83ca-e3b50d95ba3b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: .version_select at 0x7fe1076c14c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1160781953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKntbQLOHXf+LI2FNqOMEXMtE16pfpMGsMM7T3qS/nBYe/HxP5RHHW/yKG+PZvrlTeeH/H679BoWN703W2k4GLlWJ8kcmplWLDvWCTTLrmDYeiudaAuKe4ETDMyLexUd6Q=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:57.158054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-85953fdc-3300-400b-83ca-e3b50d95ba3b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:08:57.163974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-85953fdc-3300-400b-83ca-e3b50d95ba3b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for user 73f7faf531af426a8f4c702dc089e8da and project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:08:57.187594 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85953fdc-3300-400b-83ca-e3b50d95ba3b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049767 Oct 31 15:08:57.188198 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3705/7158] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:08:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:08:57.238405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-60508353", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1160781953", "networks": [{"uuid": "e313d9ea-6db4-4810-8ab1-b7f7003b815d"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:57.291892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] validate_networks() for [('e313d9ea-6db4-4810-8ab1-b7f7003b815d', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:08:57.659795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:08:57.660221 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:08:57.660696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:08:57.661107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:08:57.661519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:08:57.670564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:57.671243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:57.671491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:57.672236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:57.672696 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:57.673168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:57.690747 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:08:57.695951 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for user 73f7faf531af426a8f4c702dc089e8da and project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:08:57.709023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:08:57.711343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:08:57.758576 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6fcfafbf-c1bd-499e-b61e-5863bd053935 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524249 Oct 31 15:08:57.759424 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3454/7159] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:08:57.771317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-838f9bf3-7eac-4293-9b6e-241122cf8029 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:57.771942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-838f9bf3-7eac-4293-9b6e-241122cf8029 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:57.826298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-838f9bf3-7eac-4293-9b6e-241122cf8029 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:57.833981 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-838f9bf3-7eac-4293-9b6e-241122cf8029 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1261 microversion: 2.1 time: 0.067365 Oct 31 15:08:57.834629 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3706/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:57 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:58.857941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:58.858593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:58.868316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:58.868815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:58.869312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:58.869954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:58.870471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:58.870869 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:58.933918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:58.941725 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31c0381e-e2bd-4890-b62a-27f84102b96c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1319 microversion: 2.1 time: 0.088808 Oct 31 15:08:58.942309 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3455/7161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:58 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:59.965755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:59.966593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:59.974095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:59.974638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:59.975085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:59.975791 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:59.976256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:59.976690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:00.160427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:00.169414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-217390c9-633d-439b-b160-7bd0796b29b1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1361 microversion: 2.1 time: 0.208219 Oct 31 15:09:00.170015 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3707/7162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:59 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:00.182638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-07903e3a-115e-4161-98b0-4a8e49bd54a2 req-4819d718-5ea7-4ad4-968e-7b58d4f2b619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f979a9-af13-4c71-9e01-0e3be2e162dc", "tag": "dd457fb6-b022-4fbf-94c7-bd7f5de041e2"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:00.193832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07903e3a-115e-4161-98b0-4a8e49bd54a2 req-4819d718-5ea7-4ad4-968e-7b58d4f2b619 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:00.194367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07903e3a-115e-4161-98b0-4a8e49bd54a2 req-4819d718-5ea7-4ad4-968e-7b58d4f2b619 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:00.195006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07903e3a-115e-4161-98b0-4a8e49bd54a2 req-4819d718-5ea7-4ad4-968e-7b58d4f2b619 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:00.207074 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-07903e3a-115e-4161-98b0-4a8e49bd54a2 req-4819d718-5ea7-4ad4-968e-7b58d4f2b619 service nova] Creating event network-changed:dd457fb6-b022-4fbf-94c7-bd7f5de041e2 for instance b1f979a9-af13-4c71-9e01-0e3be2e162dc on n-h2-863052-1 Oct 31 15:09:00.212133 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-07903e3a-115e-4161-98b0-4a8e49bd54a2 req-4819d718-5ea7-4ad4-968e-7b58d4f2b619 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033274 Oct 31 15:09:00.212916 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3456/7163] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:01.195822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:01.196740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:01.204974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:01.205481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:01.205933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:01.206681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:01.207156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:01.207602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:01.339434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:01.348014 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e61bd663-fea8-40d9-9d21-5151a534a4ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1361 microversion: 2.1 time: 0.156549 Oct 31 15:09:01.348610 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3708/7164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:01 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:02.372763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:02.373445 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:02.380199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:02.380678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:02.381117 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:02.381798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:02.382285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:02.382712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:02.514273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:02.521981 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9565a58d-39c3-47dc-b0ea-8ad8a8cdacfd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1361 microversion: 2.1 time: 0.154317 Oct 31 15:09:02.522596 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3457/7165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:02 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:03.545030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:03.545723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:03.552542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:03.553038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:03.553485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:03.554203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:03.554671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:03.555109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:03.687176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:03.695557 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87a42092-3e1f-4d4b-8609-f9219a9c82d5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1361 microversion: 2.1 time: 0.154419 Oct 31 15:09:03.696134 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3709/7166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:03 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:04.720048 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:04.720615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:04.727667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:04.728147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:04.728583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:04.729264 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:04.729714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:04.730135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:04.859624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:04.867502 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-614f778c-7ab3-47ed-9536-b6a19eb20d64 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1361 microversion: 2.1 time: 0.151969 Oct 31 15:09:04.868087 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3458/7167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:04 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:05.338493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9220bae0-e355-45e2-9d87-cdec8672c25e req-0fef8a0f-a2d3-4d36-8f4b-c2075e157d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f979a9-af13-4c71-9e01-0e3be2e162dc", "name": "network-vif-plugged", "status": "completed", "tag": "dd457fb6-b022-4fbf-94c7-bd7f5de041e2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:05.350490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9220bae0-e355-45e2-9d87-cdec8672c25e req-0fef8a0f-a2d3-4d36-8f4b-c2075e157d03 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:05.351071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9220bae0-e355-45e2-9d87-cdec8672c25e req-0fef8a0f-a2d3-4d36-8f4b-c2075e157d03 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:05.351590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9220bae0-e355-45e2-9d87-cdec8672c25e req-0fef8a0f-a2d3-4d36-8f4b-c2075e157d03 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:05.364946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9220bae0-e355-45e2-9d87-cdec8672c25e req-0fef8a0f-a2d3-4d36-8f4b-c2075e157d03 service nova] Creating event network-vif-plugged:dd457fb6-b022-4fbf-94c7-bd7f5de041e2 for instance b1f979a9-af13-4c71-9e01-0e3be2e162dc on n-h2-863052-1 Oct 31 15:09:05.370034 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9220bae0-e355-45e2-9d87-cdec8672c25e req-0fef8a0f-a2d3-4d36-8f4b-c2075e157d03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035177 Oct 31 15:09:05.370676 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3710/7168] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:09:05.890609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:05.891259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:05.898056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:05.898582 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:05.899025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:05.899826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:05.900175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:05.900761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:06.040254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:06.049114 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-438f01aa-3fa5-461e-8377-b3d9a344823d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1361 microversion: 2.1 time: 0.162395 Oct 31 15:09:06.049734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3459/7169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:05 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:07.073915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:07.074662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:07.081629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:07.082135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:07.082612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:07.083323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:07.083793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:07.084234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:07.215008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:07.223537 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a951ec4-ea7f-4e9c-8a82-e7876523ea59 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1554 microversion: 2.1 time: 0.154797 Oct 31 15:09:07.224130 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3711/7170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:07 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:07.247427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:07.248036 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:07.255046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:07.255532 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:07.255970 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:07.256725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:07.257169 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:07.257585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:07.388059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:07.396851 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bce0832f-0bba-4134-9be1-a675a2947dda tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1554 microversion: 2.1 time: 0.153649 Oct 31 15:09:07.397435 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3460/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:07 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:08.935589 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b473fc45-6653-4f7c-9cb1-5b3e4ef4e749"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:08.937981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:08.940011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:08.945629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:08.946131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:08.946615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:08.947316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:08.947784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:08.948229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:09.187467 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-593d54a6-9b21-41b3-9012-01888b737259 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255824 Oct 31 15:09:09.188098 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3712/7172] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 15:09:08 2022] POST /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:19.903463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:19.903972 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:19.905941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:19.906710 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:19.908319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:19.909070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:19.916536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:19.917043 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:19.917509 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:19.918250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:19.918720 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:19.919153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:20.002344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lazy-loading 'services' on Instance uuid b1f979a9-af13-4c71-9e01-0e3be2e162dc {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:09:20.073153 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7342434c-a61d-4820-a5b2-09c50595f06c tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments/b473fc45-6653-4f7c-9cb1-5b3e4ef4e749" status: 202 len: 0 microversion: 2.1 time: 0.173359 Oct 31 15:09:20.073839 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3461/7173] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:09:19 2022] DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments/b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:09:20.080512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:20.081363 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:20.085579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:20.088048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:20.097902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:20.098440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:20.098899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:20.099886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:20.100073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:20.100513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:20.133507 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3de8fa10-8d5b-461e-af9e-607e21cf135a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054796 Oct 31 15:09:20.134084 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3713/7174] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:20 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:21.146458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:21.149011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:21.157357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:21.157851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:21.158389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:21.159104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:21.159543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:21.159968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:21.193607 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ff1f5db-ff3f-4025-8cfc-074fb9de890f tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051508 Oct 31 15:09:21.194214 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3462/7175] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:21 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:22.206297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:22.208515 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:22.215588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:22.216079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:22.216532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:22.217228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:22.217690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:22.218126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:22.248998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bd02412-f7fb-44a2-86f1-d77c13f660c6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Oct 31 15:09:22.249565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3714/7176] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:22 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:23.262364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:23.264633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:23.273094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:23.273596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:23.274239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:23.274957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:23.275506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:23.275939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:23.312646 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4c9705a3-173d-4d6a-a616-f075c6dd70b5 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054388 Oct 31 15:09:23.313731 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3463/7177] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:23 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:24.325141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:24.327390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:24.334730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:24.335240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:24.335698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:24.336417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:24.336887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:24.337327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:24.371627 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36fdd4b9-cd1b-43eb-9012-0e903791b9c1 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050490 Oct 31 15:09:24.372227 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3715/7178] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:24 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:25.385120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:25.387346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:25.394050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:25.394562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:25.395084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:25.395904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:25.396358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:25.396783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:25.426937 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-565f0634-8539-4197-a442-68bd419bd59d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046149 Oct 31 15:09:25.427504 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3464/7179] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:25 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:09:25.439449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:25.439958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:25.446844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:25.447339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:25.447786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:25.448488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:25.448951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:25.449385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:25.527946 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] HTTP exception thrown: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc is not attached to volume b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Request method failure captured: Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments/b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 HTTP/1.1 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-TdWNUqYkSnh1xBARFAtvi7wEMFwyQ5KMCvCctnhaICGW9krzy0LxVM-ppWuxJnHOzKCjtSeX5IACN-rHCxBHDEwJJMItNg48-aEMkpOqV-fO3vS86kPzNYkgduW2iLwBKiQ6ErvrgkN4cxn6bBP446BN9bRSP1kRwhS_91yS1rXaQ Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54bfa020dc904dbd9fe545acf4c692c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 73f7faf531af426a8f4c702dc089e8da Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc is not attached to volume b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': 'b1f979a9-af13-4c71-9e01-0e3be2e162dc', 'id': 'b473fc45-6653-4f7c-9cb1-5b3e4ef4e749'} Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b473fc45-6653-4f7c-9cb1-5b3e4ef4e749. Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc is not attached to volume b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:09:25.529563 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc is not attached to volume b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Returning 404 to user: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc is not attached to volume b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c718bf9-c209-4544-ad85-480bab27d2cd tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments/b473fc45-6653-4f7c-9cb1-5b3e4ef4e749" status: 404 len: 154 microversion: 2.1 time: 0.096172 Oct 31 15:09:25.534230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3716/7180] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:09:25 2022] DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc/os-volume_attachments/b473fc45-6653-4f7c-9cb1-5b3e4ef4e749 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:09:28.901284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:28.902038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:28.911099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:28.911721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:28.912408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:28.913235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:28.913765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:28.914337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:28.942562 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:09:29.033058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ff12d36-b8b5-48f6-a206-538575461207 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 204 len: 0 microversion: 2.1 time: 0.135438 Oct 31 15:09:29.040031 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3465/7181] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:09:28 2022] DELETE /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:09:29.047542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:29.047542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:29.055155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:29.055673 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:29.056165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:29.056912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:29.057365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:29.057805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:29.202592 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:29.211328 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24c86e0d-fbbe-4b3e-99c2-e28ecfed3321 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1560 microversion: 2.1 time: 0.169699 Oct 31 15:09:29.211915 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3717/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:29 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:30.236077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:30.236745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:30.243880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:30.244374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:30.244825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:30.245527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:30.245985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:30.246447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:30.388415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:30.396864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b507b24-1378-4717-ac75-74708c021b15 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1560 microversion: 2.1 time: 0.165565 Oct 31 15:09:30.397453 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3466/7183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:30 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:31.059770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-52d7389b-d6ea-4474-b47f-9c8e46d75fb9 req-4a725c6e-a66a-4fb4-a3b7-dce7b1c98cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f979a9-af13-4c71-9e01-0e3be2e162dc", "name": "network-vif-deleted", "tag": "dd457fb6-b022-4fbf-94c7-bd7f5de041e2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:31.075353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52d7389b-d6ea-4474-b47f-9c8e46d75fb9 req-4a725c6e-a66a-4fb4-a3b7-dce7b1c98cc3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:31.075858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52d7389b-d6ea-4474-b47f-9c8e46d75fb9 req-4a725c6e-a66a-4fb4-a3b7-dce7b1c98cc3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:31.076514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-52d7389b-d6ea-4474-b47f-9c8e46d75fb9 req-4a725c6e-a66a-4fb4-a3b7-dce7b1c98cc3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:31.091681 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-52d7389b-d6ea-4474-b47f-9c8e46d75fb9 req-4a725c6e-a66a-4fb4-a3b7-dce7b1c98cc3 service nova] Creating event network-vif-deleted:dd457fb6-b022-4fbf-94c7-bd7f5de041e2 for instance b1f979a9-af13-4c71-9e01-0e3be2e162dc on n-h2-863052-1 Oct 31 15:09:31.098758 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-52d7389b-d6ea-4474-b47f-9c8e46d75fb9 req-4a725c6e-a66a-4fb4-a3b7-dce7b1c98cc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048176 Oct 31 15:09:31.099511 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3718/7184] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:31.420677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:31.421563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:31.428649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:31.429146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:31.429598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:31.430342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:31.430804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:31.431237 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:31.465903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:31.466406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:31.466845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:31.467316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lazy-loading 'fault' on Instance uuid b1f979a9-af13-4c71-9e01-0e3be2e162dc {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:09:31.519993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:31.529148 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f544d486-f0ae-430c-b72c-3c83fa11b631 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 200 len: 1351 microversion: 2.1 time: 0.112423 Oct 31 15:09:31.536625 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3467/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:31 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:32.553945 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:32.554700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: b1f979a9-af13-4c71-9e01-0e3be2e162dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:32.562231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:32.562675 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:32.563123 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:32.563835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:32.564299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:32.564742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:32.579438 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] HTTP exception thrown: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc could not be found. Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Request method failure captured: Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc HTTP/1.1 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-TdWNUqYkSnh1xBARFAtvi7wEMFwyQ5KMCvCctnhaICGW9krzy0LxVM-ppWuxJnHOzKCjtSeX5IACN-rHCxBHDEwJJMItNg48-aEMkpOqV-fO3vS86kPzNYkgduW2iLwBKiQ6ErvrgkN4cxn6bBP446BN9bRSP1kRwhS_91yS1rXaQ Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54bfa020dc904dbd9fe545acf4c692c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 73f7faf531af426a8f4c702dc089e8da Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc could not be found. Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'b1f979a9-af13-4c71-9e01-0e3be2e162dc'} Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc could not be found. Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc could not be found. Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:09:32.581210 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc could not be found. Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Returning 404 to user: Instance b1f979a9-af13-4c71-9e01-0e3be2e162dc could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-257dcb3e-d45a-4b44-89b1-2a7e3b03602d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc" status: 404 len: 111 microversion: 2.1 time: 0.033123 Oct 31 15:09:32.585525 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3719/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:32 2022] GET /compute/v2.1/servers/b1f979a9-af13-4c71-9e01-0e3be2e162dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:09:32.595604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6c8bf72b-ca07-4f7b-8170-44264cf74f27 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '.version_select at 0x7fe107ab8f70>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:32.618489 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6c8bf72b-ca07-4f7b-8170-44264cf74f27 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1160781953" status: 202 len: 0 microversion: 2.1 time: 0.030175 Oct 31 15:09:32.619100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3468/7187] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 31 15:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1160781953 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:09:32.636060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0c0296b-7694-462c-ac1e-c51eecda8e51 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: .version_select at 0x7fe107871d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1645019632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyNipvPF5R0Dq4xMK9cHkLDTgYJCiZ0k6p9zxP28AZcalsbQKAxd/8UTIYK3TJnKDEFmhBJYGbsODO1lllMpMM2pDfkcoNBiLguTIg40bUYETSs4PlsndQz65PsGEaGKw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:32.652323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a0c0296b-7694-462c-ac1e-c51eecda8e51 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:09:32.658011 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a0c0296b-7694-462c-ac1e-c51eecda8e51 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for user 73f7faf531af426a8f4c702dc089e8da and project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:09:32.683250 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0c0296b-7694-462c-ac1e-c51eecda8e51 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050541 Oct 31 15:09:32.683870 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3720/7188] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:09:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:09:32.876192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1187037192", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1645019632", "networks": [{"uuid": "e313d9ea-6db4-4810-8ab1-b7f7003b815d"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:32.930585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] validate_networks() for [('e313d9ea-6db4-4810-8ab1-b7f7003b815d', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:09:33.336042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:09:33.336469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:09:33.336943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:09:33.337353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:09:33.337776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:09:33.346846 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:33.347337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:33.347773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:33.348508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:33.348961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:33.349387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:33.369003 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:09:33.374607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Getting quotas for user 73f7faf531af426a8f4c702dc089e8da and project 54bfa020dc904dbd9fe545acf4c692c4. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:09:33.388133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:09:33.390518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:09:33.438656 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-952d9370-a737-40e6-abb8-480e13013af2 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566243 Oct 31 15:09:33.439312 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3469/7189] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:09:33.450571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e21a528-d5b3-4645-98de-d68257591346 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:33.451258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e21a528-d5b3-4645-98de-d68257591346 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:33.508789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e21a528-d5b3-4645-98de-d68257591346 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:33.515924 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e21a528-d5b3-4645-98de-d68257591346 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1263 microversion: 2.1 time: 0.069190 Oct 31 15:09:33.516512 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3721/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:33 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:34.539376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:34.539996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:34.548098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:34.548815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:34.549260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:34.549969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:34.550441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:34.550865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:34.618015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:34.626787 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75a69b0d-798d-4177-a608-c72a071ecfb7 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1333 microversion: 2.1 time: 0.091542 Oct 31 15:09:34.627379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3470/7191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:34 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:35.651298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:35.651946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:35.659575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:35.660099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:35.660638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:35.661278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:35.661755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:35.662227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:35.875711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:35.881663 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c312f864-1216-4d42-bd52-811c0e79447e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1363 microversion: 2.1 time: 0.234286 Oct 31 15:09:35.882286 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3722/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:35 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:35.941129 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fb3d5727-8ad6-45ee-b6f9-618640dd3e73 req-7fc7b370-9954-4f14-be8c-a9322d41bd0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bec1362-fc43-4719-a38f-063486c747ec", "tag": "d8400a76-dd9b-4e19-8460-b96cda3cad37"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:35.953736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb3d5727-8ad6-45ee-b6f9-618640dd3e73 req-7fc7b370-9954-4f14-be8c-a9322d41bd0c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:35.954337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb3d5727-8ad6-45ee-b6f9-618640dd3e73 req-7fc7b370-9954-4f14-be8c-a9322d41bd0c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:35.954768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb3d5727-8ad6-45ee-b6f9-618640dd3e73 req-7fc7b370-9954-4f14-be8c-a9322d41bd0c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:35.968342 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fb3d5727-8ad6-45ee-b6f9-618640dd3e73 req-7fc7b370-9954-4f14-be8c-a9322d41bd0c service nova] Creating event network-changed:d8400a76-dd9b-4e19-8460-b96cda3cad37 for instance 8bec1362-fc43-4719-a38f-063486c747ec on n-h2-863052-1 Oct 31 15:09:35.973523 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fb3d5727-8ad6-45ee-b6f9-618640dd3e73 req-7fc7b370-9954-4f14-be8c-a9322d41bd0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036587 Oct 31 15:09:35.974129 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3471/7193] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:09:36.905397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:36.905951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:36.913434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:36.913953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:36.914436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:36.915249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:36.915911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:36.916358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:37.059597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:37.067461 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4707f512-680c-4fc1-81f3-dc5ea59bdf37 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1363 microversion: 2.1 time: 0.166197 Oct 31 15:09:37.068050 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3723/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:36 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:38.091879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:38.092585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:38.099765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:38.100257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:38.100729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:38.101433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:38.101891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:38.102608 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:38.236380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:38.244339 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5305001-7931-49cf-b6b7-1000776743ad tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1363 microversion: 2.1 time: 0.156676 Oct 31 15:09:38.244928 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3472/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:38 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:39.269063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:39.269687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:39.276441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:39.276941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:39.277385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:39.278092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:39.278584 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:39.279017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:39.419456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:39.427820 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41c74fb7-67c2-4c7c-b0e8-120e1e732831 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1363 microversion: 2.1 time: 0.163337 Oct 31 15:09:39.428407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3724/7196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:39 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:40.450729 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:40.451355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:40.459115 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:40.459613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:40.460058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:40.460774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:40.461238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:40.461676 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:40.601301 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:40.609882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-763da028-b403-43f0-bbba-b7d976f9829a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1363 microversion: 2.1 time: 0.162739 Oct 31 15:09:40.610696 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3473/7197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:40 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:41.574490 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ee5c0c36-4cf3-488d-beb3-484068baa81f req-c8855ba4-a707-4cc5-b888-c67e5d40308f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bec1362-fc43-4719-a38f-063486c747ec", "name": "network-vif-plugged", "status": "completed", "tag": "d8400a76-dd9b-4e19-8460-b96cda3cad37"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:41.587479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ee5c0c36-4cf3-488d-beb3-484068baa81f req-c8855ba4-a707-4cc5-b888-c67e5d40308f service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:41.587989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ee5c0c36-4cf3-488d-beb3-484068baa81f req-c8855ba4-a707-4cc5-b888-c67e5d40308f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:41.588440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ee5c0c36-4cf3-488d-beb3-484068baa81f req-c8855ba4-a707-4cc5-b888-c67e5d40308f service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:41.604753 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ee5c0c36-4cf3-488d-beb3-484068baa81f req-c8855ba4-a707-4cc5-b888-c67e5d40308f service nova] Creating event network-vif-plugged:d8400a76-dd9b-4e19-8460-b96cda3cad37 for instance 8bec1362-fc43-4719-a38f-063486c747ec on n-h2-863052-1 Oct 31 15:09:41.612577 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ee5c0c36-4cf3-488d-beb3-484068baa81f req-c8855ba4-a707-4cc5-b888-c67e5d40308f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041918 Oct 31 15:09:41.613486 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3725/7198] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:41.632925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:41.633531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:41.641925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:41.642677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:41.643314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:41.644042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:41.644500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:41.645112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:41.788936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:41.797367 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19a2246f-8053-4e91-8647-58465285671d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1363 microversion: 2.1 time: 0.167821 Oct 31 15:09:41.797958 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3474/7199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:41 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:42.821719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:42.822455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:42.830459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:42.830956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:42.831403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:42.832113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:42.832576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:42.833013 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:42.969855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:42.977643 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9ae4f57-a7d5-4daa-8622-f5f1730e6298 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1555 microversion: 2.1 time: 0.160351 Oct 31 15:09:42.978236 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3726/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:42 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:43.001641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:43.002307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:43.009171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:43.009666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:43.010109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:43.010863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:43.011325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:43.011755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:43.150034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:43.158236 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16c11b26-9f2e-43ec-82de-acfaba7d55d9 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1555 microversion: 2.1 time: 0.160989 Oct 31 15:09:43.158832 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3475/7201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:42 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:44.679807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20ea2c8-22d4-459a-b244-cdba90e00a27"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:44.682250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:44.684361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:44.691008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:44.691506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:44.691953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:44.692660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:44.693120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:44.693554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:44.944625 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41349d48-57f2-4ed5-9efa-450fd6201b98 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "POST /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268365 Oct 31 15:09:44.945020 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3727/7202] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 15:09:44 2022] POST /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:55.701674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:55.702284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:55.704478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.705189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.705934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.706585 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.713310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:55.713804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:55.714273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:55.714985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:55.715442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:55.715870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:55.805467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lazy-loading 'services' on Instance uuid 8bec1362-fc43-4719-a38f-063486c747ec {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:09:55.879009 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94669acb-ee1d-4138-9d12-c7259f52f14a tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments/b20ea2c8-22d4-459a-b244-cdba90e00a27" status: 202 len: 0 microversion: 2.1 time: 0.181100 Oct 31 15:09:55.879761 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3476/7203] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:09:55 2022] DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments/b20ea2c8-22d4-459a-b244-cdba90e00a27 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:09:55.886723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.887610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.892173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:55.894746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:55.904521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:55.904521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:55.904521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:55.905276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:55.905642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:55.906097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:55.941878 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0af12f27-9728-4089-a09d-16a9acf33f40 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057084 Oct 31 15:09:55.942494 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3728/7204] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:55 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:56.957330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:56.963416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:56.968054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:56.968548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:56.969148 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:56.969874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:56.970349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:56.970779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:57.003833 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dc94c603-9904-42bd-a8da-d5854e152561 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052315 Oct 31 15:09:57.004427 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3477/7205] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:56 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:58.017307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:58.019726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:58.027089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:58.027588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:58.028035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:58.028766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:58.029230 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:58.029665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:58.065012 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39c6e548-352a-4052-b661-d9950c85a83d tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052264 Oct 31 15:09:58.067267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3729/7206] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:58 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:59.077632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:59.080634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:59.088026 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:59.088544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:59.088981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:59.089692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:59.090143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:59.090600 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:59.122183 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b5872a7-e035-430e-aca5-31edd0c40b69 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048575 Oct 31 15:09:59.122794 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3478/7207] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:09:59 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:00.137108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:00.139430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:00.147643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:00.148231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:00.148702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:00.149397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:00.149856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:00.150327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:00.183276 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7cf6938-6af7-4736-bcec-fe777f2008d6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050187 Oct 31 15:10:00.183866 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3730/7208] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:10:00 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:01.195089 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:01.197409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:01.204903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:01.205405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:01.205855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:01.206646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:01.207116 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:01.207549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:01.242216 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-44fa2f6c-bb92-4e48-b1a8-edbd9c268c6e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051055 Oct 31 15:10:01.242802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3479/7209] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:10:01 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:10:01.254450 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:01.254978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:01.262049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:01.262590 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:01.263048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:01.263765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:01.264372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:01.264682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:01.353183 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] HTTP exception thrown: Instance 8bec1362-fc43-4719-a38f-063486c747ec is not attached to volume b20ea2c8-22d4-459a-b244-cdba90e00a27 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Request method failure captured: Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments/b20ea2c8-22d4-459a-b244-cdba90e00a27 HTTP/1.1 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-TdWNUqYkSnh1xBARFAtvi7wEMFwyQ5KMCvCctnhaICGW9krzy0LxVM-ppWuxJnHOzKCjtSeX5IACN-rHCxBHDEwJJMItNg48-aEMkpOqV-fO3vS86kPzNYkgduW2iLwBKiQ6ErvrgkN4cxn6bBP446BN9bRSP1kRwhS_91yS1rXaQ Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54bfa020dc904dbd9fe545acf4c692c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 73f7faf531af426a8f4c702dc089e8da Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 8bec1362-fc43-4719-a38f-063486c747ec is not attached to volume b20ea2c8-22d4-459a-b244-cdba90e00a27 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'server_id': '8bec1362-fc43-4719-a38f-063486c747ec', 'id': 'b20ea2c8-22d4-459a-b244-cdba90e00a27'} Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b20ea2c8-22d4-459a-b244-cdba90e00a27. Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bec1362-fc43-4719-a38f-063486c747ec is not attached to volume b20ea2c8-22d4-459a-b244-cdba90e00a27 Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:01.354871 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bec1362-fc43-4719-a38f-063486c747ec is not attached to volume b20ea2c8-22d4-459a-b244-cdba90e00a27 Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Returning 404 to user: Instance 8bec1362-fc43-4719-a38f-063486c747ec is not attached to volume b20ea2c8-22d4-459a-b244-cdba90e00a27 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5bc5f67-f9fb-4219-8cd4-a1c0f63e91b6 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments/b20ea2c8-22d4-459a-b244-cdba90e00a27" status: 404 len: 154 microversion: 2.1 time: 0.106616 Oct 31 15:10:01.360136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3731/7210] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:10:01 2022] DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec/os-volume_attachments/b20ea2c8-22d4-459a-b244-cdba90e00a27 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:10:04.720952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:04.721796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:04.732071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:04.732584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:04.733030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:04.733755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:04.735032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:04.735470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:04.766423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:10:04.850670 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b019deee-c6c1-4f8f-b6d1-8ed15177cc65 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 204 len: 0 microversion: 2.1 time: 0.133366 Oct 31 15:10:04.851614 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3480/7211] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:10:04 2022] DELETE /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:10:04.865340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:04.866659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:04.878520 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:04.879042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:04.879475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:04.880195 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:04.880653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:04.881262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:05.023997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:05.032358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7179f5aa-19da-4d2f-9841-c0f5a2260fc3 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1561 microversion: 2.1 time: 0.175516 Oct 31 15:10:05.032930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3732/7212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:04 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:06.057443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:06.058273 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:06.065336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:06.065828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:06.066330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:06.067042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:06.067495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:06.067921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:06.199878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:06.208931 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b182d2e6-5d08-427a-b9ee-8077af28da3e tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1561 microversion: 2.1 time: 0.155877 Oct 31 15:10:06.209519 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3481/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:06 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:06.872747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-63a7b333-6d4b-4f6b-99f9-3fa6582c23c5 req-4d61290b-d551-48ef-8bbc-ea959d6f01d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bec1362-fc43-4719-a38f-063486c747ec", "name": "network-vif-deleted", "tag": "d8400a76-dd9b-4e19-8460-b96cda3cad37"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:06.887952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-63a7b333-6d4b-4f6b-99f9-3fa6582c23c5 req-4d61290b-d551-48ef-8bbc-ea959d6f01d3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:06.888460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-63a7b333-6d4b-4f6b-99f9-3fa6582c23c5 req-4d61290b-d551-48ef-8bbc-ea959d6f01d3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:06.888912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-63a7b333-6d4b-4f6b-99f9-3fa6582c23c5 req-4d61290b-d551-48ef-8bbc-ea959d6f01d3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:06.902462 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-63a7b333-6d4b-4f6b-99f9-3fa6582c23c5 req-4d61290b-d551-48ef-8bbc-ea959d6f01d3 service nova] Creating event network-vif-deleted:d8400a76-dd9b-4e19-8460-b96cda3cad37 for instance 8bec1362-fc43-4719-a38f-063486c747ec on n-h2-863052-1 Oct 31 15:10:06.912074 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-63a7b333-6d4b-4f6b-99f9-3fa6582c23c5 req-4d61290b-d551-48ef-8bbc-ea959d6f01d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042917 Oct 31 15:10:06.912812 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3733/7214] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:07.232539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:07.233077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:07.241153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:07.241644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:07.242087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:07.242817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:07.243274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:07.243711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:07.276992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:07.277481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:07.277923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:07.278413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lazy-loading 'fault' on Instance uuid 8bec1362-fc43-4719-a38f-063486c747ec {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:10:07.322494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f7faf531af426a8f4c702dc089e8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bfa020dc904dbd9fe545acf4c692c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:07.330889 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b67b77c-2b73-419a-965b-287a824ba19b tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 200 len: 1353 microversion: 2.1 time: 0.102645 Oct 31 15:10:07.332720 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3482/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:07 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:08.356650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:08.357372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] [instance: 8bec1362-fc43-4719-a38f-063486c747ec] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:08.363946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:08.364472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:08.364932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:08.365645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:08.366206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:08.366577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:08.381044 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] HTTP exception thrown: Instance 8bec1362-fc43-4719-a38f-063486c747ec could not be found. Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Request method failure captured: Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec HTTP/1.1 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-TdWNUqYkSnh1xBARFAtvi7wEMFwyQ5KMCvCctnhaICGW9krzy0LxVM-ppWuxJnHOzKCjtSeX5IACN-rHCxBHDEwJJMItNg48-aEMkpOqV-fO3vS86kPzNYkgduW2iLwBKiQ6ErvrgkN4cxn6bBP446BN9bRSP1kRwhS_91yS1rXaQ Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54bfa020dc904dbd9fe545acf4c692c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54bfa020dc904dbd9fe545acf4c692c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: 54bfa020dc904dbd9fe545acf4c692c4 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-281047162 Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 73f7faf531af426a8f4c702dc089e8da Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestEncryptedCinderVolumes-281047162-project Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 8bec1362-fc43-4719-a38f-063486c747ec could not be found. Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '8bec1362-fc43-4719-a38f-063486c747ec'} Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bec1362-fc43-4719-a38f-063486c747ec could not be found. Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bec1362-fc43-4719-a38f-063486c747ec could not be found. Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:08.382784 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bec1362-fc43-4719-a38f-063486c747ec could not be found. Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Returning 404 to user: Instance 8bec1362-fc43-4719-a38f-063486c747ec could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6837c951-9cb7-45d3-90e8-ecd4f9e48e16 tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec" status: 404 len: 111 microversion: 2.1 time: 0.032839 Oct 31 15:10:08.387270 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3734/7216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:08 2022] GET /compute/v2.1/servers/8bec1362-fc43-4719-a38f-063486c747ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:10:08.393797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-36cf48f3-013a-4a1b-9dce-3e7a208483ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] Calling method '.version_select at 0x7fe107aae1f0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:08.413773 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-36cf48f3-013a-4a1b-9dce-3e7a208483ab tempest-TestEncryptedCinderVolumes-281047162 tempest-TestEncryptedCinderVolumes-281047162-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1645019632" status: 202 len: 0 microversion: 2.1 time: 0.024413 Oct 31 15:10:08.414502 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3483/7217] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 31 15:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1645019632 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:10:36.486559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00630f47-a375-4f23-8341-7a99c8c27ab1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'create', calling method: .version_select at 0x7fe10fc983a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1872759564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9g0IccLnpDwo3vViGoAz49tzMywUa9GpbHs1LUXtF1HXyVJEVMo3zg18xAVyuMzjYf2GXp95qp1tUGghegx/SldnDTecj+iloSGSAcOgXVP+Fr3aFHCMKagOUT/XSESQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:36.495232 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=14 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:36.496104 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=34 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:36.507682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-00630f47-a375-4f23-8341-7a99c8c27ab1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:10:36.513879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-00630f47-a375-4f23-8341-7a99c8c27ab1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for user 906072a954884c78af2e40a19ab7ebf5 and project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:10:36.539331 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00630f47-a375-4f23-8341-7a99c8c27ab1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057677 Oct 31 15:10:36.539972 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3735/7218] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:10:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:36.593714 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:36.594526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:36.600428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1746600350", "imageRef": "02acd921-5786-407f-a4ff-34f2572cfda5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1872759564", "networks": [{"uuid": "e1a1a7f7-16e0-4b43-b7fc-f6e60de9488c"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:36.657073 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] validate_networks() for [('e1a1a7f7-16e0-4b43-b7fc-f6e60de9488c', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:10:37.059044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:10:37.059476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:10:37.059960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:10:37.060378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:10:37.060797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:10:37.076143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:37.076636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:37.077074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:37.077830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:37.078320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:37.078750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:37.097080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:10:37.102561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for user 906072a954884c78af2e40a19ab7ebf5 and project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:10:37.116037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:10:37.118351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='02acd921-5786-407f-a4ff-34f2572cfda5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:10:37.165782 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d58092b7-c3d6-4237-b10f-16ed234de362 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574174 Oct 31 15:10:37.166478 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3484/7219] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:10:37.178155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-487be9b6-88e3-4967-85d6-d6649ea87bba tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:37.179117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-487be9b6-88e3-4967-85d6-d6649ea87bba tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:37.236732 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-487be9b6-88e3-4967-85d6-d6649ea87bba tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:37.243847 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-487be9b6-88e3-4967-85d6-d6649ea87bba tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1259 microversion: 2.1 time: 0.069683 Oct 31 15:10:37.244437 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3736/7220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:37 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:38.270947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:38.271525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:38.280188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:38.280735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:38.281230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:38.281944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:38.282432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:38.282859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:38.357184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:38.365666 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2156a2f6-bbda-455a-ac0d-90e5308955e8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1319 microversion: 2.1 time: 0.100897 Oct 31 15:10:38.366597 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3485/7221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:38 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:39.397549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:39.398905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:39.411747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:39.414876 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:39.415448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:39.416317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:39.422262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:39.423069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:39.594015 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:39.602460 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-598367fd-fac5-41b3-a577-325c402a5e7f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.208930 Oct 31 15:10:39.603060 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3737/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:39 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:40.628488 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:40.629101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:40.636314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:40.636806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:40.637244 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:40.638035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:40.638435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:40.638867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:40.800219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:40.808981 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0205ae76-a086-41d3-9577-bad0791b0e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.185385 Oct 31 15:10:40.809931 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3486/7223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:40 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:41.833211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:41.834001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:41.841661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:41.842201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:41.842700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:41.844033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:41.844571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:41.845049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:42.114821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:42.126599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6d00915-49ea-47b0-b9de-c658955ba67a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.297294 Oct 31 15:10:42.128316 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3738/7224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:41 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:43.161735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:43.162410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:43.169802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:43.170339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:43.170790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:43.171546 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:43.172016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:43.172444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:43.330897 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:43.339508 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb65c634-09d5-4869-ac0c-0827d159c4ad tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.181581 Oct 31 15:10:43.340203 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3487/7225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:43 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:44.365053 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:44.365800 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:44.373174 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:44.374859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:44.375333 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:44.376105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:44.376585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:44.377025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:44.537445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:44.545913 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6abbbe76-d942-4ad6-9180-40cf43b1a92a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.184832 Oct 31 15:10:44.547708 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3739/7226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:44 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:45.570651 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:45.571477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:45.579825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:45.580371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:45.580816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:45.581603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:45.582060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:45.582564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:45.727671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:45.736333 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fada6dc-b004-4dc1-9c0b-33ed849191b5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.169651 Oct 31 15:10:45.736913 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3488/7227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:45 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:10:46.761034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:46.761916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:46.769856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:46.770415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:46.770892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:46.772212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:46.772212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:46.772665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:46.979399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:46.987893 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99c6a3a1-3d65-45fb-b8f9-98e9304e3373 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.230783 Oct 31 15:10:46.988606 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3740/7228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:46 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:47.084960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-4eaaa42c-8b5f-445c-a033-d2fb60877f86 req-770ec417-191e-4395-8681-ad917e56e136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:47.093628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.099632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4eaaa42c-8b5f-445c-a033-d2fb60877f86 req-770ec417-191e-4395-8681-ad917e56e136 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:47.100213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4eaaa42c-8b5f-445c-a033-d2fb60877f86 req-770ec417-191e-4395-8681-ad917e56e136 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:47.100712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-4eaaa42c-8b5f-445c-a033-d2fb60877f86 req-770ec417-191e-4395-8681-ad917e56e136 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:47.112567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.115697 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-4eaaa42c-8b5f-445c-a033-d2fb60877f86 req-770ec417-191e-4395-8681-ad917e56e136 service nova] Creating event network-changed:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:10:47.125089 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-4eaaa42c-8b5f-445c-a033-d2fb60877f86 req-770ec417-191e-4395-8681-ad917e56e136 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043311 Oct 31 15:10:47.125802 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3489/7229] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:48.013378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:48.014080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:48.016465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:48.022671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:48.023173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:48.023624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:48.024360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:48.024818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:48.025257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:48.162702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:48.171126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5335db4-39a8-4530-a7e9-176951c0ebe6 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.162095 Oct 31 15:10:48.171728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3741/7230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:48 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:49.195243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:49.195949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:49.202808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:49.203309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:49.203748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:49.204471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:49.204925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:49.205349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:49.345904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:49.353969 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cbd0ebe1-3606-417c-ad61-69a071159150 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.164068 Oct 31 15:10:49.354590 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3490/7231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:49 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:50.377588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:50.378276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:50.389505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:50.390631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:50.391093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:50.391824 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:50.392295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:50.392736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:50.542399 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:50.550346 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44e9e292-aaad-48bb-a52a-c3897b053a37 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.176623 Oct 31 15:10:50.550930 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3742/7232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:50 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:51.573769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:51.574420 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:51.582072 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:51.582623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:51.583049 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:51.583769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:51.584230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:51.584669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:51.724832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:51.736576 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-082bf049-757a-4316-a7f2-ff6b6b416df4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.166689 Oct 31 15:10:51.744618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3491/7233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:51 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:51.885751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-769afa73-740e-4773-b30c-7dc56e678058 req-ccbe52d5-b994-4615-84ef-64837a6594f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "name": "network-vif-plugged", "status": "completed", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:51.898738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-769afa73-740e-4773-b30c-7dc56e678058 req-ccbe52d5-b994-4615-84ef-64837a6594f8 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:51.898738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-769afa73-740e-4773-b30c-7dc56e678058 req-ccbe52d5-b994-4615-84ef-64837a6594f8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:51.898738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-769afa73-740e-4773-b30c-7dc56e678058 req-ccbe52d5-b994-4615-84ef-64837a6594f8 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:51.911008 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-769afa73-740e-4773-b30c-7dc56e678058 req-ccbe52d5-b994-4615-84ef-64837a6594f8 service nova] Creating event network-vif-plugged:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:10:51.916449 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-769afa73-740e-4773-b30c-7dc56e678058 req-ccbe52d5-b994-4615-84ef-64837a6594f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034741 Oct 31 15:10:51.917157 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3743/7234] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:52.760391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:52.760963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:52.768080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:52.768571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:52.769014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:52.769724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:52.770208 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:52.770644 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:53.094669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:53.103424 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af646ffa-12e6-467f-98f4-b6a5d57aa7b4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1359 microversion: 2.1 time: 0.346996 Oct 31 15:10:53.104114 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3492/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:52 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:54.129534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:54.130424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:54.136698 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.137204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.137670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.138393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.138859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.139296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.337158 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:54.344957 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09a8ac45-a4da-48d5-b537-06a4c79fe691 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1549 microversion: 2.1 time: 0.221051 Oct 31 15:10:54.345579 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3744/7236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:54 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1549 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:54.368555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:54.369180 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:54.376838 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.377341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.377788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.378542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.379010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.379447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.518881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:54.529670 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c589625f-648e-409c-aefc-fb656d7c611a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1549 microversion: 2.1 time: 0.165220 Oct 31 15:10:54.530971 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3493/7237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:54 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:54.553235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:54.557892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:54.558703 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Searching by: {'deleted': False, 'project_id': '4897ca8f72a34f87b714f3d0542900b6'} {{(pid=120640) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:10:54.564152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.564639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.565080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.565799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.566381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.566816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.591755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.multi_cell_list [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:10:54.621543 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d69848bf-5e04-4c88-a0f4-a01abe6e8d15 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072067 Oct 31 15:10:54.622145 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3745/7238] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 15:10:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:54.636000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:54.637062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:54.643440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.643971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.644552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.645604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.646409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.647095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.781796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:54.789997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ede8a5c4-b236-4646-9194-58d860c96815 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1549 microversion: 2.1 time: 0.159475 Oct 31 15:10:54.790675 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3494/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:54 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:56.366588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad698a61-16c0-4181-8ed5-dba833e42360"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:56.368994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:56.376323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:56.376822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:56.377272 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:56.377981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:56.378480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:56.378922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:56.634656 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78f71715-0dea-4eba-866d-9c7f5a593677 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271955 Oct 31 15:10:56.635286 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3746/7240] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 15:10:56 2022] POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:11:09.735446 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:11:09.736099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:11:09.738538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:09.739196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=58 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:09.746037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:09.746568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:09.747011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:09.747716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:09.748168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:09.749084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:09.887484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:11:09.896699 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9bfd9d4-4bbc-4518-b517-cc56a69e7a63 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1595 microversion: 2.1 time: 0.165497 Oct 31 15:11:09.897287 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3495/7241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:11:09 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1595 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:11:11.632577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:11.633881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:11.634764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:11.639829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a57d6b89-f6a5-4647-9f67-c885936515da req-1a899c92-8681-432b-af34-7b82294cf164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:11:11.653778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a57d6b89-f6a5-4647-9f67-c885936515da req-1a899c92-8681-432b-af34-7b82294cf164 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:11.654465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a57d6b89-f6a5-4647-9f67-c885936515da req-1a899c92-8681-432b-af34-7b82294cf164 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:11.654992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a57d6b89-f6a5-4647-9f67-c885936515da req-1a899c92-8681-432b-af34-7b82294cf164 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:11.667845 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a57d6b89-f6a5-4647-9f67-c885936515da req-1a899c92-8681-432b-af34-7b82294cf164 service nova] Creating event network-changed:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:11:11.674672 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a57d6b89-f6a5-4647-9f67-c885936515da req-1a899c92-8681-432b-af34-7b82294cf164 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044126 Oct 31 15:11:11.675933 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3747/7242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:11:12.891687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1994686786"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:11:12.892298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:11:12.899768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:12.900452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:12.900708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:12.901425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:12.901883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:12.902353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:13.354656 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Adding security group 3ed597cf-bf9e-4000-b1b1-09ac6fc5001b to port 9809510c-dd14-45c1-991e-873335e3603c Oct 31 15:11:13.691321 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9fb29fe2-9591-4433-a59d-49c7a51a2377 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action" status: 202 len: 0 microversion: 2.1 time: 0.798815 Oct 31 15:11:13.691321 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3496/7243] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:11:12 2022] POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:11:13.695711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-81899ff2-b897-4858-b4f8-cb1f9a587fc7 req-e1901953-8ef6-456d-beed-f6c1fea14df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:11:13.701681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:11:13.710581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:11:13.720518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:13.722933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:13.723530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:13.724298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:13.725332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:13.725332 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:13.727771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-81899ff2-b897-4858-b4f8-cb1f9a587fc7 req-e1901953-8ef6-456d-beed-f6c1fea14df6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:11:13.728274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-81899ff2-b897-4858-b4f8-cb1f9a587fc7 req-e1901953-8ef6-456d-beed-f6c1fea14df6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:11:13.728727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-81899ff2-b897-4858-b4f8-cb1f9a587fc7 req-e1901953-8ef6-456d-beed-f6c1fea14df6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:11:13.755142 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-81899ff2-b897-4858-b4f8-cb1f9a587fc7 req-e1901953-8ef6-456d-beed-f6c1fea14df6 service nova] Creating event network-changed:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:11:13.764265 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-81899ff2-b897-4858-b4f8-cb1f9a587fc7 req-e1901953-8ef6-456d-beed-f6c1fea14df6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071877 Oct 31 15:11:13.766387 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3748/7244] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:11:13.912431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:11:13.922234 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd1e2fc2-a0aa-46d5-9c49-d3740bb5f5c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1761 microversion: 2.1 time: 0.224537 Oct 31 15:11:13.923485 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3497/7245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:11:13 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1761 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:12:51.198281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:51.199131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:51.201007 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 15:12:51.201160 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action (ip 10.222.0.27) !!! Oct 31 15:12:51.202972 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:12:51.203115 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action (ip 10.222.0.27) !!! Oct 31 15:12:51.210948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:12:51.213893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:12:51.225125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:51.225623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:51.226067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:51.226799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:51.227263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:51.227692 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:51.306965 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-327e82a3-86ce-4d6b-8064-5c41d5d9175a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action" status: 202 len: 0 microversion: 2.1 time: 0.110793 Oct 31 15:12:51.307938 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3749/7246] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:12:51 2022] POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:12:51.314444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:51.315194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:51.316781 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:12:51.316923 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 (ip 10.222.0.27) !!! Oct 31 15:12:51.321762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:12:51.322487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:12:51.334661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:51.335155 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:51.335686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:51.336419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:51.336874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:51.337325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:51.494035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:12:51.503077 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c6d1342d-3f01-4849-83a3-90ccaef46f01 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1763 microversion: 2.1 time: 0.190753 Oct 31 15:12:51.509249 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3498/7247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:12:51 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1763 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:12:52.528504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:12:52.529259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:12:52.536652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:52.537209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:52.537664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:52.538447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:52.538966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:52.539405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:52.691513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:12:52.700162 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37e13c0d-dcb4-47c7-8bf6-ca5fcdd70147 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1761 microversion: 2.1 time: 0.176864 Oct 31 15:12:52.700747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3750/7248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:12:52 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1761 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:05.255748 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:14:05.256681 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:14:05.257164 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:05.257915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:05.262498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1994686786"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:05.263060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:05.270475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:05.270974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:05.271417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:05.272128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:05.272588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:05.273018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:05.404438 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Removing security group 3ed597cf-bf9e-4000-b1b1-09ac6fc5001b from port 9809510c-dd14-45c1-991e-873335e3603c Oct 31 15:14:05.713805 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4964eae4-617f-4b9b-a0c8-86549fc0e66f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action" status: 202 len: 0 microversion: 2.1 time: 0.459944 Oct 31 15:14:05.714843 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3499/7249] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:14:05 2022] POST /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:05.721778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:05.723364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:05.863456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c86c2a61-6578-40da-850f-5241f8c57447 req-401b9945-6b64-4b58-b650-3a1e3bdf983d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:05.873769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c86c2a61-6578-40da-850f-5241f8c57447 req-401b9945-6b64-4b58-b650-3a1e3bdf983d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:05.874214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c86c2a61-6578-40da-850f-5241f8c57447 req-401b9945-6b64-4b58-b650-3a1e3bdf983d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:05.874648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c86c2a61-6578-40da-850f-5241f8c57447 req-401b9945-6b64-4b58-b650-3a1e3bdf983d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:05.890306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c86c2a61-6578-40da-850f-5241f8c57447 req-401b9945-6b64-4b58-b650-3a1e3bdf983d service nova] Creating event network-changed:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:14:05.896485 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c86c2a61-6578-40da-850f-5241f8c57447 req-401b9945-6b64-4b58-b650-3a1e3bdf983d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177425 Oct 31 15:14:05.897239 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3751/7250] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:07.181213 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53452. Oct 31 15:14:07.184502 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53454. Oct 31 15:14:07.225346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:07.226080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:07.232632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:07.233470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:07.233980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:07.235130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:07.235787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:07.236402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:07.245640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:07.257389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:07.258028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:07.258593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:07.272020 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] Creating event network-changed:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:14:07.275683 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] [2a187fbd-8fa8-4a26-b849-f6b7f1e69d30] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:14:07.325963 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lazy-loading 'services' on Instance uuid 0ad4f499-5b3c-4f93-aa6f-813b91193c35 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:14:07.410425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72331c8d-aa18-49af-8653-207fe9edb31e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments/ad698a61-16c0-4181-8ed5-dba833e42360" status: 202 len: 0 microversion: 2.1 time: 0.189739 Oct 31 15:14:07.415421 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3752/7251] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:14:07 2022] DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments/ad698a61-16c0-4181-8ed5-dba833e42360 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:14:07.421318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:07.423665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:07.430890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:07.431506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:07.431851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:07.432571 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:07.433035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:07.433494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:07.467043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c13a1a0e-51a6-4810-bee6-71fc1654638b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050031 Oct 31 15:14:07.467628 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3753/7252] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:14:07 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:08.284736 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] [2a187fbd-8fa8-4a26-b849-f6b7f1e69d30] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53470. Oct 31 15:14:08.288527 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e6154cb5-6a75-4df2-87ba-2f2b4890ea08 req-318274bd-023b-4370-b733-a3e6312a4f8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.124775 Oct 31 15:14:08.289768 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3500/7253] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:08.482613 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:08.485456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:08.492993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:08.493727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:08.494278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:08.495066 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:08.495604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:08.496297 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:08.529921 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-256167c3-994d-448c-b25b-e9e7f40c85d9 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051645 Oct 31 15:14:08.530845 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3754/7254] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:14:08 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:09.544128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:09.546499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:09.552845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:09.553339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:09.553778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:09.554508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:09.554971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:09.555399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:09.587108 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fddaac52-dece-4c12-9bf6-d666a51fea90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 Oct 31 15:14:09.587601 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3501/7255] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:14:09 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:10.600111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:10.602314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:10.609638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:10.610148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:10.610626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:10.611848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:10.612322 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:10.612764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:10.647487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30a7f970-719d-49ed-bf24-45c6491edb95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051490 Oct 31 15:14:10.648100 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3755/7256] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:14:10 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:11.660178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:11.662377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:11.669326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:11.669946 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:11.670424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:11.671137 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:11.671599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:11.672034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:11.704292 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7ad24801-61b9-4cf9-913c-3b5fb847385b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Oct 31 15:14:11.704888 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3502/7257] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:14:11 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:12.717716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:12.719968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:12.728068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:12.728536 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:12.728989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:12.729694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:12.730204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:12.730634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:12.772166 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a0e2af0-6db4-4d57-afff-aaa501421e1f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058496 Oct 31 15:14:12.772747 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3756/7258] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:14:12 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:14:12.783788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:12.784310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:12.791159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:12.791647 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:12.792095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:12.792791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:12.793248 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:12.793674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:12.869393 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] HTTP exception thrown: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 is not attached to volume ad698a61-16c0-4181-8ed5-dba833e42360 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Request method failure captured: Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments/ad698a61-16c0-4181-8ed5-dba833e42360 HTTP/1.1 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-VdD1qQcGG_F-kw_UmAOgU3ppjRL4hl9dgbbeRAUVt1bi8r_KyUzb8yjjCd4Jg3r97jhwq4ZgwtQ30iPltWvsOT4frTqYFx5rakcWgzBVVpRvy8C2OEmsJVW_6Q1ZsiMKrY6_2jgVHgYJ4iBQ5KvfzKdkjxk24NvIeZK7PtlH3pCL8 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4897ca8f72a34f87b714f3d0542900b6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 906072a954884c78af2e40a19ab7ebf5 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 is not attached to volume ad698a61-16c0-4181-8ed5-dba833e42360 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '0ad4f499-5b3c-4f93-aa6f-813b91193c35', 'id': 'ad698a61-16c0-4181-8ed5-dba833e42360'} Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ad698a61-16c0-4181-8ed5-dba833e42360. Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 is not attached to volume ad698a61-16c0-4181-8ed5-dba833e42360 Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:12.873200 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 is not attached to volume ad698a61-16c0-4181-8ed5-dba833e42360 Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Returning 404 to user: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 is not attached to volume ad698a61-16c0-4181-8ed5-dba833e42360 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-951bf95d-7ec6-4eba-b990-5d9cd5f797d4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments/ad698a61-16c0-4181-8ed5-dba833e42360" status: 404 len: 154 microversion: 2.1 time: 0.096113 Oct 31 15:14:12.878786 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3503/7259] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:14:12 2022] DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35/os-volume_attachments/ad698a61-16c0-4181-8ed5-dba833e42360 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:16.130564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:16.131325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:16.138619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:16.139116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:16.139568 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:16.140275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:16.140744 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:16.141220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:16.166253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:14:16.250668 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9996a574-3545-4c0c-8384-ad8ca1d110fb tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 204 len: 0 microversion: 2.1 time: 0.123500 Oct 31 15:14:16.251381 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3757/7260] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:14:16 2022] DELETE /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:14:16.260012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:16.260642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:16.267980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:16.268476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:16.268922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:16.269635 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:16.270093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:16.270552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:16.405649 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:16.414311 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-16ddee41-5368-448b-8e23-d320856d3133 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1555 microversion: 2.1 time: 0.158278 Oct 31 15:14:16.414898 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3504/7261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:16 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:17.438534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:17.439852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:17.447463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:17.447966 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:17.448414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:17.449144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:17.449608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:17.450074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:17.583031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:17.590796 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cda1b6d7-1a19-485a-9760-bfa8a3c91b5b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1555 microversion: 2.1 time: 0.156597 Oct 31 15:14:17.591364 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3758/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:17 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:18.286415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e8cb503a-4880-4c1f-b625-843273febf69 req-acad080f-fda5-4e5d-98d7-60776cce1e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad4f499-5b3c-4f93-aa6f-813b91193c35", "name": "network-vif-deleted", "tag": "9809510c-dd14-45c1-991e-873335e3603c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:18.296799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e8cb503a-4880-4c1f-b625-843273febf69 req-acad080f-fda5-4e5d-98d7-60776cce1e19 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:18.297318 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e8cb503a-4880-4c1f-b625-843273febf69 req-acad080f-fda5-4e5d-98d7-60776cce1e19 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:18.297784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e8cb503a-4880-4c1f-b625-843273febf69 req-acad080f-fda5-4e5d-98d7-60776cce1e19 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:18.309762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e8cb503a-4880-4c1f-b625-843273febf69 req-acad080f-fda5-4e5d-98d7-60776cce1e19 service nova] Creating event network-vif-deleted:9809510c-dd14-45c1-991e-873335e3603c for instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 on n-h2-863052-1 Oct 31 15:14:18.315443 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e8cb503a-4880-4c1f-b625-843273febf69 req-acad080f-fda5-4e5d-98d7-60776cce1e19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032801 Oct 31 15:14:18.316090 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3505/7263] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:18.615533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:18.616185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:18.623697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:18.624191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:18.624639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:18.625357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:18.625817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:18.626276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:18.661003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:18.661533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:18.662000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:18.662684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lazy-loading 'fault' on Instance uuid 0ad4f499-5b3c-4f93-aa6f-813b91193c35 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:14:18.711243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:18.719535 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7242a066-eca4-4afc-aca9-e879c8fbe275 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 200 len: 1349 microversion: 2.1 time: 0.107785 Oct 31 15:14:18.720127 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3759/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:18 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:19.744556 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:19.745173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 0ad4f499-5b3c-4f93-aa6f-813b91193c35] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:19.751476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:19.752595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:19.753032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:19.753725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:19.754184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:19.754626 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:19.767786 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] HTTP exception thrown: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 could not be found. Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Request method failure captured: Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 HTTP/1.1 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-VdD1qQcGG_F-kw_UmAOgU3ppjRL4hl9dgbbeRAUVt1bi8r_KyUzb8yjjCd4Jg3r97jhwq4ZgwtQ30iPltWvsOT4frTqYFx5rakcWgzBVVpRvy8C2OEmsJVW_6Q1ZsiMKrY6_2jgVHgYJ4iBQ5KvfzKdkjxk24NvIeZK7PtlH3pCL8 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4897ca8f72a34f87b714f3d0542900b6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 906072a954884c78af2e40a19ab7ebf5 Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 could not be found. Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '0ad4f499-5b3c-4f93-aa6f-813b91193c35'} Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 could not be found. Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 could not be found. Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:19.769415 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 could not be found. Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Returning 404 to user: Instance 0ad4f499-5b3c-4f93-aa6f-813b91193c35 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de266de6-08b2-4014-b685-9e1595de7e6d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35" status: 404 len: 111 microversion: 2.1 time: 0.031468 Oct 31 15:14:19.773773 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3506/7265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:19 2022] GET /compute/v2.1/servers/0ad4f499-5b3c-4f93-aa6f-813b91193c35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:19.779862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51ad069a-bc67-4957-8205-746d15454e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '.version_select at 0x7fe1061898b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:19.805139 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51ad069a-bc67-4957-8205-746d15454e8f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1872759564" status: 202 len: 0 microversion: 2.1 time: 0.029385 Oct 31 15:14:19.805720 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3760/7266] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 31 15:14:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1872759564 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:14:29.078121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cd2d9d29-ec86-43fb-8fbc-4423216cbce7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'create', calling method: .version_select at 0x7fe1069800d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-467280624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOhuYD+9ZE2PPLt2S1n9rHWu/LrJ/T50q0MFbxXMGzBO+22g5LqlBNQe0pxYIGBgO7Kse/2Hr2Ejc7GvPyptBUvEWIZUu6ZVhb/zF5V+5OT6ffque1HWTfw0EUWxzhx+w=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:29.096932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cd2d9d29-ec86-43fb-8fbc-4423216cbce7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:14:29.102207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-cd2d9d29-ec86-43fb-8fbc-4423216cbce7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for user 906072a954884c78af2e40a19ab7ebf5 and project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:14:29.131297 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cd2d9d29-ec86-43fb-8fbc-4423216cbce7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058541 Oct 31 15:14:29.131948 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3507/7267] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:14:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:29.189905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:29.195108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-627347858", "imageRef": "fa476273-bc4d-4f22-852f-12bdd0f5cc6f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-467280624", "networks": [{"uuid": "e1a1a7f7-16e0-4b43-b7fc-f6e60de9488c"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:29.261381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] validate_networks() for [('e1a1a7f7-16e0-4b43-b7fc-f6e60de9488c', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:14:29.721405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:14:29.721905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:14:29.722396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:14:29.723128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:14:29.723555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:14:29.732481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:29.733502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:29.733952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:29.734788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:29.735246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:29.736332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:29.754915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:14:29.760517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Getting quotas for user 906072a954884c78af2e40a19ab7ebf5 and project 4897ca8f72a34f87b714f3d0542900b6. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:14:29.773422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:14:29.775650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa476273-bc4d-4f22-852f-12bdd0f5cc6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:14:29.824573 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-515a71c7-0811-4097-ba7b-79efa4f3ebd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637600 Oct 31 15:14:29.825504 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3761/7268] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:14:29.835986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=34 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:29.840825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e4bebe9-74ae-42e0-88d9-3217c0bd3579 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:29.841493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e4bebe9-74ae-42e0-88d9-3217c0bd3579 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:29.914844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e4bebe9-74ae-42e0-88d9-3217c0bd3579 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:29.924756 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e4bebe9-74ae-42e0-88d9-3217c0bd3579 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1257 microversion: 2.1 time: 0.089359 Oct 31 15:14:29.925534 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3508/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:29 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1257 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:30.953970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b44a8d5a-138d-447d-a3f7-f551463f6578 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:30.954650 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b44a8d5a-138d-447d-a3f7-f551463f6578 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:31.012178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b44a8d5a-138d-447d-a3f7-f551463f6578 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:31.020000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b44a8d5a-138d-447d-a3f7-f551463f6578 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1257 microversion: 2.1 time: 0.070873 Oct 31 15:14:31.020564 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3762/7270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:30 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:32.044219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d8d7ec2-8c72-40a8-adc3-ef830e3db43f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:32.044860 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d8d7ec2-8c72-40a8-adc3-ef830e3db43f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:32.047877 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:14:32.047982 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 (ip 10.222.0.27) !!! Oct 31 15:14:32.108383 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d8d7ec2-8c72-40a8-adc3-ef830e3db43f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:32.115499 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d8d7ec2-8c72-40a8-adc3-ef830e3db43f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1257 microversion: 2.1 time: 0.075435 Oct 31 15:14:32.116108 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3509/7271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:32 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:33.140449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-343014aa-bdcb-480c-a21c-84e6592b101f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.141131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-343014aa-bdcb-480c-a21c-84e6592b101f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:33.199310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-343014aa-bdcb-480c-a21c-84e6592b101f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:33.206990 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-343014aa-bdcb-480c-a21c-84e6592b101f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1257 microversion: 2.1 time: 0.070457 Oct 31 15:14:33.207577 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3763/7272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:34.230788 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.231333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:34.239993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.240485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.240939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.241653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.242113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.242570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.305863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:34.314027 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37646872-4364-4df2-a429-0852ca1dfd9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1261 microversion: 2.1 time: 0.087148 Oct 31 15:14:34.314646 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3510/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.341307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.355416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:35.368112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:35.368626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:35.369114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:35.369924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:35.370439 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:35.370915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:35.511317 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:35.520566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-589b5254-e7ab-47e4-8ccc-ff1564ec678e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1315 microversion: 2.1 time: 0.186711 Oct 31 15:14:35.531494 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3764/7274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:36.560395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.561126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:36.566080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:36.578749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:36.580304 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:36.581070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:36.582413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:36.583236 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:36.583990 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:36.729584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:36.738488 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dfd0e021-9de5-4822-b125-68f919fc9d95 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.182436 Oct 31 15:14:36.739100 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3511/7275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.761427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.762699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:37.769192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:37.770951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:37.771764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:37.772235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:37.773007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:37.773588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:37.774025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:37.923924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:37.931929 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f562a11b-e994-4c70-bbae-93ffded10170 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.174455 Oct 31 15:14:37.932520 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3765/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:38.957680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:38.958461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:38.965342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:38.965834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:38.966296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:38.967014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:38.967463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:38.967887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:39.123128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:39.133267 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c12b32be-43f1-48ad-9f93-46d426073559 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.180887 Oct 31 15:14:39.134238 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3512/7277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:38 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:40.158505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:40.159155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:40.161754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:40.167305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:40.167805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:40.168258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:40.168968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:40.169436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:40.169875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:40.321573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:40.330081 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-143ee95f-361b-4b76-a12e-f94f0d5bf9fe tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.175538 Oct 31 15:14:40.330699 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3766/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:40 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:41.353941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:41.354619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:41.363922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:41.364820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:41.365362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:41.366082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:41.366566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:41.366995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:41.560698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:41.569208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7f2e8f3-4b92-4f13-ac5f-2b8ee0493863 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.219217 Oct 31 15:14:41.569863 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3513/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:41 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:42.592785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:42.593438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:42.600535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.601039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.601488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.602231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.602697 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.603130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.748034 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:42.756948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e4fe0b07-3d69-48a2-8245-5ee030adf22a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.168075 Oct 31 15:14:42.757537 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3767/7280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:42 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:43.780225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.781017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:43.782956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:43.789166 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.789641 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.790388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.791023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.791482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.791913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.928538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:43.936891 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5f04db8f-8460-401d-80df-826b2f104d67 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.160515 Oct 31 15:14:43.939563 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3514/7281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:43.975204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1f62289b-b91c-4f05-8bb7-3022dc62b976 req-20349a00-13fe-46ab-bbfc-95b0d817fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:43.984184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:43.991417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1f62289b-b91c-4f05-8bb7-3022dc62b976 req-20349a00-13fe-46ab-bbfc-95b0d817fee1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.992880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1f62289b-b91c-4f05-8bb7-3022dc62b976 req-20349a00-13fe-46ab-bbfc-95b0d817fee1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.993690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1f62289b-b91c-4f05-8bb7-3022dc62b976 req-20349a00-13fe-46ab-bbfc-95b0d817fee1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:44.006238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1f62289b-b91c-4f05-8bb7-3022dc62b976 req-20349a00-13fe-46ab-bbfc-95b0d817fee1 service nova] Creating event network-changed:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:14:44.011341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1f62289b-b91c-4f05-8bb7-3022dc62b976 req-20349a00-13fe-46ab-bbfc-95b0d817fee1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040936 Oct 31 15:14:44.012176 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3768/7282] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:44.965182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:44.965711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:44.973348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:44.973841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:44.974316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:44.975023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:44.975510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:44.975939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:45.109776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:45.117672 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a7274c2-cff9-49e8-933a-bfa1f9bb32cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.156506 Oct 31 15:14:45.118274 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3515/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:44 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:46.140993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:46.142372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:46.149637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:46.150070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:46.150559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:46.151257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:46.151718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:46.152155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:46.281822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:46.289724 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3074fb8c-1b99-45b2-aff6-d8ca4f147487 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.153053 Oct 31 15:14:46.290328 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3769/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:46 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:47.312826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:47.313450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:47.320074 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:47.320570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:47.321165 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:47.322549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:47.322549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:47.322728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:47.470262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:47.478127 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1320da01-e602-4892-9904-706796ef70c7 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.169123 Oct 31 15:14:47.478859 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3516/7285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:47 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:48.502064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:48.502729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:48.510035 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:48.510573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:48.511014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:48.511723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:48.512191 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:48.512624 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:48.649686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:48.657404 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf94e3ad-c649-42a6-ac88-79621433e2c5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.159714 Oct 31 15:14:48.657973 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3770/7286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:48 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:49.174037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c23617b9-bf2f-41ab-a872-6c7e28e3838a req-24b57e58-2a66-4c62-9a48-fdacf8c57c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "name": "network-vif-plugged", "status": "completed", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:49.183825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c23617b9-bf2f-41ab-a872-6c7e28e3838a req-24b57e58-2a66-4c62-9a48-fdacf8c57c44 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:49.184316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c23617b9-bf2f-41ab-a872-6c7e28e3838a req-24b57e58-2a66-4c62-9a48-fdacf8c57c44 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:49.184755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c23617b9-bf2f-41ab-a872-6c7e28e3838a req-24b57e58-2a66-4c62-9a48-fdacf8c57c44 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.196876 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c23617b9-bf2f-41ab-a872-6c7e28e3838a req-24b57e58-2a66-4c62-9a48-fdacf8c57c44 service nova] Creating event network-vif-plugged:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:14:49.203408 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c23617b9-bf2f-41ab-a872-6c7e28e3838a req-24b57e58-2a66-4c62-9a48-fdacf8c57c44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111359 Oct 31 15:14:49.204979 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3517/7287] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:49.681078 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:49.681699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:49.689552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:49.690044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:49.690519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.691259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:49.691724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:49.692159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.829622 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:49.837412 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86723e5b-cc6e-43a0-ae4c-3a8651989757 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1357 microversion: 2.1 time: 0.160196 Oct 31 15:14:49.837991 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3771/7288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:49 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:50.863271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:50.863986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:50.870252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:50.870745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:50.871189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:50.871886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:50.872343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:50.872772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.002138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:51.009927 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a7bd9c8-795f-4296-97ea-973c55a95e22 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1546 microversion: 2.1 time: 0.152671 Oct 31 15:14:51.010535 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3518/7289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:50 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:51.033903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:51.034556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:51.041499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:51.041995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:51.042473 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.043268 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:51.043735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:51.044168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.178802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:51.186777 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1bb2777-9dd5-4aa2-86db-76c218585f51 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1546 microversion: 2.1 time: 0.157379 Oct 31 15:14:51.187358 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3772/7290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:51 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:51.209019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:51.213876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:51.214669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Searching by: {'deleted': False, 'project_id': '4897ca8f72a34f87b714f3d0542900b6'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:14:51.220852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:51.221331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:51.221764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.222677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:51.223216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:51.223646 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.251086 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:14:51.278985 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e26d724d-8e2e-42c2-af2d-a0681e58682a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073564 Oct 31 15:14:51.279585 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3519/7291] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 31 15:14:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:51.291319 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:51.291946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:51.298071 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:51.298614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:51.299061 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.299757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:51.300244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:51.300679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.432308 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:51.440528 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44bda708-e8b4-4859-90c1-813a8b277d8e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1546 microversion: 2.1 time: 0.153087 Oct 31 15:14:51.441122 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3773/7292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:51 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:52.957692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:52.960101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:52.967717 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.968215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.968734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:52.970098 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.971268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.971898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:53.215568 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b480c9d3-e480-4ebb-b9f9-98d9f7a2495e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261619 Oct 31 15:14:53.216241 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3520/7293] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 31 15:14:52 2022] POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:04.017341 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:04.017971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:04.020726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=17 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:04.021396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=58 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:04.027989 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:04.028535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:04.028994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:04.029713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:04.030212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:04.030658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:04.170447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:04.180158 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66d55eb5-585c-4225-97ac-1a9390d3bd90 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1592 microversion: 2.1 time: 0.166932 Oct 31 15:15:04.180746 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3774/7294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:04 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1592 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:05.860560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:05.861957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=19 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:05.863182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:05.868971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-33966876-deeb-44ef-8907-48e4f3934cf5 req-8612cbb0-f5c9-4deb-b39f-9c8cd4cb8c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:05.883403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-33966876-deeb-44ef-8907-48e4f3934cf5 req-8612cbb0-f5c9-4deb-b39f-9c8cd4cb8c9e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.884007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-33966876-deeb-44ef-8907-48e4f3934cf5 req-8612cbb0-f5c9-4deb-b39f-9c8cd4cb8c9e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.884450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-33966876-deeb-44ef-8907-48e4f3934cf5 req-8612cbb0-f5c9-4deb-b39f-9c8cd4cb8c9e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:05.898838 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-33966876-deeb-44ef-8907-48e4f3934cf5 req-8612cbb0-f5c9-4deb-b39f-9c8cd4cb8c9e service nova] Creating event network-changed:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:15:05.904385 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-33966876-deeb-44ef-8907-48e4f3934cf5 req-8612cbb0-f5c9-4deb-b39f-9c8cd4cb8c9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046281 Oct 31 15:15:05.905355 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3521/7295] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:06.987040 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1560783659"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:06.987587 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:06.995014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:06.995510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:06.995959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:06.996664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:06.997124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:06.997558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.132096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.network.security_group_api [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Adding security group 80b3d581-8201-40ab-8be5-da1138966ec4 to port 9d98bd99-8ce4-4218-8502-33ba6bd27e84 Oct 31 15:15:07.495131 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1745d31-025c-405e-8d0c-b2de5f8fa85c tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/action" status: 202 len: 0 microversion: 2.1 time: 0.512648 Oct 31 15:15:07.496534 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3775/7296] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:15:06 2022] POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:15:07.505632 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:07.506408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:07.514868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.515388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.515836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.516549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.517000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.517622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.716870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:07.725884 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f96f9dce-0f09-423e-9f62-38fe3ad7c740 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1758 microversion: 2.1 time: 0.224567 Oct 31 15:15:07.726532 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3522/7297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:07 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:07.920377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-37da9e48-1849-43a8-ba1e-38318f5e8415 req-390cdb5d-32fb-450c-9613-c8b390703a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:07.931663 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37da9e48-1849-43a8-ba1e-38318f5e8415 req-390cdb5d-32fb-450c-9613-c8b390703a5a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.932067 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37da9e48-1849-43a8-ba1e-38318f5e8415 req-390cdb5d-32fb-450c-9613-c8b390703a5a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.932510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-37da9e48-1849-43a8-ba1e-38318f5e8415 req-390cdb5d-32fb-450c-9613-c8b390703a5a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.945903 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-37da9e48-1849-43a8-ba1e-38318f5e8415 req-390cdb5d-32fb-450c-9613-c8b390703a5a service nova] Creating event network-changed:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:15:07.952084 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-37da9e48-1849-43a8-ba1e-38318f5e8415 req-390cdb5d-32fb-450c-9613-c8b390703a5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Oct 31 15:15:07.953063 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3776/7298] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:24.938818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:24.941462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:24.944478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:24.945134 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:24.951274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.951753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.952187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.952879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.953917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.954412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.025505 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-12615479-cf00-49a1-8ef2-1dab2ae76df3 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/action" status: 202 len: 0 microversion: 2.1 time: 0.090803 Oct 31 15:15:25.026188 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3523/7299] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:15:24 2022] POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:15:25.032919 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:25.033757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:25.037871 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.038629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:25.045704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.046241 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.046701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.047407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.047875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.048315 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.292401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:25.300818 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa3c0f8c-607a-409b-856d-913ae69cb872 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1750 microversion: 2.1 time: 0.270017 Oct 31 15:15:25.301743 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3777/7300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:26.371673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.372385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:26.378686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.379178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.379622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.380319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.380776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.381209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.526320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:26.535054 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3ae2273-f77d-4206-af06-f2db4586b8cd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.213684 Oct 31 15:15:26.535619 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3524/7301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:27.559101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:27.559687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:27.566554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.567042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.567485 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.568175 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.568632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.569064 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.710370 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:27.718568 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9137dae-8fac-42c4-8898-34ab135991e2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.163441 Oct 31 15:15:27.719145 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3778/7302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:27 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:28.743432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:28.744055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:28.750965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.751497 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.751936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.752631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.753087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.753513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.900197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:28.909161 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-158d6efc-1aa7-4ef9-b6fb-416071cf0155 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.169715 Oct 31 15:15:28.909734 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3525/7303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:28 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:29.933327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:29.934058 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:29.941727 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.942180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.942632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.943330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.943792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.944226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:30.094028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:30.103341 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2d6f491-d8d8-419c-a8f1-d1f7f1e81c73 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.173858 Oct 31 15:15:30.104257 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3779/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:29 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:31.127590 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.128123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:31.134917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.135430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.135872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.136571 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.137028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.137454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.278159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:31.286489 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2fdede59-08f0-4a8b-9291-b1f174ea6615 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.163499 Oct 31 15:15:31.287273 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3526/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:31 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:32.310434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.311069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:32.317917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.318448 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.318903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.319610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.320074 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.320510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.461543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:32.469897 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c637eccd-743d-4012-a9d4-ccd6aad68583 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.163445 Oct 31 15:15:32.470501 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3780/7306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:33.492999 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:33.493617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:33.500531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.501513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.501955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.502682 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.503140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.503569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.648267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:33.656636 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72091794-9783-4574-8801-2e4245611a30 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.167610 Oct 31 15:15:33.657207 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3527/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:33 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:34.680116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:34.680672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:34.687533 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.688032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.689128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:34.689832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.690336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.690778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:34.834652 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:34.842963 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5942f408-a298-43d0-a289-96691fcda61b tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.166921 Oct 31 15:15:34.843562 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3781/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:34 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:35.866881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:35.867506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:35.874527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:35.875015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:35.875458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:35.876152 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:35.876615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:35.877038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.015565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:36.024395 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4b8e688e-0313-4376-ba92-9625a5b05cd5 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.161421 Oct 31 15:15:36.024970 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3528/7309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:35 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:37.048886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:37.049510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:37.056481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.056974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.057420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.058112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.058597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.059030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.205634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:37.213905 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6def927f-c96e-4c20-9e38-4fa31920895a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.168953 Oct 31 15:15:37.214503 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3782/7310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:37 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:38.237923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:38.238610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:38.244840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:38.245325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:38.245764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:38.246495 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:38.246954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:38.247378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:38.391312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:38.400146 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c879cfd-7d4e-47e7-a175-1a439a3edda4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.166387 Oct 31 15:15:38.400725 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3529/7311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:38 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:39.426818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:39.427447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:39.434039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.434722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.435098 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.435786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.436247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.436682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.579206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:39.588024 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4df4950f-2f07-40c9-a45b-f7310a99f0a8 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.167385 Oct 31 15:15:39.589027 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3783/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:39 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:40.613388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:40.613998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:40.621017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.621503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.621940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.622791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.623246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.623670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.765963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:40.774834 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b2921c6-da34-4daf-a445-e95c7f63ff9f tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1755 microversion: 2.1 time: 0.165877 Oct 31 15:15:40.775404 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3530/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:40 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:41.797863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:41.799041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:41.805927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:41.806449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:41.806902 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:41.807595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:41.808059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:41.808498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:42.271010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:42.279288 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d361e2a3-c7ed-4e0a-8898-90a0071a189d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1758 microversion: 2.1 time: 0.485434 Oct 31 15:15:42.279866 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3784/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:41 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1758 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:15.204132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1560783659"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:15.204764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:15.206845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:15.207742 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:15.214564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:15.215051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:15.215492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:15.216187 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:15.216655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:15.217084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:15.390632 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Removing security group 80b3d581-8201-40ab-8be5-da1138966ec4 from port 9d98bd99-8ce4-4218-8502-33ba6bd27e84 Oct 31 15:16:15.695179 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cbfee658-6cb7-407d-8a7b-82e6b2ce69d2 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/action" status: 202 len: 0 microversion: 2.1 time: 0.494756 Oct 31 15:16:15.699379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3531/7315] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:16:15 2022] POST /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:15.707855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f7beca23-66df-4b11-aa97-598abfeacd5a req-ce97c8f3-e0d3-43fe-a782-99b9f815a659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:15.719802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:15.721069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=48 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:15.728847 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f7beca23-66df-4b11-aa97-598abfeacd5a req-ce97c8f3-e0d3-43fe-a782-99b9f815a659 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:15.730208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f7beca23-66df-4b11-aa97-598abfeacd5a req-ce97c8f3-e0d3-43fe-a782-99b9f815a659 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:15.731261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f7beca23-66df-4b11-aa97-598abfeacd5a req-ce97c8f3-e0d3-43fe-a782-99b9f815a659 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:15.752992 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f7beca23-66df-4b11-aa97-598abfeacd5a req-ce97c8f3-e0d3-43fe-a782-99b9f815a659 service nova] Creating event network-changed:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:16:15.760487 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f7beca23-66df-4b11-aa97-598abfeacd5a req-ce97c8f3-e0d3-43fe-a782-99b9f815a659 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058202 Oct 31 15:16:15.762521 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3785/7316] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:16.774937 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:16.775466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:16.781448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.781933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.782398 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.783092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.783548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.783978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.867974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lazy-loading 'services' on Instance uuid 06348da7-cde7-4b29-b276-8377cc216f33 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:16.945365 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24e504a8-0355-4b70-afad-66e0d78ea250 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments/e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f" status: 202 len: 0 microversion: 2.1 time: 0.175493 Oct 31 15:16:16.945968 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3532/7317] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:16:16 2022] DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments/e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:16.955201 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:16.957517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:16.965514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.965995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.966472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.967190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.967759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.968204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:17.001344 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7835821e-5bba-4a27-9383-ba0081900f3a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050378 Oct 31 15:16:17.002068 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3786/7318] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:16:16 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:17.792159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0dd5b3fa-bc2d-40ed-8d0b-8f2eab502f11 req-cc15acba-6989-4f37-87ea-e1e910469864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:17.802563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0dd5b3fa-bc2d-40ed-8d0b-8f2eab502f11 req-cc15acba-6989-4f37-87ea-e1e910469864 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:17.803055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0dd5b3fa-bc2d-40ed-8d0b-8f2eab502f11 req-cc15acba-6989-4f37-87ea-e1e910469864 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:17.803492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0dd5b3fa-bc2d-40ed-8d0b-8f2eab502f11 req-cc15acba-6989-4f37-87ea-e1e910469864 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:17.814442 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0dd5b3fa-bc2d-40ed-8d0b-8f2eab502f11 req-cc15acba-6989-4f37-87ea-e1e910469864 service nova] Creating event network-changed:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:16:17.819989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0dd5b3fa-bc2d-40ed-8d0b-8f2eab502f11 req-cc15acba-6989-4f37-87ea-e1e910469864 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Oct 31 15:16:17.820588 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3533/7319] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:18.014528 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:18.016910 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:18.024217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.024837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.025418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.026267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.026831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.027366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.058895 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c672fa7a-ac4e-480f-bcae-0bd6106c7bfc tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048366 Oct 31 15:16:18.059762 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3787/7320] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:16:18 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:19.073375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:19.075725 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:19.082035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.082577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.083053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.083762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.084226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.084664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.116941 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d003893-4366-4285-8da3-2d40ed312e3e tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048745 Oct 31 15:16:19.117898 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3534/7321] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:16:19 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:20.129080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.131873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:20.139057 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.139583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.140030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.140725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.141183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.141614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.173038 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70448b7f-d824-48ce-b4a3-c343ed4c04ca tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Oct 31 15:16:20.173605 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3788/7322] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:21.186424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:21.188618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:21.195985 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.196480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.196917 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.197618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.198075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.198528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.228606 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf870294-8233-480c-96ae-d5de0130a5f1 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046214 Oct 31 15:16:21.229218 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3535/7323] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:16:21 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:22.241429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.243637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:22.250525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.251014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.251459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.252150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.252610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.253047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.282462 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9165d98d-3b60-454b-b33e-dd84a2152609 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045058 Oct 31 15:16:22.283022 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3789/7324] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:22.294291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.294796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:22.301851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.302376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.302815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.303507 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.303958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.304378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.378431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] HTTP exception thrown: Instance 06348da7-cde7-4b29-b276-8377cc216f33 is not attached to volume e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Request method failure captured: Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments/e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f HTTP/1.1 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-VdD1qQcGG_F-kw_UmAOgU3ppjRL4hl9dgbbeRAUVt1bi8r_KyUzb8yjjCd4Jg3r97jhwq4ZgwtQ30iPltWvsOT4frTqYFx5rakcWgzBVVpRvy8C2OEmsJVW_6Q1ZsiMKrY6_2jgVHgYJ4iBQ5KvfzKdkjxk24NvIeZK7PtlH3pCL8 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4897ca8f72a34f87b714f3d0542900b6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 906072a954884c78af2e40a19ab7ebf5 Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 06348da7-cde7-4b29-b276-8377cc216f33 is not attached to volume e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'server_id': '06348da7-cde7-4b29-b276-8377cc216f33', 'id': 'e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f'} Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f. Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06348da7-cde7-4b29-b276-8377cc216f33 is not attached to volume e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:22.380075 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06348da7-cde7-4b29-b276-8377cc216f33 is not attached to volume e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Returning 404 to user: Instance 06348da7-cde7-4b29-b276-8377cc216f33 is not attached to volume e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-23d60d73-47d1-4a59-abca-f6a8372c76fd tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments/e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f" status: 404 len: 154 microversion: 2.1 time: 0.091320 Oct 31 15:16:22.385282 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3536/7325] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 31 15:16:22 2022] DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33/os-volume_attachments/e5c47792-22e6-4dbe-8cc2-cfb0f7edb54f => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:25.643524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:25.644076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:25.651041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.651542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.652000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.652711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.653180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.653623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.680394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:16:25.762083 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b907891c-6227-411b-8cd5-b9e8b44efb66 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 204 len: 0 microversion: 2.1 time: 0.122198 Oct 31 15:16:25.762825 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3790/7326] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:25 2022] DELETE /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:25.772694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:25.773313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:25.783842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.784328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.784765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.785461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.786422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.787052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.922416 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:25.930906 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c5afab7-4147-4aef-9b82-1c7097720ff4 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1552 microversion: 2.1 time: 0.162139 Oct 31 15:16:25.931503 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3537/7327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:25 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:26.955337 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:26.956085 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:26.963001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.963498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.963948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.964646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.965111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.965550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.137209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.144945 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1019d44c-c501-415a-94c0-1164b92b974a tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1552 microversion: 2.1 time: 0.193895 Oct 31 15:16:27.145528 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3791/7328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:26 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:27.850430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-73d30812-417f-4155-9c57-461ba0557bea req-048229bc-4185-4a69-8de6-658787015dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06348da7-cde7-4b29-b276-8377cc216f33", "name": "network-vif-deleted", "tag": "9d98bd99-8ce4-4218-8502-33ba6bd27e84"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:27.861513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-73d30812-417f-4155-9c57-461ba0557bea req-048229bc-4185-4a69-8de6-658787015dec service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.861994 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-73d30812-417f-4155-9c57-461ba0557bea req-048229bc-4185-4a69-8de6-658787015dec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.862456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-73d30812-417f-4155-9c57-461ba0557bea req-048229bc-4185-4a69-8de6-658787015dec service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.874593 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-73d30812-417f-4155-9c57-461ba0557bea req-048229bc-4185-4a69-8de6-658787015dec service nova] Creating event network-vif-deleted:9d98bd99-8ce4-4218-8502-33ba6bd27e84 for instance 06348da7-cde7-4b29-b276-8377cc216f33 on n-h2-863052-1 Oct 31 15:16:27.879455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-73d30812-417f-4155-9c57-461ba0557bea req-048229bc-4185-4a69-8de6-658787015dec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032949 Oct 31 15:16:27.880052 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3538/7329] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:28.168659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.169288 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:28.176493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.176996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.177980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.178731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.179202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.179639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.217612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.218124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.218611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.219076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lazy-loading 'fault' on Instance uuid 06348da7-cde7-4b29-b276-8377cc216f33 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:28.268778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906072a954884c78af2e40a19ab7ebf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4897ca8f72a34f87b714f3d0542900b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.279251 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-018a98ae-2744-4637-8fff-9d73988b8564 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 200 len: 1347 microversion: 2.1 time: 0.114466 Oct 31 15:16:28.289501 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3792/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:28 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 1347 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:29.304010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.304711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] [instance: 06348da7-cde7-4b29-b276-8377cc216f33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:29.311102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.311586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.312025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.312716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.313167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.313589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.327473 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] HTTP exception thrown: Instance 06348da7-cde7-4b29-b276-8377cc216f33 could not be found. Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Request method failure captured: Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 HTTP/1.1 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-VdD1qQcGG_F-kw_UmAOgU3ppjRL4hl9dgbbeRAUVt1bi8r_KyUzb8yjjCd4Jg3r97jhwq4ZgwtQ30iPltWvsOT4frTqYFx5rakcWgzBVVpRvy8C2OEmsJVW_6Q1ZsiMKrY6_2jgVHgYJ4iBQ5KvfzKdkjxk24NvIeZK7PtlH3pCL8 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4897ca8f72a34f87b714f3d0542900b6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4897ca8f72a34f87b714f3d0542900b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 4897ca8f72a34f87b714f3d0542900b6 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1312183351 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 906072a954884c78af2e40a19ab7ebf5 Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestMinimumBasicScenario-1312183351-project Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 06348da7-cde7-4b29-b276-8377cc216f33 could not be found. Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '06348da7-cde7-4b29-b276-8377cc216f33'} Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06348da7-cde7-4b29-b276-8377cc216f33 could not be found. Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06348da7-cde7-4b29-b276-8377cc216f33 could not be found. Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:29.329114 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06348da7-cde7-4b29-b276-8377cc216f33 could not be found. Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Returning 404 to user: Instance 06348da7-cde7-4b29-b276-8377cc216f33 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-584a5f81-dd1a-47eb-9ed9-c219ae4e007d tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33" status: 404 len: 111 microversion: 2.1 time: 0.031610 Oct 31 15:16:29.333212 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3539/7331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/servers/06348da7-cde7-4b29-b276-8377cc216f33 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:29.339939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa9b5af2-b543-4901-a0b9-d4c4307eab32 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] Calling method '.version_select at 0x7fe106366040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.358671 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa9b5af2-b543-4901-a0b9-d4c4307eab32 tempest-TestMinimumBasicScenario-1312183351 tempest-TestMinimumBasicScenario-1312183351-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-467280624" status: 202 len: 0 microversion: 2.1 time: 0.022507 Oct 31 15:16:29.359244 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3793/7332] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 31 15:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-467280624 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:16:38.592513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3cc90cc3-866e-4a8e-8f20-1a6e3e252a53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: .version_select at 0x7fe107ebaf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-678041913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHi7/WRIia7Ne+os7taQsgoUWsu2WFg3EVSrW80V3zl9r9Ujbvo7idKQuOCnkemRcVFWhaCDd+bU4ck6VaZ2etsFAut4IiM9wT+H7QjL/tChVK5HkYHDBBkz4uDiiBP3Q=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:38.608251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-3cc90cc3-866e-4a8e-8f20-1a6e3e252a53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:38.613310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-3cc90cc3-866e-4a8e-8f20-1a6e3e252a53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:38.638334 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3cc90cc3-866e-4a8e-8f20-1a6e3e252a53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.207395 Oct 31 15:16:38.638944 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3540/7333] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:16:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:44.505043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:44.506387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:44.511260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-959131540", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "18115b8b-49a4-4541-b5bc-e75462258509"}], "key_name": "tempest-TestNetworkAdvancedServerOps-678041913", "security_groups": [{"name": "tempest-secgroup-smoke-1956326391"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:44.629764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] validate_networks() for [('18115b8b-49a4-4541-b5bc-e75462258509', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:45.016103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:45.016543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:45.017173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:45.017602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:45.018036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:45.027865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.028366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.028845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.029825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.030332 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.030802 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.050780 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:45.057134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:45.070487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:45.072856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:45.123368 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7909620-bcb3-4fb4-b332-9601916cf963 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.620087 Oct 31 15:16:45.124444 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3794/7334] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:45.132757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:45.141942 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c3e2d005-040d-4c08-9fe0-4c9c216a86c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.142698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c3e2d005-040d-4c08-9fe0-4c9c216a86c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.212909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c3e2d005-040d-4c08-9fe0-4c9c216a86c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.222709 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c3e2d005-040d-4c08-9fe0-4c9c216a86c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1265 microversion: 2.1 time: 0.090469 Oct 31 15:16:45.224574 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3541/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:46.261499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.262685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.272124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.272694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.273221 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.273873 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.274389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.274863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.403237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:46.415154 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f473551a-6509-4684-90fc-c3e79af43c99 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1325 microversion: 2.1 time: 0.170576 Oct 31 15:16:46.416635 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3795/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:46 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:47.439891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.440535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:47.443679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:47.449718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.450229 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.450674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.451381 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.451836 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.452261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.584329 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:47.593543 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e45951d3-8214-4c52-baed-70dd770e57a9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1391 microversion: 2.1 time: 0.157943 Oct 31 15:16:47.594133 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3542/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:47 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:47.891429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5293443d-aaa3-4ab7-a387-3b2013b468a6 req-94402488-cd85-486a-b5bd-2125d9c570de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6219a576-b451-4d72-b864-f6b01d1e5501", "tag": "e2711d7a-7fae-43df-b47d-73afcbd8a95d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.903017 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5293443d-aaa3-4ab7-a387-3b2013b468a6 req-94402488-cd85-486a-b5bd-2125d9c570de service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.903638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5293443d-aaa3-4ab7-a387-3b2013b468a6 req-94402488-cd85-486a-b5bd-2125d9c570de service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.904153 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5293443d-aaa3-4ab7-a387-3b2013b468a6 req-94402488-cd85-486a-b5bd-2125d9c570de service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.919177 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5293443d-aaa3-4ab7-a387-3b2013b468a6 req-94402488-cd85-486a-b5bd-2125d9c570de service nova] Creating event network-changed:e2711d7a-7fae-43df-b47d-73afcbd8a95d for instance 6219a576-b451-4d72-b864-f6b01d1e5501 on n-h2-863052-1 Oct 31 15:16:47.924230 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5293443d-aaa3-4ab7-a387-3b2013b468a6 req-94402488-cd85-486a-b5bd-2125d9c570de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 Oct 31 15:16:47.924939 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3796/7338] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:48.616845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.617480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.624451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.624936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.625374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.626063 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.626542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.626969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.758122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.765751 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5bf4c291-207e-49d3-9728-4c203a4d0c28 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1391 microversion: 2.1 time: 0.153265 Oct 31 15:16:48.766379 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3543/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:49.790978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.791688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:49.797887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.798410 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.798857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.799550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.800012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.800446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.952792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:49.961100 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-332ba36e-571e-4f83-b207-79ce99581a98 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1391 microversion: 2.1 time: 0.175895 Oct 31 15:16:49.961804 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3797/7340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:50.985095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.985708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.993087 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.993574 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.994016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.994733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.995188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.995613 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.123452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.131401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-497a1684-7fcb-4945-9ddb-c888ed269c8a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1391 microversion: 2.1 time: 0.150471 Oct 31 15:16:51.131970 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3544/7341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:51.650310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-613f8726-333e-4194-bbcd-5a33e78d833d req-1da8d4d8-1a80-4c3b-b9ca-887203c302f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6219a576-b451-4d72-b864-f6b01d1e5501", "name": "network-vif-plugged", "status": "completed", "tag": "e2711d7a-7fae-43df-b47d-73afcbd8a95d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:51.661834 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-613f8726-333e-4194-bbcd-5a33e78d833d req-1da8d4d8-1a80-4c3b-b9ca-887203c302f4 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.662635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-613f8726-333e-4194-bbcd-5a33e78d833d req-1da8d4d8-1a80-4c3b-b9ca-887203c302f4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.663079 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-613f8726-333e-4194-bbcd-5a33e78d833d req-1da8d4d8-1a80-4c3b-b9ca-887203c302f4 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.674358 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-613f8726-333e-4194-bbcd-5a33e78d833d req-1da8d4d8-1a80-4c3b-b9ca-887203c302f4 service nova] Creating event network-vif-plugged:e2711d7a-7fae-43df-b47d-73afcbd8a95d for instance 6219a576-b451-4d72-b864-f6b01d1e5501 on n-h2-863052-1 Oct 31 15:16:51.679384 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-613f8726-333e-4194-bbcd-5a33e78d833d req-1da8d4d8-1a80-4c3b-b9ca-887203c302f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Oct 31 15:16:51.679980 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3798/7342] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:52.154810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.155425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:52.162526 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.163016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.163454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.164145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.164603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.165027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.297492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.305767 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2339025c-b22e-42c9-9b67-21af057e189e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1391 microversion: 2.1 time: 0.154884 Oct 31 15:16:52.306380 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3545/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:52 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:53.330958 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.331660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:53.338597 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.339093 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.339540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.340236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.340716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.341132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.474953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.482989 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-797e25b6-9fd9-4ae6-8138-b50808d7c82a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1563 microversion: 2.1 time: 0.157409 Oct 31 15:16:53.483600 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3799/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:53.506594 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.507234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:53.514477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.515006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.515459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.516161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.516625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.517078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.650969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.658729 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-202d7bc3-798a-4cea-9715-5b6e3a97c717 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1563 microversion: 2.1 time: 0.156593 Oct 31 15:16:53.659350 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3546/7345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:55.471234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:55.476650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-975b164a-7611-443a-b5ba-e9a505f2e09e req-d0beddb9-2b81-44e7-98d5-eeba22c55839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6219a576-b451-4d72-b864-f6b01d1e5501", "tag": "e2711d7a-7fae-43df-b47d-73afcbd8a95d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:55.482635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:55.486343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:55.487143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:55.488881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:55.491939 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.492446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.492899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.493617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.494084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.494552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.497969 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-975b164a-7611-443a-b5ba-e9a505f2e09e req-d0beddb9-2b81-44e7-98d5-eeba22c55839 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.498113 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-975b164a-7611-443a-b5ba-e9a505f2e09e req-d0beddb9-2b81-44e7-98d5-eeba22c55839 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.498573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-975b164a-7611-443a-b5ba-e9a505f2e09e req-d0beddb9-2b81-44e7-98d5-eeba22c55839 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.511210 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-975b164a-7611-443a-b5ba-e9a505f2e09e req-d0beddb9-2b81-44e7-98d5-eeba22c55839 service nova] Creating event network-changed:e2711d7a-7fae-43df-b47d-73afcbd8a95d for instance 6219a576-b451-4d72-b864-f6b01d1e5501 on n-h2-863052-1 Oct 31 15:16:55.516662 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-975b164a-7611-443a-b5ba-e9a505f2e09e req-d0beddb9-2b81-44e7-98d5-eeba22c55839 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043706 Oct 31 15:16:55.517865 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3547/7346] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:55.721729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:55.731383 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e17cdb0-5772-4591-a9bd-d1244d107ee8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1563 microversion: 2.1 time: 0.263983 Oct 31 15:16:55.732388 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3800/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:55 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:16.999499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:17.001804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.004216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=11 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:17.005056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=32 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:17.010925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.011409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.011849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.012540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.012995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.013419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.064324 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9572c030-e31f-4747-92c1-c781363a37ff tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action" status: 200 len: 24577 microversion: 2.1 time: 0.069033 Oct 31 15:17:17.064963 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3548/7348] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:16 2022] POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action => generated 24577 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:27.853436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:27.854010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.856103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:27.857179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:27.862893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.863392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.863841 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.864549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.865647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.866231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.931379 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ceadbfcb-020d-48b6-93d8-cd7a79bae13e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action" status: 202 len: 0 microversion: 2.1 time: 0.082370 Oct 31 15:17:27.932064 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3801/7349] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:27 2022] POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:27.940852 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.941689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.944732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:27.945464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:27.951628 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.952145 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.952575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.953290 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.953769 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.954216 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.401226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.409002 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd9e7003-28d7-4639-b9be-514061d9ec71 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1686 microversion: 2.1 time: 0.472474 Oct 31 15:17:28.409605 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3549/7350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1686 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:29.435711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.436419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.443654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.444151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.444600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.445294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.445758 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.446213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.580131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.588021 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f9c01f4-3ed6-49ed-837e-37f604292cd7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1666 microversion: 2.1 time: 0.157969 Oct 31 15:17:29.588588 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3802/7351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:30.687140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:30.689359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.697228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.697726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.698190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.698925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.699385 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.699821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.750886 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7c2a56c-1021-4443-9638-b96abf5a1034 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action" status: 200 len: 32648 microversion: 2.1 time: 0.067470 Oct 31 15:17:30.751781 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3550/7352] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:30 2022] POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action => generated 32648 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:30.763579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:30.764130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.771764 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.772296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.772766 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.773479 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.773946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.774407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.848686 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6d1a99c-bdec-4b23-83ac-c6dbce7580d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action" status: 202 len: 0 microversion: 2.1 time: 0.088734 Oct 31 15:17:30.852607 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3803/7353] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:30 2022] POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:30.860027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.860753 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.871316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.872223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.873107 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.873850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.874391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.874828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.032888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.040941 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fcc7aa7f-7245-4261-bdb1-fb161219575f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1673 microversion: 2.1 time: 0.186579 Oct 31 15:17:31.041521 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3551/7354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:32.066655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.067372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.074369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.074874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.075325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.076024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.076495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.076935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.212100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.219923 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50e3ac50-b78e-46d4-989f-3768b9a107bc tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1681 microversion: 2.1 time: 0.158386 Oct 31 15:17:32.220494 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3804/7355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:32.315138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:32.317493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.325182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.325675 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.326123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.326987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.328402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.328841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.381509 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e16e1b8-2ff5-4e01-a378-17c4e52d7c72 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action" status: 200 len: 38398 microversion: 2.1 time: 0.070138 Oct 31 15:17:32.382188 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3552/7356] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:32 2022] POST /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501/action => generated 38398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:33.587659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:33.588161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:33.591591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-57db200b-b034-43fe-86d2-bc51c07725b9 req-c5117a4f-9b6a-48f6-93ca-000cf305d8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6219a576-b451-4d72-b864-f6b01d1e5501", "tag": "e2711d7a-7fae-43df-b47d-73afcbd8a95d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:33.595157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.595724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.596251 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.597024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.597559 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.598062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.604040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-57db200b-b034-43fe-86d2-bc51c07725b9 req-c5117a4f-9b6a-48f6-93ca-000cf305d8be service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.604694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-57db200b-b034-43fe-86d2-bc51c07725b9 req-c5117a4f-9b6a-48f6-93ca-000cf305d8be service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.605172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-57db200b-b034-43fe-86d2-bc51c07725b9 req-c5117a4f-9b6a-48f6-93ca-000cf305d8be service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.617776 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-57db200b-b034-43fe-86d2-bc51c07725b9 req-c5117a4f-9b6a-48f6-93ca-000cf305d8be service nova] Creating event network-changed:e2711d7a-7fae-43df-b47d-73afcbd8a95d for instance 6219a576-b451-4d72-b864-f6b01d1e5501 on n-h2-863052-1 Oct 31 15:17:33.623254 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-57db200b-b034-43fe-86d2-bc51c07725b9 req-c5117a4f-9b6a-48f6-93ca-000cf305d8be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036587 Oct 31 15:17:33.624047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3553/7357] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:33.626769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:33.716039 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94c2b1f1-4595-416d-9767-840fc1533c13 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 204 len: 0 microversion: 2.1 time: 0.132288 Oct 31 15:17:33.720818 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3805/7358] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:33 2022] DELETE /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:33.727312 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:33.728054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:33.734884 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.735693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.736404 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.737156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.737623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.738054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.876704 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:33.885332 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d964f7d-b534-42d0-b4bc-73d57db86f74 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1687 microversion: 2.1 time: 0.163573 Oct 31 15:17:33.885906 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3554/7359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:33 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:34.910747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:34.911408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:34.918752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.919248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.919694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.920396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.920858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.921294 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.095486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:35.104168 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10544b11-ba36-4fb0-9415-0c5141fec50d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1687 microversion: 2.1 time: 0.197760 Oct 31 15:17:35.104742 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3806/7360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:34 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:35.663545 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f9e1235a-1d69-4b44-80d6-aba3a039aa60 req-7a139ebc-353b-4117-a093-bb927236a559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6219a576-b451-4d72-b864-f6b01d1e5501", "name": "network-vif-deleted", "tag": "e2711d7a-7fae-43df-b47d-73afcbd8a95d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:35.676810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f9e1235a-1d69-4b44-80d6-aba3a039aa60 req-7a139ebc-353b-4117-a093-bb927236a559 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.677802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f9e1235a-1d69-4b44-80d6-aba3a039aa60 req-7a139ebc-353b-4117-a093-bb927236a559 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.678266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f9e1235a-1d69-4b44-80d6-aba3a039aa60 req-7a139ebc-353b-4117-a093-bb927236a559 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.691874 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f9e1235a-1d69-4b44-80d6-aba3a039aa60 req-7a139ebc-353b-4117-a093-bb927236a559 service nova] Creating event network-vif-deleted:e2711d7a-7fae-43df-b47d-73afcbd8a95d for instance 6219a576-b451-4d72-b864-f6b01d1e5501 on n-h2-863052-1 Oct 31 15:17:35.698466 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f9e1235a-1d69-4b44-80d6-aba3a039aa60 req-7a139ebc-353b-4117-a093-bb927236a559 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039156 Oct 31 15:17:35.699251 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3555/7361] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:36.127993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:36.128619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:36.135658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.136395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.136844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.137549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.138063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.138525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.170518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.171014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.171460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.171915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lazy-loading 'fault' on Instance uuid 6219a576-b451-4d72-b864-f6b01d1e5501 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:36.213163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:36.220325 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-720f3ea7-e3e5-4c40-9fbb-0089990fb6eb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 200 len: 1355 microversion: 2.1 time: 0.096293 Oct 31 15:17:36.220899 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3807/7362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:36 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 1355 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:37.245627 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.246368 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 6219a576-b451-4d72-b864-f6b01d1e5501] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:37.253326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.253816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.254362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.255108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.255589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.256019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.269039 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] HTTP exception thrown: Instance 6219a576-b451-4d72-b864-f6b01d1e5501 could not be found. Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Request method failure captured: Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 HTTP/1.1 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-bVSaYd724pQHwr1Sx4jgDq03Pne7k1nseaUF5HaI43CP9RJp93lhDvVz5aG7huqkwhQ5kTKyvlACRo4p-hQRxh8BxGlRz3hgbgBYkUW_AU78fFyO9WCAnuO7LYyWOToABSm4_vQrv3JGuWcyOvbTUUv4DYloKMjNY58MyEhm9L1gs Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b711002d2e3f46249fd31eb32fadfd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 41eaa9a77a624fe98ea4a04e08a3865c Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 6219a576-b451-4d72-b864-f6b01d1e5501 could not be found. Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '6219a576-b451-4d72-b864-f6b01d1e5501'} Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6219a576-b451-4d72-b864-f6b01d1e5501 could not be found. Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6219a576-b451-4d72-b864-f6b01d1e5501 could not be found. Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.271197 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6219a576-b451-4d72-b864-f6b01d1e5501 could not be found. Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Returning 404 to user: Instance 6219a576-b451-4d72-b864-f6b01d1e5501 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d2581de-045e-4227-88cf-a6ae80b576c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501" status: 404 len: 111 microversion: 2.1 time: 0.031309 Oct 31 15:17:37.276118 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3556/7363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:37 2022] GET /compute/v2.1/servers/6219a576-b451-4d72-b864-f6b01d1e5501 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:17:40.554101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a8c0dda-52d7-461c-a3a5-5aeec0a6aec7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '.version_select at 0x7fe1077124c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:40.579302 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a8c0dda-52d7-461c-a3a5-5aeec0a6aec7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-678041913" status: 202 len: 0 microversion: 2.1 time: 0.029024 Oct 31 15:17:40.579900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3808/7364] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 15:17:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-678041913 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:40.605423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9c2c99f-b57d-4822-ad91-d7446db4f603 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: .version_select at 0x7fe10799de50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1409706134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqicZKHLYNxhwKLVVeAso6L2INOY9RItzrMn8p/e5nlRXHQlgfarmR+rUMLNkv2eRcHG4Syuy2jg5WvkztTR7hJzDjZH/4oYWqlvQjhrcHLPyn+D/RXUsKLUCZp7koQrQ=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:40.622746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c9c2c99f-b57d-4822-ad91-d7446db4f603 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:40.627952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-c9c2c99f-b57d-4822-ad91-d7446db4f603 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:40.651976 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9c2c99f-b57d-4822-ad91-d7446db4f603 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050583 Oct 31 15:17:40.658649 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3557/7365] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:17:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:45.967572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1797553504", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "3f487b0f-f330-4989-90e6-60328e344d22"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1409706134", "security_groups": [{"name": "tempest-secgroup-smoke-1995172336"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:46.122262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] validate_networks() for [('3f487b0f-f330-4989-90e6-60328e344d22', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:46.217922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:46.563018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:46.563357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:46.564182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:46.564839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:46.565783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:46.581997 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.582646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.583234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.584549 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.585274 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.585679 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.612595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:46.619739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:46.633932 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:46.636483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:46.694502 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84e0c6a6-ad97-446a-bbeb-90d1b7eacef8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730890 Oct 31 15:17:46.695888 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3809/7366] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:46.706960 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-196cd69a-26bc-46d0-8b52-45e1a87d808f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.708235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-196cd69a-26bc-46d0-8b52-45e1a87d808f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:46.774126 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-196cd69a-26bc-46d0-8b52-45e1a87d808f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.785313 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-196cd69a-26bc-46d0-8b52-45e1a87d808f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1267 microversion: 2.1 time: 0.082132 Oct 31 15:17:46.785913 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3558/7367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:47.809734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:47.810844 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:47.825252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.825252 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.825850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.826669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.827200 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.827726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.910431 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:47.919643 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ad32d69-44df-409d-ba4f-b04806e3e995 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1327 microversion: 2.1 time: 0.114232 Oct 31 15:17:47.923054 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3810/7368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:47 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:48.952037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:48.952667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:48.959467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=32 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:48.962306 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.962806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.963436 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.964171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.964636 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.965066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.209903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:49.218427 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-61cd4271-231a-42dc-9018-a8ba17a19fd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.270094 Oct 31 15:17:49.219152 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3559/7369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:48 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:49.547405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-3bf5fb05-3e45-4e40-a473-21b537a5e384 req-02f4016d-e849-434f-8305-0b9aeed929f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6296da-e779-41b5-9485-0e18f26835d8", "tag": "fa08caf5-3523-4363-a236-a90e94dcae93"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:49.558618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3bf5fb05-3e45-4e40-a473-21b537a5e384 req-02f4016d-e849-434f-8305-0b9aeed929f3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.559188 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3bf5fb05-3e45-4e40-a473-21b537a5e384 req-02f4016d-e849-434f-8305-0b9aeed929f3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.559641 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-3bf5fb05-3e45-4e40-a473-21b537a5e384 req-02f4016d-e849-434f-8305-0b9aeed929f3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.572410 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-3bf5fb05-3e45-4e40-a473-21b537a5e384 req-02f4016d-e849-434f-8305-0b9aeed929f3 service nova] Creating event network-changed:fa08caf5-3523-4363-a236-a90e94dcae93 for instance 5c6296da-e779-41b5-9485-0e18f26835d8 on n-h2-863052-1 Oct 31 15:17:49.577544 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-3bf5fb05-3e45-4e40-a473-21b537a5e384 req-02f4016d-e849-434f-8305-0b9aeed929f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Oct 31 15:17:49.578156 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3811/7370] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:50.248192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.248912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.256109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.256679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.257224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.257934 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.258421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.258856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.394581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:50.402318 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-436657a7-37a8-446d-b8ec-ddaab95786f2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.158081 Oct 31 15:17:50.402903 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3560/7371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:51.426666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:51.427306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:51.433575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.434077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.434561 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.435271 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.435740 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.436325 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.575991 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:51.584368 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2938687b-1184-461b-add1-53da95bab3f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.163049 Oct 31 15:17:51.584945 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3812/7372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:51 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:52.607668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.608285 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:52.616233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.616716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.617154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.617851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.618346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.618777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.755958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:52.763754 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a6d62663-d4b5-4ec3-9280-c5593e9f73af tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.160198 Oct 31 15:17:52.764348 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3561/7373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:53.787539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:53.788168 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:53.795091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.795585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.796030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.796735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.797194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.797629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.930030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:53.937639 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab077bc9-ab7e-4147-80b9-2c17d7af523b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.154348 Oct 31 15:17:53.938227 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3813/7374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:53 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.960944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.961475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:54.968331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.968822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.969267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.969967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.970459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.970894 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.100263 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:55.108152 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5ecd147-0bb4-42c0-9ee1-37b143aac55f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.151229 Oct 31 15:17:55.108718 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3562/7375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:55.817360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-68996bbd-217a-43b5-8704-4f2575955781 req-6db7e17f-f845-4ff7-a5c9-ab1a0cd0fefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6296da-e779-41b5-9485-0e18f26835d8", "name": "network-vif-plugged", "status": "completed", "tag": "fa08caf5-3523-4363-a236-a90e94dcae93"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:55.828494 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-68996bbd-217a-43b5-8704-4f2575955781 req-6db7e17f-f845-4ff7-a5c9-ab1a0cd0fefa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.829002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-68996bbd-217a-43b5-8704-4f2575955781 req-6db7e17f-f845-4ff7-a5c9-ab1a0cd0fefa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.829521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-68996bbd-217a-43b5-8704-4f2575955781 req-6db7e17f-f845-4ff7-a5c9-ab1a0cd0fefa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.841638 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-68996bbd-217a-43b5-8704-4f2575955781 req-6db7e17f-f845-4ff7-a5c9-ab1a0cd0fefa service nova] Creating event network-vif-plugged:fa08caf5-3523-4363-a236-a90e94dcae93 for instance 5c6296da-e779-41b5-9485-0e18f26835d8 on n-h2-863052-1 Oct 31 15:17:55.846637 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-68996bbd-217a-43b5-8704-4f2575955781 req-6db7e17f-f845-4ff7-a5c9-ab1a0cd0fefa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Oct 31 15:17:55.847226 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3814/7376] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:56.131654 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.132855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.135176 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:17:56.135319 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:17:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 (ip 10.222.0.27) !!! Oct 31 15:17:56.141976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.142506 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.142952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.143661 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.144121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.144550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.274599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.282292 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d38161fb-6c59-40bc-a2df-655cb21e6bfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1393 microversion: 2.1 time: 0.155109 Oct 31 15:17:56.282870 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3563/7377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:57.302996 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:57.303785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:57.309983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.310789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.317813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.319179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.319649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.320508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.320974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.321408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.453432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:57.461265 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b59a5b8-9c3e-4ce9-ac24-b5026f439b81 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1565 microversion: 2.1 time: 0.159316 Oct 31 15:17:57.461834 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3815/7378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:57.483763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.484391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.486294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:57.493002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.493500 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.493948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.494694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.495160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.495604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.627387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:57.635831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a43a6409-8450-4819-bfe8-d928f7062452 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1565 microversion: 2.1 time: 0.156285 Oct 31 15:17:57.636440 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3564/7379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:59.512781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-dc86311d-2ba6-4bc5-98b9-8cbc0c984610 req-f42a2fe0-67f3-4d61-868e-1beb37698a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6296da-e779-41b5-9485-0e18f26835d8", "tag": "fa08caf5-3523-4363-a236-a90e94dcae93"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:59.514150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.519678 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:59.521712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:59.524532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:59.529806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.530327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.530782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.531510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.531959 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.532389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.542824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dc86311d-2ba6-4bc5-98b9-8cbc0c984610 req-f42a2fe0-67f3-4d61-868e-1beb37698a57 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.543313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dc86311d-2ba6-4bc5-98b9-8cbc0c984610 req-f42a2fe0-67f3-4d61-868e-1beb37698a57 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.543745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dc86311d-2ba6-4bc5-98b9-8cbc0c984610 req-f42a2fe0-67f3-4d61-868e-1beb37698a57 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.558740 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-dc86311d-2ba6-4bc5-98b9-8cbc0c984610 req-f42a2fe0-67f3-4d61-868e-1beb37698a57 service nova] Creating event network-changed:fa08caf5-3523-4363-a236-a90e94dcae93 for instance 5c6296da-e779-41b5-9485-0e18f26835d8 on n-h2-863052-1 Oct 31 15:17:59.564843 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-dc86311d-2ba6-4bc5-98b9-8cbc0c984610 req-f42a2fe0-67f3-4d61-868e-1beb37698a57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055587 Oct 31 15:17:59.566023 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3565/7380] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:59.691423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:59.699648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2512e4cd-6966-4668-a2b3-5c16d9472cfe tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1565 microversion: 2.1 time: 0.195157 Oct 31 15:17:59.700575 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3816/7381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:22.993622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:22.995941 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:22.998076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:22.998726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:23.004568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.005037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.005476 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.006186 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.006645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.007071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.058311 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-76f4e52b-a59c-4cf8-8f5c-b60f1a698d60 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8/action" status: 200 len: 24572 microversion: 2.1 time: 0.069226 Oct 31 15:18:23.058960 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3566/7382] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:22 2022] POST /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:29.438552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:29.440750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.442954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:29.443604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:29.450382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.450898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.451798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.452279 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.452870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.453401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.529273 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80a33b30-3e21-452c-82a0-976b561aef35 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8/action" status: 202 len: 0 microversion: 2.1 time: 0.094616 Oct 31 15:18:29.529939 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3817/7383] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:29 2022] POST /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:29.539807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.540523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.549188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.549712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.550160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.550918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.551377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.551844 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.783377 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.791939 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed88d4fe-e461-46b1-87d5-da705f13a1ab tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1675 microversion: 2.1 time: 0.256641 Oct 31 15:18:29.792735 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3567/7384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:30.818068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:30.819290 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:30.825535 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.826055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.826532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.827218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.827677 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.828109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.964409 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:30.972134 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86295bd4-aded-4198-9c38-350c2489ad51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.159388 Oct 31 15:18:30.972711 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3818/7385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:30 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:31.996881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.997530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:32.005338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.005832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.006463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.007163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.007625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.008056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.137746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:32.145542 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad5707c2-7ec6-4c4f-8ce1-0a616306292d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.152668 Oct 31 15:18:32.146128 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3568/7386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.168954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.169583 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.176342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.176840 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.177291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.177995 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.178497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.178935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.315886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.324441 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0bbec36-9d23-4310-9a9a-2a4103ee3a3e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.159347 Oct 31 15:18:33.325038 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3819/7387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.347754 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.348376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.356548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.357032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.357467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.358153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.358631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.359054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.491324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.499049 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ff7288b-d00e-48cd-ad62-495e5317bb9c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.155191 Oct 31 15:18:34.499614 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3569/7388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:35.523748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:35.524408 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.531265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.531760 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.532213 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.532916 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.533381 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.533818 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.664434 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:35.672074 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c563a84-20d2-438a-8ddc-d866e0ed2998 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.152851 Oct 31 15:18:35.672636 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3820/7389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:35 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:36.694542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:36.695200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:36.701905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.702427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.702867 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.703555 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.704007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.704431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.832709 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:36.840635 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-453df5ba-7813-4bd0-ae63-4230d03afb5f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.150012 Oct 31 15:18:36.841216 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3570/7390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:36 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.864929 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.865553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.872451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.872955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.873393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.874086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.874573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.875006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.004942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.013285 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64a8ec60-3ecd-4840-85cb-68a46e099ac8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.152577 Oct 31 15:18:38.013913 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3821/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.036955 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.037575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.044835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.045327 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.045773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.046568 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.047040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.047470 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.176701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.184831 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45791e16-dac2-4532-9f3a-fcc0776f6e19 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.151851 Oct 31 15:18:39.185407 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3571/7392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:40.210443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.210982 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.218287 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.218787 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.219236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.219933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.220397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.220832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.357879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:40.365566 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c55b3a32-4174-4c3f-9b09-a347a9d8dc95 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1680 microversion: 2.1 time: 0.159604 Oct 31 15:18:40.366653 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3822/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:41.389154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.389772 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.396666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.397153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.398346 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.399044 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.399496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.399926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.531966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.539702 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-619062be-20c3-4c79-9224-cb09e078283a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1683 microversion: 2.1 time: 0.154541 Oct 31 15:18:41.540276 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3572/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.725038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:05.727722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.730480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=12 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:05.731422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:05.737384 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.737885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.738428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.739135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.739602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.740042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.799250 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cba404c-7e43-43c8-81f8-230d4bf6c5b0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8/action" status: 200 len: 68972 microversion: 2.1 time: 0.078034 Oct 31 15:19:05.799897 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3823/7395] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:05 2022] POST /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8/action => generated 68972 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:19:12.825130 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.826241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.829615 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:12.830431 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=40 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:12.836430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.837024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.837475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.838320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.838791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.839225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.865866 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:12.890887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5fb7f576-6d7a-4d6e-b839-b785a32a65f5 req-8d01cbc4-76f1-4523-8506-759452720685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6296da-e779-41b5-9485-0e18f26835d8", "tag": "fa08caf5-3523-4363-a236-a90e94dcae93"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:12.905761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5fb7f576-6d7a-4d6e-b839-b785a32a65f5 req-8d01cbc4-76f1-4523-8506-759452720685 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.906491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5fb7f576-6d7a-4d6e-b839-b785a32a65f5 req-8d01cbc4-76f1-4523-8506-759452720685 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.907021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5fb7f576-6d7a-4d6e-b839-b785a32a65f5 req-8d01cbc4-76f1-4523-8506-759452720685 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.920908 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5fb7f576-6d7a-4d6e-b839-b785a32a65f5 req-8d01cbc4-76f1-4523-8506-759452720685 service nova] Creating event network-changed:fa08caf5-3523-4363-a236-a90e94dcae93 for instance 5c6296da-e779-41b5-9485-0e18f26835d8 on n-h2-863052-1 Oct 31 15:19:12.927926 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5fb7f576-6d7a-4d6e-b839-b785a32a65f5 req-8d01cbc4-76f1-4523-8506-759452720685 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108711 Oct 31 15:19:12.928947 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3824/7396] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:12.956807 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50c70754-9b7e-4e1c-806f-57024f6316fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 204 len: 0 microversion: 2.1 time: 0.140382 Oct 31 15:19:12.957450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3573/7397] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:12 2022] DELETE /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:12.970262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.972804 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.982745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.983566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.984196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.985089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.985712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.986346 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.125707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.133771 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac0a780b-c6dd-48fd-93ad-01c3859176a8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1689 microversion: 2.1 time: 0.170953 Oct 31 15:19:13.134383 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3825/7398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:12 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.158484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.159336 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.166156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.166680 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.167128 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.167825 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.168281 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.168708 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.324065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.331913 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5ede5e9-2baa-43cf-a34e-ca14a5818abb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1689 microversion: 2.1 time: 0.177879 Oct 31 15:19:14.332487 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3574/7399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:14 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.983063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6d3f7e5a-4e37-4c0a-9538-9a0887d9b3e0 req-37ea66ba-d407-4e52-b636-6ebe6dca9877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6296da-e779-41b5-9485-0e18f26835d8", "name": "network-vif-deleted", "tag": "fa08caf5-3523-4363-a236-a90e94dcae93"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:14.993075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6d3f7e5a-4e37-4c0a-9538-9a0887d9b3e0 req-37ea66ba-d407-4e52-b636-6ebe6dca9877 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.993981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6d3f7e5a-4e37-4c0a-9538-9a0887d9b3e0 req-37ea66ba-d407-4e52-b636-6ebe6dca9877 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.994550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6d3f7e5a-4e37-4c0a-9538-9a0887d9b3e0 req-37ea66ba-d407-4e52-b636-6ebe6dca9877 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.006272 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6d3f7e5a-4e37-4c0a-9538-9a0887d9b3e0 req-37ea66ba-d407-4e52-b636-6ebe6dca9877 service nova] Creating event network-vif-deleted:fa08caf5-3523-4363-a236-a90e94dcae93 for instance 5c6296da-e779-41b5-9485-0e18f26835d8 on n-h2-863052-1 Oct 31 15:19:15.011387 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6d3f7e5a-4e37-4c0a-9538-9a0887d9b3e0 req-37ea66ba-d407-4e52-b636-6ebe6dca9877 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099911 Oct 31 15:19:15.012065 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3826/7400] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:15.355447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.356384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.365402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.365910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.366392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.367108 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.367565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.368172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.401444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.401932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.402406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.402865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lazy-loading 'fault' on Instance uuid 5c6296da-e779-41b5-9485-0e18f26835d8 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:15.444911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.453858 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cb9db5db-75c9-47fb-ae13-756686ad23a7 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 200 len: 1508 microversion: 2.1 time: 0.102527 Oct 31 15:19:15.454462 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3575/7401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 1508 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:16.557092 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:16.557805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 5c6296da-e779-41b5-9485-0e18f26835d8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:16.564062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.564655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.565111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.565812 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.566311 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.566753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.579802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] HTTP exception thrown: Instance 5c6296da-e779-41b5-9485-0e18f26835d8 could not be found. Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Request method failure captured: Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 HTTP/1.1 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-bVSaYd724pQHwr1Sx4jgDq03Pne7k1nseaUF5HaI43CP9RJp93lhDvVz5aG7huqkwhQ5kTKyvlACRo4p-hQRxh8BxGlRz3hgbgBYkUW_AU78fFyO9WCAnuO7LYyWOToABSm4_vQrv3JGuWcyOvbTUUv4DYloKMjNY58MyEhm9L1gs Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b711002d2e3f46249fd31eb32fadfd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 41eaa9a77a624fe98ea4a04e08a3865c Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 5c6296da-e779-41b5-9485-0e18f26835d8 could not be found. Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '5c6296da-e779-41b5-9485-0e18f26835d8'} Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6296da-e779-41b5-9485-0e18f26835d8 could not be found. Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6296da-e779-41b5-9485-0e18f26835d8 could not be found. Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:19:16.581511 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6296da-e779-41b5-9485-0e18f26835d8 could not be found. Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Returning 404 to user: Instance 5c6296da-e779-41b5-9485-0e18f26835d8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32593a9f-dab5-4a3b-9f07-18f1a923b084 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8" status: 404 len: 111 microversion: 2.1 time: 0.031142 Oct 31 15:19:16.587267 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3827/7402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:16 2022] GET /compute/v2.1/servers/5c6296da-e779-41b5-9485-0e18f26835d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:19.823896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b134a403-db33-48ce-b4bd-0b28d2b2376b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '.version_select at 0x7fe10c3118b0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.848676 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b134a403-db33-48ce-b4bd-0b28d2b2376b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1409706134" status: 202 len: 0 microversion: 2.1 time: 0.028185 Oct 31 15:19:19.854580 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3576/7403] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 31 15:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1409706134 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:19.871865 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eafb06a5-c49f-4102-b54d-9b3abf475c70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: .version_select at 0x7fe107dc20d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1479861951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxtw1NqGgEm6df9QqSJLZhfGaXnaXkCjnBh4zLMYmFZgKoDR7SftU5Q93tNXVyfXKdHDHoOqAS10oZheWwqUyK3rodwQJAuQs4NeTvDV+CKXzP+37exx3+9ZgA5PFfrLQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:19.889161 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-eafb06a5-c49f-4102-b54d-9b3abf475c70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:19.894412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-eafb06a5-c49f-4102-b54d-9b3abf475c70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:19.919948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eafb06a5-c49f-4102-b54d-9b3abf475c70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052547 Oct 31 15:19:19.920820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3828/7404] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:19:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:19:25.630473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:25.634737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1186120452", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "538fdb08-4292-430b-a328-2fee1fa1887e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1479861951", "security_groups": [{"name": "tempest-secgroup-smoke-1758728389"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:25.768992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] validate_networks() for [('538fdb08-4292-430b-a328-2fee1fa1887e', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:26.213719 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:26.214240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:26.214820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:26.215294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:26.215816 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:26.224736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.225293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.225923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.226961 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.227414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.227841 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.247918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:26.253326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:26.266514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:26.269008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:26.351308 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ca94ff0-2b91-4e4d-a583-b5fe70e5ee34 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722550 Oct 31 15:19:26.352247 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3577/7405] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:19:26.365310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8c10adb-0087-4451-91df-a02d05cfd368 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:26.366582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8c10adb-0087-4451-91df-a02d05cfd368 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:26.433702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8c10adb-0087-4451-91df-a02d05cfd368 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:26.440936 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8c10adb-0087-4451-91df-a02d05cfd368 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1267 microversion: 2.1 time: 0.080860 Oct 31 15:19:26.441522 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3829/7406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:26 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:27.465987 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1b52fce4-5d71-48e9-b823-8a740d0c9d11 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.466879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1b52fce4-5d71-48e9-b823-8a740d0c9d11 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:27.529388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-1b52fce4-5d71-48e9-b823-8a740d0c9d11 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.536875 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1b52fce4-5d71-48e9-b823-8a740d0c9d11 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1267 microversion: 2.1 time: 0.074867 Oct 31 15:19:27.537474 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3578/7407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:28.559683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0224e786-6acf-47ec-9e33-fa2dc6242737 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.560347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0224e786-6acf-47ec-9e33-fa2dc6242737 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:28.562954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:28.618495 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0224e786-6acf-47ec-9e33-fa2dc6242737 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.626192 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0224e786-6acf-47ec-9e33-fa2dc6242737 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1267 microversion: 2.1 time: 0.070467 Oct 31 15:19:28.627259 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3830/7408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:29.649681 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-60d0174a-d66a-4266-a7a4-e687d2fb0097 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:29.650521 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-60d0174a-d66a-4266-a7a4-e687d2fb0097 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:29.709538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-60d0174a-d66a-4266-a7a4-e687d2fb0097 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:29.716426 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-60d0174a-d66a-4266-a7a4-e687d2fb0097 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1267 microversion: 2.1 time: 0.070759 Oct 31 15:19:29.717017 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3579/7409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:29 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:30.740531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.741157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:30.748731 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.749238 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.749696 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.750441 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.750908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.751347 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.812626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.820802 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-adef79be-1026-4ae4-b867-987a21600a54 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1271 microversion: 2.1 time: 0.083730 Oct 31 15:19:30.821406 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3831/7410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:31.843548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:31.844182 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:31.853191 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.853822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.854296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.855040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.855498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.856458 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.950648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:31.958372 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d807cc7e-9e90-4a24-8b50-2ce6345d8e9e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1325 microversion: 2.1 time: 0.118729 Oct 31 15:19:31.959137 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3580/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:31 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1325 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:32.852116 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-74b38120-ef16-49f5-abb1-b5c79116b0b7 req-afb1fa4c-0673-452c-a4db-727d1f8ed381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:32.868056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-74b38120-ef16-49f5-abb1-b5c79116b0b7 req-afb1fa4c-0673-452c-a4db-727d1f8ed381 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.869190 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-74b38120-ef16-49f5-abb1-b5c79116b0b7 req-afb1fa4c-0673-452c-a4db-727d1f8ed381 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.869642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-74b38120-ef16-49f5-abb1-b5c79116b0b7 req-afb1fa4c-0673-452c-a4db-727d1f8ed381 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.883290 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-74b38120-ef16-49f5-abb1-b5c79116b0b7 req-afb1fa4c-0673-452c-a4db-727d1f8ed381 service nova] Creating event network-changed:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h1-863052-1 Oct 31 15:19:32.888861 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-74b38120-ef16-49f5-abb1-b5c79116b0b7 req-afb1fa4c-0673-452c-a4db-727d1f8ed381 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040825 Oct 31 15:19:32.889478 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3832/7412] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:19:32.980815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.981685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:32.988797 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.989286 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.989730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.990464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.990940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.991364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:33.214848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:33.222565 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7aeafd0a-129f-4b7a-954e-100abd0a0d7b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1393 microversion: 2.1 time: 0.245623 Oct 31 15:19:33.223152 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3581/7413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:32 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:34.247269 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.248003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.255569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.256075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.256543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.257751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.258245 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.258691 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.399246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:34.407089 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8e3d05d-6b09-4d64-8d7f-26bc27a1167f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1393 microversion: 2.1 time: 0.164607 Oct 31 15:19:34.407684 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3833/7414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:34 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:35.430579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:35.431200 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:35.438071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:35.438592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:35.439038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:35.439733 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:35.440188 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:35.440618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:35.574099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:35.581766 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f5b4ccac-8d79-47dc-a9cb-880fe1440085 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1393 microversion: 2.1 time: 0.155164 Oct 31 15:19:35.582369 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3582/7415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:35 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:36.605523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:36.606372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:36.609872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:36.615170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:36.615670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:36.616118 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:36.617474 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:36.617935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:36.618394 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:36.749007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:36.756651 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2bfacfbd-3ea0-471b-bd78-4ecb001a2a42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1393 microversion: 2.1 time: 0.155661 Oct 31 15:19:36.757216 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3834/7416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:36 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:37.779094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:37.779741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:37.782422 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:37.788093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:37.789080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:37.789528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:37.790259 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:37.790722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:37.791158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:37.923572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:37.933568 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5429e51e-8c28-46c3-8f90-1121dc4f4231 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1393 microversion: 2.1 time: 0.158389 Oct 31 15:19:37.934177 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3583/7417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:37 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:38.956918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:38.957558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:38.959974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:38.965420 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.965924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.966407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.967128 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.967601 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.968045 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:39.013144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b8c594da-97cd-4a16-aaf8-2921b746474b req-90b3cce7-e0d4-486d-8c57-94944e8d4a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "name": "network-vif-plugged", "status": "completed", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:39.027380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8c594da-97cd-4a16-aaf8-2921b746474b req-90b3cce7-e0d4-486d-8c57-94944e8d4a98 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:39.028156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8c594da-97cd-4a16-aaf8-2921b746474b req-90b3cce7-e0d4-486d-8c57-94944e8d4a98 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:39.028822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8c594da-97cd-4a16-aaf8-2921b746474b req-90b3cce7-e0d4-486d-8c57-94944e8d4a98 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:39.043850 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b8c594da-97cd-4a16-aaf8-2921b746474b req-90b3cce7-e0d4-486d-8c57-94944e8d4a98 service nova] Creating event network-vif-plugged:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h1-863052-1 Oct 31 15:19:39.049649 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b8c594da-97cd-4a16-aaf8-2921b746474b req-90b3cce7-e0d4-486d-8c57-94944e8d4a98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041643 Oct 31 15:19:39.050568 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3584/7418] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:39.119927 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:39.127828 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bdd443d-bb92-4a97-8e31-317c1a5b509f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1393 microversion: 2.1 time: 0.175063 Oct 31 15:19:39.128626 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3835/7419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:38 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:40.149784 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:40.156172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:40.156991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:40.165224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.165736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.166203 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.166911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.167373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.167808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.300918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:40.308837 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57d03b0e-a85d-47d8-9336-5d97d536143b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1564 microversion: 2.1 time: 0.160024 Oct 31 15:19:40.309410 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3585/7420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:40 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:40.331786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:40.332418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:40.339900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.340407 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.340862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.341570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.342042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.342517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.475457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:40.483964 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53520f4b-24f8-43dc-a6b9-7f96ab03ae2a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1564 microversion: 2.1 time: 0.156000 Oct 31 15:19:40.484547 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3836/7421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:40 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:42.055732 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:42.056920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:42.059120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fba5255e-564c-478f-af07-6b9943d9f32d req-ae2ad1f1-9660-4d58-8979-ea10d54ffc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:42.063976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.064463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.065095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.065962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.066447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.066872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.072187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fba5255e-564c-478f-af07-6b9943d9f32d req-ae2ad1f1-9660-4d58-8979-ea10d54ffc53 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.072803 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fba5255e-564c-478f-af07-6b9943d9f32d req-ae2ad1f1-9660-4d58-8979-ea10d54ffc53 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.073552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fba5255e-564c-478f-af07-6b9943d9f32d req-ae2ad1f1-9660-4d58-8979-ea10d54ffc53 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.086504 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fba5255e-564c-478f-af07-6b9943d9f32d req-ae2ad1f1-9660-4d58-8979-ea10d54ffc53 service nova] Creating event network-changed:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h1-863052-1 Oct 31 15:19:42.092300 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fba5255e-564c-478f-af07-6b9943d9f32d req-ae2ad1f1-9660-4d58-8979-ea10d54ffc53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038214 Oct 31 15:19:42.093365 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3837/7422] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:19:42.305886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:42.314213 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a160940e-7725-461f-ba66-981ff01cc9c5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1564 microversion: 2.1 time: 0.262767 Oct 31 15:19:42.314995 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3586/7423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:42 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:05.601424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=7 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:05.602109 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=34 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:05.607836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:05.610138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:05.617385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.617888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.618379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.619681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.620152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.620595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.671599 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-420d448b-3553-4afe-a56d-5e9af05b75e2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action" status: 200 len: 24563 microversion: 2.1 time: 0.071971 Oct 31 15:20:05.672233 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3838/7424] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:05 2022] POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action => generated 24563 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:20:16.786291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:16.788581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.790778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:16.791563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=40 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:16.797309 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.797794 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.798254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.798952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.799406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.799863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.841520 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:16.847380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120641) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 31 15:20:16.853832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:16.854280 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:16.854755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:16.855167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:16.855577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:16.922485 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f2efb3a-af0f-4d01-af24-956acdc68f4e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action" status: 202 len: 0 microversion: 2.1 time: 0.140239 Oct 31 15:20:16.923108 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3587/7425] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:16 2022] POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:16.932049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.932767 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.935538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:16.936144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:16.942576 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.943080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.943647 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.944334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.944883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.945331 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.088719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.096591 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65e48caf-3fc8-4e78-ab47-b418a5231cd0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1692 microversion: 2.1 time: 0.168961 Oct 31 15:20:17.097154 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3839/7426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:18.120890 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:18.121438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:18.129261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:18.129756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:18.130228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:18.130967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:18.131444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:18.131870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:18.268789 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:18.277317 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b32a8ad0-2cba-4643-b10d-70c63ca40e04 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1692 microversion: 2.1 time: 0.161306 Oct 31 15:20:18.277895 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3588/7427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:18 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:19.300931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:19.301693 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:19.309296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.309814 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.310310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.311028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.311504 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.311971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.440350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:19.448096 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-860e7ec3-12ae-47f7-aaee-a4f6f73717ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.151096 Oct 31 15:20:19.448676 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3840/7428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:19 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:20.471721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:20.472341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:20.479721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.480262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.480697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.481904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.482384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.482859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.625735 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:20.633627 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7309994f-5889-4d53-8cf2-63d71f21e0fb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.165850 Oct 31 15:20:20.634227 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3589/7429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:20 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:21.656433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:21.656979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:21.664277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.664746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.665263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.666027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.666526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.666970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.803856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.812336 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58893aa2-d8bd-4f82-9ea4-483cdf3c5436 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.159913 Oct 31 15:20:21.812913 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3841/7430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:21 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:22.836643 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:22.837267 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:22.844865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.845360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.845812 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.846549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.847015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.847447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.976707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.984991 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e23bfcf-7408-43da-97e7-aa56018ba0d5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.152204 Oct 31 15:20:22.985588 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3590/7431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:22 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:24.008756 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:24.009428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:24.016216 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.016684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.017129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.017820 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.018307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.018746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.152255 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:24.160104 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae8b60c4-df02-46ac-82f5-3512b4c0f800 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.155256 Oct 31 15:20:24.160680 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3842/7432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:24 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:25.185360 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:25.186008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:25.192863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:25.193353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:25.193796 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:25.194516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:25.194975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:25.195405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:25.328231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:25.335941 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e5b48df-4030-4963-b1c7-49ab4db38a40 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.155129 Oct 31 15:20:25.336511 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3591/7433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:25 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:26.360047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:26.360669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:26.367648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:26.368149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:26.368599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:26.369299 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:26.369763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:26.370234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:26.505505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:26.513293 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-997b4103-a97d-44c1-839d-f53e8a44c35a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.157417 Oct 31 15:20:26.513874 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3843/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:26 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:27.536637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:27.537254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:27.544388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:27.544876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:27.545321 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:27.546046 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:27.546551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:27.546976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:27.678097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:27.686345 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-84aaae50-dfb1-4556-be5c-7591d67258c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.153573 Oct 31 15:20:27.686903 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3592/7435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:27 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:28.710144 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.710797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:28.718357 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.719001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.719446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.720139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.720596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.721029 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.851170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:28.859197 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e742804-2587-4b9f-9093-8d77cc06ba05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.153001 Oct 31 15:20:28.859777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3844/7436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:29.882918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.883539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:29.890499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:29.890993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:29.891438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:29.892135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:29.892596 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:29.893027 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:30.032907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:30.040948 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa93c505-c2bc-4736-ad9e-c826bee06ed5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.161967 Oct 31 15:20:30.041552 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3593/7437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:29 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:31.064974 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:31.065599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:31.072505 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:31.073007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:31.073460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:31.074186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:31.074649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:31.075084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:31.206688 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:31.214350 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b24e294f-7581-4fde-8fca-9cde661e735c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.153277 Oct 31 15:20:31.214940 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3845/7438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:31 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:32.238499 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.239111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:32.246459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.246940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.247374 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.248060 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.248514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.248940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.381402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.389781 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fa540bc1-47b0-407c-a318-b18ef544bae9 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.155304 Oct 31 15:20:32.390377 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3594/7439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:32 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:33.413055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:33.413706 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:33.420530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.421024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.421524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.422275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.422741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.423176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.556130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:33.564425 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f59237b1-b3f2-4c54-bac5-f60b8415b8ca tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.155264 Oct 31 15:20:33.564996 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3846/7440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:33 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:34.589397 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:34.590012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:34.596839 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:34.597349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:34.597787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:34.598577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:34.599029 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:34.599452 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:34.733081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:34.741086 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67d611c3-2811-45a3-9c14-9e1fa239654c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.156009 Oct 31 15:20:34.741700 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3595/7441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:34 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:35.764147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:35.764799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:35.771569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:35.772059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:35.772503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:35.773199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:35.773656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:35.774088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:35.911906 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:35.920367 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f7fe736-a173-4f8f-95ac-33470219d623 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1697 microversion: 2.1 time: 0.160216 Oct 31 15:20:35.921405 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3847/7442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:35 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:36.594605 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "name": "network-vif-unplugged", "status": "completed", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:36.604910 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.605386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.605819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.618039 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] Creating event network-vif-unplugged:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h2-863052-1 Oct 31 15:20:36.623954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120641) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:20:36.634893 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-1e9aff20-6d01-454f-8c0a-011c569d1706 req-7a85f9fb-4ff3-46a9-bb97-7d9aa33a1e85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044157 Oct 31 15:20:36.635564 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3596/7443] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:36.944481 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:36.945112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:36.952033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.952530 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.952978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.953683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.954141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.954602 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.098110 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:37.107765 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3119d220-8abd-4c88-b4b3-bbc3dbf0325d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1696 microversion: 2.1 time: 0.167114 Oct 31 15:20:37.108420 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3848/7444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:36 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:38.134192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:38.134903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:38.141792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.142317 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.142764 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.143459 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.143915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.144340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.281364 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:38.289162 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-46feb878-4720-4aad-bbca-de61dae11987 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1694 microversion: 2.1 time: 0.160321 Oct 31 15:20:38.289735 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3597/7445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:38 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:38.650554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:38.660537 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.661028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.661478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.673771 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] Creating event network-changed:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h2-863052-1 Oct 31 15:20:38.679091 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-1', 'n-h2-863052-1'} {{(pid=120640) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 31 15:20:38.690853 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c8b45a99-59ed-4bbd-ba58-d2c3638b7216 req-699226e0-ebc7-4338-a39f-c21bcad2a13c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043920 Oct 31 15:20:38.691453 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3849/7446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:39.312956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.313581 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.320512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.321002 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.321448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.322153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.322659 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.323566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.626094 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.634692 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2706b5a9-56a9-4f45-a93b-73aa039787f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1691 microversion: 2.1 time: 0.325631 Oct 31 15:20:39.635275 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3598/7447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1691 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.658925 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:39.659572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.666669 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.667178 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.667635 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.668344 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.668807 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.669244 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.726958 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69c3f14b-a5e1-4b2a-aace-1018eb65ad7d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action" status: 204 len: 0 microversion: 2.1 time: 0.072108 Oct 31 15:20:39.728396 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3850/7448] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:39 2022] POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:39.736534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.737262 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.743354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.743826 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.744320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.745597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.746144 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.746580 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.960484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.968670 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e745ea8-ccfa-40f5-b667-3e0f20a8f65a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1691 microversion: 2.1 time: 0.236140 Oct 31 15:20:39.969252 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3599/7449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.992898 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.993524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:40.000323 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.000822 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.001285 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.001981 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.002464 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.002920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.139033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:40.147206 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84a126fb-4430-41b5-a917-7babd1f3143f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1691 microversion: 2.1 time: 0.158689 Oct 31 15:20:40.147830 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3851/7450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:41.171220 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:41.171773 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:41.178712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.179207 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.179667 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.180358 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.180817 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.181243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.315344 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:41.323951 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d597f2df-f4db-420c-8c57-7cd0ee2dfbc6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1683 microversion: 2.1 time: 0.156116 Oct 31 15:20:41.324511 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3600/7451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:41 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:42.550738 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9ac73cc4-4f29-4939-bfb8-c9518e45a558 req-3d65206e-8f80-41d7-8909-fe983dff1c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "name": "network-vif-plugged", "status": "completed", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:42.561643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ac73cc4-4f29-4939-bfb8-c9518e45a558 req-3d65206e-8f80-41d7-8909-fe983dff1c95 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.562223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ac73cc4-4f29-4939-bfb8-c9518e45a558 req-3d65206e-8f80-41d7-8909-fe983dff1c95 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.562651 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ac73cc4-4f29-4939-bfb8-c9518e45a558 req-3d65206e-8f80-41d7-8909-fe983dff1c95 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.576741 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9ac73cc4-4f29-4939-bfb8-c9518e45a558 req-3d65206e-8f80-41d7-8909-fe983dff1c95 service nova] Creating event network-vif-plugged:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h2-863052-1 Oct 31 15:20:42.581894 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9ac73cc4-4f29-4939-bfb8-c9518e45a558 req-3d65206e-8f80-41d7-8909-fe983dff1c95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091295 Oct 31 15:20:42.582674 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3852/7452] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:03.506468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:03.508762 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:03.511859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=32 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:03.512527 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:03.519498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.519979 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.520428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.521150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.521618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.522059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.574208 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d658c989-1098-4d77-a937-af4552d6d6d4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action" status: 200 len: 24582 microversion: 2.1 time: 0.071457 Oct 31 15:21:03.574787 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3601/7453] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:03 2022] POST /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d/action => generated 24582 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:21:11.033984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.034777 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.035689 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c402d75a-631b-4faa-b5dd-d69165f73e00 req-7272f8a5-02c5-4262-8bc9-0755a1dc901d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:11.038306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=28 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:11.038979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:11.043267 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.043788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.044305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.045278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.045753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.046497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.049447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c402d75a-631b-4faa-b5dd-d69165f73e00 req-7272f8a5-02c5-4262-8bc9-0755a1dc901d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.049930 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c402d75a-631b-4faa-b5dd-d69165f73e00 req-7272f8a5-02c5-4262-8bc9-0755a1dc901d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.050578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c402d75a-631b-4faa-b5dd-d69165f73e00 req-7272f8a5-02c5-4262-8bc9-0755a1dc901d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.062742 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c402d75a-631b-4faa-b5dd-d69165f73e00 req-7272f8a5-02c5-4262-8bc9-0755a1dc901d service nova] Creating event network-changed:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h2-863052-1 Oct 31 15:21:11.068821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c402d75a-631b-4faa-b5dd-d69165f73e00 req-7272f8a5-02c5-4262-8bc9-0755a1dc901d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 Oct 31 15:21:11.069504 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3602/7454] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:11.076843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:11.171440 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71b54f25-8723-47aa-ae8e-4965ef9658f3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 204 len: 0 microversion: 2.1 time: 0.141914 Oct 31 15:21:11.175499 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3853/7455] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:11 2022] DELETE /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:11.182158 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.183069 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.190020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.190539 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.190977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.191787 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.192157 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.192736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.346933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.354848 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a33da862-e113-4008-8642-bc3c49af1186 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1689 microversion: 2.1 time: 0.177855 Oct 31 15:21:11.355442 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3603/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:11 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:12.381165 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.381886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:12.388793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.389298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.389752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.390488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.390970 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.391412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.526903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.534648 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72108dd9-68a2-4d91-8a62-fa0fa777aa56 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1689 microversion: 2.1 time: 0.158253 Oct 31 15:21:12.535223 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3854/7457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:12 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:13.057749 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f25a976c-a1c2-4e20-a11a-2b191b112727 req-5cb494bc-7cbc-49d5-9968-f87496b9961b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc67ed7-8602-4171-b65c-18d0f3a46f1d", "name": "network-vif-deleted", "tag": "ef4b324f-7ec5-4ce7-baea-a07b20a29a09"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:13.069313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f25a976c-a1c2-4e20-a11a-2b191b112727 req-5cb494bc-7cbc-49d5-9968-f87496b9961b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.069756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f25a976c-a1c2-4e20-a11a-2b191b112727 req-5cb494bc-7cbc-49d5-9968-f87496b9961b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.070219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f25a976c-a1c2-4e20-a11a-2b191b112727 req-5cb494bc-7cbc-49d5-9968-f87496b9961b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.083371 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f25a976c-a1c2-4e20-a11a-2b191b112727 req-5cb494bc-7cbc-49d5-9968-f87496b9961b service nova] Creating event network-vif-deleted:ef4b324f-7ec5-4ce7-baea-a07b20a29a09 for instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d on n-h2-863052-1 Oct 31 15:21:13.089074 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f25a976c-a1c2-4e20-a11a-2b191b112727 req-5cb494bc-7cbc-49d5-9968-f87496b9961b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Oct 31 15:21:13.089896 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3604/7458] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:13.559968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:13.560608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:13.567618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.568063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.568514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.569298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.569848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.570307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.602746 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.603159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.603626 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.604068 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lazy-loading 'fault' on Instance uuid 8bc67ed7-8602-4171-b65c-18d0f3a46f1d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:13.646047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:13.653126 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d64b2fc-0f93-4e8d-8e63-2d46ca2f3e3f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 200 len: 1357 microversion: 2.1 time: 0.098589 Oct 31 15:21:13.653701 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3855/7459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:13 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:14.679958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:14.680565 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 8bc67ed7-8602-4171-b65c-18d0f3a46f1d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:14.687807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.688289 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.688730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.689418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.689872 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.690331 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.703358 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] HTTP exception thrown: Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d could not be found. Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Request method failure captured: Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d HTTP/1.1 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-bVSaYd724pQHwr1Sx4jgDq03Pne7k1nseaUF5HaI43CP9RJp93lhDvVz5aG7huqkwhQ5kTKyvlACRo4p-hQRxh8BxGlRz3hgbgBYkUW_AU78fFyO9WCAnuO7LYyWOToABSm4_vQrv3JGuWcyOvbTUUv4DYloKMjNY58MyEhm9L1gs Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b711002d2e3f46249fd31eb32fadfd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 41eaa9a77a624fe98ea4a04e08a3865c Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d could not be found. Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '8bc67ed7-8602-4171-b65c-18d0f3a46f1d'} Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d could not be found. Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d could not be found. Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:21:14.704954 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d could not be found. Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Returning 404 to user: Instance 8bc67ed7-8602-4171-b65c-18d0f3a46f1d could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-787d24dd-eaac-4417-acad-9128d4985a05 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d" status: 404 len: 111 microversion: 2.1 time: 0.030825 Oct 31 15:21:14.709963 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3605/7460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:14 2022] GET /compute/v2.1/servers/8bc67ed7-8602-4171-b65c-18d0f3a46f1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:17.698729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2accaf52-75a6-4171-9f84-573a74b3f84f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '.version_select at 0x7fe106623820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:17.720402 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2accaf52-75a6-4171-9f84-573a74b3f84f tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1479861951" status: 202 len: 0 microversion: 2.1 time: 0.025550 Oct 31 15:21:17.720999 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3856/7461] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 31 15:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1479861951 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:17.747468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b0318c7-f36f-4e85-87cf-ef7fb61dc0c8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: .version_select at 0x7fe107af5a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-854523602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9QnqODXkib2gZSJP+s90rtN9txIFLyMdy9k1eRPbyl0QliBXCMhOp8cn+iVffYU/vz4HsfLjBX61huYBGGpy8lJR16FAiwXZMjUgpCb+hVTRCwWyRwdS+8l3esnDsBxg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:17.764965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0b0318c7-f36f-4e85-87cf-ef7fb61dc0c8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:17.771015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-0b0318c7-f36f-4e85-87cf-ef7fb61dc0c8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:17.793963 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b0318c7-f36f-4e85-87cf-ef7fb61dc0c8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050475 Oct 31 15:21:17.794580 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3606/7462] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:21:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:21:23.278424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1789571382", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "6cdb2430-be2c-4f75-a071-06c07b6478f7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-854523602", "security_groups": [{"name": "tempest-secgroup-smoke-1427952613"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:23.402197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] validate_networks() for [('6cdb2430-be2c-4f75-a071-06c07b6478f7', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:23.650445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:23.880455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:23.880979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:23.881600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:23.882117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:23.882856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:23.892789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:23.893277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:23.893979 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.894862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:23.895242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:23.895714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.914682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:23.920137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:23.933900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:23.936283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:23.989275 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bdd5cda-dd38-4944-8324-321d60b59b38 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714520 Oct 31 15:21:23.990320 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3857/7463] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:24.004443 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27c718cc-c617-4a82-9a3a-08c2a1da369a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:24.005140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27c718cc-c617-4a82-9a3a-08c2a1da369a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:24.194472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27c718cc-c617-4a82-9a3a-08c2a1da369a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:24.202642 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27c718cc-c617-4a82-9a3a-08c2a1da369a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1266 microversion: 2.1 time: 0.204687 Oct 31 15:21:24.220296 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3607/7464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:23 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:25.227073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:25.227719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:25.236117 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.236670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.237099 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.237828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.238514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.239136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.334353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:25.342420 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09cc1869-e48f-477d-bf66-705efcc68099 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1336 microversion: 2.1 time: 0.119472 Oct 31 15:21:25.343005 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3858/7465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:25 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1336 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:26.368255 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:26.369538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:26.371901 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:26.381914 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.385530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.385998 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.386780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.387258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.387698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.566728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.574772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74a009d0-99bd-4b2e-89ef-65546c327735 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.211510 Oct 31 15:21:26.575927 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3608/7466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:26 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:27.016755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-f4ac131f-2467-411b-8f15-91756e649806 req-b9c5387a-5e53-4cd8-9c90-4efaae2c6002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc227fb-0db5-49a6-8cfa-11275e9a3393", "tag": "7e062dba-6379-4aff-bc39-e97bc7154b05"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:27.027639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f4ac131f-2467-411b-8f15-91756e649806 req-b9c5387a-5e53-4cd8-9c90-4efaae2c6002 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.028371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f4ac131f-2467-411b-8f15-91756e649806 req-b9c5387a-5e53-4cd8-9c90-4efaae2c6002 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.029005 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-f4ac131f-2467-411b-8f15-91756e649806 req-b9c5387a-5e53-4cd8-9c90-4efaae2c6002 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.041031 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-f4ac131f-2467-411b-8f15-91756e649806 req-b9c5387a-5e53-4cd8-9c90-4efaae2c6002 service nova] Creating event network-changed:7e062dba-6379-4aff-bc39-e97bc7154b05 for instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 on n-h2-863052-1 Oct 31 15:21:27.045876 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-f4ac131f-2467-411b-8f15-91756e649806 req-b9c5387a-5e53-4cd8-9c90-4efaae2c6002 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033365 Oct 31 15:21:27.046517 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3859/7467] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:27.599686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:27.600305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:27.607453 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.607978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.608423 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.609118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.609579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.610007 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.743415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:27.751108 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4fe3e81d-a65a-4a58-b1d6-261ee3d830f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.155408 Oct 31 15:21:27.751688 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3609/7468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:27 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:28.775849 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:28.776491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:28.783138 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:28.783639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:28.784088 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:28.784817 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:28.785289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:28.785729 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:28.977141 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:28.985218 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4e54cab-c57b-4828-94cc-23596102e271 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.214628 Oct 31 15:21:28.985811 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3860/7469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:28 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:30.008633 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:30.009275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:30.017442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:30.017931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:30.018403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:30.019109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:30.019625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:30.020056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:30.150873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:30.158712 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27a51305-008f-4f41-a952-4e960aa4e4a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.154176 Oct 31 15:21:30.159289 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3610/7470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:30 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:31.182382 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:31.182895 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:31.189720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.190234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.190682 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.191371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.191830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.192262 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.323496 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.331601 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bbc6f46d-6396-4804-9fea-50facc208ccd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.153258 Oct 31 15:21:31.332169 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3861/7471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:31 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:32.355040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:32.355664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:32.363320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.363806 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.364250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.364944 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.365399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.365828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.498275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:32.505978 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8b87a4c-f05a-4402-a304-3aa3a74544e5 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.154828 Oct 31 15:21:32.506572 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3611/7472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:32 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:32.705879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8f48cf07-e60e-4193-b154-510b28e71b96 req-875c646d-49ad-4717-af89-81c0bec72ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc227fb-0db5-49a6-8cfa-11275e9a3393", "name": "network-vif-plugged", "status": "completed", "tag": "7e062dba-6379-4aff-bc39-e97bc7154b05"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:32.718025 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8f48cf07-e60e-4193-b154-510b28e71b96 req-875c646d-49ad-4717-af89-81c0bec72ca2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.718563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8f48cf07-e60e-4193-b154-510b28e71b96 req-875c646d-49ad-4717-af89-81c0bec72ca2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.719012 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8f48cf07-e60e-4193-b154-510b28e71b96 req-875c646d-49ad-4717-af89-81c0bec72ca2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.730817 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8f48cf07-e60e-4193-b154-510b28e71b96 req-875c646d-49ad-4717-af89-81c0bec72ca2 service nova] Creating event network-vif-plugged:7e062dba-6379-4aff-bc39-e97bc7154b05 for instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 on n-h2-863052-1 Oct 31 15:21:32.736313 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8f48cf07-e60e-4193-b154-510b28e71b96 req-875c646d-49ad-4717-af89-81c0bec72ca2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034697 Oct 31 15:21:32.736952 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3862/7473] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:21:33.529677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:33.530308 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:33.532936 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:33.538392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:33.538878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:33.539316 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:33.540004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:33.540492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:33.540916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:33.676067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:33.683685 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c7010fe3-f1f3-4e5f-b783-6689ae487877 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1392 microversion: 2.1 time: 0.157957 Oct 31 15:21:33.684265 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3612/7474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:33 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:34.709391 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:34.710131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:34.712941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:34.713627 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:34.720114 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:34.720612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:34.721059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:34.721765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:34.722280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:34.722716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:34.893094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:34.900991 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07586f5b-3819-43a8-8802-427f212acf82 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1564 microversion: 2.1 time: 0.196827 Oct 31 15:21:34.901670 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3863/7475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:34 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1564 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:34.923905 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:34.924524 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:34.926417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:34.932434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:34.932928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:34.933372 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:34.934078 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:34.934578 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:34.934988 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.072302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:35.080294 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a4efa215-9e4c-4c68-9f00-1fb72675e0a2 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1564 microversion: 2.1 time: 0.160774 Oct 31 15:21:35.080869 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3613/7476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:34 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:36.962388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:36.967617 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6017169b-a5b8-4464-a78f-9e2de06f696e req-5a08554b-ff4e-4d2a-ad7e-27d160385e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc227fb-0db5-49a6-8cfa-11275e9a3393", "tag": "7e062dba-6379-4aff-bc39-e97bc7154b05"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:36.975417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:36.979511 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6017169b-a5b8-4464-a78f-9e2de06f696e req-5a08554b-ff4e-4d2a-ad7e-27d160385e7c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:36.979992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6017169b-a5b8-4464-a78f-9e2de06f696e req-5a08554b-ff4e-4d2a-ad7e-27d160385e7c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:36.980564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6017169b-a5b8-4464-a78f-9e2de06f696e req-5a08554b-ff4e-4d2a-ad7e-27d160385e7c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:36.982745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:36.983321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:36.983838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:36.984751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:36.985805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:36.986468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:36.993964 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6017169b-a5b8-4464-a78f-9e2de06f696e req-5a08554b-ff4e-4d2a-ad7e-27d160385e7c service nova] Creating event network-changed:7e062dba-6379-4aff-bc39-e97bc7154b05 for instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 on n-h2-863052-1 Oct 31 15:21:36.999726 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6017169b-a5b8-4464-a78f-9e2de06f696e req-5a08554b-ff4e-4d2a-ad7e-27d160385e7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035651 Oct 31 15:21:37.000493 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3614/7477] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:37.226621 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:37.234848 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-faba46ff-1397-4fa4-8998-6d7e7b1c064d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1564 microversion: 2.1 time: 0.276509 Oct 31 15:21:37.238194 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3864/7478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:36 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1564 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:58.472015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:58.472765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:58.523112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:58.525487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:58.531815 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.533096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.533550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.534341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.534804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.535233 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.585197 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a61865a5-2a4a-4781-b76a-67a98af7e73d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action" status: 200 len: 24570 microversion: 2.1 time: 0.115555 Oct 31 15:21:58.585739 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3615/7479] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:58 2022] POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action => generated 24570 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:09.645148 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6441be22-4dda-4a48-a0b5-c6ed575185f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:09.647242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:09.647924 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:09.654455 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6441be22-4dda-4a48-a0b5-c6ed575185f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.654965 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6441be22-4dda-4a48-a0b5-c6ed575185f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.655418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6441be22-4dda-4a48-a0b5-c6ed575185f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.680113 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6441be22-4dda-4a48-a0b5-c6ed575185f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Going to try to stop instance {{(pid=120640) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:22:09.720836 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6441be22-4dda-4a48-a0b5-c6ed575185f1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action" status: 202 len: 0 microversion: 2.1 time: 0.079883 Oct 31 15:22:09.721479 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3865/7480] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:09 2022] POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:09.730517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.731294 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:09.734028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:09.734702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:09.741807 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.742403 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.742813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.743559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.744014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.744528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.877677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.885989 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72406c27-1a45-4980-9804-7c795988d7ae tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.160010 Oct 31 15:22:09.886592 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3616/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:09 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:10.912845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.913554 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:10.919805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.920305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.920753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.921449 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.921914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.922377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.060883 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:11.068590 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7de8e4db-076a-4149-9e6e-38a943dba3b6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.161554 Oct 31 15:22:11.069163 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3866/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.092261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.092878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.101135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.101621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.102062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.102855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.103314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.103744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.236531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.244325 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40105d29-c1ca-4b3d-b837-7e11c9408ee1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.156154 Oct 31 15:22:12.244903 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3617/7483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:13.267689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:13.268302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:13.275166 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.275672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.276130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.276837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.277309 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.277749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.406751 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:13.414447 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de3dbba1-d851-439e-a37f-2d4ebce97731 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.150609 Oct 31 15:22:13.415024 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3867/7484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:13 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:14.439181 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:14.439798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:14.446592 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:14.447057 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:14.447496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.448183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:14.448668 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:14.449092 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.582084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:14.589839 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d44e4b3-bb8f-4df2-ae84-c4704e3fe706 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.155134 Oct 31 15:22:14.590435 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3618/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:14 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:15.614149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.614723 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.621739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.622265 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.622716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.623412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.623870 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.624301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.754134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.761851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4021ab50-0ed5-41fd-bf86-38f6d5a715d6 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.152246 Oct 31 15:22:15.762467 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3868/7486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:15 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:16.785621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:16.786193 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:16.792922 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.793406 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.793847 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.794566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.795021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.795447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.927543 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:16.935194 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e4e69fd-6153-4af0-8bc5-edd337ab38ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.153627 Oct 31 15:22:16.935769 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3619/7487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:16 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:17.959580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:17.960209 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:17.967131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.967632 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.968086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.968789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.969948 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.970427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.104396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:18.112510 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-925aeee1-312d-4dbd-85f8-3a926715147b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.156916 Oct 31 15:22:18.113094 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3869/7488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:17 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:19.135949 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.136563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.143885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.144369 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.144804 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.145493 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.145948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.146424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.275518 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.283899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-468bc0de-60f1-445b-963d-eaa6afa5a52c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.151864 Oct 31 15:22:19.284472 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3620/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:19 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:20.308059 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.308725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.316181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.316771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.317226 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.317936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.318438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.318904 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.449565 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.457322 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c208a940-f039-4671-b04f-e37449c1bd70 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.153220 Oct 31 15:22:20.457900 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3870/7490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.481522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.482427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.489909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.490437 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.490879 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.491579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.492037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.492467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.624911 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.633249 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f6886ae-f849-4d4c-ad55-587e87e30150 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.155708 Oct 31 15:22:21.633817 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3621/7491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:22.656829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.657386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.664324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.664823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.665280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.666004 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.666510 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.666952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.802596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.810288 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf000edc-f213-488f-8519-12a025554d51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.157474 Oct 31 15:22:22.810862 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3871/7492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:23.834904 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.835517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.842412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.842900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.843341 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.844657 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.845111 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.845536 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.974702 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.982648 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98428bb9-ff28-44a6-9e2e-53fb9516dddb tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1693 microversion: 2.1 time: 0.151566 Oct 31 15:22:23.983227 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3622/7493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:23 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:25.005918 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.006593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.013686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.014300 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.014754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.015523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.015968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.016451 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.154443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:25.162784 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd832926-98f7-4749-bf23-9d7290b32376 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1670 microversion: 2.1 time: 0.160839 Oct 31 15:22:25.163363 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3872/7494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:26.259738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:26.262058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.268915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.269395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.269830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.270577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.271028 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.271451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.327058 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b1e1ed3b-905a-4699-84e7-3616ea172da4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action" status: 200 len: 38392 microversion: 2.1 time: 0.071020 Oct 31 15:22:26.327712 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3623/7495] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:26 2022] POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action => generated 38392 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:26.339862 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce74b239-48d5-4d6f-9f04-6dfcf6bf0a0c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:26.347296 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce74b239-48d5-4d6f-9f04-6dfcf6bf0a0c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.347789 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce74b239-48d5-4d6f-9f04-6dfcf6bf0a0c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.348480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce74b239-48d5-4d6f-9f04-6dfcf6bf0a0c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.371077 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce74b239-48d5-4d6f-9f04-6dfcf6bf0a0c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:22:26.411816 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce74b239-48d5-4d6f-9f04-6dfcf6bf0a0c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action" status: 202 len: 0 microversion: 2.1 time: 0.075847 Oct 31 15:22:26.412596 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3873/7496] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:26 2022] POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:26.421813 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.422584 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.430859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.431454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.432566 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.433283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.433908 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.434373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.575468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.583356 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e593a75-ae8f-4617-ad19-ba35bbdd2e51 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1679 microversion: 2.1 time: 0.165893 Oct 31 15:22:26.583941 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3624/7497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:26 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:27.608969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.609638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.617171 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.617671 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.618126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.618854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.619324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.619770 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.755396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.763345 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07e3f5a8-6383-4e74-9193-abf28e360cd1 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1683 microversion: 2.1 time: 0.159178 Oct 31 15:22:27.763917 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3874/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:51.948599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:51.950821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:51.953559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=18 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:51.954234 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=52 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:51.960595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.961080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.961519 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.962242 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.962699 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.963125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.016469 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba085648-c96c-48fd-8169-8c555e0e1ea8 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action" status: 200 len: 62960 microversion: 2.1 time: 0.071638 Oct 31 15:22:52.017167 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3625/7499] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:51 2022] POST /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393/action => generated 62960 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:22:59.470645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-df9cb7c8-1776-4623-b9fe-bde35561c810 req-a59e4073-dec8-42c9-87e7-f47e21506491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc227fb-0db5-49a6-8cfa-11275e9a3393", "tag": "7e062dba-6379-4aff-bc39-e97bc7154b05"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:59.473705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:59.474302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:59.477354 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:22:59.477492 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:22:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:22:59.480214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=20 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:59.481080 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:59.483857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.484282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.484725 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.485531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.486001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.486582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.493663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df9cb7c8-1776-4623-b9fe-bde35561c810 req-a59e4073-dec8-42c9-87e7-f47e21506491 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.494455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df9cb7c8-1776-4623-b9fe-bde35561c810 req-a59e4073-dec8-42c9-87e7-f47e21506491 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.495105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df9cb7c8-1776-4623-b9fe-bde35561c810 req-a59e4073-dec8-42c9-87e7-f47e21506491 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.508506 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-df9cb7c8-1776-4623-b9fe-bde35561c810 req-a59e4073-dec8-42c9-87e7-f47e21506491 service nova] Creating event network-changed:7e062dba-6379-4aff-bc39-e97bc7154b05 for instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 on n-h2-863052-1 Oct 31 15:22:59.514037 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-df9cb7c8-1776-4623-b9fe-bde35561c810 req-a59e4073-dec8-42c9-87e7-f47e21506491 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047395 Oct 31 15:22:59.514914 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3626/7500] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:22:59.520990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:59.620694 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93c3a947-0603-4a77-a6a9-a9e6f42783a4 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 204 len: 0 microversion: 2.1 time: 0.157905 Oct 31 15:22:59.621413 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3875/7501] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:59 2022] DELETE /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:59.631260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:59.632239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:59.639333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.639819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.640448 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.641326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.641943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.642577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.785778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:59.793613 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37108cb0-7830-4431-abc8-02f344dbbe53 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1689 microversion: 2.1 time: 0.167150 Oct 31 15:22:59.794235 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3627/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:59 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:00.817975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:00.818717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:00.825511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.826008 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.826493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.827186 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.827653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.828087 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.978961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:00.987094 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93397982-5d90-4ab6-85e8-550a1b02f64a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 200 len: 1689 microversion: 2.1 time: 0.173931 Oct 31 15:23:00.987669 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3876/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:00 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:01.546355 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-830a1c55-3c32-4436-9c47-d9209858afe5 req-781954a2-5474-4e09-8667-abaab851321b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc227fb-0db5-49a6-8cfa-11275e9a3393", "name": "network-vif-deleted", "tag": "7e062dba-6379-4aff-bc39-e97bc7154b05"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:01.557715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-830a1c55-3c32-4436-9c47-d9209858afe5 req-781954a2-5474-4e09-8667-abaab851321b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.558260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-830a1c55-3c32-4436-9c47-d9209858afe5 req-781954a2-5474-4e09-8667-abaab851321b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.558697 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-830a1c55-3c32-4436-9c47-d9209858afe5 req-781954a2-5474-4e09-8667-abaab851321b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.570578 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-830a1c55-3c32-4436-9c47-d9209858afe5 req-781954a2-5474-4e09-8667-abaab851321b service nova] Creating event network-vif-deleted:7e062dba-6379-4aff-bc39-e97bc7154b05 for instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 on n-h2-863052-1 Oct 31 15:23:01.575292 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-830a1c55-3c32-4436-9c47-d9209858afe5 req-781954a2-5474-4e09-8667-abaab851321b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Oct 31 15:23:01.575909 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3628/7504] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:02.011218 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.011992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: bfc227fb-0db5-49a6-8cfa-11275e9a3393] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:02.018521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.019539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.020007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.020714 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.021187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.021623 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.036287 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] HTTP exception thrown: Instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 could not be found. Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Request method failure captured: Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 HTTP/1.1 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-bVSaYd724pQHwr1Sx4jgDq03Pne7k1nseaUF5HaI43CP9RJp93lhDvVz5aG7huqkwhQ5kTKyvlACRo4p-hQRxh8BxGlRz3hgbgBYkUW_AU78fFyO9WCAnuO7LYyWOToABSm4_vQrv3JGuWcyOvbTUUv4DYloKMjNY58MyEhm9L1gs Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b711002d2e3f46249fd31eb32fadfd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 41eaa9a77a624fe98ea4a04e08a3865c Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 could not be found. Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'bfc227fb-0db5-49a6-8cfa-11275e9a3393'} Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 could not be found. Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 could not be found. Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:23:02.038051 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 could not be found. Oct 31 15:23:02.043082 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:23:02.044348 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Returning 404 to user: Instance bfc227fb-0db5-49a6-8cfa-11275e9a3393 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:02.045209 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1446fe5e-d261-482f-97db-fc11fc887a84 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393" status: 404 len: 111 microversion: 2.1 time: 0.038060 Oct 31 15:23:02.045777 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3877/7505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:02 2022] GET /compute/v2.1/servers/bfc227fb-0db5-49a6-8cfa-11275e9a3393 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:05.533093 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5920397-ee22-4158-ac4e-97f60405d495 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '.version_select at 0x7fe107f725e0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:05.556192 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5920397-ee22-4158-ac4e-97f60405d495 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-854523602" status: 202 len: 0 microversion: 2.1 time: 0.027405 Oct 31 15:23:05.556790 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3629/7506] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 15:23:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-854523602 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:05.589001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a39c345-7fff-4456-8ed6-645a89fce8c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: .version_select at 0x7fe104135b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-697424371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPD0QE3EHXiqLF1mDWRmUF/VtzwxaBAKG0VHcnw0I405lbxMU8h7hgGzDUtZF/Lv4dOIGXsOgIQK1UTOZjjHp7ObevUQGzyQoRi2wtt7b2OrvqSmylDr86EapkSAx+Stg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:05.607350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1a39c345-7fff-4456-8ed6-645a89fce8c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:05.612637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-1a39c345-7fff-4456-8ed6-645a89fce8c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:05.638413 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a39c345-7fff-4456-8ed6-645a89fce8c0 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053177 Oct 31 15:23:05.645115 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3878/7507] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:23:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:11.096204 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-583557162", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "networks": [{"uuid": "ed4285b3-9dea-4d29-8015-4ef2c73bfeaf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-697424371", "security_groups": [{"name": "tempest-secgroup-smoke-355476653"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:11.221315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] validate_networks() for [('ed4285b3-9dea-4d29-8015-4ef2c73bfeaf', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:11.563268 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:11.645388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:11.645993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:11.646491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:11.646900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:11.647463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:11.657419 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.657907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.658412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.659133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.659622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.660143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.684071 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:11.690484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Getting quotas for user 41eaa9a77a624fe98ea4a04e08a3865c and project b711002d2e3f46249fd31eb32fadfd63. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:11.706444 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:11.708868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:11.762660 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f9c28d54-405d-413d-934d-9701b3471204 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.670524 Oct 31 15:23:11.763676 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3630/7508] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:23:11.776227 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eccad3db-6a3a-42f4-94e4-1719b43b1341 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.777293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eccad3db-6a3a-42f4-94e4-1719b43b1341 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.838805 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-eccad3db-6a3a-42f4-94e4-1719b43b1341 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.848598 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eccad3db-6a3a-42f4-94e4-1719b43b1341 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1265 microversion: 2.1 time: 0.076400 Oct 31 15:23:11.854300 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3879/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:12.873502 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:12.874950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:12.883698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.884196 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.884740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.885454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.893770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.895034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.970777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.979827 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2c12c79-dfa7-49d9-ad4a-ffaf892c681d tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1323 microversion: 2.1 time: 0.111136 Oct 31 15:23:12.980423 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3631/7510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:12 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1323 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:14.003983 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.005440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:14.011263 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:14.014493 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.015030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.015851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.016579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.017051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.017482 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.174069 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.182398 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87037f8e-04f1-4133-856f-d9b803265b2c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.182656 Oct 31 15:23:14.183007 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3880/7511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:14.294900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-36a8b758-5b3c-4dc0-8bc5-2c1aea814066 req-63f21ce1-ed35-4335-8b30-cdd367d5f63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67cf6abc-2467-415c-9f9e-7f65c815fc65", "tag": "855bce93-f246-4966-aec7-7e1898dee659"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:14.318384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-36a8b758-5b3c-4dc0-8bc5-2c1aea814066 req-63f21ce1-ed35-4335-8b30-cdd367d5f63a service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.328858 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-36a8b758-5b3c-4dc0-8bc5-2c1aea814066 req-63f21ce1-ed35-4335-8b30-cdd367d5f63a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.329424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-36a8b758-5b3c-4dc0-8bc5-2c1aea814066 req-63f21ce1-ed35-4335-8b30-cdd367d5f63a service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.344311 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-36a8b758-5b3c-4dc0-8bc5-2c1aea814066 req-63f21ce1-ed35-4335-8b30-cdd367d5f63a service nova] Creating event network-changed:855bce93-f246-4966-aec7-7e1898dee659 for instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 on n-h1-863052-1 Oct 31 15:23:14.349467 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-36a8b758-5b3c-4dc0-8bc5-2c1aea814066 req-63f21ce1-ed35-4335-8b30-cdd367d5f63a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060194 Oct 31 15:23:14.350625 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3632/7512] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:23:15.206657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:15.207282 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:15.214155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.214676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.215131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.215827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.216293 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.216730 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.349618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:15.357633 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c2c26f7-6e16-4dd9-9529-38fdb36615ea tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.155017 Oct 31 15:23:15.358230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3881/7513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:15 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.383050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.383575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:16.389899 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.390424 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.390868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.391637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.392095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.392525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.528939 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.537193 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-29d4092d-a872-4c7d-b7ed-7a1b6f81badf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.159935 Oct 31 15:23:16.537811 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3633/7514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:17.560893 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.561445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:17.569031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.569531 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.569978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.570707 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.571177 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.571615 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.705971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:17.713828 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e8f4034-431f-452f-a788-0cae33ba8993 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.156904 Oct 31 15:23:17.714435 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3882/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:18.736433 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.737052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:18.743996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.744489 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.744933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.745631 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.746090 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.746544 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.879864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.887567 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-90917f8d-4103-4c28-a658-dd53e198cc0b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.155392 Oct 31 15:23:18.888137 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3634/7516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:19.911686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.912412 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:19.919574 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.920157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.920611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.921334 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.921785 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.922249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.015992 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-04fb6ffa-926a-4f8f-a823-d6a4ba8ab4ad req-2032943f-d399-4cf3-97a4-1c08deabac1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf6abc-2467-415c-9f9e-7f65c815fc65", "name": "network-vif-plugged", "status": "completed", "tag": "855bce93-f246-4966-aec7-7e1898dee659"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:20.028823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-04fb6ffa-926a-4f8f-a823-d6a4ba8ab4ad req-2032943f-d399-4cf3-97a4-1c08deabac1b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:20.029624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-04fb6ffa-926a-4f8f-a823-d6a4ba8ab4ad req-2032943f-d399-4cf3-97a4-1c08deabac1b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:20.030293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-04fb6ffa-926a-4f8f-a823-d6a4ba8ab4ad req-2032943f-d399-4cf3-97a4-1c08deabac1b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.043160 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-04fb6ffa-926a-4f8f-a823-d6a4ba8ab4ad req-2032943f-d399-4cf3-97a4-1c08deabac1b service nova] Creating event network-vif-plugged:855bce93-f246-4966-aec7-7e1898dee659 for instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 on n-h1-863052-1 Oct 31 15:23:20.048839 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-04fb6ffa-926a-4f8f-a823-d6a4ba8ab4ad req-2032943f-d399-4cf3-97a4-1c08deabac1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036491 Oct 31 15:23:20.049830 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3635/7517] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:23:20.069343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.077245 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e6492cc-9c5c-49b7-9619-47f044a1f249 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.170018 Oct 31 15:23:20.078051 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3883/7518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:19 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:21.109929 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:21.110652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:21.118442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.118974 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.119421 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.120161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.120622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.121055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.260940 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:21.268772 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6213bede-0a40-424b-8f2f-5bd4785e4a93 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1390 microversion: 2.1 time: 0.170138 Oct 31 15:23:21.269554 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3636/7519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:21 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.292888 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.293519 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:22.296365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:22.302608 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.303121 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.303572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.304286 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.304755 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.305196 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.441084 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:22.449463 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-979468d3-9afb-4187-a1e9-7c896a08c471 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1563 microversion: 2.1 time: 0.160512 Oct 31 15:23:22.450045 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3884/7520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.473460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.474247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:22.476517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:22.477209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:22.479101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:22.486307 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.486855 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.487303 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.488265 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.488798 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.489235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.625487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:22.633806 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e91bfac0-9b12-4d02-bc8f-6abb2253681e tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1563 microversion: 2.1 time: 0.164329 Oct 31 15:23:22.634687 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3637/7521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:24.209973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:24.210631 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:24.213684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-01a026fc-dea5-4f36-afba-f3607430e10d req-bd891e9d-f739-41a2-beec-56592ce6dce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67cf6abc-2467-415c-9f9e-7f65c815fc65", "tag": "855bce93-f246-4966-aec7-7e1898dee659"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:24.224094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.224643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.225143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.225897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.226400 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.226845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.227595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-01a026fc-dea5-4f36-afba-f3607430e10d req-bd891e9d-f739-41a2-beec-56592ce6dce1 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.228085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-01a026fc-dea5-4f36-afba-f3607430e10d req-bd891e9d-f739-41a2-beec-56592ce6dce1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.228522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-01a026fc-dea5-4f36-afba-f3607430e10d req-bd891e9d-f739-41a2-beec-56592ce6dce1 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.240196 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-01a026fc-dea5-4f36-afba-f3607430e10d req-bd891e9d-f739-41a2-beec-56592ce6dce1 service nova] Creating event network-changed:855bce93-f246-4966-aec7-7e1898dee659 for instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 on n-h1-863052-1 Oct 31 15:23:24.246089 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-01a026fc-dea5-4f36-afba-f3607430e10d req-bd891e9d-f739-41a2-beec-56592ce6dce1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036888 Oct 31 15:23:24.246728 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3638/7522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:23:24.371784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:24.382310 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2761aaba-9e17-4623-b685-3d371d24d103 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1563 microversion: 2.1 time: 0.176165 Oct 31 15:23:24.401066 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3885/7523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:24 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:47.631330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:47.633621 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:47.636222 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:47.637015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=38 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:47.643171 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.643670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.644095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.644786 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.646472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.646755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.697280 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78f9a330-3191-451f-91d1-19d107e3936a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action" status: 200 len: 24574 microversion: 2.1 time: 0.070063 Oct 31 15:23:47.697924 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3639/7524] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:47 2022] POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action => generated 24574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:23:54.090726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:54.091372 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.095236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:54.096176 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:54.100596 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.101082 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.101526 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.102330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.102793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.103345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.129418 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lazy-loading 'flavor' on Instance uuid 67cf6abc-2467-415c-9f9e-7f65c815fc65 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:54.197622 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f404fac-c710-4882-97cd-23bf17db1d42 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action" status: 202 len: 0 microversion: 2.1 time: 0.110627 Oct 31 15:23:54.198307 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3886/7525] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:54 2022] POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:54.207274 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:54.208619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.216895 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.217333 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.217776 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.218512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.219097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.219541 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.354442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:54.362789 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f15ac816-554c-43f6-ad81-fa807372e094 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1689 microversion: 2.1 time: 0.159797 Oct 31 15:23:54.363365 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3640/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:54 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.396920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.398146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:55.407854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.408578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.409321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.410508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.411291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.411843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.545532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:55.553262 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e8bc077-fd83-429d-8fdf-995f727985fd tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1672 microversion: 2.1 time: 0.166703 Oct 31 15:23:55.553836 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3887/7527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:56.651963 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:56.654085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.665056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.665542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.665983 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.666730 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.667185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.667611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.715804 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b644980-8a3c-40b9-bb60-24952f2fcfd3 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action" status: 200 len: 36493 microversion: 2.1 time: 0.067724 Oct 31 15:23:56.716454 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3641/7528] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:56 2022] POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action => generated 36493 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:23:56.728900 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:56.729476 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.736518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.737007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.737453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.738145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.738629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.739094 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.805129 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d39b4d04-131e-49ef-afc2-3d39ccb46297 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action" status: 202 len: 0 microversion: 2.1 time: 0.079922 Oct 31 15:23:56.805766 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3888/7529] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:56 2022] POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:56.814625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.815350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.822670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.823156 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.823591 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.824485 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.824959 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.825382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.052533 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.060950 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-990772dd-388c-4e59-8b62-06d104d09658 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1678 microversion: 2.1 time: 0.250594 Oct 31 15:23:57.061525 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3642/7530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:56 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:58.087512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.088233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:58.094456 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.094953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.095405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.096100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.096585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.097001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.240217 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:58.248220 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c980c144-5910-4650-b458-ed48c72f074b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1678 microversion: 2.1 time: 0.166494 Oct 31 15:23:58.248800 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3889/7531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:59.272006 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.272619 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.279552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.280035 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.280471 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.281154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.281604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.282023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.412560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:59.420289 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b57140a2-4f93-421c-b717-b289206a5878 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1681 microversion: 2.1 time: 0.152176 Oct 31 15:23:59.420863 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3643/7532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:59 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:59.519049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:59.521863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.528722 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.529214 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.529661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.530397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.530861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.531295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.572426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e8f80bc-9847-42e3-ae23-64f30489e91b tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action" status: 200 len: 36493 microversion: 2.1 time: 0.057145 Oct 31 15:23:59.573087 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3890/7533] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:59 2022] POST /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65/action => generated 36493 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:24:00.854133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.854653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:00.856534 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-181e80f1-82be-4bbb-80d5-0f6b1b3c299b req-9acf544c-a3d4-407d-9c7b-ae645fa0f4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67cf6abc-2467-415c-9f9e-7f65c815fc65", "tag": "855bce93-f246-4966-aec7-7e1898dee659"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:00.862428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.862923 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.863367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.864638 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.865099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.865530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.868261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-181e80f1-82be-4bbb-80d5-0f6b1b3c299b req-9acf544c-a3d4-407d-9c7b-ae645fa0f4eb service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.868753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-181e80f1-82be-4bbb-80d5-0f6b1b3c299b req-9acf544c-a3d4-407d-9c7b-ae645fa0f4eb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.869192 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-181e80f1-82be-4bbb-80d5-0f6b1b3c299b req-9acf544c-a3d4-407d-9c7b-ae645fa0f4eb service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.880978 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-181e80f1-82be-4bbb-80d5-0f6b1b3c299b req-9acf544c-a3d4-407d-9c7b-ae645fa0f4eb service nova] Creating event network-changed:855bce93-f246-4966-aec7-7e1898dee659 for instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 on n-h1-863052-1 Oct 31 15:24:00.886294 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-181e80f1-82be-4bbb-80d5-0f6b1b3c299b req-9acf544c-a3d4-407d-9c7b-ae645fa0f4eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Oct 31 15:24:00.886883 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3891/7534] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:24:00.892266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:00.984396 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24931d0d-4407-4d80-8b7e-340281a6a1bf tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 204 len: 0 microversion: 2.1 time: 0.133181 Oct 31 15:24:00.985489 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3644/7535] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:00 2022] DELETE /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:00.995507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.996247 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.003000 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.003501 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.003955 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.004690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.005162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.005586 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.147872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:01.156278 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4584083c-8e9b-4cd6-8050-fdb0424dbbad tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1687 microversion: 2.1 time: 0.165336 Oct 31 15:24:01.156859 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3892/7536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.182886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:02.183512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:02.190292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.190783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.191227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.191921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.192378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.192805 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.396054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:02.403929 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d8e5085-7576-49c2-a6cb-5d351a9ce63a tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1687 microversion: 2.1 time: 0.225452 Oct 31 15:24:02.404509 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3645/7537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:02 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1687 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:03.022280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-10925b9c-513a-4bc1-80a9-53539c7c47fb req-450ed3b6-e537-4a01-9176-3b9d3e446d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf6abc-2467-415c-9f9e-7f65c815fc65", "name": "network-vif-deleted", "tag": "855bce93-f246-4966-aec7-7e1898dee659"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:03.035361 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-10925b9c-513a-4bc1-80a9-53539c7c47fb req-450ed3b6-e537-4a01-9176-3b9d3e446d9b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.035990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-10925b9c-513a-4bc1-80a9-53539c7c47fb req-450ed3b6-e537-4a01-9176-3b9d3e446d9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.036444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-10925b9c-513a-4bc1-80a9-53539c7c47fb req-450ed3b6-e537-4a01-9176-3b9d3e446d9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.052662 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-10925b9c-513a-4bc1-80a9-53539c7c47fb req-450ed3b6-e537-4a01-9176-3b9d3e446d9b service nova] Creating event network-vif-deleted:855bce93-f246-4966-aec7-7e1898dee659 for instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 on n-h1-863052-1 Oct 31 15:24:03.058465 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-10925b9c-513a-4bc1-80a9-53539c7c47fb req-450ed3b6-e537-4a01-9176-3b9d3e446d9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039818 Oct 31 15:24:03.059829 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3893/7538] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:03.429313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:03.429976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:03.437803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.438440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.438892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.439607 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.440066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.440529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.476342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.476778 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.477230 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.477677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lazy-loading 'fault' on Instance uuid 67cf6abc-2467-415c-9f9e-7f65c815fc65 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:03.521305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa9a77a624fe98ea4a04e08a3865c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b711002d2e3f46249fd31eb32fadfd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:03.529162 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2cc20409-1002-4ff0-b27a-28df39e9ff79 tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 200 len: 1355 microversion: 2.1 time: 0.104116 Oct 31 15:24:03.529978 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3646/7539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:03 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:04.553225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:04.553931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] [instance: 67cf6abc-2467-415c-9f9e-7f65c815fc65] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:04.561629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.562062 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.562546 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.563240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.563701 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.564136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.578194 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] HTTP exception thrown: Instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 could not be found. Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Request method failure captured: Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 HTTP/1.1 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-bVSaYd724pQHwr1Sx4jgDq03Pne7k1nseaUF5HaI43CP9RJp93lhDvVz5aG7huqkwhQ5kTKyvlACRo4p-hQRxh8BxGlRz3hgbgBYkUW_AU78fFyO9WCAnuO7LYyWOToABSm4_vQrv3JGuWcyOvbTUUv4DYloKMjNY58MyEhm9L1gs Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b711002d2e3f46249fd31eb32fadfd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b711002d2e3f46249fd31eb32fadfd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: b711002d2e3f46249fd31eb32fadfd63 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1007008866 Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 41eaa9a77a624fe98ea4a04e08a3865c Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1007008866-project Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 could not be found. Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '67cf6abc-2467-415c-9f9e-7f65c815fc65'} Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 could not be found. Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 could not be found. Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.579806 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 could not be found. Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Returning 404 to user: Instance 67cf6abc-2467-415c-9f9e-7f65c815fc65 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3d10d3fd-965d-4eb6-9003-cf50dc0fecce tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65" status: 404 len: 111 microversion: 2.1 time: 0.032220 Oct 31 15:24:04.585538 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3894/7540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:04 2022] GET /compute/v2.1/servers/67cf6abc-2467-415c-9f9e-7f65c815fc65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:24:08.105819 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6cbf40d0-8111-47fe-b7bd-31610ead1e1c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] Calling method '.version_select at 0x7fe10681aca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:08.126713 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6cbf40d0-8111-47fe-b7bd-31610ead1e1c tempest-TestNetworkAdvancedServerOps-1007008866 tempest-TestNetworkAdvancedServerOps-1007008866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697424371" status: 202 len: 0 microversion: 2.1 time: 0.024660 Oct 31 15:24:08.127417 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3647/7541] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 31 15:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697424371 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:18.881753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=18 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:18.882619 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:19.078022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1b68494-0b22-4130-aa52-2da3ed1363b9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'create', calling method: .version_select at 0x7fe104096ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1423916475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJr9K0RcHoHUNEXl8CfquAfgjNXe2gPKqjChXS3JXvSz9ydIvu9lf69sTdH5rJRJYF/apzmglKXcxJo5JRomNbORAlqcrasYtuJ7Q8LTxgJ3P8b1l5XP86nwUi1Q4UjxvQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:19.095492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a1b68494-0b22-4130-aa52-2da3ed1363b9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for project f90067787cf54ebb8faa3833deb78f46. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:19.101616 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-a1b68494-0b22-4130-aa52-2da3ed1363b9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for user 39ab8e20000746308e1a82e2b071d38c and project f90067787cf54ebb8faa3833deb78f46. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:19.142574 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1b68494-0b22-4130-aa52-2da3ed1363b9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.266623 Oct 31 15:24:19.143835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3895/7542] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:24:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:20.236781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:20.237558 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:20.242482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1327128350", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1423916475", "security_groups": [{"name": "tempest-secgroup-smoke-1739177952"}], "networks": [{"uuid": "ca742d44-0bb8-4178-a036-5619afbb405b"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:20.352978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] validate_networks() for [('ca742d44-0bb8-4178-a036-5619afbb405b', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:20.741948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:20.742531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:20.743012 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:20.743597 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:20.744010 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:20.753016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.753504 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.753996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.754775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.755226 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.755650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.773209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for project f90067787cf54ebb8faa3833deb78f46. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:20.780227 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for user 39ab8e20000746308e1a82e2b071d38c and project f90067787cf54ebb8faa3833deb78f46. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:20.795828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:24:20.798320 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:20.849431 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-95da5034-a14f-492c-bb0b-72d6efd77a8b tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.614394 Oct 31 15:24:20.855368 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3648/7543] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:24:20.863377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1befbb7-5d10-4ac7-a29a-712fb127a75f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:20.864007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1befbb7-5d10-4ac7-a29a-712fb127a75f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:20.919433 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1befbb7-5d10-4ac7-a29a-712fb127a75f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:20.926560 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1befbb7-5d10-4ac7-a29a-712fb127a75f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1247 microversion: 2.1 time: 0.068554 Oct 31 15:24:20.927187 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3896/7544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:20 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:21.950328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-694c500a-947f-427b-841c-ae2c360374c7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:21.950886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-694c500a-947f-427b-841c-ae2c360374c7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:22.013102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-694c500a-947f-427b-841c-ae2c360374c7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:22.023315 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-694c500a-947f-427b-841c-ae2c360374c7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1247 microversion: 2.1 time: 0.077133 Oct 31 15:24:22.024255 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3649/7545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:21 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:23.047086 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d53952c1-e36f-4308-83f6-215ea177e391 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:23.048460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d53952c1-e36f-4308-83f6-215ea177e391 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:23.106801 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d53952c1-e36f-4308-83f6-215ea177e391 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:23.114948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d53952c1-e36f-4308-83f6-215ea177e391 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1247 microversion: 2.1 time: 0.071897 Oct 31 15:24:23.115547 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3897/7546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:23 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:24.138201 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-236029ba-aa33-4155-bfbe-b29ed68d8894 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:24.138818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-236029ba-aa33-4155-bfbe-b29ed68d8894 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:24.192430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-236029ba-aa33-4155-bfbe-b29ed68d8894 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:24.199398 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-236029ba-aa33-4155-bfbe-b29ed68d8894 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1247 microversion: 2.1 time: 0.065383 Oct 31 15:24:24.199972 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3650/7547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:24 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1247 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:25.223629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:25.224258 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:25.231850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.232600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.233212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.233749 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.234236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.234678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.294774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:25.302641 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-768cf86d-1e9c-433a-8c51-e31e4d7cdc8f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1251 microversion: 2.1 time: 0.083504 Oct 31 15:24:25.303222 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3898/7548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:25 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1251 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:26.324982 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:26.325624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:26.333082 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:26.333575 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:26.334018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:26.334757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:26.335213 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:26.335642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:26.407674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:26.415997 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6b51ef1-a35e-418b-b1a3-7d6f6f1e5e4e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1305 microversion: 2.1 time: 0.094937 Oct 31 15:24:26.416925 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3651/7549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:26 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:27.440384 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:27.441120 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:27.450091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.450624 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.451070 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.451780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.452241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.452672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.490122 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d653fd07-8d00-48d0-980a-c509f9c04c8a req-84900c01-c94d-48ce-a6e8-a92b654799f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:27.500095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d653fd07-8d00-48d0-980a-c509f9c04c8a req-84900c01-c94d-48ce-a6e8-a92b654799f9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.500684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d653fd07-8d00-48d0-980a-c509f9c04c8a req-84900c01-c94d-48ce-a6e8-a92b654799f9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.501260 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d653fd07-8d00-48d0-980a-c509f9c04c8a req-84900c01-c94d-48ce-a6e8-a92b654799f9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.513992 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d653fd07-8d00-48d0-980a-c509f9c04c8a req-84900c01-c94d-48ce-a6e8-a92b654799f9 service nova] Creating event network-changed:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:24:27.519413 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d653fd07-8d00-48d0-980a-c509f9c04c8a req-84900c01-c94d-48ce-a6e8-a92b654799f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106846 Oct 31 15:24:27.520029 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3899/7550] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:27.665688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:27.673486 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-addbed28-4d3f-476e-a7cb-17292e1b7283 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1373 microversion: 2.1 time: 0.237344 Oct 31 15:24:27.674148 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3652/7551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:27 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:28.699259 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:28.699901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:28.707640 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:28.708146 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:28.708599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.709306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:28.709774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:28.710237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.847424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:28.855307 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ead24d6-8461-4eab-b6a9-51af33c51fa2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1373 microversion: 2.1 time: 0.161289 Oct 31 15:24:28.855898 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3900/7552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:28 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:29.879133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:29.879744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:29.886755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.887245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.887679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.888373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.888821 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.889243 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:30.023275 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:30.031082 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c4c6100-c150-428f-a3a1-30eef9e57557 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1373 microversion: 2.1 time: 0.156363 Oct 31 15:24:30.031663 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3653/7553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:29 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:31.052894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:31.053512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:31.060681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.061173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.061618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.062350 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.062816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.063246 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.192806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:31.201087 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24407e5e-eaa8-448d-a643-2f1a8ec2f7e2 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1373 microversion: 2.1 time: 0.152107 Oct 31 15:24:31.201671 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3901/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:31 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:32.225349 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:32.225962 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:32.227862 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:32.234417 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.234920 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.235361 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.236075 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.236537 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.236967 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.367820 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:32.375425 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b29a9172-736f-4033-8cc1-30a02033eb63 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1373 microversion: 2.1 time: 0.154528 Oct 31 15:24:32.376003 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3654/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:32 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:33.398462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:33.399103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:33.401891 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:33.407373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:33.407813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:33.408261 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:33.408973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:33.409447 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:33.409886 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:33.457030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5a7057d2-7f9a-48f7-b639-3c13c28e5d8d req-fdebe3fe-c3cf-427b-a016-fa9d5be5545c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "name": "network-vif-plugged", "status": "completed", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:33.471023 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5a7057d2-7f9a-48f7-b639-3c13c28e5d8d req-fdebe3fe-c3cf-427b-a016-fa9d5be5545c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:33.471270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5a7057d2-7f9a-48f7-b639-3c13c28e5d8d req-fdebe3fe-c3cf-427b-a016-fa9d5be5545c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:33.471721 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5a7057d2-7f9a-48f7-b639-3c13c28e5d8d req-fdebe3fe-c3cf-427b-a016-fa9d5be5545c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:33.484225 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5a7057d2-7f9a-48f7-b639-3c13c28e5d8d req-fdebe3fe-c3cf-427b-a016-fa9d5be5545c service nova] Creating event network-vif-plugged:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:24:33.490212 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5a7057d2-7f9a-48f7-b639-3c13c28e5d8d req-fdebe3fe-c3cf-427b-a016-fa9d5be5545c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037074 Oct 31 15:24:33.490818 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3655/7556] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:33.558786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:33.566531 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c0c8db4-fef9-45f6-83ef-ad96ab75dd9a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1373 microversion: 2.1 time: 0.171964 Oct 31 15:24:33.567115 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3902/7557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:33 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:34.591096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:34.591763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:34.593684 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:34.601210 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.601791 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.602302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.603099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.603583 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.604192 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.745924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:34.753798 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb60a1f7-e7bc-4f74-b727-c169fcbec187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1557 microversion: 2.1 time: 0.167207 Oct 31 15:24:34.754421 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3656/7558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:34 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:34.776705 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:34.777330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:34.784044 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.784532 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.784977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.785666 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.786154 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.786606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:35.185060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:35.192696 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fec2e1e8-0102-4c56-bac0-5b4f9d04b280 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1557 microversion: 2.1 time: 0.419912 Oct 31 15:24:35.193255 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3903/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:34 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1557 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:37.148701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6b206be0-0f69-468a-8405-e3ba8276f431 req-c46aebce-2739-4e5b-8ec8-bbcff86172fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:37.158190 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6b206be0-0f69-468a-8405-e3ba8276f431 req-c46aebce-2739-4e5b-8ec8-bbcff86172fd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.158666 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6b206be0-0f69-468a-8405-e3ba8276f431 req-c46aebce-2739-4e5b-8ec8-bbcff86172fd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.159095 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6b206be0-0f69-468a-8405-e3ba8276f431 req-c46aebce-2739-4e5b-8ec8-bbcff86172fd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.170738 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6b206be0-0f69-468a-8405-e3ba8276f431 req-c46aebce-2739-4e5b-8ec8-bbcff86172fd service nova] Creating event network-changed:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:24:37.175840 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6b206be0-0f69-468a-8405-e3ba8276f431 req-c46aebce-2739-4e5b-8ec8-bbcff86172fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089252 Oct 31 15:24:37.176339 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3657/7560] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:29.309562 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:26:29.310018 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812/action (ip 10.222.0.27) !!! Oct 31 15:26:29.311073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:29.311825 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=32 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:29.315874 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:29.316416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.326570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.327189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.327759 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.328572 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.329157 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.329689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.353658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lazy-loading 'flavor' on Instance uuid 3beaa1ca-bff4-4410-9da0-549d2712b812 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:29.676463 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09379801-e530-43ca-8b13-a4e6e5423f67 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812/action" status: 202 len: 0 microversion: 2.1 time: 0.368876 Oct 31 15:26:29.677178 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3904/7561] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:29 2022] POST /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:29.687129 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 15:26:29.687951 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:26:29.689467 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:29.690365 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=36 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:29.697861 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.698618 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.709225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.709727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.710698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.711408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.711859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.712712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.900305 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:29.908078 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-970dab4a-ce17-443a-821b-9cc3615101f3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.224928 Oct 31 15:26:29.908660 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3658/7562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:30.934779 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.935491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.942556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.943055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.943508 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.944204 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.944670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.945105 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.078097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.085810 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ccec286-c4c9-4ed7-8266-4dce5f151589 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.156944 Oct 31 15:26:31.086434 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3905/7563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:30 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:32.110030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.110687 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.120112 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.120610 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.121052 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.121751 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.122232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.122664 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.128726 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55238. Oct 31 15:26:32.140370 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55236. Oct 31 15:26:32.254118 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.262480 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a565554a-a2c3-4ecc-980f-8ba91099a7a3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.156566 Oct 31 15:26:32.263051 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3659/7564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:33.286028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.286737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.294160 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.294686 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.295131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.295826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.296283 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.296711 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.431830 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.439686 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c347d4b-dfff-4eee-a568-32e576002c19 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.157684 Oct 31 15:26:33.440251 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3906/7565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:34.464891 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:34.465426 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:34.472716 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.473103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.473548 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.474284 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.474746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.475177 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.609490 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.617882 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-afc92d72-9092-4c53-afdf-0f652ca0f634 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.157009 Oct 31 15:26:34.618491 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3660/7566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:34 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:35.640951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:35.641502 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:35.648349 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.648848 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.649301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.650006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.650509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.650951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.783392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:35.791782 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9000ed0b-8743-4457-832b-8ccbf039852e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.154774 Oct 31 15:26:35.792373 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3907/7567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:35 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:36.815091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.815728 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.823184 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.823671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.824109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.824795 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.825246 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.825671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.953928 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.961864 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e52dafcd-2e12-4e97-b2ae-0b8c1595e06c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.150701 Oct 31 15:26:36.962475 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3661/7568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:37.986036 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.986852 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.993851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.994390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.994837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.995681 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.996314 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.996748 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.134081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.142105 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00ea2410-2707-4557-b5ff-7c56dbbbfa5c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.160518 Oct 31 15:26:38.142705 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3908/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:39.166053 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.166698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.173587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.174080 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.174679 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.175373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.175831 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.176260 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.314498 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.322810 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d107af8-e4c2-4943-bb31-9dc5dfd5d35c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.160704 Oct 31 15:26:39.323388 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3662/7570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:40.346194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.346838 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:40.354514 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.355016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.355467 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.356179 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.356653 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.357345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.489416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.497296 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74f32b2c-219c-460c-87a2-657b2106a781 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1702 microversion: 2.1 time: 0.155066 Oct 31 15:26:40.497865 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3909/7571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:41.521163 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:41.521779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:41.529366 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.529856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.530326 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.531038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.531478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.531903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.662915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.670622 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c597bc3d-4c3c-4a79-8668-80593517a6be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1702 microversion: 2.1 time: 0.153420 Oct 31 15:26:41.671192 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3663/7572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:41 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:42.696772 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:42.698150 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:42.705828 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.706498 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.707240 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.708219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.708765 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.709511 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.855826 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:42.866548 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9316eb7a-495b-4535-af96-9d86d83661be tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.175514 Oct 31 15:26:42.867403 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3910/7573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:42 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:43.891790 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:43.892386 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:43.900160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.900738 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.901175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.901966 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.902454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.902925 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.076288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.086061 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c773b150-2b4f-41c4-a6ed-fcc83aece306 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.198045 Oct 31 15:26:44.099163 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3664/7574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:43 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:44.201794 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8342b271-b86d-47f3-a044-885285d91667 req-a5687346-82c6-441b-97b7-692ad3c5d438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "name": "network-vif-plugged", "status": "completed", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:44.212941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8342b271-b86d-47f3-a044-885285d91667 req-a5687346-82c6-441b-97b7-692ad3c5d438 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.213471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8342b271-b86d-47f3-a044-885285d91667 req-a5687346-82c6-441b-97b7-692ad3c5d438 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.214375 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8342b271-b86d-47f3-a044-885285d91667 req-a5687346-82c6-441b-97b7-692ad3c5d438 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.239003 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8342b271-b86d-47f3-a044-885285d91667 req-a5687346-82c6-441b-97b7-692ad3c5d438 service nova] Creating event network-vif-plugged:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:26:44.247090 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8342b271-b86d-47f3-a044-885285d91667 req-a5687346-82c6-441b-97b7-692ad3c5d438 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108813 Oct 31 15:26:44.247835 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3911/7575] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:45.112693 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:45.113432 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:45.120550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.121125 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.121871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.122371 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.122830 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.123481 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.272276 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.280652 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d4314c3-205b-4dcc-98a8-7553f157ce2e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.171878 Oct 31 15:26:45.281527 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3665/7576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:45 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:46.306971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:46.307527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:46.315030 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.315719 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.316250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.317043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.317734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.318442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.469712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:46.479851 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b7a3e95-39dc-4c63-8538-748e824024e9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.177281 Oct 31 15:26:46.486613 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3912/7577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:46 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:47.502282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:47.502896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:47.510711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.511225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.511671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.512399 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.512863 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.513298 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.651915 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.661546 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-934c1a5e-6307-4b24-8114-ce4d2004c6c8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.163371 Oct 31 15:26:47.662131 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3666/7578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:47 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:48.685486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.686257 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:48.693947 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.694445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.694977 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.695699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.696747 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.697163 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.850668 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.862231 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6a184fb-0a50-455b-94f7-22e8ab514acf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.180657 Oct 31 15:26:48.878195 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3913/7579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:48 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:49.887224 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:49.887859 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:49.897712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.898391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.898898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.899707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.900239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.900737 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.050700 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.060825 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c2f1de27-aad6-4ed2-a259-d9dfb75d7fd8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.177443 Oct 31 15:26:50.074187 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3667/7580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:49 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:51.085889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:51.086555 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:51.093639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.094137 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.094614 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.095321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.095790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.096228 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.240509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.249043 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5bff9f50-50c5-4cd9-8b73-f23536012a3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1697 microversion: 2.1 time: 0.167263 Oct 31 15:26:51.249615 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3914/7581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:51 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:52.272792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.273405 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:52.280438 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.280926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.281367 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.282059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.282538 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.282965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.484857 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.493429 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b1274797-2059-4537-ad44-4bc05bbc85d0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1679 microversion: 2.1 time: 0.224535 Oct 31 15:26:52.494021 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3668/7582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:52 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:53.518108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.518776 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.525869 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.526414 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.526858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.527556 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.528022 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.528457 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.663739 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.671490 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fe46cc8-0d35-496c-8dc1-ba9f4a7a2548 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1679 microversion: 2.1 time: 0.157313 Oct 31 15:26:53.672080 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3915/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:54.696741 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:54.697356 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:54.704223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.704718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.705159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.705850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.706338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.706774 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.844091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.852455 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e7cbb078-4ee1-43ef-a1cf-ef1f758eab5a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1622 microversion: 2.1 time: 0.160826 Oct 31 15:26:54.853014 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3669/7584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:54 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1622 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:54.876147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:54.876771 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:54.883733 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.884231 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.884684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.885387 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.885859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.886330 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.982406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 15:26:55.048563 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a573544c-f393-45d3-8e96-4fdb3783b37d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812/action" status: 202 len: 0 microversion: 2.1 time: 0.176367 Oct 31 15:26:55.049099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3916/7585] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:54 2022] POST /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:55.057271 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:55.057893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:55.064042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.064810 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.065484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.066223 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.066952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.067324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.204935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.213458 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c871f46-200d-4937-9e88-c209d519922a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1630 microversion: 2.1 time: 0.160092 Oct 31 15:26:55.214035 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3670/7586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:55 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:56.120278 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5f6adb7c-94d6-46b2-9e65-399bc5f389f4 req-4b5dac38-dfc0-48a1-869b-1d6a38bdebc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "name": "network-vif-unplugged", "status": "completed", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:56.132503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f6adb7c-94d6-46b2-9e65-399bc5f389f4 req-4b5dac38-dfc0-48a1-869b-1d6a38bdebc3 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:56.133211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f6adb7c-94d6-46b2-9e65-399bc5f389f4 req-4b5dac38-dfc0-48a1-869b-1d6a38bdebc3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:56.133832 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5f6adb7c-94d6-46b2-9e65-399bc5f389f4 req-4b5dac38-dfc0-48a1-869b-1d6a38bdebc3 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:56.146770 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5f6adb7c-94d6-46b2-9e65-399bc5f389f4 req-4b5dac38-dfc0-48a1-869b-1d6a38bdebc3 service nova] Creating event network-vif-unplugged:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:26:56.153000 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5f6adb7c-94d6-46b2-9e65-399bc5f389f4 req-4b5dac38-dfc0-48a1-869b-1d6a38bdebc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038070 Oct 31 15:26:56.153724 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3917/7587] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:56.239529 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:56.240205 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:56.247593 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:56.248076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:56.248512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:56.249232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:56.249935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:56.250496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:56.464351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:56.472151 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bae3ba32-a6ee-4cf7-9a90-da176248682e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.236607 Oct 31 15:26:56.472729 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3671/7588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:56 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:57.498998 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:57.499884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:57.508901 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:57.509503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:57.510042 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:57.510933 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:57.511470 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:57.511975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:57.665326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:57.669063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:57.674324 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14d3af4d-8b66-4596-8b86-c969ec63acf9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.180503 Oct 31 15:26:57.686190 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3918/7589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:57 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:58.699887 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:58.700463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:58.707410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.707916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.708335 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.709031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.709528 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.709957 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.855168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.863898 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e716ecb-dd45-4166-a530-78ec8ba15187 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.168018 Oct 31 15:26:58.864987 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3672/7590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:58 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:59.889430 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:59.890855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:59.893978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:59.901993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.902930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.903628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.904573 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.905310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.905985 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.066588 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.075118 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f5407f3-0f7e-4940-ad51-a22e89b0dea8 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.190459 Oct 31 15:27:00.075782 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3919/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:59 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:01.099250 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.100703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.103799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=31 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:01.111170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.111783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.112337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.113062 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.113707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.114442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.118534 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=91 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:01.271146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.283023 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a66adcbd-fc36-40de-a547-9b074cd04b50 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.187613 Oct 31 15:27:01.283610 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3673/7592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:02.309324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:02.310076 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:02.317151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.317643 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.318089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.319468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.319954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.320389 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.523446 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.535748 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e979f04-e82e-4e61-9e4f-37ca7b7281e1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.230367 Oct 31 15:27:02.536748 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3920/7593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:02 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:03.561576 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:03.562353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.569249 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.569834 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.570918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.571711 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.572373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.572864 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.721514 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.730509 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8902a968-24ed-4d56-9904-4c0f66cfa0cf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.173621 Oct 31 15:27:03.740441 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3674/7594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:04.754782 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.755377 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.762850 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.763353 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.763799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.764517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.764990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.765483 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.937868 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.946788 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8ec5fb0-eebb-46cf-a278-5fef26213ee0 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.195960 Oct 31 15:27:04.947674 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3921/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:05.970756 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.971319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.978898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.979387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.979832 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.980550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.981014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.981440 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.123342 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:06.130957 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf8fb17d-6f13-4243-a66d-708c65cdf720 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.164222 Oct 31 15:27:06.131523 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3675/7596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:07.154875 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:07.155506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:07.162423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.163419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.163879 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.164577 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.165049 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.165487 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.296185 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:07.304229 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dad7a7d9-1212-410e-ae03-8fb3375fe625 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.153188 Oct 31 15:27:07.304816 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3922/7597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:07 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:08.327761 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:08.328375 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:08.335228 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:08.335712 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:08.336150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.336833 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:08.337288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:08.337746 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.466975 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.474986 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db4b36ee-59ef-4b97-a6cf-f131a798092a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.151120 Oct 31 15:27:08.475571 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3676/7598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:08 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:09.500338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:09.500968 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:09.508054 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:09.508548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:09.508994 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:09.509717 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:09.510187 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:09.510642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:09.641460 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.649237 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1160ea8-61ac-42ff-98cd-c63ca5d693e6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.153206 Oct 31 15:27:09.649813 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3923/7599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:09 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:10.185843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "name": "network-vif-plugged", "status": "completed", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:10.196563 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.197059 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.197494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.208644 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] Creating event network-vif-plugged:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:27:10.212739 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] [2a187fbd-8fa8-4a26-b849-f6b7f1e69d30] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:27:10.672892 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:10.673518 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:10.680458 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.680957 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.681402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.682100 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.682593 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.683028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.819877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:10.827576 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21a7bd58-8057-4850-ac9a-efc23b15c286 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.158715 Oct 31 15:27:10.828138 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3924/7600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:10 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:11.220025 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] [2a187fbd-8fa8-4a26-b849-f6b7f1e69d30] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55422. Oct 31 15:27:11.223350 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a402bcef-74ac-43db-b5ae-363ec044fdf7 req-c9f82352-10f1-4930-97d1-e24ea66a3e49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041800 Oct 31 15:27:11.223969 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3677/7601] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:27:11.851951 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:11.852575 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:11.859790 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.860289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.860741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.861440 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.861907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.862379 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.992031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:11.999756 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75f80584-8fea-473c-88d4-3a7f90179e01 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1688 microversion: 2.1 time: 0.152349 Oct 31 15:27:12.000342 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3925/7602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:11 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:13.026345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:13.027050 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:13.033425 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.033912 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.034376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.035066 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.035677 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.036099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.167040 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.174820 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fbba1baf-c7aa-4c9e-a25b-b39e4a72e324 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1675 microversion: 2.1 time: 0.155380 Oct 31 15:27:13.175384 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3678/7603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:13 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:26.895843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=13 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:26.897020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=42 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:26.897390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=11 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:26.898011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=31 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:26.898515 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:28:26.898515 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 (ip 10.222.0.27) !!! Oct 31 15:28:26.902777 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:28:26.903268 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:28:26.903887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:26.904539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:26.905733 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:28:26.906089 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:28:26.913194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e81afd71-9620-4463-be96-5907952b342f req-c68376ec-cfe3-4ecc-b236-09c1e423981d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:26.913395 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.913859 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.914366 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.915089 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.915560 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.916152 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.939351 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e81afd71-9620-4463-be96-5907952b342f req-c68376ec-cfe3-4ecc-b236-09c1e423981d service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.939948 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e81afd71-9620-4463-be96-5907952b342f req-c68376ec-cfe3-4ecc-b236-09c1e423981d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.940447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e81afd71-9620-4463-be96-5907952b342f req-c68376ec-cfe3-4ecc-b236-09c1e423981d service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.943829 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:26.953664 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e81afd71-9620-4463-be96-5907952b342f req-c68376ec-cfe3-4ecc-b236-09c1e423981d service nova] Creating event network-changed:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:28:26.960019 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e81afd71-9620-4463-be96-5907952b342f req-c68376ec-cfe3-4ecc-b236-09c1e423981d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064255 Oct 31 15:28:26.960647 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3679/7604] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:27.032239 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-377629a3-bef0-4264-af23-1b97e439f08d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 204 len: 0 microversion: 2.1 time: 0.138165 Oct 31 15:28:27.033215 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3926/7605] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:26 2022] DELETE /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:27.043015 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:27.044270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:27.051447 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.051943 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.052380 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.053085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.053567 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.054257 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.196047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.204125 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-96ec5728-dcc0-439d-8749-d8fc0e07ce89 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.166075 Oct 31 15:28:27.204703 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3680/7606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:27 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:28.229881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.230654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:28.238021 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.238552 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.239003 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.239699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.240159 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.240598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.417031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.425370 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f207016b-a677-4c29-a4fd-4ccca0d0088f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 200 len: 1681 microversion: 2.1 time: 0.200032 Oct 31 15:28:28.426370 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3927/7607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:28.974254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-851ff48c-3814-451a-9344-8865496335e1 req-7e572757-4d80-4f02-a12e-fcd32cee05ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beaa1ca-bff4-4410-9da0-549d2712b812", "name": "network-vif-deleted", "tag": "ca51dd79-d869-482d-8aa9-877b43f18dd7"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:28.985685 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-851ff48c-3814-451a-9344-8865496335e1 req-7e572757-4d80-4f02-a12e-fcd32cee05ff service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.986178 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-851ff48c-3814-451a-9344-8865496335e1 req-7e572757-4d80-4f02-a12e-fcd32cee05ff service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.986625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-851ff48c-3814-451a-9344-8865496335e1 req-7e572757-4d80-4f02-a12e-fcd32cee05ff service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.997533 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-851ff48c-3814-451a-9344-8865496335e1 req-7e572757-4d80-4f02-a12e-fcd32cee05ff service nova] Creating event network-vif-deleted:ca51dd79-d869-482d-8aa9-877b43f18dd7 for instance 3beaa1ca-bff4-4410-9da0-549d2712b812 on n-h2-863052-1 Oct 31 15:28:29.003074 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-851ff48c-3814-451a-9344-8865496335e1 req-7e572757-4d80-4f02-a12e-fcd32cee05ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Oct 31 15:28:29.003854 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3681/7608] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:29.451090 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.451642 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: 3beaa1ca-bff4-4410-9da0-549d2712b812] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:29.458428 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.458921 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.459369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.460063 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.460525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.461580 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.474659 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] HTTP exception thrown: Instance 3beaa1ca-bff4-4410-9da0-549d2712b812 could not be found. Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Request method failure captured: Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 HTTP/1.1 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-id8hTOa7gZVTt403HfSA1SS11D47adPvSTRWQf0ghDlj4XPVWna5w0DD8SucHI2DIcwb6HlXGEowVyBEkzjh-_pAXvXti8cu3dliOj8_jX650vdWPYzTAiTCPHA7SRkAQBUrExRcrU3RT5MIBt0Q-lgP1qqywIihXbkB36VZGWqWQ Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: f90067787cf54ebb8faa3833deb78f46 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestShelveInstance-273108882 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f90067787cf54ebb8faa3833deb78f46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f90067787cf54ebb8faa3833deb78f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f90067787cf54ebb8faa3833deb78f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f90067787cf54ebb8faa3833deb78f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestShelveInstance-273108882 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: f90067787cf54ebb8faa3833deb78f46 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestShelveInstance-273108882 Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestShelveInstance-273108882-project Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 39ab8e20000746308e1a82e2b071d38c Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestShelveInstance-273108882-project Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance 3beaa1ca-bff4-4410-9da0-549d2712b812 could not be found. Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': '3beaa1ca-bff4-4410-9da0-549d2712b812'} Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3beaa1ca-bff4-4410-9da0-549d2712b812 could not be found. Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3beaa1ca-bff4-4410-9da0-549d2712b812 could not be found. Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:29.476302 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3beaa1ca-bff4-4410-9da0-549d2712b812 could not be found. Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Returning 404 to user: Instance 3beaa1ca-bff4-4410-9da0-549d2712b812 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d4140c1-d420-49e7-9116-11cf2d19a912 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812" status: 404 len: 111 microversion: 2.1 time: 0.030697 Oct 31 15:28:29.481783 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3928/7609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/3beaa1ca-bff4-4410-9da0-549d2712b812 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:28:29.644135 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d587e6a1-3592-40b4-ada2-fbade5a1b55f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '.version_select at 0x7fe10684aaf0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.667258 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d587e6a1-3592-40b4-ada2-fbade5a1b55f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1423916475" status: 202 len: 0 microversion: 2.1 time: 0.027442 Oct 31 15:28:29.668076 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3682/7610] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 31 15:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1423916475 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:28:29.692835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a2be086-445b-44fb-9a66-dcbfef95d0ac tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'create', calling method: .version_select at 0x7fe107c08550>, body: {"keypair": {"name": "tempest-TestShelveInstance-351620743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErYEu38+USomSuTJMhXBR4NeCjEGwtas46/MfGFU37O1jfPuKI//Kz3FNeu2eRHg41VuqKeN+YDYu23hkpR0Jsu2HPrrE9uJmzLNt4UFt1SQ8Iz0+sJQ1oJGHzC8CHkJA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:29.710253 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4a2be086-445b-44fb-9a66-dcbfef95d0ac tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for project f90067787cf54ebb8faa3833deb78f46. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:29.715687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-4a2be086-445b-44fb-9a66-dcbfef95d0ac tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for user 39ab8e20000746308e1a82e2b071d38c and project f90067787cf54ebb8faa3833deb78f46. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:29.744033 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a2be086-445b-44fb-9a66-dcbfef95d0ac tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.055307 Oct 31 15:28:29.744638 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3929/7611] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:28:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:45.995698 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:45.996450 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:46.000803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-15550380", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-351620743", "security_groups": [{"name": "tempest-secgroup-smoke-1755153234"}], "networks": [{"uuid": "ca742d44-0bb8-4178-a036-5619afbb405b"}], "block_device_mapping_v2": [{"uuid": "b33c2683-1db0-4bbf-86d5-01edf720dd35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:46.120408 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] validate_networks() for [('ca742d44-0bb8-4178-a036-5619afbb405b', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:46.524837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:46.525269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:46.525743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:46.526153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:46.526589 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:46.535382 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.535865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.536300 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.537058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.537745 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.538076 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.555777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for project f90067787cf54ebb8faa3833deb78f46. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:46.560991 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Getting quotas for user 39ab8e20000746308e1a82e2b071d38c and project f90067787cf54ebb8faa3833deb78f46. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:46.620288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:46.622579 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b33c2683-1db0-4bbf-86d5-01edf720dd35',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:46.754360 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05f4fbfe-834e-4d1b-ae2e-7e8530d04ab7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760399 Oct 31 15:28:46.755021 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3683/7612] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:46.764638 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:46.765521 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:46.766581 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:46.771833 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d642cf00-b9e9-4dd3-836b-f29ced103a9d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:46.772468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d642cf00-b9e9-4dd3-836b-f29ced103a9d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:46.832786 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d642cf00-b9e9-4dd3-836b-f29ced103a9d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:46.840283 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d642cf00-b9e9-4dd3-836b-f29ced103a9d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1086 microversion: 2.1 time: 0.077796 Oct 31 15:28:46.840855 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3930/7613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:46 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1086 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:47.862870 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e23c5cc-af06-4df9-961a-b088a422f08c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:47.863494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e23c5cc-af06-4df9-961a-b088a422f08c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:47.916183 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3e23c5cc-af06-4df9-961a-b088a422f08c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:47.923068 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e23c5cc-af06-4df9-961a-b088a422f08c tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1086 microversion: 2.1 time: 0.064080 Oct 31 15:28:47.923637 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3684/7614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:47 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1086 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:48.946436 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b9f134e-6e38-48fd-bfe6-bf799c5a05ed tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:48.947072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b9f134e-6e38-48fd-bfe6-bf799c5a05ed tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:49.005700 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b9f134e-6e38-48fd-bfe6-bf799c5a05ed tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:49.014078 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b9f134e-6e38-48fd-bfe6-bf799c5a05ed tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1086 microversion: 2.1 time: 0.072052 Oct 31 15:28:49.014696 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3931/7615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:48 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:50.037042 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40453e08-0965-42f2-a806-611e8c104418 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:50.037569 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40453e08-0965-42f2-a806-611e8c104418 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:50.092766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-40453e08-0965-42f2-a806-611e8c104418 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.100034 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40453e08-0965-42f2-a806-611e8c104418 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1086 microversion: 2.1 time: 0.067005 Oct 31 15:28:50.100601 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3685/7616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:50 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1086 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:51.122969 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:51.123600 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:51.131212 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.131718 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.132670 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.133388 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.133861 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.134339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.193132 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.202430 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9992aa71-b7db-4221-94f7-0d30f16e7678 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1136 microversion: 2.1 time: 0.083359 Oct 31 15:28:51.203195 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3932/7617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:51 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:52.227950 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:52.228978 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:52.238818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.239435 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.239935 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.240779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.241170 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.241598 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.319101 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:52.327575 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f1cbd036-04b6-4f1e-bc66-6c846edad43f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1202 microversion: 2.1 time: 0.104627 Oct 31 15:28:52.328272 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3686/7618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:52 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:53.352542 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:53.353173 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:53.360629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.361147 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.361599 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.362376 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.362851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.363292 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.568784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.577862 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b6b3d55-ff34-491b-b693-49973c5c385d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1270 microversion: 2.1 time: 0.229450 Oct 31 15:28:53.578691 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3933/7619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:53 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:53.620378 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-053e129d-ff62-4b70-88f9-1fc92a8ee769 req-11069667-8b2f-4e81-a06c-2960bde20cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:53.634921 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-053e129d-ff62-4b70-88f9-1fc92a8ee769 req-11069667-8b2f-4e81-a06c-2960bde20cee service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.635726 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-053e129d-ff62-4b70-88f9-1fc92a8ee769 req-11069667-8b2f-4e81-a06c-2960bde20cee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.636139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-053e129d-ff62-4b70-88f9-1fc92a8ee769 req-11069667-8b2f-4e81-a06c-2960bde20cee service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.651140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-053e129d-ff62-4b70-88f9-1fc92a8ee769 req-11069667-8b2f-4e81-a06c-2960bde20cee service nova] Creating event network-changed:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h1-863052-1 Oct 31 15:28:53.656350 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-053e129d-ff62-4b70-88f9-1fc92a8ee769 req-11069667-8b2f-4e81-a06c-2960bde20cee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040863 Oct 31 15:28:53.657150 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3687/7620] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:54.603032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.603769 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.611371 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.611863 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.612307 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.613007 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.613471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.613903 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.752164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.760698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcb0b8e4-f6b7-46ff-8235-22be8006ade9 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1270 microversion: 2.1 time: 0.162322 Oct 31 15:28:54.761274 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3934/7621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:55.784976 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:55.785674 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.793652 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.794140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.794629 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.795313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.795770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.796199 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.931461 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.939793 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bf97b9d6-41e4-4040-844d-75ef10321b04 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1270 microversion: 2.1 time: 0.159200 Oct 31 15:28:55.940374 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3688/7622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:55 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:56.962950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.963550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:56.970492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.970990 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.971442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.972143 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.972611 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.973055 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.104140 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.112135 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd1a427a-70b2-4b84-992b-975789575525 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.153210 Oct 31 15:28:57.112709 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3935/7623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:58.136840 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:58.137487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:58.139603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:58.147141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.147637 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.148081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.148782 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.149245 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.149671 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.291945 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.300092 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d94a61cc-8070-447f-8009-16d5fb3400d6 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.167663 Oct 31 15:28:58.300681 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3689/7624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:58 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:59.324101 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:59.324737 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.327475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:59.333432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.333937 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.334421 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.335134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.335604 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.336715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.472899 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.480712 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6ecf8a8-aca1-4953-a335-e233f3bf98b4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.161103 Oct 31 15:28:59.481303 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3936/7625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:59 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:00.503127 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:00.503662 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:00.506345 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:00.511768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.512258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.512703 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.513394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.513850 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.514310 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.645278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:00.653507 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a7756d1-10b5-4cb5-aa59-cc890fbc9fa1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.154344 Oct 31 15:29:00.654068 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3690/7626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:00 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:01.677205 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:01.677831 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:01.685321 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.685821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.686305 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.687014 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.687486 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.687926 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.820912 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.828673 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6248e7f8-9a76-4916-a7e0-c1b28379ad10 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.155498 Oct 31 15:29:01.829249 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3937/7627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:01 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:02.852462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.853081 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.859551 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.860041 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.860480 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.861168 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.861623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.862047 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.993740 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.001575 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e353504-f3df-4303-8ed2-b0f5b84f2c3d tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.153385 Oct 31 15:29:03.002151 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3691/7628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:02 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:04.024645 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:04.025298 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:04.032302 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.032793 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.033426 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.034127 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.034620 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.035056 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.165754 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:04.173658 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e1fca12-b420-4641-8ff7-e8b5e0393ecc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.153520 Oct 31 15:29:04.174254 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3938/7629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:04 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:05.197561 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:05.198109 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:05.204845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:05.205323 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:05.205757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:05.206469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:05.206918 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:05.207337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:05.339916 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:05.347845 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01eff130-d97f-42f0-a327-83ba664e5224 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.154724 Oct 31 15:29:05.348449 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3692/7630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:05 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:06.371442 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:06.372097 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:06.379081 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.379585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.380041 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.380745 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.381219 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.381662 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.519164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.527350 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63644223-c3cd-41f7-aede-42f0b4bc7f4f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.159851 Oct 31 15:29:06.527924 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3939/7631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:06 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:07.550549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:07.551172 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:07.558744 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.559247 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.559692 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.560387 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.560848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.561278 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.568452 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-382e4085-fe9a-4732-879e-d1e524bd836e req-7570bcd4-0812-4da3-9bc2-494d57bb8d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "name": "network-vif-plugged", "status": "completed", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:07.579469 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-382e4085-fe9a-4732-879e-d1e524bd836e req-7570bcd4-0812-4da3-9bc2-494d57bb8d8c service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.580169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-382e4085-fe9a-4732-879e-d1e524bd836e req-7570bcd4-0812-4da3-9bc2-494d57bb8d8c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.580694 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-382e4085-fe9a-4732-879e-d1e524bd836e req-7570bcd4-0812-4da3-9bc2-494d57bb8d8c service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.592655 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-382e4085-fe9a-4732-879e-d1e524bd836e req-7570bcd4-0812-4da3-9bc2-494d57bb8d8c service nova] Creating event network-vif-plugged:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h1-863052-1 Oct 31 15:29:07.609602 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-382e4085-fe9a-4732-879e-d1e524bd836e req-7570bcd4-0812-4da3-9bc2-494d57bb8d8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045435 Oct 31 15:29:07.610447 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3940/7632] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:07.697900 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.706107 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9acebc93-7964-4f29-9d46-66a149117f9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.159635 Oct 31 15:29:07.706837 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3693/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:07 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:08.730667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:08.731301 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:08.737954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.738499 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.738949 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.739656 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.740120 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.740655 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.879295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:08.887597 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f66d33f8-ab6e-434e-8621-7c5b2bfec485 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1258 microversion: 2.1 time: 0.162236 Oct 31 15:29:08.888168 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3941/7634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:08 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:09.910400 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:09.911065 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:09.917874 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.918409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.918849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.919540 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.919993 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.920418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.050849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.059221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78b192a5-4932-4c48-8f79-b04649829d69 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1442 microversion: 2.1 time: 0.152792 Oct 31 15:29:10.059789 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3694/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:09 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:10.082033 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.082690 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.089523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.090020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.090507 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.091215 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.091687 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.092131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.224243 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.232306 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0cd4ba62-b36a-48a3-9877-fe3f15f373d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1442 microversion: 2.1 time: 0.153866 Oct 31 15:29:10.232874 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3942/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:12.050439 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-98d42a9e-be85-4bef-8119-f084d5593d4b req-6093bf77-074e-483b-b216-cf832117f62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:12.062014 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-98d42a9e-be85-4bef-8119-f084d5593d4b req-6093bf77-074e-483b-b216-cf832117f62e service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.062586 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-98d42a9e-be85-4bef-8119-f084d5593d4b req-6093bf77-074e-483b-b216-cf832117f62e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.063021 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-98d42a9e-be85-4bef-8119-f084d5593d4b req-6093bf77-074e-483b-b216-cf832117f62e service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.074334 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-98d42a9e-be85-4bef-8119-f084d5593d4b req-6093bf77-074e-483b-b216-cf832117f62e service nova] Creating event network-changed:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h1-863052-1 Oct 31 15:29:12.079555 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-98d42a9e-be85-4bef-8119-f084d5593d4b req-6093bf77-074e-483b-b216-cf832117f62e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033252 Oct 31 15:29:12.080152 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3695/7637] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:07.208595 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:31:07.209401 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:07.210197 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=62 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:07.211844 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:31:07.212069 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:31:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011/action (ip 10.222.0.27) !!! Oct 31 15:31:07.264908 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:07.265488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:07.271497 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.271992 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.272437 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.273914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.274415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.274854 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.297639 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lazy-loading 'flavor' on Instance uuid df91785a-095f-45c4-a645-be0d96f02011 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:31:07.368138 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38083b59-aa9d-44fe-87e2-d9e431d73567 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011/action" status: 202 len: 0 microversion: 2.1 time: 0.161401 Oct 31 15:31:07.368790 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3943/7638] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:07 2022] POST /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:07.375318 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:31:07.376188 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:31:07.376876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:07.377780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=54 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:07.384642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.385353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:07.393392 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.393933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.394401 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.395099 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.395549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.395968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.534008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:07.541848 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7733db3b-ce6a-46c2-911d-b3b336c25818 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.168593 Oct 31 15:31:07.542462 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3696/7639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:08.563784 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:31:08.567540 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.568264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:08.576183 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.576708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.577155 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.577855 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.578351 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.578788 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.605061 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55778. Oct 31 15:31:08.718046 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.725849 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2804d50a-b788-4145-8542-7c674c76d129 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.164315 Oct 31 15:31:08.726849 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3944/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:08 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:09.755354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.755964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:09.769896 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.770434 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.770886 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.771595 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.772056 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.772487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.777187 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55782. Oct 31 15:31:09.777889 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55784. Oct 31 15:31:09.903362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.911156 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82d1aaa2-676a-4c27-abf8-a449f55b2ecd tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.159846 Oct 31 15:31:09.911764 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3697/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:10.936129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.936684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:10.944827 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.945345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.945884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.946654 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.947151 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.947594 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.952919 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55788. Oct 31 15:31:11.079229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.087116 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-391c2e66-f985-43cb-a8ca-44ea8b37b352 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.155145 Oct 31 15:31:11.087711 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3945/7642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:12.111402 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.112016 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:12.119362 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.119851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.120287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.120977 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.121429 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.121854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.255025 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.262899 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b878c35e-45a5-4dcd-b74f-69c6c4c6bf3e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.155696 Oct 31 15:31:12.263482 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3698/7643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:13.286952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:13.287569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:13.294750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.295256 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.295712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:13.296423 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.296897 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.297338 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:13.427115 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:13.435245 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75f219c1-3634-4d50-a936-2b27a08dd913 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.152324 Oct 31 15:31:13.435814 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3946/7644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:13 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:14.459409 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.460030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.467622 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.468138 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.468577 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.469269 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.469727 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.470154 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.598849 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.606591 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efbce56b-b6f2-49bc-a00d-7e74c64e5a6e tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.151040 Oct 31 15:31:14.607425 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3699/7645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:14 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:15.630550 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.631125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.638563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.639060 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.639503 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.640198 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.640660 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.641342 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.775953 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:15.783684 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-267ea102-a8a1-40c1-9da3-ebdd770eabcc tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.157199 Oct 31 15:31:15.785136 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3947/7646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:16.808239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.808888 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.815775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.816277 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.816718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.817415 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.817873 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.818339 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.960932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.969474 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-947de200-6ed4-4f8e-9f05-652356a461ea tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.165187 Oct 31 15:31:16.970055 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3700/7647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:17.992880 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.993539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:18.000480 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.000973 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.001419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.002124 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.002617 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.003052 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.139095 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:18.146896 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56c46d0c-d29f-4048-845a-184715716226 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.157975 Oct 31 15:31:18.147470 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3948/7648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:19.171153 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:19.171780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:19.178768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:19.179252 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:19.179722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:19.180414 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:19.181462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:19.181885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:19.312411 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:19.320115 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c2d7368c-0415-42af-b87c-20edd3efd704 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.152899 Oct 31 15:31:19.320687 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3701/7649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:19 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:20.344234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.344971 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.352145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.353303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.353823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.354637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.355203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.355713 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.493194 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.501131 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a456013d-f079-4fdd-bd5b-da5c778ba3da tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.160901 Oct 31 15:31:20.501716 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3949/7650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:20 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:21.530034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.531141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.543449 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.544353 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.545141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.546477 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.547009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.547640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.708000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:21.716404 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-db24bbde-e415-40bc-b27f-e225b666dbe1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1568 microversion: 2.1 time: 0.194253 Oct 31 15:31:21.716974 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3702/7651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:21.739343 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:21.739961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.746938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.747432 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.747907 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.748637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.749103 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.749541 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.778585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 15:31:21.842543 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62a80dd8-5a6a-4182-b633-6553694f3747 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "POST /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011/action" status: 202 len: 0 microversion: 2.1 time: 0.107037 Oct 31 15:31:21.846099 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3950/7652] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:21 2022] POST /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:31:21.851705 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.852559 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.859149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.859856 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.861926 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.862478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.863011 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.863472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.252136 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-79d294b0-37f1-484a-b767-d6791c70cc08 req-48d4a6d9-405f-4730-8d79-f0d4c2e3ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "name": "network-vif-unplugged", "status": "completed", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:22.262774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-79d294b0-37f1-484a-b767-d6791c70cc08 req-48d4a6d9-405f-4730-8d79-f0d4c2e3ce83 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.263276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-79d294b0-37f1-484a-b767-d6791c70cc08 req-48d4a6d9-405f-4730-8d79-f0d4c2e3ce83 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.263721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-79d294b0-37f1-484a-b767-d6791c70cc08 req-48d4a6d9-405f-4730-8d79-f0d4c2e3ce83 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.282742 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-79d294b0-37f1-484a-b767-d6791c70cc08 req-48d4a6d9-405f-4730-8d79-f0d4c2e3ce83 service nova] Unable to find a host for instance df91785a-095f-45c4-a645-be0d96f02011. Dropping event network-vif-unplugged {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:31:22.283674 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-79d294b0-37f1-484a-b767-d6791c70cc08 req-48d4a6d9-405f-4730-8d79-f0d4c2e3ce83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035376 Oct 31 15:31:22.291331 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3951/7653] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 31 15:31:22.384293 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.392221 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-45c1c2bf-8934-4648-95b0-867d1c90dfdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1516 microversion: 2.1 time: 0.544657 Oct 31 15:31:22.392922 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3703/7654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1516 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:23.416543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:23.417182 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:23.424930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.425445 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.425905 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.426657 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.427135 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.427585 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.564629 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:23.572644 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-214dc52c-6de4-4631-92a2-a5207931a035 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1518 microversion: 2.1 time: 0.160732 Oct 31 15:31:23.573230 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3952/7655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:23 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:24.596484 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:24.597219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:24.604603 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.605088 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.605522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.606238 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.606694 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.607412 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.744770 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.752635 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d0a2927-2776-4d6f-a5d5-3cedf00a56c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1518 microversion: 2.1 time: 0.160124 Oct 31 15:31:24.753524 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3704/7656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:24 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:25.776006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:25.776649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:25.783811 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.784303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.784768 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.785472 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.785936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.786405 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.924006 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:25.931879 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7b3e901-0738-43a7-a8c4-4bd60212e807 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1518 microversion: 2.1 time: 0.160351 Oct 31 15:31:25.932483 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3953/7657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:25 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:26.956348 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:26.956913 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:26.964219 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.964734 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.965167 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.965851 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.966394 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.966818 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.096067 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.104682 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27bf0c24-b3d0-4712-984a-ec6d1f375817 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1518 microversion: 2.1 time: 0.152925 Oct 31 15:31:27.105324 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3705/7658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:26 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:28.128582 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:28.129211 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.136181 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.136689 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.137134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.137872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.138443 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.138884 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.348453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.357146 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6206ca95-ab5c-40e3-a784-e4216d38d76a tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.232202 Oct 31 15:31:28.357728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3954/7659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:28 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:28.960640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5ab6a161-792e-4c88-8b4d-e4afaa7f1115 req-856f39ea-bff2-4d33-b07a-feb97aeb4c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:28.970084 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ab6a161-792e-4c88-8b4d-e4afaa7f1115 req-856f39ea-bff2-4d33-b07a-feb97aeb4c9b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.971516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ab6a161-792e-4c88-8b4d-e4afaa7f1115 req-856f39ea-bff2-4d33-b07a-feb97aeb4c9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.971516 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ab6a161-792e-4c88-8b4d-e4afaa7f1115 req-856f39ea-bff2-4d33-b07a-feb97aeb4c9b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.984546 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5ab6a161-792e-4c88-8b4d-e4afaa7f1115 req-856f39ea-bff2-4d33-b07a-feb97aeb4c9b service nova] Creating event network-changed:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h2-863052-1 Oct 31 15:31:28.989821 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5ab6a161-792e-4c88-8b4d-e4afaa7f1115 req-856f39ea-bff2-4d33-b07a-feb97aeb4c9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094913 Oct 31 15:31:28.990481 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3706/7660] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:29.380774 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.381465 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:29.389295 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.389798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.390289 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.391001 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.391506 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.391967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.663313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:29.672042 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afd53745-fa2d-4b96-8cf5-d0e475fe3c9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.295253 Oct 31 15:31:29.672728 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3955/7661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:29 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:30.697768 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:30.698491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:30.704648 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.705132 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.705564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.706270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.706722 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.707139 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.891919 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.899786 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b00d180-45b3-4ffb-914d-cefa09e6e325 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.207872 Oct 31 15:31:30.900357 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3707/7662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:30 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:31.923872 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:31.924419 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:31.932023 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.932524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.932975 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.933676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.934145 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.934609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.064229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:32.072026 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cd05da0-7928-485c-bb23-5cde3ba3da91 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.152179 Oct 31 15:31:32.072615 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3956/7663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:31 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:33.096039 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:33.096650 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:33.103427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.103909 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.104370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.105121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.105573 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.105997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.237880 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.246722 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-caff17f5-cd36-4b07-b8b8-8df601c8bb49 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.154150 Oct 31 15:31:33.247505 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3708/7664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:33 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:34.270543 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.271180 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.278721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.279225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.279678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.280386 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.280944 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.281392 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.285422 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:34.419478 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.427440 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c41066a2-4d77-4cb8-a73d-36570fc77c1f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.160892 Oct 31 15:31:34.428024 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3957/7665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:35.451881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:35.452494 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:35.459291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.459775 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.460215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.460906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.461357 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.461780 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.592324 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.600080 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26744320-0bca-42e3-b86b-f6f7754f8aec tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.152595 Oct 31 15:31:35.600655 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3709/7666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:35 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:36.624073 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:36.624609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:36.631661 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.632167 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.632618 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.633324 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.633797 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.634264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.765403 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:36.773238 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b4dbfd6-1890-4528-9bac-6987b1d46e31 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.153439 Oct 31 15:31:36.773817 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3958/7667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:36 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:37.796642 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:37.797258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.800141 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=29 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:37.805531 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.806017 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.806492 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.807251 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.808258 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.808686 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.812634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=81 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:37.941898 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.949819 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-025b99ab-5812-4f3f-897f-71cec10a30d4 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.157086 Oct 31 15:31:37.950435 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3710/7668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:37 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:38.973684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:38.974517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:38.976938 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:38.982612 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.983131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.983553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.984248 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.984709 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.985156 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.123024 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.130808 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0acaaae-2373-41f9-a65c-5c7eddabbd55 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.161272 Oct 31 15:31:39.131390 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3959/7669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:38 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:39.669837 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f09567db-34a4-4710-bb39-2129b64a1f4e req-60788ed2-b622-46bb-a7bf-e1c86cb98b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "name": "network-vif-plugged", "status": "completed", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:39.681340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f09567db-34a4-4710-bb39-2129b64a1f4e req-60788ed2-b622-46bb-a7bf-e1c86cb98b5b service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.681968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f09567db-34a4-4710-bb39-2129b64a1f4e req-60788ed2-b622-46bb-a7bf-e1c86cb98b5b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.682468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f09567db-34a4-4710-bb39-2129b64a1f4e req-60788ed2-b622-46bb-a7bf-e1c86cb98b5b service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.693916 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f09567db-34a4-4710-bb39-2129b64a1f4e req-60788ed2-b622-46bb-a7bf-e1c86cb98b5b service nova] Creating event network-vif-plugged:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h2-863052-1 Oct 31 15:31:39.699269 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f09567db-34a4-4710-bb39-2129b64a1f4e req-60788ed2-b622-46bb-a7bf-e1c86cb98b5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Oct 31 15:31:39.700450 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3711/7670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:40.155444 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.155978 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.162881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.163385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.163839 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.164548 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.165020 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.165462 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.294799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.302737 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e3fb2c4-61b0-4bb5-a60e-501e79e1d243 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1574 microversion: 2.1 time: 0.151939 Oct 31 15:31:40.303318 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3960/7671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:41.327755 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:41.328451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:41.335034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.335491 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.335932 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.336609 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.337061 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.337482 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.469525 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.477641 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b683cfc5-063f-490a-837f-2a2d3c61f5c3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1561 microversion: 2.1 time: 0.154243 Oct 31 15:31:41.478226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3712/7672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:41 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:58.133123 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:58.134208 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.134726 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.135376 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=13 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:58.136587 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:32:58.137044 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:32:58.139308 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:32:58.139503 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:32:58.140606 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:58.141352 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=22 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:58.142536 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:32:58.142662 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 (ip 10.222.0.27) !!! Oct 31 15:32:58.147415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.147943 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.148552 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6ddbd63a-1f67-4d52-9086-102f16ae4463 req-30e01885-820d-4e78-840e-bc3793c850b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:58.148851 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.149778 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.150276 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.150716 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.172588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6ddbd63a-1f67-4d52-9086-102f16ae4463 req-30e01885-820d-4e78-840e-bc3793c850b9 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.173388 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6ddbd63a-1f67-4d52-9086-102f16ae4463 req-30e01885-820d-4e78-840e-bc3793c850b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.173823 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6ddbd63a-1f67-4d52-9086-102f16ae4463 req-30e01885-820d-4e78-840e-bc3793c850b9 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.183126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:32:58.188553 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6ddbd63a-1f67-4d52-9086-102f16ae4463 req-30e01885-820d-4e78-840e-bc3793c850b9 service nova] Creating event network-changed:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h2-863052-1 Oct 31 15:32:58.194102 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6ddbd63a-1f67-4d52-9086-102f16ae4463 req-30e01885-820d-4e78-840e-bc3793c850b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062926 Oct 31 15:32:58.195293 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3713/7673] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:58.270948 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8307a4bc-94b2-4666-b96c-0999e04c89d7 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 204 len: 0 microversion: 2.1 time: 0.141897 Oct 31 15:32:58.274742 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3961/7674] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:32:58 2022] DELETE /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:32:58.282185 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.283034 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.290953 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.291599 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.292143 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.292924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.293460 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.293980 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.433973 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.441953 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27c568c9-9ee2-49fb-898f-df4c7ac05501 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.165365 Oct 31 15:32:58.442685 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3714/7675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:59.467523 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:59.468242 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.475266 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.475735 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.476184 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.476890 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.477365 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.477806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.634658 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.642527 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-195d5aab-e52e-4609-9272-5e74dbc14070 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1567 microversion: 2.1 time: 0.179245 Oct 31 15:32:59.644812 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3962/7676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:59 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:00.274054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-32f607f3-8f38-455b-8631-1b3890e0d3bc req-4743cebd-acb2-4876-a394-05aa26f80f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df91785a-095f-45c4-a645-be0d96f02011", "name": "network-vif-deleted", "tag": "254e4a12-c73a-4252-b3dc-0d202a6bf998"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:00.283611 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-32f607f3-8f38-455b-8631-1b3890e0d3bc req-4743cebd-acb2-4876-a394-05aa26f80f99 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.284133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-32f607f3-8f38-455b-8631-1b3890e0d3bc req-4743cebd-acb2-4876-a394-05aa26f80f99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.284570 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-32f607f3-8f38-455b-8631-1b3890e0d3bc req-4743cebd-acb2-4876-a394-05aa26f80f99 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.301140 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-32f607f3-8f38-455b-8631-1b3890e0d3bc req-4743cebd-acb2-4876-a394-05aa26f80f99 service nova] Creating event network-vif-deleted:254e4a12-c73a-4252-b3dc-0d202a6bf998 for instance df91785a-095f-45c4-a645-be0d96f02011 on n-h2-863052-1 Oct 31 15:33:00.306908 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-32f607f3-8f38-455b-8631-1b3890e0d3bc req-4743cebd-acb2-4876-a394-05aa26f80f99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087354 Oct 31 15:33:00.307515 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3715/7677] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:00.667806 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:00.668813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:00.676339 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.676914 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.677425 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.678280 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.678864 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.679427 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.745915 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:00.753998 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3426107d-8859-49dc-9f85-1924f6c1fe9f tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1217 microversion: 2.1 time: 0.090924 Oct 31 15:33:00.754601 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3963/7678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:00 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:01.778623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:01.779330 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:01.785757 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.786279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.786724 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.787428 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.787889 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.788315 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.854140 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.862495 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b3f4c9b-df96-4d18-ae6e-a6d4ee9107a1 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1217 microversion: 2.1 time: 0.089098 Oct 31 15:33:01.863093 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3716/7679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:01 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:02.886984 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.887527 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.894393 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.894887 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.895335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.896031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.896492 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.896936 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.958459 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.967122 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1a446e2-4add-4d2e-8114-45749e001f85 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1217 microversion: 2.1 time: 0.084336 Oct 31 15:33:02.967697 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3964/7680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:03.991266 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.992645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.999473 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.999958 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.000395 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.001097 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.001550 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.001971 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.065328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ab8e20000746308e1a82e2b071d38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90067787cf54ebb8faa3833deb78f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.073223 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b02a27fe-4177-4231-b608-f434891cf7e3 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 200 len: 1217 microversion: 2.1 time: 0.086013 Oct 31 15:33:04.073796 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3717/7681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:05.096236 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.096856 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] [instance: df91785a-095f-45c4-a645-be0d96f02011] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.106032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.107235 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.107684 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.108821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.109310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.109734 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.125193 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] HTTP exception thrown: Instance df91785a-095f-45c4-a645-be0d96f02011 could not be found. Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Request method failure captured: Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 HTTP/1.1 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Accept: application/json Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Accept-Encoding: identity Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Connection: close Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Content-Length: 0 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Content-Type: application/json Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Host: 10.222.0.27 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: Openstack-System-Scope: None Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjX-id8hTOa7gZVTt403HfSA1SS11D47adPvSTRWQf0ghDlj4XPVWna5w0DD8SucHI2DIcwb6HlXGEowVyBEkzjh-_pAXvXti8cu3dliOj8_jX650vdWPYzTAiTCPHA7SRkAQBUrExRcrU3RT5MIBt0Q-lgP1qqywIihXbkB36VZGWqWQ Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Id: None Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Domain-Name: None Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Identity-Status: Confirmed Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Is-Admin-Project: True Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Id: default Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Domain-Name: Default Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Id: f90067787cf54ebb8faa3833deb78f46 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Project-Name: tempest-TestShelveInstance-273108882 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Role: member,reader Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Roles: member,reader Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f90067787cf54ebb8faa3833deb78f46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f90067787cf54ebb8faa3833deb78f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f90067787cf54ebb8faa3833deb78f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f90067787cf54ebb8faa3833deb78f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant: tempest-TestShelveInstance-273108882 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Id: f90067787cf54ebb8faa3833deb78f46 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestShelveInstance-273108882 Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-User: tempest-TestShelveInstance-273108882-project Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Id: default Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-User-Domain-Name: Default Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-User-Id: 39ab8e20000746308e1a82e2b071d38c Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: X-User-Name: tempest-TestShelveInstance-273108882-project Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: method: > Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: exception: Instance df91785a-095f-45c4-a645-be0d96f02011 could not be found. Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: action_args: {'id': 'df91785a-095f-45c4-a645-be0d96f02011'} Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df91785a-095f-45c4-a645-be0d96f02011 could not be found. Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df91785a-095f-45c4-a645-be0d96f02011 could not be found. Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:05.126950 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df91785a-095f-45c4-a645-be0d96f02011 could not be found. Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Returning 404 to user: Instance df91785a-095f-45c4-a645-be0d96f02011 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0eb41f51-3f6a-4b4d-8ed6-07c8859dad53 tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011" status: 404 len: 111 microversion: 2.1 time: 0.036140 Oct 31 15:33:05.131942 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3965/7682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:05 2022] GET /compute/v2.1/servers/df91785a-095f-45c4-a645-be0d96f02011 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:05.296054 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2010a972-dea5-428c-8016-9b6abb7aecdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] Calling method '.version_select at 0x7fe1075d6280>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.331222 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2010a972-dea5-428c-8016-9b6abb7aecdf tempest-TestShelveInstance-273108882 tempest-TestShelveInstance-273108882-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-351620743" status: 202 len: 0 microversion: 2.1 time: 0.038943 Oct 31 15:33:05.332553 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3718/7683] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 31 15:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-351620743 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:33:22.617275 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:22.618683 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:22.807491 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89d3e68c-cd8e-4054-9016-01ecc6bba95d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Action: 'create', calling method: .version_select at 0x7fe1077b53a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-233015082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnEQ4BkdkSheVcrO2nRohNBsIC7KgargZ4ct/16mlTCSmKI2xZMwJCnc5vX/EKP1+lkudL1CvF7A6wmux+3yYfQ4KQNR2H12/0+y4cpMuC1C7TmMCuFGNYYh+E2T8q8WQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:22.824206 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-89d3e68c-cd8e-4054-9016-01ecc6bba95d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Getting quotas for project 95d2c0debf98467cae0adc3e5bd05d5f. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:22.829999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-89d3e68c-cd8e-4054-9016-01ecc6bba95d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Getting quotas for user 35d3ca406e5948399edb7cd6064a2547 and project 95d2c0debf98467cae0adc3e5bd05d5f. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:22.860884 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89d3e68c-cd8e-4054-9016-01ecc6bba95d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.248706 Oct 31 15:33:22.861509 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3966/7684] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 31 15:33:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:23.864103 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1612646191", "imageRef": "cf380c16-a362-46be-bffa-e45fdf8f7e66", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-233015082", "security_groups": [{"name": "tempest-secgroup-smoke-2030129222"}], "networks": [{"uuid": "ed8117b3-551c-4fd5-b481-a17476fd7374"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:23.876503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=22 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:23.877133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:23.979868 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] validate_networks() for [('ed8117b3-551c-4fd5-b481-a17476fd7374', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:24.388287 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:24.388715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:24.389410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:24.389824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:24.390282 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:24.400319 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.400814 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.401254 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.401984 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.402522 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.402956 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.421000 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Getting quotas for project 95d2c0debf98467cae0adc3e5bd05d5f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:24.426564 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.quota [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Getting quotas for user 35d3ca406e5948399edb7cd6064a2547 and project 95d2c0debf98467cae0adc3e5bd05d5f. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:24.439024 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:24.441359 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf380c16-a362-46be-bffa-e45fdf8f7e66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:24.490309 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d01b0fda-34fc-432e-8bc3-6c99d8911c03 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630331 Oct 31 15:33:24.491047 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3719/7685] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:24.503923 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-992fee26-bc0b-47b2-b970-4a1c14a0d987 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:24.504603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-992fee26-bc0b-47b2-b970-4a1c14a0d987 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:24.570364 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-992fee26-bc0b-47b2-b970-4a1c14a0d987 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.577319 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-992fee26-bc0b-47b2-b970-4a1c14a0d987 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1248 microversion: 2.1 time: 0.079026 Oct 31 15:33:24.577885 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3967/7686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:24 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:25.602032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:25.602828 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:25.611389 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.611986 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.612469 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.613295 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.613824 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.614523 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.705478 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:25.713872 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32ff4794-c774-4c3b-8636-1027eff70316 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1308 microversion: 2.1 time: 0.116966 Oct 31 15:33:25.714793 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3720/7687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:25 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:26.740475 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:26.742835 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:26.749999 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.750557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.751018 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.751752 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.752229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.752676 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.017628 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:27.042101 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-006aaaf8-26e2-4b85-a986-3c56021f9407 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.305161 Oct 31 15:33:27.043228 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3968/7688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:26 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:27.508235 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-78ca4336-8507-40e3-b6d3-f629df8adee3 req-90b096b9-1532-4746-ae6d-6dbd6db216c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:27.518981 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-78ca4336-8507-40e3-b6d3-f629df8adee3 req-90b096b9-1532-4746-ae6d-6dbd6db216c7 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.519456 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-78ca4336-8507-40e3-b6d3-f629df8adee3 req-90b096b9-1532-4746-ae6d-6dbd6db216c7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.519881 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-78ca4336-8507-40e3-b6d3-f629df8adee3 req-90b096b9-1532-4746-ae6d-6dbd6db216c7 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.531762 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-78ca4336-8507-40e3-b6d3-f629df8adee3 req-90b096b9-1532-4746-ae6d-6dbd6db216c7 service nova] Creating event network-changed:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:33:27.536586 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-78ca4336-8507-40e3-b6d3-f629df8adee3 req-90b096b9-1532-4746-ae6d-6dbd6db216c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033032 Oct 31 15:33:27.537183 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3721/7689] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:28.066345 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:28.066976 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:28.074512 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.074961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.075411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.076112 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.076579 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.077016 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.223665 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:28.232004 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8b925ec-f828-4025-a150-1f93cbcf13ed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.169320 Oct 31 15:33:28.232610 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3969/7690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:28 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:29.258018 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:29.258763 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:29.265146 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.265640 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.266133 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.266871 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.267350 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.267766 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.402718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.410377 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a07dbb15-e395-4320-b0eb-d1ab38f62a86 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.157568 Oct 31 15:33:29.410956 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3722/7691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:29 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:30.434539 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:30.435170 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:30.442125 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.442659 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.443111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.443816 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.444281 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.444721 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.581961 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:30.590409 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e86179a-67ac-4f6c-984b-b9199e303f9e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.159848 Oct 31 15:33:30.591000 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3970/7692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:30 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:31.613463 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:31.614085 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:31.621391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.621883 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.622354 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.623051 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.623517 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.623947 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.756105 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:31.764087 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f8cbb1e-99aa-4f3f-9df0-53649792b71b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.154499 Oct 31 15:33:31.764666 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3723/7693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:31 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:32.786885 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:32.787516 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:32.794277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.794784 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.795237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.795946 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.796417 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.796858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.942004 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-205822ac-79ce-4320-81db-a53d5ea4ad6e req-d7fd3a42-3c73-4608-8565-a40013cbe501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "name": "network-vif-plugged", "status": "completed", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:32.951234 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.952614 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-205822ac-79ce-4320-81db-a53d5ea4ad6e req-d7fd3a42-3c73-4608-8565-a40013cbe501 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.953173 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-205822ac-79ce-4320-81db-a53d5ea4ad6e req-d7fd3a42-3c73-4608-8565-a40013cbe501 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.953672 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-205822ac-79ce-4320-81db-a53d5ea4ad6e req-d7fd3a42-3c73-4608-8565-a40013cbe501 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.958864 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26614e4b-f011-4a16-af8b-9fb68530a602 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.176019 Oct 31 15:33:32.959476 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3971/7694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:32 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:32.964919 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-205822ac-79ce-4320-81db-a53d5ea4ad6e req-d7fd3a42-3c73-4608-8565-a40013cbe501 service nova] Creating event network-vif-plugged:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:33:32.969992 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-205822ac-79ce-4320-81db-a53d5ea4ad6e req-d7fd3a42-3c73-4608-8565-a40013cbe501 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099945 Oct 31 15:33:32.970618 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3724/7695] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:33.982702 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:33.983264 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:33.990131 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.990664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.991119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.991819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.992284 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.992724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:34.128610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:34.137122 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bd2b3ff-dbdd-4141-ad86-9aa77290fe90 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1374 microversion: 2.1 time: 0.158648 Oct 31 15:33:34.137820 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3972/7696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:33 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:35.159019 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:35.159792 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:35.164997 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:35.165701 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:35.172743 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.173232 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.173673 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.174393 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.174854 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.175279 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.309503 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:35.317600 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ecc56d9-f402-497b-924b-46a8394544c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1558 microversion: 2.1 time: 0.160449 Oct 31 15:33:35.318191 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3725/7697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:35 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:35.341318 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:35.341952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:35.344139 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:35.351429 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.351931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.352416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.353130 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.353603 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.354048 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.490306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:35.498117 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5f308da-6862-49ff-8033-0c364b98feef tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1558 microversion: 2.1 time: 0.160778 Oct 31 15:33:35.498725 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3973/7698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:35 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.150513 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e58a492a-4aa8-4797-9f11-765a1a905526 req-3e1aad00-4065-4156-84b6-6565726ca456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:37.160843 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e58a492a-4aa8-4797-9f11-765a1a905526 req-3e1aad00-4065-4156-84b6-6565726ca456 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.161391 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e58a492a-4aa8-4797-9f11-765a1a905526 req-3e1aad00-4065-4156-84b6-6565726ca456 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.161906 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e58a492a-4aa8-4797-9f11-765a1a905526 req-3e1aad00-4065-4156-84b6-6565726ca456 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.173569 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e58a492a-4aa8-4797-9f11-765a1a905526 req-3e1aad00-4065-4156-84b6-6565726ca456 service nova] Creating event network-changed:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:33:37.179278 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e58a492a-4aa8-4797-9f11-765a1a905526 req-3e1aad00-4065-4156-84b6-6565726ca456 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031968 Oct 31 15:33:37.179879 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3726/7699] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:34.326713 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:35:34.327724 n-d-863052-1 devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:35:34.328513 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:34.329326 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=36 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:34.330284 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 15:35:34.330434 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7/action (ip 10.222.0.27) !!! Oct 31 15:35:34.331510 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:35:34.331646 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7/action (ip 10.222.0.27) !!! Oct 31 15:35:34.336664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-571465711"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:34.339096 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.350111 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.350649 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.351106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.351821 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.352291 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.352736 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.556852 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24e1ef11-3744-486f-8703-b7ea8e6c1aba tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "POST /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7/action" status: 202 len: 0 microversion: 2.1 time: 0.231803 Oct 31 15:35:34.557586 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3974/7700] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:34 2022] POST /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:35:39.552710 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:35:39.554527 n-d-863052-1 devstack@n-api.service[120641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 15:35:39.555150 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:39.555885 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=32 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:39.561283 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f622338a-e83b-4213-95a4-e550ce7d79f2 req-9e6133c7-ba66-46d6-929f-5ee93f9d3671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "name": "network-vif-plugged", "status": "completed", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:39.572535 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f622338a-e83b-4213-95a4-e550ce7d79f2 req-9e6133c7-ba66-46d6-929f-5ee93f9d3671 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.573288 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f622338a-e83b-4213-95a4-e550ce7d79f2 req-9e6133c7-ba66-46d6-929f-5ee93f9d3671 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.574077 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f622338a-e83b-4213-95a4-e550ce7d79f2 req-9e6133c7-ba66-46d6-929f-5ee93f9d3671 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.592272 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f622338a-e83b-4213-95a4-e550ce7d79f2 req-9e6133c7-ba66-46d6-929f-5ee93f9d3671 service nova] Creating event network-vif-plugged:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:35:39.598583 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f622338a-e83b-4213-95a4-e550ce7d79f2 req-9e6133c7-ba66-46d6-929f-5ee93f9d3671 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047580 Oct 31 15:35:39.599801 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3727/7701] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:48.118988 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:48.119715 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:48.124277 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-318816327", "imageRef": "24b5c57a-4af1-4ee0-a34f-d41e79463ae2", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-233015082", "security_groups": [{"name": "tempest-secgroup-smoke-2030129222"}], "networks": [{"uuid": "ed8117b3-551c-4fd5-b481-a17476fd7374"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:48.149391 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [857d970c-536e-40cb-8c1d-eb9b9de312b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56290. Oct 31 15:35:48.152419 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee8f5ce8-773e-4767-8dab-7b435b77a3cb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56288. Oct 31 15:35:48.245858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] validate_networks() for [('ed8117b3-551c-4fd5-b481-a17476fd7374', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:35:48.668562 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:48.669002 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:48.669488 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:48.669911 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:48.670369 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:48.679303 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.679741 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.680189 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.680935 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.681438 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.681877 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.698823 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Getting quotas for project 95d2c0debf98467cae0adc3e5bd05d5f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:48.704038 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.quota [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Getting quotas for user 35d3ca406e5948399edb7cd6064a2547 and project 95d2c0debf98467cae0adc3e5bd05d5f. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:48.716836 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:35:48.719354 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24b5c57a-4af1-4ee0-a34f-d41e79463ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:35:48.767321 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7957dfa2-9fcc-4454-9db2-6e95664a71cd tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.652904 Oct 31 15:35:48.767983 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3975/7702] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 31 15:35:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:35:48.781848 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-906b01d4-f54c-49e6-8a08-3939baee2111 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:48.782604 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-906b01d4-f54c-49e6-8a08-3939baee2111 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:48.794998 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23659ae-0c3c-4f3f-aacf-3126ce84f88b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56304. Oct 31 15:35:48.797219 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] [65cc9517-ba3d-47cd-81db-625ee4f15a31] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56306. Oct 31 15:35:48.843215 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-906b01d4-f54c-49e6-8a08-3939baee2111 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:48.851638 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-906b01d4-f54c-49e6-8a08-3939baee2111 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1247 microversion: 2.1 time: 0.075785 Oct 31 15:35:48.852206 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3728/7703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:48 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:49.875239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:49.876162 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:49.885223 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.885809 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.887072 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.887866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.888685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.889126 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.956320 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:49.964499 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d710cbf3-aec6-43ba-a120-90958accd1e3 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1317 microversion: 2.1 time: 0.094268 Oct 31 15:35:49.965076 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3976/7704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:49 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1317 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:50.988572 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.990091 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.997272 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:51.009291 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.010302 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.011159 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.012149 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.012822 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.013457 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.191892 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.200780 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4acb7684-5418-47b2-a519-69a1840ec267 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.216247 Oct 31 15:35:51.201515 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3729/7705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:50 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:51.551952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2d8c58d6-7fc8-4fee-b9b8-b9e6af3a344a req-c552dbc3-2a12-4614-b353-6344bc6aa020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "name": "network-vif-unplugged", "status": "completed", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:51.566390 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2d8c58d6-7fc8-4fee-b9b8-b9e6af3a344a req-c552dbc3-2a12-4614-b353-6344bc6aa020 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.566889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2d8c58d6-7fc8-4fee-b9b8-b9e6af3a344a req-c552dbc3-2a12-4614-b353-6344bc6aa020 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.567547 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2d8c58d6-7fc8-4fee-b9b8-b9e6af3a344a req-c552dbc3-2a12-4614-b353-6344bc6aa020 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.584859 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2d8c58d6-7fc8-4fee-b9b8-b9e6af3a344a req-c552dbc3-2a12-4614-b353-6344bc6aa020 service nova] Creating event network-vif-unplugged:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:35:51.591414 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2d8c58d6-7fc8-4fee-b9b8-b9e6af3a344a req-c552dbc3-2a12-4614-b353-6344bc6aa020 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043025 Oct 31 15:35:51.592407 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3977/7706] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:52.225995 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:52.226625 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:52.233799 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.234325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.234750 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.235430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.235878 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.236296 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.380466 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.388401 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0311985-b235-4bd4-a2f0-3092a2e08a0d tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.166868 Oct 31 15:35:52.389226 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3730/7707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:52 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:53.414411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.415845 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.422250 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.422761 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.423225 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.423993 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.424411 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.424857 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.575199 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.583109 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c2ae54e-ccd7-4aca-865f-67f96372f5f4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.174532 Oct 31 15:35:53.583704 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3978/7708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:54.606462 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.607110 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.613931 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.614454 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.614903 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.615623 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.616100 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.617032 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.770314 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.778898 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-33bccf62-6385-4c02-8fbe-6408ca712e77 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.176131 Oct 31 15:35:54.794472 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3731/7709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:55.802672 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.803306 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.810378 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.810881 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.811336 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.812360 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.812940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.813385 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.979941 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:55.987815 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08cf51a9-9a16-4247-a0c2-56d8916ebfed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.189129 Oct 31 15:35:55.988392 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3979/7710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:55 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:57.011455 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.012104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.019174 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.019736 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.020239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.021008 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.021530 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.022020 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.176209 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:57.184163 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0fa1ee23-4d7b-462e-9c44-2a13f157ebed tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.176540 Oct 31 15:35:57.199371 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3732/7711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:57 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:58.209032 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:58.209678 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:58.217424 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.217930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.218416 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.219129 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.219598 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.220039 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.360798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.369115 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3377e82-e468-4a28-8d15-788746dae339 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.163985 Oct 31 15:35:58.369709 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3980/7712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:58 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:59.393802 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:59.394430 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:59.397121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:59.402707 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.403194 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.403634 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.404325 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.404781 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.405239 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.570688 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.578609 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-32a1f5d9-ef85-4ed6-8725-f9813e2df42b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.188594 Oct 31 15:35:59.579195 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3733/7713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:59 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:00.179783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-551b3aec-6319-4622-aa6b-11be702e2679 req-cdc98e0b-fd0a-4a1a-96e1-9b9698df3586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80cf0cc-ee40-4651-b26e-683fd75bfdae", "tag": "29bce060-bd52-45e6-b955-53032e38c817"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:00.184783 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:00.185558 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:00.194792 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-551b3aec-6319-4622-aa6b-11be702e2679 req-cdc98e0b-fd0a-4a1a-96e1-9b9698df3586 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.195397 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-551b3aec-6319-4622-aa6b-11be702e2679 req-cdc98e0b-fd0a-4a1a-96e1-9b9698df3586 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.195843 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-551b3aec-6319-4622-aa6b-11be702e2679 req-cdc98e0b-fd0a-4a1a-96e1-9b9698df3586 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.206934 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-551b3aec-6319-4622-aa6b-11be702e2679 req-cdc98e0b-fd0a-4a1a-96e1-9b9698df3586 service nova] Creating event network-changed:29bce060-bd52-45e6-b955-53032e38c817 for instance e80cf0cc-ee40-4651-b26e-683fd75bfdae on n-h2-863052-1 Oct 31 15:36:00.212723 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-551b3aec-6319-4622-aa6b-11be702e2679 req-cdc98e0b-fd0a-4a1a-96e1-9b9698df3586 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036636 Oct 31 15:36:00.213331 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3981/7714] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:00.601588 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.602240 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:00.609225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.609715 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.610160 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.610876 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.611338 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.611765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.803009 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.810944 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-df26fc18-587f-43cc-8427-99d86d1ccf3b tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.213901 Oct 31 15:36:00.811705 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3734/7715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:01.835595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:01.836310 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:01.843396 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:01.843889 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:01.844335 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:01.845027 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:01.845564 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:01.846010 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:01.984940 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:01.993109 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c35055d4-5c45-41fb-be44-4472b154104c tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.162410 Oct 31 15:36:01.993693 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3982/7716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:01 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:03.017512 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:03.018122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:03.025718 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:03.026225 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:03.026669 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:03.027390 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:03.027845 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:03.028270 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:03.165079 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:03.172966 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b0b109a-441c-4de2-aacd-a174d033aeb7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.159307 Oct 31 15:36:03.173689 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3735/7717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:03 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:04.196028 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:04.196637 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:04.203468 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.203967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.204415 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.205106 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.205569 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.206031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.343524 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:04.352426 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc1912ab-b1d9-4fb7-8977-0362df8b5d36 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.160290 Oct 31 15:36:04.353004 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3983/7718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:04 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:04.802058 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3008b6bc-c998-4b08-9767-380d481a4102 req-14a313da-fc8c-4f57-b42b-88bcc9aec7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80cf0cc-ee40-4651-b26e-683fd75bfdae", "name": "network-vif-plugged", "status": "completed", "tag": "29bce060-bd52-45e6-b955-53032e38c817"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:04.812487 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3008b6bc-c998-4b08-9767-380d481a4102 req-14a313da-fc8c-4f57-b42b-88bcc9aec7bd service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.812968 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3008b6bc-c998-4b08-9767-380d481a4102 req-14a313da-fc8c-4f57-b42b-88bcc9aec7bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.813410 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3008b6bc-c998-4b08-9767-380d481a4102 req-14a313da-fc8c-4f57-b42b-88bcc9aec7bd service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.824996 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3008b6bc-c998-4b08-9767-380d481a4102 req-14a313da-fc8c-4f57-b42b-88bcc9aec7bd service nova] Creating event network-vif-plugged:29bce060-bd52-45e6-b955-53032e38c817 for instance e80cf0cc-ee40-4651-b26e-683fd75bfdae on n-h2-863052-1 Oct 31 15:36:04.830242 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3008b6bc-c998-4b08-9767-380d481a4102 req-14a313da-fc8c-4f57-b42b-88bcc9aec7bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Oct 31 15:36:04.831465 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3736/7719] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:05.375930 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:05.376595 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:05.383509 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:05.384009 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:05.384463 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:05.385164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:05.385634 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:05.386075 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:05.517680 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:05.525616 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52f96b01-3b0b-4595-a213-8e08690e9417 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1373 microversion: 2.1 time: 0.153543 Oct 31 15:36:05.532541 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3984/7720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:05 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:06.550808 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:06.551508 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:06.558241 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.558663 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.559096 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.559779 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.560231 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.560653 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.690777 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.699173 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d6523be-f6c1-455c-841e-62afd46fa14a tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1557 microversion: 2.1 time: 0.153612 Oct 31 15:36:06.699753 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3737/7721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:06 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:06.721313 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:06.721956 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:06.728837 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.729340 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.729798 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.730609 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.731406 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.731858 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.868720 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.876450 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-240dae9e-9fb9-4001-aabd-64cc8b706dcb tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1557 microversion: 2.1 time: 0.159072 Oct 31 15:36:06.877033 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3985/7722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:06 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:08.468151 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b8bd992c-b8de-48fa-a9fd-dbeb209ea002 req-33c4b368-0fb5-48fc-a894-6a3b6151d5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80cf0cc-ee40-4651-b26e-683fd75bfdae", "tag": "29bce060-bd52-45e6-b955-53032e38c817"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:08.479122 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8bd992c-b8de-48fa-a9fd-dbeb209ea002 req-33c4b368-0fb5-48fc-a894-6a3b6151d5d6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.479601 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8bd992c-b8de-48fa-a9fd-dbeb209ea002 req-33c4b368-0fb5-48fc-a894-6a3b6151d5d6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.480037 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8bd992c-b8de-48fa-a9fd-dbeb209ea002 req-33c4b368-0fb5-48fc-a894-6a3b6151d5d6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.492066 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b8bd992c-b8de-48fa-a9fd-dbeb209ea002 req-33c4b368-0fb5-48fc-a894-6a3b6151d5d6 service nova] Creating event network-changed:29bce060-bd52-45e6-b955-53032e38c817 for instance e80cf0cc-ee40-4651-b26e-683fd75bfdae on n-h2-863052-1 Oct 31 15:36:08.497220 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b8bd992c-b8de-48fa-a9fd-dbeb209ea002 req-33c4b368-0fb5-48fc-a894-6a3b6151d5d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032723 Oct 31 15:36:08.497814 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3738/7723] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:40.048373 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:40.049193 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=54 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:40.049954 n-d-863052-1 devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:37:40.050116 n-d-863052-1 devstack@n-api.service[120640]: Mon Oct 31 15:37:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae/action (ip 10.222.0.27) !!! Oct 31 15:37:40.056557 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-642770284"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:40.059646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:40.071047 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:40.071553 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:40.072043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:40.072763 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:40.073239 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:40.073685 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:40.479600 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99aa3f93-8f7a-42ad-85fa-e82a700cca12 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "POST /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae/action" status: 202 len: 0 microversion: 2.1 time: 0.433069 Oct 31 15:37:40.481353 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3986/7724] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 31 15:37:40 2022] POST /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:37:45.397670 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=26 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:45.399147 n-d-863052-1 devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=52 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:45.400260 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:37:45.400402 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:37:45.402488 n-d-863052-1 devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:37:45.403316 n-d-863052-1 devstack@n-api.service[120641]: Mon Oct 31 15:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 31 15:37:45.410496 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9977ded7-a431-4afd-831d-03878cf429a7 req-4650659c-d145-41e4-ae01-99dc9c2e34a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80cf0cc-ee40-4651-b26e-683fd75bfdae", "name": "network-vif-plugged", "status": "completed", "tag": "29bce060-bd52-45e6-b955-53032e38c817"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:45.427055 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9977ded7-a431-4afd-831d-03878cf429a7 req-4650659c-d145-41e4-ae01-99dc9c2e34a2 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:45.427842 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9977ded7-a431-4afd-831d-03878cf429a7 req-4650659c-d145-41e4-ae01-99dc9c2e34a2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:45.428464 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9977ded7-a431-4afd-831d-03878cf429a7 req-4650659c-d145-41e4-ae01-99dc9c2e34a2 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:45.445441 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9977ded7-a431-4afd-831d-03878cf429a7 req-4650659c-d145-41e4-ae01-99dc9c2e34a2 service nova] Creating event network-vif-plugged:29bce060-bd52-45e6-b955-53032e38c817 for instance e80cf0cc-ee40-4651-b26e-683fd75bfdae on n-h2-863052-1 Oct 31 15:37:45.451655 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9977ded7-a431-4afd-831d-03878cf429a7 req-4650659c-d145-41e4-ae01-99dc9c2e34a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056736 Oct 31 15:37:45.452362 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3739/7725] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:55.342917 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:55.343610 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:55.346119 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:55.346920 n-d-863052-1 devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:55.352866 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.353453 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.354149 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.354967 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.355954 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.357233 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.395894 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:55.404373 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5ac3ceaa-473f-4835-ab17-41e188a6ab78 req-074eba5c-3742-4008-9d04-87b8e62d8ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80cf0cc-ee40-4651-b26e-683fd75bfdae", "tag": "29bce060-bd52-45e6-b955-53032e38c817"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:55.414038 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ac3ceaa-473f-4835-ab17-41e188a6ab78 req-074eba5c-3742-4008-9d04-87b8e62d8ce0 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.414560 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ac3ceaa-473f-4835-ab17-41e188a6ab78 req-074eba5c-3742-4008-9d04-87b8e62d8ce0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.414996 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5ac3ceaa-473f-4835-ab17-41e188a6ab78 req-074eba5c-3742-4008-9d04-87b8e62d8ce0 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.427109 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5ac3ceaa-473f-4835-ab17-41e188a6ab78 req-074eba5c-3742-4008-9d04-87b8e62d8ce0 service nova] Creating event network-changed:29bce060-bd52-45e6-b955-53032e38c817 for instance e80cf0cc-ee40-4651-b26e-683fd75bfdae on n-h2-863052-1 Oct 31 15:37:55.432300 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5ac3ceaa-473f-4835-ab17-41e188a6ab78 req-074eba5c-3742-4008-9d04-87b8e62d8ce0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092538 Oct 31 15:37:55.433127 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3740/7726] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:37:55.489698 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79e4f5b9-32e7-46a5-91c7-b9ffe9940112 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 204 len: 0 microversion: 2.1 time: 0.152117 Oct 31 15:37:55.490829 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3987/7727] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:37:55 2022] DELETE /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:37:55.500554 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:55.501451 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:55.508313 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.508964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.509475 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.510418 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.510952 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.511442 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.694161 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:55.702218 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00b4ef6a-a651-4eae-89b6-c1dd76700506 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1681 microversion: 2.1 time: 0.206704 Oct 31 15:37:55.702813 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3741/7728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:55 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:56.727070 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:56.727708 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:56.735750 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.736249 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.736704 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.737402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.737867 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.738327 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.877545 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:56.885472 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f858320a-baef-4e61-9688-126dfae9cb8e tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1681 microversion: 2.1 time: 0.162711 Oct 31 15:37:56.886026 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3988/7729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:56 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:57.485549 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-92de40a1-c074-4387-9cb6-e3a8888075bd req-9477c132-9db0-4b4b-b5a0-ef8b61cb36fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80cf0cc-ee40-4651-b26e-683fd75bfdae", "name": "network-vif-deleted", "tag": "29bce060-bd52-45e6-b955-53032e38c817"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:57.496102 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-92de40a1-c074-4387-9cb6-e3a8888075bd req-9477c132-9db0-4b4b-b5a0-ef8b61cb36fa service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.496645 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-92de40a1-c074-4387-9cb6-e3a8888075bd req-9477c132-9db0-4b4b-b5a0-ef8b61cb36fa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.497104 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-92de40a1-c074-4387-9cb6-e3a8888075bd req-9477c132-9db0-4b4b-b5a0-ef8b61cb36fa service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.510850 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-92de40a1-c074-4387-9cb6-e3a8888075bd req-9477c132-9db0-4b4b-b5a0-ef8b61cb36fa service nova] Creating event network-vif-deleted:29bce060-bd52-45e6-b955-53032e38c817 for instance e80cf0cc-ee40-4651-b26e-683fd75bfdae on n-h2-863052-1 Oct 31 15:37:57.515620 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-92de40a1-c074-4387-9cb6-e3a8888075bd req-9477c132-9db0-4b4b-b5a0-ef8b61cb36fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034583 Oct 31 15:37:57.516227 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3742/7730] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:57.911931 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:57.912566 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:57.920842 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.921358 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.921819 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.922563 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.923031 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.923471 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.956712 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.957270 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.957753 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.958237 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lazy-loading 'fault' on Instance uuid e80cf0cc-ee40-4651-b26e-683fd75bfdae {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:58.004646 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:58.011906 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-776a7d16-7c4f-4fd5-813f-808d9bddf5a4 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 200 len: 1337 microversion: 2.1 time: 0.104081 Oct 31 15:37:58.012421 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3989/7731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:57 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 1337 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:59.037441 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:59.038121 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: e80cf0cc-ee40-4651-b26e-683fd75bfdae] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:59.044893 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.045370 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.045803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.046510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.046964 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.047413 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.060536 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] HTTP exception thrown: Instance e80cf0cc-ee40-4651-b26e-683fd75bfdae could not be found. Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Request method failure captured: Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae HTTP/1.1 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-q9X9Oe2eALqk5pJCS_vbfnB9edU2Jni_QRNgBr74XFSVlDlDqXaQy00biEwtxG3OqJYLooZ21W3M0M2vqHHe3PJBXelmKoiN9z_IopGSp0ylTuMMbXDqWnpVakxLH3w9b60TkJHtVQ9_-ItfNXZW9toJVcykX0jp3wvdFwiRQvKk8 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 95d2c0debf98467cae0adc3e5bd05d5f Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestSnapshotPattern-1633301316 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95d2c0debf98467cae0adc3e5bd05d5f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95d2c0debf98467cae0adc3e5bd05d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95d2c0debf98467cae0adc3e5bd05d5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95d2c0debf98467cae0adc3e5bd05d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestSnapshotPattern-1633301316 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 95d2c0debf98467cae0adc3e5bd05d5f Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestSnapshotPattern-1633301316 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestSnapshotPattern-1633301316-project Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 35d3ca406e5948399edb7cd6064a2547 Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestSnapshotPattern-1633301316-project Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance e80cf0cc-ee40-4651-b26e-683fd75bfdae could not be found. Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': 'e80cf0cc-ee40-4651-b26e-683fd75bfdae'} Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80cf0cc-ee40-4651-b26e-683fd75bfdae could not be found. Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80cf0cc-ee40-4651-b26e-683fd75bfdae could not be found. Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:59.062189 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80cf0cc-ee40-4651-b26e-683fd75bfdae could not be found. Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Returning 404 to user: Instance e80cf0cc-ee40-4651-b26e-683fd75bfdae could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83283653-aa55-4169-8d04-b876683471a2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae" status: 404 len: 111 microversion: 2.1 time: 0.031303 Oct 31 15:37:59.067468 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3743/7732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:59 2022] GET /compute/v2.1/servers/e80cf0cc-ee40-4651-b26e-683fd75bfdae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:38:00.421229 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:00.421813 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:00.424292 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-873cb99e-e03d-4794-b2c4-2424f4d31d26 req-464e9912-cd9c-40a8-be2e-f91a50e59741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:00.428922 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.429664 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.430203 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.430980 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.431699 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.432202 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.435865 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-873cb99e-e03d-4794-b2c4-2424f4d31d26 req-464e9912-cd9c-40a8-be2e-f91a50e59741 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.436340 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-873cb99e-e03d-4794-b2c4-2424f4d31d26 req-464e9912-cd9c-40a8-be2e-f91a50e59741 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.436965 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-873cb99e-e03d-4794-b2c4-2424f4d31d26 req-464e9912-cd9c-40a8-be2e-f91a50e59741 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.448629 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-873cb99e-e03d-4794-b2c4-2424f4d31d26 req-464e9912-cd9c-40a8-be2e-f91a50e59741 service nova] Creating event network-changed:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:38:00.454966 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-873cb99e-e03d-4794-b2c4-2424f4d31d26 req-464e9912-cd9c-40a8-be2e-f91a50e59741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 Oct 31 15:38:00.455650 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3744/7733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:00.459757 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:38:00.554317 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0cb981f8-6eb9-41d5-b262-82214dcb0ed7 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "DELETE /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 204 len: 0 microversion: 2.1 time: 0.137428 Oct 31 15:38:00.555757 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3990/7734] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 31 15:38:00 2022] DELETE /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:38:00.566748 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:00.567803 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:00.575655 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.576261 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.577030 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.577924 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.578587 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.579175 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.726472 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.policy [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:00.734611 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a4f7c40-9546-4f63-82c2-bb27f93276aa tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1682 microversion: 2.1 time: 0.173914 Oct 31 15:38:00.735193 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3745/7735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:00 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:01.760316 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:01.760952 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:01.767896 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.768402 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.768860 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.769578 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.770051 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.770525 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.944065 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.951972 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b195395-9c58-4667-8ed5-721051381435 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1682 microversion: 2.1 time: 0.196176 Oct 31 15:38:01.952565 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3991/7736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:01 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:02.607542 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-522d8987-047d-481c-bd32-ccd078cc1f1b req-986f4945-4b9b-40e7-b4fe-4a7584402ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671a3c63-f857-48e1-a6a3-66e8120e4ff7", "name": "network-vif-deleted", "tag": "894cb5f3-593d-45fc-a262-a36bfef7b136"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:02.617337 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-522d8987-047d-481c-bd32-ccd078cc1f1b req-986f4945-4b9b-40e7-b4fe-4a7584402ee6 service nova] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.617835 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-522d8987-047d-481c-bd32-ccd078cc1f1b req-986f4945-4b9b-40e7-b4fe-4a7584402ee6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.618328 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-522d8987-047d-481c-bd32-ccd078cc1f1b req-986f4945-4b9b-40e7-b4fe-4a7584402ee6 service nova] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.630057 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-522d8987-047d-481c-bd32-ccd078cc1f1b req-986f4945-4b9b-40e7-b4fe-4a7584402ee6 service nova] Creating event network-vif-deleted:894cb5f3-593d-45fc-a262-a36bfef7b136 for instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 on n-h1-863052-1 Oct 31 15:38:02.634780 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-522d8987-047d-481c-bd32-ccd078cc1f1b req-986f4945-4b9b-40e7-b4fe-4a7584402ee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089659 Oct 31 15:38:02.635374 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3746/7737] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:02.976164 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:02.976799 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:02.984667 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.985169 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.985648 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.986570 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.987043 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.987484 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.023724 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.024220 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.024674 n-d-863052-1 devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.025134 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lazy-loading 'fault' on Instance uuid 671a3c63-f857-48e1-a6a3-66e8120e4ff7 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:38:03.069108 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.policy [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d3ca406e5948399edb7cd6064a2547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d2c0debf98467cae0adc3e5bd05d5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:03.076493 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9063200b-ccb9-48c5-a197-547b6cf22bc1 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 200 len: 1338 microversion: 2.1 time: 0.104128 Oct 31 15:38:03.077013 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3992/7738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:02 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:04.100783 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:04.101486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] [instance: 671a3c63-f857-48e1-a6a3-66e8120e4ff7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:04.108427 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:04.108907 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:04.109343 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:04.110031 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Acquiring lock "eeb84869-0594-4d8b-b4ff-3179511445e7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:04.110510 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:04.110933 n-d-863052-1 devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Lock "eeb84869-0594-4d8b-b4ff-3179511445e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:04.124791 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] HTTP exception thrown: Instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 could not be found. Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Request method failure captured: Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 HTTP/1.1 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Accept: application/json Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Accept-Encoding: identity Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Connection: close Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Content-Length: 0 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Content-Type: application/json Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Host: 10.222.0.27 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: Openstack-System-Scope: None Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjX-q9X9Oe2eALqk5pJCS_vbfnB9edU2Jni_QRNgBr74XFSVlDlDqXaQy00biEwtxG3OqJYLooZ21W3M0M2vqHHe3PJBXelmKoiN9z_IopGSp0ylTuMMbXDqWnpVakxLH3w9b60TkJHtVQ9_-ItfNXZW9toJVcykX0jp3wvdFwiRQvKk8 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Id: None Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Domain-Name: None Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Identity-Status: Confirmed Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Is-Admin-Project: True Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Id: default Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Domain-Name: Default Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Id: 95d2c0debf98467cae0adc3e5bd05d5f Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Project-Name: tempest-TestSnapshotPattern-1633301316 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Role: member,reader Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Roles: member,reader Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95d2c0debf98467cae0adc3e5bd05d5f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95d2c0debf98467cae0adc3e5bd05d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95d2c0debf98467cae0adc3e5bd05d5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95d2c0debf98467cae0adc3e5bd05d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant: tempest-TestSnapshotPattern-1633301316 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Id: 95d2c0debf98467cae0adc3e5bd05d5f Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestSnapshotPattern-1633301316 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-User: tempest-TestSnapshotPattern-1633301316-project Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Id: default Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-User-Domain-Name: Default Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-User-Id: 35d3ca406e5948399edb7cd6064a2547 Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: X-User-Name: tempest-TestSnapshotPattern-1633301316-project Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: method: > Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: exception: Instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 could not be found. Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: action_args: {'id': '671a3c63-f857-48e1-a6a3-66e8120e4ff7'} Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 could not be found. Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 could not be found. Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:04.126486 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 could not be found. Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Returning 404 to user: Instance 671a3c63-f857-48e1-a6a3-66e8120e4ff7 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b6a1afba-4cc7-43bf-8aa6-7c58ff1cd3c2 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7" status: 404 len: 111 microversion: 2.1 time: 0.032177 Oct 31 15:38:04.131765 n-d-863052-1 devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3747/7739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:04 2022] GET /compute/v2.1/servers/671a3c63-f857-48e1-a6a3-66e8120e4ff7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:38:04.288517 n-d-863052-1 devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1f3c06d-e9aa-4f86-8383-c926f2244f22 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] Calling method '.version_select at 0x7fe107a7c4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:04.314738 n-d-863052-1 devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1f3c06d-e9aa-4f86-8383-c926f2244f22 tempest-TestSnapshotPattern-1633301316 tempest-TestSnapshotPattern-1633301316-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-233015082" status: 202 len: 0 microversion: 2.1 time: 0.030185 Oct 31 15:38:04.315416 n-d-863052-1 devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3993/7740] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 31 15:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-233015082 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)